2023-09-13T08:12:09.084 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-09-13T08:12:09.085 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-09-12_12:12:15-fs-wip-rishabh-2023sep12-b2-testing-default-smithi/7394882 --name rishabh-2023-09-12_12:12:15-fs-wip-rishabh-2023sep12-b2-testing-default-smithi --verbose --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} -- /home/teuthworker/archive/rishabh-2023-09-12_12:12:15-fs-wip-rishabh-2023sep12-b2-testing-default-smithi/7394882/orig.config.yaml 2023-09-13T08:12:09.138 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T08:12:09.230 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2023-09-12_12:12:15-fs-wip-rishabh-2023sep12-b2-testing-default-smithi/7394882 branch: wip-rishabh-2023sep12-b2 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} email: null first_in_suite: false job_id: '7394882' kernel: client: sha1: distro flavor: default kdb: true sha1: fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: rishabh-2023-09-12_12:12:15-fs-wip-rishabh-2023sep12-b2-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: wip-rishabh-2023sep12-b2 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 kclient: syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-2023sep12-b2 sha1: 4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 owner: scheduled_rishabh@teuthology priority: 80 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 2531 sha1: 4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 sleep_before_teardown: 0 subset: 165/256 suite: fs suite_branch: wip-rishabh-2023sep12-b2 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi084.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= smithi161.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.tests_from_xfstests_dev teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 54e62bcbac4e53d9685e08328b790d3b20d71cae timestamp: 2023-09-12_12:12:15 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.1394 2023-09-13T08:12:09.231 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/qa; will attempt to use it 2023-09-13T08:12:09.232 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/qa/tasks 2023-09-13T08:12:09.233 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-09-13T08:12:09.235 INFO:teuthology.task.internal:Checking packages... 2023-09-13T08:12:09.274 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5' 2023-09-13T08:12:09.275 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-09-13T08:12:09.276 INFO:teuthology.packaging:ref: None 2023-09-13T08:12:09.276 INFO:teuthology.packaging:tag: None 2023-09-13T08:12:09.277 INFO:teuthology.packaging:branch: wip-rishabh-2023sep12-b2 2023-09-13T08:12:09.277 INFO:teuthology.packaging:sha1: 4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 2023-09-13T08:12:09.278 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-rishabh-2023sep12-b2 2023-09-13T08:12:09.495 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-6083.g4a754ac9 2023-09-13T08:12:09.495 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-09-13T08:12:09.504 INFO:teuthology.task.internal:no buildpackages task found 2023-09-13T08:12:09.504 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-09-13T08:12:09.512 INFO:teuthology.task.internal:Saving configuration 2023-09-13T08:12:09.530 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-09-13T08:12:09.537 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-13T08:12:09.562 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi084.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-09-12_12:12:15-fs-wip-rishabh-2023sep12-b2-testing-default-smithi/7394882', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-13 08:06:38.325650', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-09-13T08:12:09.584 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi161.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-09-12_12:12:15-fs-wip-rishabh-2023sep12-b2-testing-default-smithi/7394882', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-13 08:06:38.327003', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-09-13T08:12:09.584 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-09-13T08:12:09.591 INFO:teuthology.task.internal:roles: ubuntu@smithi084.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-09-13T08:12:09.592 INFO:teuthology.task.internal:roles: ubuntu@smithi161.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-09-13T08:12:09.592 INFO:teuthology.run_tasks:Running task console_log... 2023-09-13T08:12:09.667 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f25d65acaf0>, signals=[15]) 2023-09-13T08:12:09.668 INFO:teuthology.run_tasks:Running task internal.connect... 2023-09-13T08:12:09.677 INFO:teuthology.task.internal:Opening connections... 2023-09-13T08:12:09.678 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi084.front.sepia.ceph.com 2023-09-13T08:12:09.680 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:12:09.750 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi161.front.sepia.ceph.com 2023-09-13T08:12:09.751 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:12:09.818 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-09-13T08:12:09.825 DEBUG:teuthology.orchestra.run.smithi084:> uname -m 2023-09-13T08:12:09.846 INFO:teuthology.orchestra.run.smithi084.stdout:x86_64 2023-09-13T08:12:09.846 DEBUG:teuthology.orchestra.run.smithi084:> cat /etc/os-release 2023-09-13T08:12:09.904 INFO:teuthology.orchestra.run.smithi084.stdout:NAME="Red Hat Enterprise Linux" 2023-09-13T08:12:09.905 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION="8.6 (Ootpa)" 2023-09-13T08:12:09.905 INFO:teuthology.orchestra.run.smithi084.stdout:ID="rhel" 2023-09-13T08:12:09.905 INFO:teuthology.orchestra.run.smithi084.stdout:ID_LIKE="fedora" 2023-09-13T08:12:09.905 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_ID="8.6" 2023-09-13T08:12:09.905 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM_ID="platform:el8" 2023-09-13T08:12:09.906 INFO:teuthology.orchestra.run.smithi084.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-13T08:12:09.906 INFO:teuthology.orchestra.run.smithi084.stdout:ANSI_COLOR="0;31" 2023-09-13T08:12:09.906 INFO:teuthology.orchestra.run.smithi084.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-13T08:12:09.906 INFO:teuthology.orchestra.run.smithi084.stdout:HOME_URL="https://www.redhat.com/" 2023-09-13T08:12:09.907 INFO:teuthology.orchestra.run.smithi084.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-13T08:12:09.907 INFO:teuthology.orchestra.run.smithi084.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-13T08:12:09.907 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:12:09.907 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-13T08:12:09.907 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-13T08:12:09.908 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-13T08:12:09.908 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-13T08:12:09.909 INFO:teuthology.lock.ops:Updating smithi084.front.sepia.ceph.com on lock server 2023-09-13T08:12:09.931 DEBUG:teuthology.orchestra.run.smithi161:> uname -m 2023-09-13T08:12:09.955 INFO:teuthology.orchestra.run.smithi161.stdout:x86_64 2023-09-13T08:12:09.956 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release 2023-09-13T08:12:10.016 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="Red Hat Enterprise Linux" 2023-09-13T08:12:10.016 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="8.6 (Ootpa)" 2023-09-13T08:12:10.017 INFO:teuthology.orchestra.run.smithi161.stdout:ID="rhel" 2023-09-13T08:12:10.017 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="fedora" 2023-09-13T08:12:10.017 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="8.6" 2023-09-13T08:12:10.018 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el8" 2023-09-13T08:12:10.018 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-13T08:12:10.019 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31" 2023-09-13T08:12:10.019 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-13T08:12:10.019 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://www.redhat.com/" 2023-09-13T08:12:10.020 INFO:teuthology.orchestra.run.smithi161.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-13T08:12:10.020 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-13T08:12:10.020 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-09-13T08:12:10.021 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-13T08:12:10.021 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-13T08:12:10.022 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-13T08:12:10.022 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-13T08:12:10.023 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server 2023-09-13T08:12:10.047 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-09-13T08:12:10.064 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-09-13T08:12:10.074 INFO:teuthology.task.internal:Checking for old test directory... 2023-09-13T08:12:10.075 DEBUG:teuthology.orchestra.run.smithi084:> test '!' -e /home/ubuntu/cephtest 2023-09-13T08:12:10.079 DEBUG:teuthology.orchestra.run.smithi161:> test '!' -e /home/ubuntu/cephtest 2023-09-13T08:12:10.098 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-09-13T08:12:10.105 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-09-13T08:12:10.106 DEBUG:teuthology.orchestra.run.smithi084:> test -z $(ls -A /var/lib/ceph) 2023-09-13T08:12:10.139 DEBUG:teuthology.orchestra.run.smithi161:> test -z $(ls -A /var/lib/ceph) 2023-09-13T08:12:10.165 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-09-13T08:12:10.216 INFO:teuthology.run_tasks:Running task kernel... 2023-09-13T08:12:10.245 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': 'fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c'} 2023-09-13T08:12:10.247 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2023-09-13T08:12:10.247 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2023-09-13T08:12:10.248 DEBUG:teuthology.orchestra.run.smithi084:> test -f /run/.containerenv -o -f /.dockerenv 2023-09-13T08:12:10.249 DEBUG:teuthology.orchestra.run.smithi161:> test -f /run/.containerenv -o -f /.dockerenv 2023-09-13T08:12:10.273 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-13T08:12:10.274 DEBUG:teuthology.orchestra.run.smithi084:> uname -r 2023-09-13T08:12:10.275 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-13T08:12:10.275 DEBUG:teuthology.orchestra.run.smithi161:> uname -r 2023-09-13T08:12:10.338 INFO:teuthology.orchestra.run.smithi161.stdout:4.18.0-372.9.1.el8.x86_64 2023-09-13T08:12:10.339 INFO:teuthology.task.kernel:Running kernel on smithi161: 4.18.0-372.9.1.el8.x86_64 2023-09-13T08:12:10.339 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum install -y kernel 2023-09-13T08:12:10.341 INFO:teuthology.orchestra.run.smithi084.stdout:4.18.0-372.9.1.el8.x86_64 2023-09-13T08:12:10.341 INFO:teuthology.task.kernel:Running kernel on smithi084: 4.18.0-372.9.1.el8.x86_64 2023-09-13T08:12:10.342 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum install -y kernel 2023-09-13T08:12:11.496 INFO:teuthology.orchestra.run.smithi161.stdout:Updating Subscription Management repositories. 2023-09-13T08:12:11.497 INFO:teuthology.orchestra.run.smithi161.stdout:Unable to read consumer identity 2023-09-13T08:12:11.560 INFO:teuthology.orchestra.run.smithi084.stdout:Updating Subscription Management repositories. 2023-09-13T08:12:11.560 INFO:teuthology.orchestra.run.smithi084.stdout:Unable to read consumer identity 2023-09-13T08:12:12.934 INFO:teuthology.orchestra.run.smithi161.stdout:Copr repo for python3-asyncssh owned by ceph 23 kB/s | 3.5 kB 00:00 2023-09-13T08:12:13.095 INFO:teuthology.orchestra.run.smithi084.stdout:Copr repo for python3-asyncssh owned by ceph 22 kB/s | 3.5 kB 00:00 2023-09-13T08:12:13.651 INFO:teuthology.orchestra.run.smithi161.stdout:Extra Packages for Enterprise Linux 23 MB/s | 16 MB 00:00 2023-09-13T08:12:15.054 INFO:teuthology.orchestra.run.smithi084.stdout:Extra Packages for Enterprise Linux 8.2 MB/s | 16 MB 00:01 2023-09-13T08:12:17.135 INFO:teuthology.orchestra.run.smithi161.stdout:lab-extras 650 kB/s | 24 kB 00:00 2023-09-13T08:12:17.779 INFO:teuthology.orchestra.run.smithi161.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-09-13T08:12:17.824 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2023-09-13T08:12:17.825 INFO:teuthology.orchestra.run.smithi161.stdout:Nothing to do. 2023-09-13T08:12:17.825 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2023-09-13T08:12:17.955 DEBUG:teuthology.orchestra.run.smithi161:> echo no | sudo yum reinstall kernel || true 2023-09-13T08:12:18.284 INFO:teuthology.orchestra.run.smithi161.stdout:Updating Subscription Management repositories. 2023-09-13T08:12:18.284 INFO:teuthology.orchestra.run.smithi161.stdout:Unable to read consumer identity 2023-09-13T08:12:18.470 INFO:teuthology.orchestra.run.smithi084.stdout:lab-extras 476 kB/s | 24 kB 00:00 2023-09-13T08:12:18.548 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:00:01 ago on Wed 13 Sep 2023 08:12:17 AM UTC. 2023-09-13T08:12:18.591 INFO:teuthology.orchestra.run.smithi161.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-09-13T08:12:18.621 INFO:teuthology.orchestra.run.smithi161.stderr:Error: No packages marked for reinstall. 2023-09-13T08:12:18.668 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum reinstall -y kernel || true 2023-09-13T08:12:19.000 INFO:teuthology.orchestra.run.smithi161.stdout:Updating Subscription Management repositories. 2023-09-13T08:12:19.000 INFO:teuthology.orchestra.run.smithi161.stdout:Unable to read consumer identity 2023-09-13T08:12:19.181 INFO:teuthology.orchestra.run.smithi084.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-09-13T08:12:19.239 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2023-09-13T08:12:19.240 INFO:teuthology.orchestra.run.smithi084.stdout:Nothing to do. 2023-09-13T08:12:19.240 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2023-09-13T08:12:19.260 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:00:02 ago on Wed 13 Sep 2023 08:12:17 AM UTC. 2023-09-13T08:12:19.300 INFO:teuthology.orchestra.run.smithi161.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-09-13T08:12:19.323 INFO:teuthology.orchestra.run.smithi161.stderr:Error: No packages marked for reinstall. 2023-09-13T08:12:19.354 DEBUG:teuthology.orchestra.run.smithi084:> echo no | sudo yum reinstall kernel || true 2023-09-13T08:12:19.370 DEBUG:teuthology.orchestra.run.smithi161:> rpm -q kernel | sort -rV | head -n 1 2023-09-13T08:12:19.453 INFO:teuthology.orchestra.run.smithi161.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-09-13T08:12:19.454 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-09-13T08:12:19.455 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-09-13T08:12:19.455 DEBUG:teuthology.parallel:result is None 2023-09-13T08:12:19.685 INFO:teuthology.orchestra.run.smithi084.stdout:Updating Subscription Management repositories. 2023-09-13T08:12:19.686 INFO:teuthology.orchestra.run.smithi084.stdout:Unable to read consumer identity 2023-09-13T08:12:19.951 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:00:01 ago on Wed 13 Sep 2023 08:12:18 AM UTC. 2023-09-13T08:12:20.003 INFO:teuthology.orchestra.run.smithi084.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-09-13T08:12:20.033 INFO:teuthology.orchestra.run.smithi084.stderr:Error: No packages marked for reinstall. 2023-09-13T08:12:20.079 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum reinstall -y kernel || true 2023-09-13T08:12:20.408 INFO:teuthology.orchestra.run.smithi084.stdout:Updating Subscription Management repositories. 2023-09-13T08:12:20.408 INFO:teuthology.orchestra.run.smithi084.stdout:Unable to read consumer identity 2023-09-13T08:12:20.670 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:00:02 ago on Wed 13 Sep 2023 08:12:18 AM UTC. 2023-09-13T08:12:20.713 INFO:teuthology.orchestra.run.smithi084.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-09-13T08:12:20.733 INFO:teuthology.orchestra.run.smithi084.stderr:Error: No packages marked for reinstall. 2023-09-13T08:12:20.783 DEBUG:teuthology.orchestra.run.smithi084:> rpm -q kernel | sort -rV | head -n 1 2023-09-13T08:12:20.863 INFO:teuthology.orchestra.run.smithi084.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-09-13T08:12:20.865 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-09-13T08:12:20.865 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-09-13T08:12:20.865 DEBUG:teuthology.parallel:result is None 2023-09-13T08:12:20.866 INFO:teuthology.run_tasks:Running task internal.base... 2023-09-13T08:12:20.873 INFO:teuthology.task.internal:Creating test directory... 2023-09-13T08:12:20.873 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-09-13T08:12:20.875 DEBUG:teuthology.orchestra.run.smithi161:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-09-13T08:12:20.897 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-09-13T08:12:20.949 INFO:teuthology.run_tasks:Running task internal.archive... 2023-09-13T08:12:20.958 INFO:teuthology.task.internal:Creating archive directory... 2023-09-13T08:12:20.958 DEBUG:teuthology.orchestra.run.smithi084:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-09-13T08:12:20.961 DEBUG:teuthology.orchestra.run.smithi161:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-09-13T08:12:20.987 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-09-13T08:12:20.995 INFO:teuthology.task.internal:Enabling coredump saving... 2023-09-13T08:12:20.995 DEBUG:teuthology.orchestra.run.smithi084:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-09-13T08:12:21.019 DEBUG:teuthology.orchestra.run.smithi161:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-09-13T08:12:21.048 INFO:teuthology.orchestra.run.smithi084.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-13T08:12:21.056 INFO:teuthology.orchestra.run.smithi161.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-13T08:12:21.067 INFO:teuthology.orchestra.run.smithi084.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-13T08:12:21.073 INFO:teuthology.orchestra.run.smithi161.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-13T08:12:21.075 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-09-13T08:12:21.083 INFO:teuthology.task.internal:Configuring sudo... 2023-09-13T08:12:21.083 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-09-13T08:12:21.114 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-09-13T08:12:21.144 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-09-13T08:12:21.155 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-09-13T08:12:21.155 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-09-13T08:12:21.181 DEBUG:teuthology.orchestra.run.smithi161:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-09-13T08:12:21.201 DEBUG:teuthology.orchestra.run.smithi084:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-09-13T08:12:21.279 DEBUG:teuthology.orchestra.run.smithi084:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-09-13T08:12:21.327 DEBUG:teuthology.orchestra.run.smithi084:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-09-13T08:12:21.411 DEBUG:teuthology.orchestra.run.smithi084:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-09-13T08:12:21.452 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-09-13T08:12:21.452 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-09-13T08:12:21.523 DEBUG:teuthology.orchestra.run.smithi161:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-09-13T08:12:21.571 DEBUG:teuthology.orchestra.run.smithi161:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-09-13T08:12:21.626 DEBUG:teuthology.orchestra.run.smithi161:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-09-13T08:12:21.714 DEBUG:teuthology.orchestra.run.smithi161:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-09-13T08:12:21.759 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-09-13T08:12:21.759 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-09-13T08:12:21.829 DEBUG:teuthology.orchestra.run.smithi084:> sudo service rsyslog restart 2023-09-13T08:12:21.832 DEBUG:teuthology.orchestra.run.smithi161:> sudo service rsyslog restart 2023-09-13T08:12:21.908 INFO:teuthology.orchestra.run.smithi084.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-09-13T08:12:21.926 INFO:teuthology.orchestra.run.smithi161.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-09-13T08:12:22.375 INFO:teuthology.run_tasks:Running task internal.timer... 2023-09-13T08:12:22.385 INFO:teuthology.task.internal:Starting timer... 2023-09-13T08:12:22.385 INFO:teuthology.run_tasks:Running task pcp... 2023-09-13T08:12:22.399 INFO:teuthology.run_tasks:Running task selinux... 2023-09-13T08:12:22.472 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']} 2023-09-13T08:12:22.473 DEBUG:teuthology.orchestra.run.smithi084:> sudo service auditd rotate 2023-09-13T08:12:22.531 INFO:teuthology.orchestra.run.smithi084.stdout:Rotating logs: 2023-09-13T08:12:22.533 DEBUG:teuthology.orchestra.run.smithi161:> sudo service auditd rotate 2023-09-13T08:12:22.608 INFO:teuthology.orchestra.run.smithi161.stdout:Rotating logs: 2023-09-13T08:12:22.609 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-09-13T08:12:22.610 DEBUG:teuthology.orchestra.run.smithi084:> /usr/sbin/getenforce 2023-09-13T08:12:22.636 INFO:teuthology.orchestra.run.smithi084.stdout:Permissive 2023-09-13T08:12:22.636 DEBUG:teuthology.orchestra.run.smithi161:> /usr/sbin/getenforce 2023-09-13T08:12:22.659 INFO:teuthology.orchestra.run.smithi161.stdout:Permissive 2023-09-13T08:12:22.659 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi084.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi161.front.sepia.ceph.com': 'permissive'} 2023-09-13T08:12:22.660 DEBUG:teuthology.orchestra.run.smithi084:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-09-13T08:12:22.703 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-13T08:12:22.704 DEBUG:teuthology.orchestra.run.smithi161:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-09-13T08:12:22.731 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-13T08:12:22.731 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-09-13T08:12:22.732 DEBUG:teuthology.orchestra.run.smithi084:> sudo /usr/sbin/setenforce permissive 2023-09-13T08:12:22.771 DEBUG:teuthology.orchestra.run.smithi161:> sudo /usr/sbin/setenforce permissive 2023-09-13T08:12:22.816 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-09-13T08:12:22.826 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-09-13T08:12:22.826 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-09-13T08:12:22.847 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-09-13T08:12:22.869 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi084.front.sepia.ceph.com,smithi161.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-09-13T08:21:22.906 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi084.front.sepia.ceph.com'), Remote(name='ubuntu@smithi161.front.sepia.ceph.com')] 2023-09-13T08:21:22.933 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2023-09-13T08:21:22.934 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:21:23.004 DEBUG:teuthology.orchestra.run.smithi084:> true 2023-09-13T08:21:23.077 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi084.front.sepia.ceph.com' 2023-09-13T08:21:23.078 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2023-09-13T08:21:23.078 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T08:21:23.148 DEBUG:teuthology.orchestra.run.smithi161:> true 2023-09-13T08:21:23.221 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi161.front.sepia.ceph.com' 2023-09-13T08:21:23.222 INFO:teuthology.run_tasks:Running task clock... 2023-09-13T08:21:23.234 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-09-13T08:21:23.235 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-09-13T08:21:23.236 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-13T08:21:23.238 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-09-13T08:21:23.239 DEBUG:teuthology.orchestra.run.smithi161:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-13T08:21:23.273 INFO:teuthology.orchestra.run.smithi084.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-09-13T08:21:23.289 INFO:teuthology.orchestra.run.smithi084.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-09-13T08:21:23.295 INFO:teuthology.orchestra.run.smithi161.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-09-13T08:21:23.311 INFO:teuthology.orchestra.run.smithi161.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-09-13T08:21:23.361 INFO:teuthology.orchestra.run.smithi084.stderr:sudo: ntpd: command not found 2023-09-13T08:21:23.374 INFO:teuthology.orchestra.run.smithi084.stdout:506 Cannot talk to daemon 2023-09-13T08:21:23.384 INFO:teuthology.orchestra.run.smithi161.stderr:sudo: ntpd: command not found 2023-09-13T08:21:23.389 INFO:teuthology.orchestra.run.smithi084.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-09-13T08:21:23.396 INFO:teuthology.orchestra.run.smithi161.stdout:506 Cannot talk to daemon 2023-09-13T08:21:23.403 INFO:teuthology.orchestra.run.smithi084.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-09-13T08:21:23.410 INFO:teuthology.orchestra.run.smithi161.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-09-13T08:21:23.424 INFO:teuthology.orchestra.run.smithi161.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-09-13T08:21:23.473 INFO:teuthology.orchestra.run.smithi084.stderr:bash: ntpq: command not found 2023-09-13T08:21:23.476 INFO:teuthology.orchestra.run.smithi084.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-09-13T08:21:23.477 INFO:teuthology.orchestra.run.smithi084.stdout:=============================================================================== 2023-09-13T08:21:23.477 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-13T08:21:23.477 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-13T08:21:23.477 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-13T08:21:23.477 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-13T08:21:23.492 INFO:teuthology.orchestra.run.smithi161.stderr:bash: ntpq: command not found 2023-09-13T08:21:23.495 INFO:teuthology.orchestra.run.smithi161.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-09-13T08:21:23.496 INFO:teuthology.orchestra.run.smithi161.stdout:=============================================================================== 2023-09-13T08:21:23.496 INFO:teuthology.orchestra.run.smithi161.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-13T08:21:23.496 INFO:teuthology.orchestra.run.smithi161.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-13T08:21:23.496 INFO:teuthology.orchestra.run.smithi161.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-13T08:21:23.496 INFO:teuthology.orchestra.run.smithi161.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-13T08:21:23.497 INFO:teuthology.run_tasks:Running task install... 2023-09-13T08:21:23.506 DEBUG:teuthology.task.install:project ceph 2023-09-13T08:21:23.506 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5'}} 2023-09-13T08:21:23.507 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5'} 2023-09-13T08:21:23.507 INFO:teuthology.task.install:Using flavor: default 2023-09-13T08:21:23.512 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-09-13T08:21:23.513 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-09-13T08:21:23.513 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5', 'tag': None, 'wait_for_package': False} 2023-09-13T08:21:23.514 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 2023-09-13T08:21:23.516 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5', 'tag': None, 'wait_for_package': False} 2023-09-13T08:21:23.516 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 2023-09-13T08:21:23.656 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/centos/8/flavors/default/ 2023-09-13T08:21:23.657 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6083.g4a754ac9 2023-09-13T08:21:23.730 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/centos/8/flavors/default/ 2023-09-13T08:21:23.731 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6083.g4a754ac9 2023-09-13T08:21:23.834 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-09-13T08:21:23.834 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-09-13T08:21:23.835 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-09-13T08:21:23.838 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-09-13T08:21:23.838 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-09-13T08:21:23.838 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-09-13T08:21:23.863 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-09-13T08:21:23.864 DEBUG:teuthology.orchestra.run.smithi161:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-09-13T08:21:23.867 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-09-13T08:21:23.867 DEBUG:teuthology.orchestra.run.smithi084:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-09-13T08:21:23.931 DEBUG:teuthology.orchestra.run.smithi161:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-09-13T08:21:23.937 DEBUG:teuthology.orchestra.run.smithi084:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-09-13T08:21:24.008 DEBUG:teuthology.orchestra.run.smithi161:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-09-13T08:21:24.012 DEBUG:teuthology.orchestra.run.smithi084:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-09-13T08:21:24.074 INFO:teuthology.orchestra.run.smithi161.stdout:check_obsoletes = 1 2023-09-13T08:21:24.076 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum clean all 2023-09-13T08:21:24.077 INFO:teuthology.orchestra.run.smithi084.stdout:check_obsoletes = 1 2023-09-13T08:21:24.078 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum clean all 2023-09-13T08:21:24.447 INFO:teuthology.orchestra.run.smithi084.stdout:Updating Subscription Management repositories. 2023-09-13T08:21:24.449 INFO:teuthology.orchestra.run.smithi161.stdout:Updating Subscription Management repositories. 2023-09-13T08:21:24.881 INFO:teuthology.orchestra.run.smithi084.stdout:44 files removed 2023-09-13T08:21:24.927 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-09-13T08:21:25.019 INFO:teuthology.orchestra.run.smithi161.stdout:44 files removed 2023-09-13T08:21:25.067 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-09-13T08:21:25.254 INFO:teuthology.orchestra.run.smithi084.stdout:Updating Subscription Management repositories. 2023-09-13T08:21:25.400 INFO:teuthology.orchestra.run.smithi161.stdout:Updating Subscription Management repositories. 2023-09-13T08:21:26.455 INFO:teuthology.orchestra.run.smithi161.stdout:ceph packages for x86_64 223 kB/s | 81 kB 00:00 2023-09-13T08:21:26.461 INFO:teuthology.orchestra.run.smithi084.stdout:ceph packages for x86_64 203 kB/s | 81 kB 00:00 2023-09-13T08:21:26.728 INFO:teuthology.orchestra.run.smithi084.stdout:ceph noarch packages 40 kB/s | 9.4 kB 00:00 2023-09-13T08:21:26.814 INFO:teuthology.orchestra.run.smithi161.stdout:ceph noarch packages 29 kB/s | 9.4 kB 00:00 2023-09-13T08:21:27.113 INFO:teuthology.orchestra.run.smithi084.stdout:ceph source packages 4.1 kB/s | 1.5 kB 00:00 2023-09-13T08:21:27.181 INFO:teuthology.orchestra.run.smithi161.stdout:ceph source packages 4.3 kB/s | 1.5 kB 00:00 2023-09-13T08:21:27.255 INFO:teuthology.orchestra.run.smithi084.stdout:Copr repo for python3-asyncssh owned by ceph 28 kB/s | 3.5 kB 00:00 2023-09-13T08:21:27.340 INFO:teuthology.orchestra.run.smithi161.stdout:Copr repo for python3-asyncssh owned by ceph 25 kB/s | 3.5 kB 00:00 2023-09-13T08:21:28.057 INFO:teuthology.orchestra.run.smithi084.stdout:Extra Packages for Enterprise Linux 20 MB/s | 16 MB 00:00 2023-09-13T08:21:28.776 INFO:teuthology.orchestra.run.smithi161.stdout:Extra Packages for Enterprise Linux 11 MB/s | 16 MB 00:01 2023-09-13T08:21:31.505 INFO:teuthology.orchestra.run.smithi084.stdout:lab-extras 411 kB/s | 24 kB 00:00 2023-09-13T08:21:32.308 INFO:teuthology.orchestra.run.smithi161.stdout:lab-extras 434 kB/s | 24 kB 00:00 2023-09-13T08:21:32.665 INFO:teuthology.orchestra.run.smithi084.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 44 MB/s | 47 MB 00:01 2023-09-13T08:21:33.551 INFO:teuthology.orchestra.run.smithi161.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 45 MB/s | 53 MB 00:01 2023-09-13T08:21:40.907 INFO:teuthology.orchestra.run.smithi084.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 50 MB/s | 53 MB 00:01 2023-09-13T08:21:42.035 INFO:teuthology.orchestra.run.smithi161.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 43 MB/s | 47 MB 00:01 2023-09-13T08:21:51.946 INFO:teuthology.orchestra.run.smithi084.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-09-13T08:21:51.946 INFO:teuthology.orchestra.run.smithi084.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-09-13T08:21:51.961 INFO:teuthology.orchestra.run.smithi084.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-09-13T08:21:51.962 INFO:teuthology.orchestra.run.smithi084.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-09-13T08:21:51.963 INFO:teuthology.orchestra.run.smithi084.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-09-13T08:21:51.964 INFO:teuthology.orchestra.run.smithi084.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-09-13T08:21:51.966 INFO:teuthology.orchestra.run.smithi084.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-09-13T08:21:51.969 INFO:teuthology.orchestra.run.smithi084.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-09-13T08:21:51.971 INFO:teuthology.orchestra.run.smithi084.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-09-13T08:21:52.103 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2023-09-13T08:21:52.115 INFO:teuthology.orchestra.run.smithi084.stdout:=========================================================================================================================== 2023-09-13T08:21:52.115 INFO:teuthology.orchestra.run.smithi084.stdout: Package Arch Version Repository Size 2023-09-13T08:21:52.116 INFO:teuthology.orchestra.run.smithi084.stdout:=========================================================================================================================== 2023-09-13T08:21:52.116 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2023-09-13T08:21:52.116 INFO:teuthology.orchestra.run.smithi084.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-09-13T08:21:52.116 INFO:teuthology.orchestra.run.smithi084.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-09-13T08:21:52.116 INFO:teuthology.orchestra.run.smithi084.stdout: ceph x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 6.4 k 2023-09-13T08:21:52.117 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-base x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 5.4 M 2023-09-13T08:21:52.117 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-fuse x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 919 k 2023-09-13T08:21:52.117 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 167 k 2023-09-13T08:21:52.117 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 1.6 M 2023-09-13T08:21:52.117 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6083.g4a754ac9.el8 ceph-noarch 132 k 2023-09-13T08:21:52.118 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6083.g4a754ac9.el8 ceph-noarch 1.7 M 2023-09-13T08:21:52.118 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6083.g4a754ac9.el8 ceph-noarch 7.4 M 2023-09-13T08:21:52.118 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-rook noarch 2:18.0.0-6083.g4a754ac9.el8 ceph-noarch 47 k 2023-09-13T08:21:52.118 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-radosgw x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 14 M 2023-09-13T08:21:52.119 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-test x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 49 M 2023-09-13T08:21:52.119 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-volume noarch 2:18.0.0-6083.g4a754ac9.el8 ceph-noarch 261 k 2023-09-13T08:21:52.119 INFO:teuthology.orchestra.run.smithi084.stdout: cephadm noarch 2:18.0.0-6083.g4a754ac9.el8 ceph-noarch 179 k 2023-09-13T08:21:52.119 INFO:teuthology.orchestra.run.smithi084.stdout: cephfs-mirror x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 260 k 2023-09-13T08:21:52.119 INFO:teuthology.orchestra.run.smithi084.stdout: cephfs-top noarch 2:18.0.0-6083.g4a754ac9.el8 ceph-noarch 18 k 2023-09-13T08:21:52.120 INFO:teuthology.orchestra.run.smithi084.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-09-13T08:21:52.120 INFO:teuthology.orchestra.run.smithi084.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-09-13T08:21:52.120 INFO:teuthology.orchestra.run.smithi084.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-09-13T08:21:52.120 INFO:teuthology.orchestra.run.smithi084.stdout: libcephfs-devel x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 31 k 2023-09-13T08:21:52.120 INFO:teuthology.orchestra.run.smithi084.stdout: libcephfs2 x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 839 k 2023-09-13T08:21:52.121 INFO:teuthology.orchestra.run.smithi084.stdout: librados-devel x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 139 k 2023-09-13T08:21:52.121 INFO:teuthology.orchestra.run.smithi084.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-09-13T08:21:52.121 INFO:teuthology.orchestra.run.smithi084.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-09-13T08:21:52.121 INFO:teuthology.orchestra.run.smithi084.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-09-13T08:21:52.121 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-09-13T08:21:52.122 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-09-13T08:21:52.122 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-09-13T08:21:52.122 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cephfs x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 197 k 2023-09-13T08:21:52.122 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rados x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 370 k 2023-09-13T08:21:52.122 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rbd x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 365 k 2023-09-13T08:21:52.123 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rgw x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 107 k 2023-09-13T08:21:52.123 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-fuse x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 93 k 2023-09-13T08:21:52.123 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-mirror x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 3.6 M 2023-09-13T08:21:52.123 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-nbd x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 179 k 2023-09-13T08:21:52.123 INFO:teuthology.orchestra.run.smithi084.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-09-13T08:21:52.124 INFO:teuthology.orchestra.run.smithi084.stdout:Upgrading: 2023-09-13T08:21:52.124 INFO:teuthology.orchestra.run.smithi084.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-09-13T08:21:52.124 INFO:teuthology.orchestra.run.smithi084.stdout: librados2 x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 3.7 M 2023-09-13T08:21:52.124 INFO:teuthology.orchestra.run.smithi084.stdout: librbd1 x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 3.7 M 2023-09-13T08:21:52.124 INFO:teuthology.orchestra.run.smithi084.stdout:Installing dependencies: 2023-09-13T08:21:52.125 INFO:teuthology.orchestra.run.smithi084.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-09-13T08:21:52.125 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-common x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 22 M 2023-09-13T08:21:52.125 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6083.g4a754ac9.el8 ceph-noarch 23 k 2023-09-13T08:21:52.125 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mds x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 2.3 M 2023-09-13T08:21:52.125 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6083.g4a754ac9.el8 ceph-noarch 242 k 2023-09-13T08:21:52.125 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mon x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 4.6 M 2023-09-13T08:21:52.126 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-osd x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 18 M 2023-09-13T08:21:52.126 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6083.g4a754ac9.el8 ceph-noarch 15 k 2023-09-13T08:21:52.126 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-selinux x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 24 k 2023-09-13T08:21:52.126 INFO:teuthology.orchestra.run.smithi084.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-09-13T08:21:52.127 INFO:teuthology.orchestra.run.smithi084.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-09-13T08:21:52.127 INFO:teuthology.orchestra.run.smithi084.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-09-13T08:21:52.127 INFO:teuthology.orchestra.run.smithi084.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-09-13T08:21:52.127 INFO:teuthology.orchestra.run.smithi084.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-09-13T08:21:52.127 INFO:teuthology.orchestra.run.smithi084.stdout: libcephsqlite x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 183 k 2023-09-13T08:21:52.128 INFO:teuthology.orchestra.run.smithi084.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-09-13T08:21:52.128 INFO:teuthology.orchestra.run.smithi084.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-09-13T08:21:52.128 INFO:teuthology.orchestra.run.smithi084.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-09-13T08:21:52.128 INFO:teuthology.orchestra.run.smithi084.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-09-13T08:21:52.128 INFO:teuthology.orchestra.run.smithi084.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-09-13T08:21:52.129 INFO:teuthology.orchestra.run.smithi084.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-09-13T08:21:52.129 INFO:teuthology.orchestra.run.smithi084.stdout: libradosstriper1 x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 518 k 2023-09-13T08:21:52.129 INFO:teuthology.orchestra.run.smithi084.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-09-13T08:21:52.129 INFO:teuthology.orchestra.run.smithi084.stdout: librgw2 x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 6.8 M 2023-09-13T08:21:52.129 INFO:teuthology.orchestra.run.smithi084.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-09-13T08:21:52.130 INFO:teuthology.orchestra.run.smithi084.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-09-13T08:21:52.130 INFO:teuthology.orchestra.run.smithi084.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-09-13T08:21:52.130 INFO:teuthology.orchestra.run.smithi084.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-09-13T08:21:52.130 INFO:teuthology.orchestra.run.smithi084.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-09-13T08:21:52.130 INFO:teuthology.orchestra.run.smithi084.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-09-13T08:21:52.131 INFO:teuthology.orchestra.run.smithi084.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-09-13T08:21:52.131 INFO:teuthology.orchestra.run.smithi084.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-09-13T08:21:52.131 INFO:teuthology.orchestra.run.smithi084.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-09-13T08:21:52.131 INFO:teuthology.orchestra.run.smithi084.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-09-13T08:21:52.131 INFO:teuthology.orchestra.run.smithi084.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-09-13T08:21:52.132 INFO:teuthology.orchestra.run.smithi084.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-09-13T08:21:52.132 INFO:teuthology.orchestra.run.smithi084.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-09-13T08:21:52.132 INFO:teuthology.orchestra.run.smithi084.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-09-13T08:21:52.132 INFO:teuthology.orchestra.run.smithi084.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-09-13T08:21:52.132 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-09-13T08:21:52.133 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ceph-argparse x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 45 k 2023-09-13T08:21:52.133 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ceph-common x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 125 k 2023-09-13T08:21:52.133 INFO:teuthology.orchestra.run.smithi084.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-09-13T08:21:52.133 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-09-13T08:21:52.133 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-09-13T08:21:52.134 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-09-13T08:21:52.134 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-09-13T08:21:52.134 INFO:teuthology.orchestra.run.smithi084.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-09-13T08:21:52.134 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-09-13T08:21:52.134 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-09-13T08:21:52.134 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-09-13T08:21:52.135 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-09-13T08:21:52.135 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-09-13T08:21:52.135 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-09-13T08:21:52.135 INFO:teuthology.orchestra.run.smithi084.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-09-13T08:21:52.135 INFO:teuthology.orchestra.run.smithi084.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-09-13T08:21:52.136 INFO:teuthology.orchestra.run.smithi084.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-09-13T08:21:52.136 INFO:teuthology.orchestra.run.smithi084.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-09-13T08:21:52.136 INFO:teuthology.orchestra.run.smithi084.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-09-13T08:21:52.136 INFO:teuthology.orchestra.run.smithi084.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-09-13T08:21:52.136 INFO:teuthology.orchestra.run.smithi084.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-09-13T08:21:52.137 INFO:teuthology.orchestra.run.smithi084.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-09-13T08:21:52.137 INFO:teuthology.orchestra.run.smithi084.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-09-13T08:21:52.137 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-09-13T08:21:52.137 INFO:teuthology.orchestra.run.smithi084.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-09-13T08:21:52.137 INFO:teuthology.orchestra.run.smithi084.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-09-13T08:21:52.138 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-09-13T08:21:52.138 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-09-13T08:21:52.138 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-09-13T08:21:52.138 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-09-13T08:21:52.138 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-09-13T08:21:52.139 INFO:teuthology.orchestra.run.smithi084.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-09-13T08:21:52.139 INFO:teuthology.orchestra.run.smithi084.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-09-13T08:21:52.139 INFO:teuthology.orchestra.run.smithi084.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-09-13T08:21:52.139 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-09-13T08:21:52.139 INFO:teuthology.orchestra.run.smithi084.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-09-13T08:21:52.140 INFO:teuthology.orchestra.run.smithi084.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-09-13T08:21:52.140 INFO:teuthology.orchestra.run.smithi084.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-09-13T08:21:52.140 INFO:teuthology.orchestra.run.smithi084.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-09-13T08:21:52.140 INFO:teuthology.orchestra.run.smithi084.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-09-13T08:21:52.140 INFO:teuthology.orchestra.run.smithi084.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-09-13T08:21:52.141 INFO:teuthology.orchestra.run.smithi084.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-09-13T08:21:52.141 INFO:teuthology.orchestra.run.smithi084.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-09-13T08:21:52.141 INFO:teuthology.orchestra.run.smithi084.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-09-13T08:21:52.141 INFO:teuthology.orchestra.run.smithi084.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-09-13T08:21:52.141 INFO:teuthology.orchestra.run.smithi084.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-09-13T08:21:52.142 INFO:teuthology.orchestra.run.smithi084.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-09-13T08:21:52.142 INFO:teuthology.orchestra.run.smithi084.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-09-13T08:21:52.142 INFO:teuthology.orchestra.run.smithi084.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-09-13T08:21:52.142 INFO:teuthology.orchestra.run.smithi084.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-09-13T08:21:52.142 INFO:teuthology.orchestra.run.smithi084.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-09-13T08:21:52.143 INFO:teuthology.orchestra.run.smithi084.stdout:Enabling module streams: 2023-09-13T08:21:52.143 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql 10 2023-09-13T08:21:52.143 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:21:52.143 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2023-09-13T08:21:52.143 INFO:teuthology.orchestra.run.smithi084.stdout:=========================================================================================================================== 2023-09-13T08:21:52.144 INFO:teuthology.orchestra.run.smithi084.stdout:Install 128 Packages 2023-09-13T08:21:52.144 INFO:teuthology.orchestra.run.smithi084.stdout:Upgrade 3 Packages 2023-09-13T08:21:52.144 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:21:52.145 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 208 M 2023-09-13T08:21:52.145 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2023-09-13T08:21:52.290 INFO:teuthology.orchestra.run.smithi084.stdout:(1/131): ceph-18.0.0-6083.g4a754ac9.el8.x86_64. 54 kB/s | 6.4 kB 00:00 2023-09-13T08:21:52.490 INFO:teuthology.orchestra.run.smithi084.stdout:(2/131): ceph-fuse-18.0.0-6083.g4a754ac9.el8.x8 4.5 MB/s | 919 kB 00:00 2023-09-13T08:21:52.532 INFO:teuthology.orchestra.run.smithi084.stdout:(3/131): ceph-immutable-object-cache-18.0.0-608 3.9 MB/s | 167 kB 00:00 2023-09-13T08:21:52.790 INFO:teuthology.orchestra.run.smithi084.stdout:(4/131): ceph-mds-18.0.0-6083.g4a754ac9.el8.x86 9.0 MB/s | 2.3 MB 00:00 2023-09-13T08:21:52.957 INFO:teuthology.orchestra.run.smithi084.stdout:(5/131): ceph-mgr-18.0.0-6083.g4a754ac9.el8.x86 9.7 MB/s | 1.6 MB 00:00 2023-09-13T08:21:52.959 INFO:teuthology.orchestra.run.smithi161.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-09-13T08:21:52.960 INFO:teuthology.orchestra.run.smithi161.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-09-13T08:21:52.975 INFO:teuthology.orchestra.run.smithi161.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-09-13T08:21:52.976 INFO:teuthology.orchestra.run.smithi161.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-09-13T08:21:52.977 INFO:teuthology.orchestra.run.smithi161.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-09-13T08:21:52.979 INFO:teuthology.orchestra.run.smithi161.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-09-13T08:21:52.981 INFO:teuthology.orchestra.run.smithi161.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-09-13T08:21:52.984 INFO:teuthology.orchestra.run.smithi161.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-09-13T08:21:52.986 INFO:teuthology.orchestra.run.smithi161.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-09-13T08:21:53.123 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2023-09-13T08:21:53.135 INFO:teuthology.orchestra.run.smithi161.stdout:=========================================================================================================================== 2023-09-13T08:21:53.135 INFO:teuthology.orchestra.run.smithi161.stdout: Package Arch Version Repository Size 2023-09-13T08:21:53.135 INFO:teuthology.orchestra.run.smithi161.stdout:=========================================================================================================================== 2023-09-13T08:21:53.136 INFO:teuthology.orchestra.run.smithi161.stdout:Installing: 2023-09-13T08:21:53.136 INFO:teuthology.orchestra.run.smithi161.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-09-13T08:21:53.136 INFO:teuthology.orchestra.run.smithi161.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-09-13T08:21:53.136 INFO:teuthology.orchestra.run.smithi161.stdout: ceph x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 6.4 k 2023-09-13T08:21:53.136 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-base x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 5.4 M 2023-09-13T08:21:53.137 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-fuse x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 919 k 2023-09-13T08:21:53.137 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 167 k 2023-09-13T08:21:53.137 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 1.6 M 2023-09-13T08:21:53.137 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6083.g4a754ac9.el8 ceph-noarch 132 k 2023-09-13T08:21:53.138 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6083.g4a754ac9.el8 ceph-noarch 1.7 M 2023-09-13T08:21:53.138 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6083.g4a754ac9.el8 ceph-noarch 7.4 M 2023-09-13T08:21:53.138 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-rook noarch 2:18.0.0-6083.g4a754ac9.el8 ceph-noarch 47 k 2023-09-13T08:21:53.138 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-radosgw x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 14 M 2023-09-13T08:21:53.139 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-test x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 49 M 2023-09-13T08:21:53.139 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-volume noarch 2:18.0.0-6083.g4a754ac9.el8 ceph-noarch 261 k 2023-09-13T08:21:53.139 INFO:teuthology.orchestra.run.smithi161.stdout: cephadm noarch 2:18.0.0-6083.g4a754ac9.el8 ceph-noarch 179 k 2023-09-13T08:21:53.139 INFO:teuthology.orchestra.run.smithi161.stdout: cephfs-mirror x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 260 k 2023-09-13T08:21:53.139 INFO:teuthology.orchestra.run.smithi161.stdout: cephfs-top noarch 2:18.0.0-6083.g4a754ac9.el8 ceph-noarch 18 k 2023-09-13T08:21:53.140 INFO:teuthology.orchestra.run.smithi161.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-09-13T08:21:53.140 INFO:teuthology.orchestra.run.smithi161.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-09-13T08:21:53.140 INFO:teuthology.orchestra.run.smithi161.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-09-13T08:21:53.140 INFO:teuthology.orchestra.run.smithi161.stdout: libcephfs-devel x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 31 k 2023-09-13T08:21:53.140 INFO:teuthology.orchestra.run.smithi161.stdout: libcephfs2 x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 839 k 2023-09-13T08:21:53.140 INFO:teuthology.orchestra.run.smithi161.stdout: librados-devel x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 139 k 2023-09-13T08:21:53.141 INFO:teuthology.orchestra.run.smithi161.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-09-13T08:21:53.141 INFO:teuthology.orchestra.run.smithi161.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-09-13T08:21:53.141 INFO:teuthology.orchestra.run.smithi161.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-09-13T08:21:53.141 INFO:teuthology.orchestra.run.smithi161.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-09-13T08:21:53.142 INFO:teuthology.orchestra.run.smithi161.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-09-13T08:21:53.142 INFO:teuthology.orchestra.run.smithi161.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-09-13T08:21:53.142 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cephfs x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 197 k 2023-09-13T08:21:53.142 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rados x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 370 k 2023-09-13T08:21:53.142 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rbd x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 365 k 2023-09-13T08:21:53.143 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rgw x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 107 k 2023-09-13T08:21:53.143 INFO:teuthology.orchestra.run.smithi161.stdout: rbd-fuse x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 93 k 2023-09-13T08:21:53.143 INFO:teuthology.orchestra.run.smithi161.stdout: rbd-mirror x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 3.6 M 2023-09-13T08:21:53.143 INFO:teuthology.orchestra.run.smithi161.stdout: rbd-nbd x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 179 k 2023-09-13T08:21:53.143 INFO:teuthology.orchestra.run.smithi161.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-09-13T08:21:53.144 INFO:teuthology.orchestra.run.smithi161.stdout:Upgrading: 2023-09-13T08:21:53.144 INFO:teuthology.orchestra.run.smithi161.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-09-13T08:21:53.144 INFO:teuthology.orchestra.run.smithi161.stdout: librados2 x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 3.7 M 2023-09-13T08:21:53.144 INFO:teuthology.orchestra.run.smithi161.stdout: librbd1 x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 3.7 M 2023-09-13T08:21:53.144 INFO:teuthology.orchestra.run.smithi161.stdout:Installing dependencies: 2023-09-13T08:21:53.144 INFO:teuthology.orchestra.run.smithi161.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-09-13T08:21:53.145 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-common x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 22 M 2023-09-13T08:21:53.145 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6083.g4a754ac9.el8 ceph-noarch 23 k 2023-09-13T08:21:53.145 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mds x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 2.3 M 2023-09-13T08:21:53.145 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6083.g4a754ac9.el8 ceph-noarch 242 k 2023-09-13T08:21:53.145 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mon x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 4.6 M 2023-09-13T08:21:53.146 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-osd x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 18 M 2023-09-13T08:21:53.146 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6083.g4a754ac9.el8 ceph-noarch 15 k 2023-09-13T08:21:53.146 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-selinux x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 24 k 2023-09-13T08:21:53.146 INFO:teuthology.orchestra.run.smithi161.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-09-13T08:21:53.146 INFO:teuthology.orchestra.run.smithi161.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-09-13T08:21:53.147 INFO:teuthology.orchestra.run.smithi161.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-09-13T08:21:53.147 INFO:teuthology.orchestra.run.smithi161.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-09-13T08:21:53.147 INFO:teuthology.orchestra.run.smithi161.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-09-13T08:21:53.147 INFO:teuthology.orchestra.run.smithi161.stdout: libcephsqlite x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 183 k 2023-09-13T08:21:53.147 INFO:teuthology.orchestra.run.smithi161.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-09-13T08:21:53.148 INFO:teuthology.orchestra.run.smithi161.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-09-13T08:21:53.148 INFO:teuthology.orchestra.run.smithi161.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-09-13T08:21:53.148 INFO:teuthology.orchestra.run.smithi161.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-09-13T08:21:53.148 INFO:teuthology.orchestra.run.smithi161.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-09-13T08:21:53.148 INFO:teuthology.orchestra.run.smithi161.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-09-13T08:21:53.149 INFO:teuthology.orchestra.run.smithi161.stdout: libradosstriper1 x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 518 k 2023-09-13T08:21:53.149 INFO:teuthology.orchestra.run.smithi161.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-09-13T08:21:53.149 INFO:teuthology.orchestra.run.smithi161.stdout: librgw2 x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 6.8 M 2023-09-13T08:21:53.149 INFO:teuthology.orchestra.run.smithi161.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-09-13T08:21:53.149 INFO:teuthology.orchestra.run.smithi161.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-09-13T08:21:53.150 INFO:teuthology.orchestra.run.smithi161.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-09-13T08:21:53.150 INFO:teuthology.orchestra.run.smithi161.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-09-13T08:21:53.150 INFO:teuthology.orchestra.run.smithi161.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-09-13T08:21:53.150 INFO:teuthology.orchestra.run.smithi161.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-09-13T08:21:53.150 INFO:teuthology.orchestra.run.smithi161.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-09-13T08:21:53.151 INFO:teuthology.orchestra.run.smithi161.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-09-13T08:21:53.151 INFO:teuthology.orchestra.run.smithi161.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-09-13T08:21:53.151 INFO:teuthology.orchestra.run.smithi161.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-09-13T08:21:53.151 INFO:teuthology.orchestra.run.smithi161.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-09-13T08:21:53.151 INFO:teuthology.orchestra.run.smithi161.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-09-13T08:21:53.151 INFO:teuthology.orchestra.run.smithi161.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-09-13T08:21:53.152 INFO:teuthology.orchestra.run.smithi161.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-09-13T08:21:53.152 INFO:teuthology.orchestra.run.smithi161.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-09-13T08:21:53.152 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-09-13T08:21:53.152 INFO:teuthology.orchestra.run.smithi161.stdout: python3-ceph-argparse x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 45 k 2023-09-13T08:21:53.152 INFO:teuthology.orchestra.run.smithi161.stdout: python3-ceph-common x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 125 k 2023-09-13T08:21:53.153 INFO:teuthology.orchestra.run.smithi161.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-09-13T08:21:53.153 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-09-13T08:21:53.153 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-09-13T08:21:53.153 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-09-13T08:21:53.153 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-09-13T08:21:53.154 INFO:teuthology.orchestra.run.smithi161.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-09-13T08:21:53.154 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-09-13T08:21:53.154 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-09-13T08:21:53.154 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-09-13T08:21:53.154 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-09-13T08:21:53.155 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-09-13T08:21:53.155 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-09-13T08:21:53.155 INFO:teuthology.orchestra.run.smithi161.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-09-13T08:21:53.155 INFO:teuthology.orchestra.run.smithi161.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-09-13T08:21:53.155 INFO:teuthology.orchestra.run.smithi161.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-09-13T08:21:53.155 INFO:teuthology.orchestra.run.smithi161.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-09-13T08:21:53.156 INFO:teuthology.orchestra.run.smithi161.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-09-13T08:21:53.156 INFO:teuthology.orchestra.run.smithi161.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-09-13T08:21:53.156 INFO:teuthology.orchestra.run.smithi161.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-09-13T08:21:53.156 INFO:teuthology.orchestra.run.smithi161.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-09-13T08:21:53.156 INFO:teuthology.orchestra.run.smithi161.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-09-13T08:21:53.157 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-09-13T08:21:53.157 INFO:teuthology.orchestra.run.smithi161.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-09-13T08:21:53.157 INFO:teuthology.orchestra.run.smithi161.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-09-13T08:21:53.157 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-09-13T08:21:53.157 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-09-13T08:21:53.158 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-09-13T08:21:53.158 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-09-13T08:21:53.158 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-09-13T08:21:53.158 INFO:teuthology.orchestra.run.smithi161.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-09-13T08:21:53.158 INFO:teuthology.orchestra.run.smithi161.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-09-13T08:21:53.159 INFO:teuthology.orchestra.run.smithi161.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-09-13T08:21:53.159 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-09-13T08:21:53.159 INFO:teuthology.orchestra.run.smithi161.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-09-13T08:21:53.159 INFO:teuthology.orchestra.run.smithi161.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-09-13T08:21:53.159 INFO:teuthology.orchestra.run.smithi161.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-09-13T08:21:53.160 INFO:teuthology.orchestra.run.smithi161.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-09-13T08:21:53.160 INFO:teuthology.orchestra.run.smithi161.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-09-13T08:21:53.160 INFO:teuthology.orchestra.run.smithi161.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-09-13T08:21:53.160 INFO:teuthology.orchestra.run.smithi161.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-09-13T08:21:53.160 INFO:teuthology.orchestra.run.smithi161.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-09-13T08:21:53.160 INFO:teuthology.orchestra.run.smithi161.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-09-13T08:21:53.161 INFO:teuthology.orchestra.run.smithi161.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-09-13T08:21:53.161 INFO:teuthology.orchestra.run.smithi161.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-09-13T08:21:53.161 INFO:teuthology.orchestra.run.smithi161.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-09-13T08:21:53.161 INFO:teuthology.orchestra.run.smithi161.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-09-13T08:21:53.161 INFO:teuthology.orchestra.run.smithi161.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-09-13T08:21:53.162 INFO:teuthology.orchestra.run.smithi161.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-09-13T08:21:53.162 INFO:teuthology.orchestra.run.smithi161.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-09-13T08:21:53.162 INFO:teuthology.orchestra.run.smithi161.stdout:Enabling module streams: 2023-09-13T08:21:53.162 INFO:teuthology.orchestra.run.smithi161.stdout: postgresql 10 2023-09-13T08:21:53.162 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-09-13T08:21:53.163 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction Summary 2023-09-13T08:21:53.163 INFO:teuthology.orchestra.run.smithi161.stdout:=========================================================================================================================== 2023-09-13T08:21:53.163 INFO:teuthology.orchestra.run.smithi161.stdout:Install 128 Packages 2023-09-13T08:21:53.163 INFO:teuthology.orchestra.run.smithi161.stdout:Upgrade 3 Packages 2023-09-13T08:21:53.164 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-09-13T08:21:53.164 INFO:teuthology.orchestra.run.smithi161.stdout:Total download size: 208 M 2023-09-13T08:21:53.165 INFO:teuthology.orchestra.run.smithi161.stdout:Downloading Packages: 2023-09-13T08:21:53.358 INFO:teuthology.orchestra.run.smithi084.stdout:(6/131): ceph-mon-18.0.0-6083.g4a754ac9.el8.x86 12 MB/s | 4.6 MB 00:00 2023-09-13T08:21:53.425 INFO:teuthology.orchestra.run.smithi084.stdout:(7/131): ceph-base-18.0.0-6083.g4a754ac9.el8.x8 4.3 MB/s | 5.4 MB 00:01 2023-09-13T08:21:53.785 INFO:teuthology.orchestra.run.smithi161.stdout:(1/131): ceph-18.0.0-6083.g4a754ac9.el8.x86_64. 26 kB/s | 6.4 kB 00:00 2023-09-13T08:21:54.852 INFO:teuthology.orchestra.run.smithi161.stdout:(2/131): ceph-fuse-18.0.0-6083.g4a754ac9.el8.x8 862 kB/s | 919 kB 00:01 2023-09-13T08:21:54.883 INFO:teuthology.orchestra.run.smithi084.stdout:(8/131): ceph-osd-18.0.0-6083.g4a754ac9.el8.x86 12 MB/s | 18 MB 00:01 2023-09-13T08:21:54.950 INFO:teuthology.orchestra.run.smithi084.stdout:(9/131): ceph-selinux-18.0.0-6083.g4a754ac9.el8 365 kB/s | 24 kB 00:00 2023-09-13T08:21:54.961 INFO:teuthology.orchestra.run.smithi161.stdout:(3/131): ceph-immutable-object-cache-18.0.0-608 1.5 MB/s | 167 kB 00:00 2023-09-13T08:21:55.400 INFO:teuthology.orchestra.run.smithi084.stdout:(10/131): ceph-radosgw-18.0.0-6083.g4a754ac9.el 6.9 MB/s | 14 MB 00:01 2023-09-13T08:21:55.534 INFO:teuthology.orchestra.run.smithi084.stdout:(11/131): cephfs-mirror-18.0.0-6083.g4a754ac9.e 1.9 MB/s | 260 kB 00:00 2023-09-13T08:21:55.634 INFO:teuthology.orchestra.run.smithi084.stdout:(12/131): libcephfs-devel-18.0.0-6083.g4a754ac9 311 kB/s | 31 kB 00:00 2023-09-13T08:21:55.851 INFO:teuthology.orchestra.run.smithi084.stdout:(13/131): libcephfs2-18.0.0-6083.g4a754ac9.el8. 3.8 MB/s | 839 kB 00:00 2023-09-13T08:21:56.080 INFO:teuthology.orchestra.run.smithi084.stdout:(14/131): ceph-common-18.0.0-6083.g4a754ac9.el8 5.7 MB/s | 22 MB 00:03 2023-09-13T08:21:56.110 INFO:teuthology.orchestra.run.smithi084.stdout:(15/131): libcephsqlite-18.0.0-6083.g4a754ac9.e 710 kB/s | 183 kB 00:00 2023-09-13T08:21:56.152 INFO:teuthology.orchestra.run.smithi084.stdout:(16/131): librados-devel-18.0.0-6083.g4a754ac9. 1.9 MB/s | 139 kB 00:00 2023-09-13T08:21:56.269 INFO:teuthology.orchestra.run.smithi084.stdout:(17/131): libradosstriper1-18.0.0-6083.g4a754ac 3.2 MB/s | 518 kB 00:00 2023-09-13T08:21:56.369 INFO:teuthology.orchestra.run.smithi084.stdout:(18/131): python3-ceph-argparse-18.0.0-6083.g4a 447 kB/s | 45 kB 00:00 2023-09-13T08:21:56.477 INFO:teuthology.orchestra.run.smithi084.stdout:(19/131): python3-ceph-common-18.0.0-6083.g4a75 1.1 MB/s | 125 kB 00:00 2023-09-13T08:21:56.594 INFO:teuthology.orchestra.run.smithi084.stdout:(20/131): python3-cephfs-18.0.0-6083.g4a754ac9. 1.7 MB/s | 197 kB 00:00 2023-09-13T08:21:56.728 INFO:teuthology.orchestra.run.smithi084.stdout:(21/131): python3-rados-18.0.0-6083.g4a754ac9.e 2.7 MB/s | 370 kB 00:00 2023-09-13T08:21:56.803 INFO:teuthology.orchestra.run.smithi161.stdout:(4/131): ceph-base-18.0.0-6083.g4a754ac9.el8.x8 1.6 MB/s | 5.4 MB 00:03 2023-09-13T08:21:56.845 INFO:teuthology.orchestra.run.smithi084.stdout:(22/131): python3-rbd-18.0.0-6083.g4a754ac9.el8 3.1 MB/s | 365 kB 00:00 2023-09-13T08:21:56.962 INFO:teuthology.orchestra.run.smithi084.stdout:(23/131): python3-rgw-18.0.0-6083.g4a754ac9.el8 919 kB/s | 107 kB 00:00 2023-09-13T08:21:57.079 INFO:teuthology.orchestra.run.smithi084.stdout:(24/131): rbd-fuse-18.0.0-6083.g4a754ac9.el8.x8 801 kB/s | 93 kB 00:00 2023-09-13T08:21:57.328 INFO:teuthology.orchestra.run.smithi161.stdout:(5/131): ceph-mgr-18.0.0-6083.g4a754ac9.el8.x86 3.1 MB/s | 1.6 MB 00:00 2023-09-13T08:21:57.354 INFO:teuthology.orchestra.run.smithi084.stdout:(25/131): librgw2-18.0.0-6083.g4a754ac9.el8.x86 5.7 MB/s | 6.8 MB 00:01 2023-09-13T08:21:57.395 INFO:teuthology.orchestra.run.smithi161.stdout:(6/131): ceph-mds-18.0.0-6083.g4a754ac9.el8.x86 974 kB/s | 2.3 MB 00:02 2023-09-13T08:21:57.446 INFO:teuthology.orchestra.run.smithi084.stdout:(26/131): rbd-nbd-18.0.0-6083.g4a754ac9.el8.x86 1.9 MB/s | 179 kB 00:00 2023-09-13T08:21:57.530 INFO:teuthology.orchestra.run.smithi084.stdout:(27/131): ceph-grafana-dashboards-18.0.0-6083.g 277 kB/s | 23 kB 00:00 2023-09-13T08:21:57.613 INFO:teuthology.orchestra.run.smithi084.stdout:(28/131): ceph-mgr-cephadm-18.0.0-6083.g4a754ac 1.5 MB/s | 132 kB 00:00 2023-09-13T08:21:57.972 INFO:teuthology.orchestra.run.smithi084.stdout:(29/131): rbd-mirror-18.0.0-6083.g4a754ac9.el8. 4.0 MB/s | 3.6 MB 00:00 2023-09-13T08:21:58.014 INFO:teuthology.orchestra.run.smithi084.stdout:(30/131): ceph-mgr-dashboard-18.0.0-6083.g4a754 4.4 MB/s | 1.7 MB 00:00 2023-09-13T08:21:58.281 INFO:teuthology.orchestra.run.smithi084.stdout:(31/131): ceph-mgr-modules-core-18.0.0-6083.g4a 906 kB/s | 242 kB 00:00 2023-09-13T08:21:58.407 INFO:teuthology.orchestra.run.smithi084.stdout:(32/131): ceph-mgr-rook-18.0.0-6083.g4a754ac9.e 379 kB/s | 47 kB 00:00 2023-09-13T08:21:58.437 INFO:teuthology.orchestra.run.smithi161.stdout:(7/131): ceph-mon-18.0.0-6083.g4a754ac9.el8.x86 4.2 MB/s | 4.6 MB 00:01 2023-09-13T08:21:58.815 INFO:teuthology.orchestra.run.smithi084.stdout:(33/131): ceph-test-18.0.0-6083.g4a754ac9.el8.x 13 MB/s | 49 MB 00:03 2023-09-13T08:21:58.832 INFO:teuthology.orchestra.run.smithi084.stdout:(34/131): ceph-prometheus-alerts-18.0.0-6083.g4 34 kB/s | 15 kB 00:00 2023-09-13T08:21:58.875 INFO:teuthology.orchestra.run.smithi084.stdout:(35/131): ceph-volume-18.0.0-6083.g4a754ac9.el8 4.4 MB/s | 261 kB 00:00 2023-09-13T08:21:58.908 INFO:teuthology.orchestra.run.smithi084.stdout:(36/131): cephadm-18.0.0-6083.g4a754ac9.el8.noa 2.3 MB/s | 179 kB 00:00 2023-09-13T08:21:58.925 INFO:teuthology.orchestra.run.smithi084.stdout:(37/131): cephfs-top-18.0.0-6083.g4a754ac9.el8. 360 kB/s | 18 kB 00:00 2023-09-13T08:21:58.992 INFO:teuthology.orchestra.run.smithi084.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 882 kB/s | 59 kB 00:00 2023-09-13T08:21:59.042 INFO:teuthology.orchestra.run.smithi084.stdout:(39/131): gperftools-libs-2.7-9.el8.x86_64.rpm 2.2 MB/s | 306 kB 00:00 2023-09-13T08:21:59.067 INFO:teuthology.orchestra.run.smithi084.stdout:(40/131): libunwind-1.3.1-3.el8.x86_64.rpm 1.0 MB/s | 75 kB 00:00 2023-09-13T08:21:59.101 INFO:teuthology.orchestra.run.smithi084.stdout:(41/131): python3-asyncssh-2.7.0-2.el8.noarch.r 8.0 MB/s | 476 kB 00:00 2023-09-13T08:21:59.126 INFO:teuthology.orchestra.run.smithi084.stdout:(42/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 744 kB/s | 44 kB 00:00 2023-09-13T08:21:59.143 INFO:teuthology.orchestra.run.smithi084.stdout:(43/131): python3-beautifulsoup4-4.6.3-2.el8.1. 4.3 MB/s | 185 kB 00:00 2023-09-13T08:21:59.168 INFO:teuthology.orchestra.run.smithi084.stdout:(44/131): python3-cachetools-3.1.1-4.el8.noarch 790 kB/s | 33 kB 00:00 2023-09-13T08:21:59.194 INFO:teuthology.orchestra.run.smithi084.stdout:(45/131): python3-certifi-2018.10.15-7.el8.noar 325 kB/s | 16 kB 00:00 2023-09-13T08:21:59.302 INFO:teuthology.orchestra.run.smithi084.stdout:(46/131): ceph-mgr-diskprediction-local-18.0.0- 5.6 MB/s | 7.4 MB 00:01 2023-09-13T08:21:59.319 INFO:teuthology.orchestra.run.smithi084.stdout:(47/131): python3-cheroot-8.5.2-1.el8.noarch.rp 1.1 MB/s | 173 kB 00:00 2023-09-13T08:21:59.345 INFO:teuthology.orchestra.run.smithi084.stdout:(48/131): python3-cherrypy-18.4.0-1.el8.noarch. 2.5 MB/s | 384 kB 00:00 2023-09-13T08:21:59.370 INFO:teuthology.orchestra.run.smithi084.stdout:(49/131): python3-jaraco-6.2-6.el8.noarch.rpm 222 kB/s | 11 kB 00:00 2023-09-13T08:21:59.397 INFO:teuthology.orchestra.run.smithi084.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 351 kB/s | 18 kB 00:00 2023-09-13T08:21:59.412 INFO:teuthology.orchestra.run.smithi084.stdout:(51/131): python3-google-auth-1.1.1-10.el8.noar 744 kB/s | 81 kB 00:00 2023-09-13T08:21:59.437 INFO:teuthology.orchestra.run.smithi084.stdout:(52/131): python3-logutils-0.3.5-11.el8.noarch. 1.1 MB/s | 49 kB 00:00 2023-09-13T08:21:59.463 INFO:teuthology.orchestra.run.smithi084.stdout:(53/131): python3-more-itertools-7.2.0-3.el8.no 1.1 MB/s | 59 kB 00:00 2023-09-13T08:21:59.488 INFO:teuthology.orchestra.run.smithi084.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 1.2 MB/s | 60 kB 00:00 2023-09-13T08:21:59.552 INFO:teuthology.orchestra.run.smithi084.stdout:(55/131): python3-kubernetes-11.0.0-6.el8.noarc 6.4 MB/s | 1.2 MB 00:00 2023-09-13T08:21:59.580 INFO:teuthology.orchestra.run.smithi084.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 169 kB/s | 16 kB 00:00 2023-09-13T08:21:59.606 INFO:teuthology.orchestra.run.smithi084.stdout:(57/131): python3-repoze-lru-0.7-6.el8.noarch.r 638 kB/s | 34 kB 00:00 2023-09-13T08:21:59.631 INFO:teuthology.orchestra.run.smithi084.stdout:(58/131): python3-pecan-1.3.2-9.el8.noarch.rpm 1.6 MB/s | 283 kB 00:00 2023-09-13T08:21:59.656 INFO:teuthology.orchestra.run.smithi084.stdout:(59/131): python3-rsa-4.9-2.el8.noarch.rpm 1.3 MB/s | 64 kB 00:00 2023-09-13T08:21:59.681 INFO:teuthology.orchestra.run.smithi084.stdout:(60/131): python3-routes-2.4.1-12.el8.noarch.rp 1.9 MB/s | 196 kB 00:00 2023-09-13T08:21:59.707 INFO:teuthology.orchestra.run.smithi084.stdout:(61/131): python3-simplegeneric-0.8.1-17.el8.no 249 kB/s | 19 kB 00:00 2023-09-13T08:21:59.732 INFO:teuthology.orchestra.run.smithi084.stdout:(62/131): python3-singledispatch-3.4.0.3-18.el8 317 kB/s | 24 kB 00:00 2023-09-13T08:21:59.757 INFO:teuthology.orchestra.run.smithi084.stdout:(63/131): python3-tempora-1.14.1-5.el8.noarch.r 583 kB/s | 29 kB 00:00 2023-09-13T08:21:59.782 INFO:teuthology.orchestra.run.smithi084.stdout:(64/131): python3-trustme-0.6.0-4.el8.noarch.rp 366 kB/s | 27 kB 00:00 2023-09-13T08:21:59.808 INFO:teuthology.orchestra.run.smithi084.stdout:(65/131): python3-waitress-1.4.3-1.el8.noarch.r 3.3 MB/s | 255 kB 00:00 2023-09-13T08:21:59.833 INFO:teuthology.orchestra.run.smithi084.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 1.2 MB/s | 61 kB 00:00 2023-09-13T08:21:59.853 INFO:teuthology.orchestra.run.smithi161.stdout:(8/131): ceph-common-18.0.0-6083.g4a754ac9.el8. 3.5 MB/s | 22 MB 00:06 2023-09-13T08:21:59.858 INFO:teuthology.orchestra.run.smithi084.stdout:(67/131): python3-webtest-2.0.33-1.el8.noarch.r 1.7 MB/s | 85 kB 00:00 2023-09-13T08:21:59.875 INFO:teuthology.orchestra.run.smithi084.stdout:(68/131): python3-zc-lockfile-2.0-2.el8.noarch. 549 kB/s | 23 kB 00:00 2023-09-13T08:21:59.895 INFO:teuthology.orchestra.run.smithi161.stdout:(9/131): ceph-selinux-18.0.0-6083.g4a754ac9.el8 586 kB/s | 24 kB 00:00 2023-09-13T08:21:59.900 INFO:teuthology.orchestra.run.smithi084.stdout:(69/131): python3-webob-1.8.5-1.el8.1.noarch.rp 2.1 MB/s | 251 kB 00:00 2023-09-13T08:21:59.926 INFO:teuthology.orchestra.run.smithi084.stdout:(70/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.4 MB/s | 70 kB 00:00 2023-09-13T08:21:59.976 INFO:teuthology.orchestra.run.smithi084.stdout:(71/131): thrift-0.13.0-2.el8.x86_64.rpm 15 MB/s | 1.7 MB 00:00 2023-09-13T08:22:00.171 INFO:teuthology.orchestra.run.smithi161.stdout:(10/131): ceph-radosgw-18.0.0-6083.g4a754ac9.el 7.9 MB/s | 14 MB 00:01 2023-09-13T08:22:00.193 INFO:teuthology.orchestra.run.smithi084.stdout:(72/131): python3-pyasn1-modules-0.3.7-6.el8.no 421 kB/s | 110 kB 00:00 2023-09-13T08:22:00.254 INFO:teuthology.orchestra.run.smithi161.stdout:(11/131): cephfs-mirror-18.0.0-6083.g4a754ac9.e 3.1 MB/s | 260 kB 00:00 2023-09-13T08:22:00.268 INFO:teuthology.orchestra.run.smithi084.stdout:(73/131): python3-pytz-2017.2-9.el8.noarch.rpm 189 kB/s | 54 kB 00:00 2023-09-13T08:22:00.321 INFO:teuthology.orchestra.run.smithi161.stdout:(12/131): libcephfs-devel-18.0.0-6083.g4a754ac9 467 kB/s | 31 kB 00:00 2023-09-13T08:22:00.393 INFO:teuthology.orchestra.run.smithi084.stdout:(74/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.3 MB/s | 259 kB 00:00 2023-09-13T08:22:00.463 INFO:teuthology.orchestra.run.smithi161.stdout:(13/131): libcephfs2-18.0.0-6083.g4a754ac9.el8. 5.8 MB/s | 839 kB 00:00 2023-09-13T08:22:00.518 INFO:teuthology.orchestra.run.smithi084.stdout:(75/131): socat-1.7.4.1-1.el8.x86_64.rpm 1.3 MB/s | 323 kB 00:00 2023-09-13T08:22:00.530 INFO:teuthology.orchestra.run.smithi161.stdout:(14/131): libcephsqlite-18.0.0-6083.g4a754ac9.e 2.7 MB/s | 183 kB 00:00 2023-09-13T08:22:00.597 INFO:teuthology.orchestra.run.smithi161.stdout:(15/131): librados-devel-18.0.0-6083.g4a754ac9. 2.0 MB/s | 139 kB 00:00 2023-09-13T08:22:00.660 INFO:teuthology.orchestra.run.smithi084.stdout:(76/131): python3-scipy-1.0.0-21.module+el8.5.0 18 MB/s | 14 MB 00:00 2023-09-13T08:22:00.677 INFO:teuthology.orchestra.run.smithi084.stdout:(77/131): python3-markupsafe-0.23-19.el8.x86_64 137 kB/s | 39 kB 00:00 2023-09-13T08:22:00.706 INFO:teuthology.orchestra.run.smithi161.stdout:(16/131): libradosstriper1-18.0.0-6083.g4a754ac 4.7 MB/s | 518 kB 00:00 2023-09-13T08:22:00.711 INFO:teuthology.orchestra.run.smithi084.stdout:(78/131): bison-3.0.4-10.el8.x86_64.rpm 3.5 MB/s | 688 kB 00:00 2023-09-13T08:22:00.870 INFO:teuthology.orchestra.run.smithi084.stdout:(79/131): python3-mako-1.0.6-13.el8.noarch.rpm 818 kB/s | 157 kB 00:00 2023-09-13T08:22:00.911 INFO:teuthology.orchestra.run.smithi084.stdout:(80/131): python3-jinja2-2.10.1-3.el8.noarch.rp 2.1 MB/s | 538 kB 00:00 2023-09-13T08:22:00.954 INFO:teuthology.orchestra.run.smithi084.stdout:(81/131): oniguruma-6.8.2-2.el8.x86_64.rpm 774 kB/s | 187 kB 00:00 2023-09-13T08:22:01.137 INFO:teuthology.orchestra.run.smithi084.stdout:(82/131): automake-1.16.1-7.el8.noarch.rpm 2.6 MB/s | 713 kB 00:00 2023-09-13T08:22:01.229 INFO:teuthology.orchestra.run.smithi084.stdout:(83/131): python3-jsonpatch-1.21-2.el8.noarch.r 96 kB/s | 27 kB 00:00 2023-09-13T08:22:01.271 INFO:teuthology.orchestra.run.smithi084.stdout:(84/131): flex-2.6.1-9.el8.x86_64.rpm 2.3 MB/s | 320 kB 00:00 2023-09-13T08:22:01.336 INFO:teuthology.orchestra.run.smithi084.stdout:(85/131): python3-prettytable-0.7.2-14.el8.noar 413 kB/s | 44 kB 00:00 2023-09-13T08:22:01.463 INFO:teuthology.orchestra.run.smithi084.stdout:(86/131): python3-babel-2.5.1-7.el8.noarch.rpm 8.7 MB/s | 4.8 MB 00:00 2023-09-13T08:22:01.481 INFO:teuthology.orchestra.run.smithi161.stdout:(17/131): librgw2-18.0.0-6083.g4a754ac9.el8.x86 8.8 MB/s | 6.8 MB 00:00 2023-09-13T08:22:01.530 INFO:teuthology.orchestra.run.smithi084.stdout:(87/131): python3-numpy-1.14.3-10.el8.x86_64.rp 14 MB/s | 3.7 MB 00:00 2023-09-13T08:22:01.539 INFO:teuthology.orchestra.run.smithi161.stdout:(18/131): python3-ceph-argparse-18.0.0-6083.g4a 772 kB/s | 45 kB 00:00 2023-09-13T08:22:01.564 INFO:teuthology.orchestra.run.smithi084.stdout:(88/131): python3-werkzeug-0.12.2-4.el8.noarch. 2.0 MB/s | 457 kB 00:00 2023-09-13T08:22:01.598 INFO:teuthology.orchestra.run.smithi161.stdout:(19/131): python3-ceph-common-18.0.0-6083.g4a75 2.1 MB/s | 125 kB 00:00 2023-09-13T08:22:01.689 INFO:teuthology.orchestra.run.smithi084.stdout:(89/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 998 kB/s | 225 kB 00:00 2023-09-13T08:22:01.690 INFO:teuthology.orchestra.run.smithi161.stdout:(20/131): python3-cephfs-18.0.0-6083.g4a754ac9. 2.1 MB/s | 197 kB 00:00 2023-09-13T08:22:01.723 INFO:teuthology.orchestra.run.smithi084.stdout:(90/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 797 kB/s | 126 kB 00:00 2023-09-13T08:22:01.739 INFO:teuthology.orchestra.run.smithi084.stdout:(91/131): uuid-1.6.2-43.el8.x86_64.rpm 306 kB/s | 64 kB 00:00 2023-09-13T08:22:01.757 INFO:teuthology.orchestra.run.smithi161.stdout:(21/131): python3-rados-18.0.0-6083.g4a754ac9.e 5.4 MB/s | 370 kB 00:00 2023-09-13T08:22:01.832 INFO:teuthology.orchestra.run.smithi161.stdout:(22/131): python3-rbd-18.0.0-6083.g4a754ac9.el8 4.8 MB/s | 365 kB 00:00 2023-09-13T08:22:01.899 INFO:teuthology.orchestra.run.smithi161.stdout:(23/131): python3-rgw-18.0.0-6083.g4a754ac9.el8 1.6 MB/s | 107 kB 00:00 2023-09-13T08:22:01.923 INFO:teuthology.orchestra.run.smithi084.stdout:(92/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 517 kB/s | 103 kB 00:00 2023-09-13T08:22:01.940 INFO:teuthology.orchestra.run.smithi084.stdout:(93/131): python3-jsonpointer-1.10-11.el8.noarc 80 kB/s | 20 kB 00:00 2023-09-13T08:22:01.966 INFO:teuthology.orchestra.run.smithi161.stdout:(24/131): rbd-fuse-18.0.0-6083.g4a754ac9.el8.x8 1.4 MB/s | 93 kB 00:00 2023-09-13T08:22:01.974 INFO:teuthology.orchestra.run.smithi084.stdout:(94/131): libtool-2.4.6-25.el8.x86_64.rpm 3.0 MB/s | 709 kB 00:00 2023-09-13T08:22:02.116 INFO:teuthology.orchestra.run.smithi084.stdout:(95/131): libpq-13.5-1.el8.x86_64.rpm 1.1 MB/s | 198 kB 00:00 2023-09-13T08:22:02.158 INFO:teuthology.orchestra.run.smithi161.stdout:(25/131): ceph-osd-18.0.0-6083.g4a754ac9.el8.x8 3.7 MB/s | 18 MB 00:04 2023-09-13T08:22:02.207 INFO:teuthology.orchestra.run.smithi084.stdout:(96/131): openblas-threads-0.3.15-3.el8.x86_64. 17 MB/s | 4.9 MB 00:00 2023-09-13T08:22:02.225 INFO:teuthology.orchestra.run.smithi161.stdout:(26/131): rbd-nbd-18.0.0-6083.g4a754ac9.el8.x86 2.6 MB/s | 179 kB 00:00 2023-09-13T08:22:02.233 INFO:teuthology.orchestra.run.smithi084.stdout:(97/131): jq-1.6-3.el8.x86_64.rpm 1.7 MB/s | 202 kB 00:00 2023-09-13T08:22:02.266 INFO:teuthology.orchestra.run.smithi084.stdout:(98/131): librdkafka-0.11.4-3.el8.x86_64.rpm 5.9 MB/s | 354 kB 00:00 2023-09-13T08:22:02.267 INFO:teuthology.orchestra.run.smithi161.stdout:(27/131): ceph-grafana-dashboards-18.0.0-6083.g 555 kB/s | 23 kB 00:00 2023-09-13T08:22:02.318 INFO:teuthology.orchestra.run.smithi161.stdout:(28/131): ceph-mgr-cephadm-18.0.0-6083.g4a754ac 2.6 MB/s | 132 kB 00:00 2023-09-13T08:22:02.350 INFO:teuthology.orchestra.run.smithi084.stdout:(99/131): openblas-0.3.15-3.el8.x86_64.rpm 13 MB/s | 4.7 MB 00:00 2023-09-13T08:22:02.400 INFO:teuthology.orchestra.run.smithi084.stdout:(100/131): postgresql-contrib-10.21-2.module+el 5.9 MB/s | 808 kB 00:00 2023-09-13T08:22:02.451 INFO:teuthology.orchestra.run.smithi084.stdout:(101/131): postgresql-10.21-2.module+el8.6.0+15 15 MB/s | 1.5 MB 00:00 2023-09-13T08:22:02.501 INFO:teuthology.orchestra.run.smithi084.stdout:(102/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 468 kB/s | 47 kB 00:00 2023-09-13T08:22:02.509 INFO:teuthology.orchestra.run.smithi161.stdout:(29/131): rbd-mirror-18.0.0-6083.g4a754ac9.el8. 6.6 MB/s | 3.6 MB 00:00 2023-09-13T08:22:02.526 INFO:teuthology.orchestra.run.smithi084.stdout:(103/131): libselinux-devel-2.9-5.el8.x86_64.rp 2.6 MB/s | 200 kB 00:00 2023-09-13T08:22:02.551 INFO:teuthology.orchestra.run.smithi084.stdout:(104/131): python3-jwt-1.6.1-2.el8.noarch.rpm 849 kB/s | 43 kB 00:00 2023-09-13T08:22:02.577 INFO:teuthology.orchestra.run.smithi084.stdout:(105/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 4.3 MB/s | 220 kB 00:00 2023-09-13T08:22:02.602 INFO:teuthology.orchestra.run.smithi084.stdout:(106/131): keyutils-libs-devel-1.5.10-9.el8.x86 956 kB/s | 48 kB 00:00 2023-09-13T08:22:02.629 INFO:teuthology.orchestra.run.smithi084.stdout:(107/131): libsepol-devel-2.9-3.el8.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2023-09-13T08:22:02.660 INFO:teuthology.orchestra.run.smithi161.stdout:(30/131): ceph-mgr-dashboard-18.0.0-6083.g4a754 5.1 MB/s | 1.7 MB 00:00 2023-09-13T08:22:02.694 INFO:teuthology.orchestra.run.smithi084.stdout:(108/131): postgresql-server-10.21-2.module+el8 11 MB/s | 5.1 MB 00:00 2023-09-13T08:22:02.720 INFO:teuthology.orchestra.run.smithi084.stdout:(109/131): python3-requests-oauthlib-1.0.0-1.el 364 kB/s | 43 kB 00:00 2023-09-13T08:22:02.744 INFO:teuthology.orchestra.run.smithi161.stdout:(31/131): ceph-mgr-modules-core-18.0.0-6083.g4a 2.8 MB/s | 242 kB 00:00 2023-09-13T08:22:02.745 INFO:teuthology.orchestra.run.smithi084.stdout:(110/131): python3-pycparser-2.14-14.el8.noarch 932 kB/s | 109 kB 00:00 2023-09-13T08:22:02.770 INFO:teuthology.orchestra.run.smithi084.stdout:(111/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 3.0 MB/s | 229 kB 00:00 2023-09-13T08:22:02.795 INFO:teuthology.orchestra.run.smithi084.stdout:(112/131): libaio-devel-0.3.112-1.el8.x86_64.rp 372 kB/s | 19 kB 00:00 2023-09-13T08:22:02.802 INFO:teuthology.orchestra.run.smithi161.stdout:(32/131): ceph-mgr-rook-18.0.0-6083.g4a754ac9.e 816 kB/s | 47 kB 00:00 2023-09-13T08:22:02.821 INFO:teuthology.orchestra.run.smithi084.stdout:(113/131): python3-oauthlib-2.1.0-1.el8.noarch. 3.0 MB/s | 155 kB 00:00 2023-09-13T08:22:02.854 INFO:teuthology.orchestra.run.smithi084.stdout:(114/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 4.1 MB/s | 560 kB 00:00 2023-09-13T08:22:02.860 INFO:teuthology.orchestra.run.smithi161.stdout:(33/131): ceph-prometheus-alerts-18.0.0-6083.g4 250 kB/s | 15 kB 00:00 2023-09-13T08:22:02.879 INFO:teuthology.orchestra.run.smithi084.stdout:(115/131): libverto-devel-0.3.0-5.el8.x86_64.rp 306 kB/s | 18 kB 00:00 2023-09-13T08:22:02.913 INFO:teuthology.orchestra.run.smithi084.stdout:(116/131): python3-cryptography-3.2.1-5.el8.x86 4.7 MB/s | 559 kB 00:00 2023-09-13T08:22:02.940 INFO:teuthology.orchestra.run.smithi084.stdout:(117/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 3.8 MB/s | 238 kB 00:00 2023-09-13T08:22:02.944 INFO:teuthology.orchestra.run.smithi161.stdout:(34/131): ceph-volume-18.0.0-6083.g4a754ac9.el8 3.1 MB/s | 261 kB 00:00 2023-09-13T08:22:02.965 INFO:teuthology.orchestra.run.smithi084.stdout:(118/131): pcre2-devel-10.32-2.el8.x86_64.rpm 5.3 MB/s | 605 kB 00:00 2023-09-13T08:22:02.991 INFO:teuthology.orchestra.run.smithi084.stdout:(119/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 1.4 MB/s | 72 kB 00:00 2023-09-13T08:22:03.011 INFO:teuthology.orchestra.run.smithi161.stdout:(35/131): cephadm-18.0.0-6083.g4a754ac9.el8.noa 2.6 MB/s | 179 kB 00:00 2023-09-13T08:22:03.016 INFO:teuthology.orchestra.run.smithi084.stdout:(120/131): fuse-2.9.7-15.el8.x86_64.rpm 1.6 MB/s | 83 kB 00:00 2023-09-13T08:22:03.075 INFO:teuthology.orchestra.run.smithi084.stdout:(121/131): elfutils-libelf-devel-0.186-1.el8.x8 716 kB/s | 60 kB 00:00 2023-09-13T08:22:03.100 INFO:teuthology.orchestra.run.smithi084.stdout:(122/131): libuuid-devel-2.32.1-35.el8.x86_64.r 1.1 MB/s | 98 kB 00:00 2023-09-13T08:22:03.125 INFO:teuthology.orchestra.run.smithi084.stdout:(123/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 1.1 MB/s | 58 kB 00:00 2023-09-13T08:22:03.140 INFO:teuthology.orchestra.run.smithi161.stdout:(36/131): cephfs-top-18.0.0-6083.g4a754ac9.el8. 140 kB/s | 18 kB 00:00 2023-09-13T08:22:03.151 INFO:teuthology.orchestra.run.smithi084.stdout:(124/131): libcom_err-devel-1.45.6-4.el8.x86_64 773 kB/s | 39 kB 00:00 2023-09-13T08:22:03.401 INFO:teuthology.orchestra.run.smithi084.stdout:(125/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 2.3 MB/s | 644 kB 00:00 2023-09-13T08:22:03.443 INFO:teuthology.orchestra.run.smithi084.stdout:(126/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 586 kB/s | 171 kB 00:00 2023-09-13T08:22:03.468 INFO:teuthology.orchestra.run.smithi084.stdout:(127/131): NetworkManager-initscripts-updown-1. 2.0 MB/s | 138 kB 00:00 2023-09-13T08:22:03.487 INFO:teuthology.orchestra.run.smithi161.stdout:(37/131): ceph-mgr-diskprediction-local-18.0.0- 7.6 MB/s | 7.4 MB 00:00 2023-09-13T08:22:03.527 INFO:teuthology.orchestra.run.smithi084.stdout:(128/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 3.8 MB/s | 2.3 MB 00:00 2023-09-13T08:22:03.571 INFO:teuthology.orchestra.run.smithi161.stdout:(38/131): gperftools-libs-2.7-9.el8.x86_64.rpm 712 kB/s | 306 kB 00:00 2023-09-13T08:22:03.577 INFO:teuthology.orchestra.run.smithi084.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 16 MB/s | 798 kB 00:00 2023-09-13T08:22:03.638 INFO:teuthology.orchestra.run.smithi161.stdout:(39/131): libunwind-1.3.1-3.el8.x86_64.rpm 1.1 MB/s | 75 kB 00:00 2023-09-13T08:22:03.663 INFO:teuthology.orchestra.run.smithi161.stdout:(40/131): liboath-2.6.2-3.el8.x86_64.rpm 335 kB/s | 59 kB 00:00 2023-09-13T08:22:03.738 INFO:teuthology.orchestra.run.smithi161.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 584 kB/s | 44 kB 00:00 2023-09-13T08:22:03.764 INFO:teuthology.orchestra.run.smithi161.stdout:(42/131): python3-asyncssh-2.7.0-2.el8.noarch.r 3.7 MB/s | 476 kB 00:00 2023-09-13T08:22:03.843 INFO:teuthology.orchestra.run.smithi161.stdout:(43/131): python3-cachetools-3.1.1-4.el8.noarch 416 kB/s | 33 kB 00:00 2023-09-13T08:22:03.852 INFO:teuthology.orchestra.run.smithi084.stdout:(130/131): librados2-18.0.0-6083.g4a754ac9.el8. 9.1 MB/s | 3.7 MB 00:00 2023-09-13T08:22:03.889 INFO:teuthology.orchestra.run.smithi161.stdout:(44/131): python3-beautifulsoup4-4.6.3-2.el8.1. 1.2 MB/s | 185 kB 00:00 2023-09-13T08:22:03.914 INFO:teuthology.orchestra.run.smithi161.stdout:(45/131): python3-certifi-2018.10.15-7.el8.noar 230 kB/s | 16 kB 00:00 2023-09-13T08:22:03.981 INFO:teuthology.orchestra.run.smithi161.stdout:(46/131): python3-cheroot-8.5.2-1.el8.noarch.rp 1.8 MB/s | 173 kB 00:00 2023-09-13T08:22:04.007 INFO:teuthology.orchestra.run.smithi161.stdout:(47/131): python3-cherrypy-18.4.0-1.el8.noarch. 4.1 MB/s | 384 kB 00:00 2023-09-13T08:22:04.049 INFO:teuthology.orchestra.run.smithi161.stdout:(48/131): python3-google-auth-1.1.1-10.el8.noar 1.2 MB/s | 81 kB 00:00 2023-09-13T08:22:04.074 INFO:teuthology.orchestra.run.smithi161.stdout:(49/131): python3-jaraco-6.2-6.el8.noarch.rpm 166 kB/s | 11 kB 00:00 2023-09-13T08:22:04.108 INFO:teuthology.orchestra.run.smithi161.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 301 kB/s | 18 kB 00:00 2023-09-13T08:22:04.119 INFO:teuthology.orchestra.run.smithi084.stdout:(131/131): librbd1-18.0.0-6083.g4a754ac9.el8.x8 5.7 MB/s | 3.7 MB 00:00 2023-09-13T08:22:04.122 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2023-09-13T08:22:04.122 INFO:teuthology.orchestra.run.smithi084.stdout:Total 17 MB/s | 208 MB 00:11 2023-09-13T08:22:04.166 INFO:teuthology.orchestra.run.smithi161.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 836 kB/s | 49 kB 00:00 2023-09-13T08:22:04.225 INFO:teuthology.orchestra.run.smithi161.stdout:(52/131): python3-more-itertools-7.2.0-3.el8.no 1.0 MB/s | 59 kB 00:00 2023-09-13T08:22:04.258 INFO:teuthology.orchestra.run.smithi161.stdout:(53/131): python3-kubernetes-11.0.0-6.el8.noarc 6.3 MB/s | 1.2 MB 00:00 2023-09-13T08:22:04.283 INFO:teuthology.orchestra.run.smithi161.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 1.0 MB/s | 60 kB 00:00 2023-09-13T08:22:04.326 INFO:teuthology.orchestra.run.smithi161.stdout:(55/131): python3-pecan-1.3.2-9.el8.noarch.rpm 4.1 MB/s | 283 kB 00:00 2023-09-13T08:22:04.351 INFO:teuthology.orchestra.run.smithi161.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 231 kB/s | 16 kB 00:00 2023-09-13T08:22:04.376 INFO:teuthology.orchestra.run.smithi161.stdout:(57/131): python3-repoze-lru-0.7-6.el8.noarch.r 668 kB/s | 34 kB 00:00 2023-09-13T08:22:04.410 INFO:teuthology.orchestra.run.smithi161.stdout:(58/131): python3-routes-2.4.1-12.el8.noarch.rp 3.3 MB/s | 196 kB 00:00 2023-09-13T08:22:04.435 INFO:teuthology.orchestra.run.smithi161.stdout:(59/131): python3-rsa-4.9-2.el8.noarch.rpm 1.1 MB/s | 64 kB 00:00 2023-09-13T08:22:04.460 INFO:teuthology.orchestra.run.smithi161.stdout:(60/131): python3-simplegeneric-0.8.1-17.el8.no 373 kB/s | 19 kB 00:00 2023-09-13T08:22:04.486 INFO:teuthology.orchestra.run.smithi161.stdout:(61/131): python3-singledispatch-3.4.0.3-18.el8 478 kB/s | 24 kB 00:00 2023-09-13T08:22:04.514 INFO:teuthology.orchestra.run.smithi161.stdout:(62/131): python3-tempora-1.14.1-5.el8.noarch.r 581 kB/s | 29 kB 00:00 2023-09-13T08:22:04.553 INFO:teuthology.orchestra.run.smithi161.stdout:(63/131): python3-trustme-0.6.0-4.el8.noarch.rp 410 kB/s | 27 kB 00:00 2023-09-13T08:22:04.579 INFO:teuthology.orchestra.run.smithi161.stdout:(64/131): python3-waitress-1.4.3-1.el8.noarch.r 3.7 MB/s | 255 kB 00:00 2023-09-13T08:22:04.621 INFO:teuthology.orchestra.run.smithi161.stdout:(65/131): python3-webob-1.8.5-1.el8.1.noarch.rp 3.7 MB/s | 251 kB 00:00 2023-09-13T08:22:04.646 INFO:teuthology.orchestra.run.smithi161.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 917 kB/s | 61 kB 00:00 2023-09-13T08:22:04.688 INFO:teuthology.orchestra.run.smithi161.stdout:(67/131): python3-webtest-2.0.33-1.el8.noarch.r 1.2 MB/s | 85 kB 00:00 2023-09-13T08:22:04.713 INFO:teuthology.orchestra.run.smithi161.stdout:(68/131): python3-zc-lockfile-2.0-2.el8.noarch. 343 kB/s | 23 kB 00:00 2023-09-13T08:22:04.738 INFO:teuthology.orchestra.run.smithi161.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2023-09-13T08:22:04.797 INFO:teuthology.orchestra.run.smithi161.stdout:(70/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 807 kB/s | 47 kB 00:00 2023-09-13T08:22:04.839 INFO:teuthology.orchestra.run.smithi161.stdout:(71/131): thrift-0.13.0-2.el8.x86_64.rpm 12 MB/s | 1.7 MB 00:00 2023-09-13T08:22:04.864 INFO:teuthology.orchestra.run.smithi161.stdout:(72/131): libselinux-devel-2.9-5.el8.x86_64.rpm 2.9 MB/s | 200 kB 00:00 2023-09-13T08:22:04.915 INFO:teuthology.orchestra.run.smithi161.stdout:(73/131): python3-jwt-1.6.1-2.el8.noarch.rpm 568 kB/s | 43 kB 00:00 2023-09-13T08:22:04.940 INFO:teuthology.orchestra.run.smithi161.stdout:(74/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 3.1 MB/s | 220 kB 00:00 2023-09-13T08:22:04.965 INFO:teuthology.orchestra.run.smithi161.stdout:(75/131): keyutils-libs-devel-1.5.10-9.el8.x86_ 959 kB/s | 48 kB 00:00 2023-09-13T08:22:04.970 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2023-09-13T08:22:04.990 INFO:teuthology.orchestra.run.smithi161.stdout:(76/131): libsepol-devel-2.9-3.el8.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2023-09-13T08:22:05.016 INFO:teuthology.orchestra.run.smithi161.stdout:(77/131): python3-requests-oauthlib-1.0.0-1.el8 852 kB/s | 43 kB 00:00 2023-09-13T08:22:05.041 INFO:teuthology.orchestra.run.smithi161.stdout:(78/131): python3-pycparser-2.14-14.el8.noarch. 2.1 MB/s | 109 kB 00:00 2023-09-13T08:22:05.066 INFO:teuthology.orchestra.run.smithi161.stdout:(79/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 4.5 MB/s | 229 kB 00:00 2023-09-13T08:22:05.089 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2023-09-13T08:22:05.090 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2023-09-13T08:22:05.100 INFO:teuthology.orchestra.run.smithi161.stdout:(80/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 9.3 MB/s | 560 kB 00:00 2023-09-13T08:22:05.125 INFO:teuthology.orchestra.run.smithi161.stdout:(81/131): libaio-devel-0.3.112-1.el8.x86_64.rpm 320 kB/s | 19 kB 00:00 2023-09-13T08:22:05.151 INFO:teuthology.orchestra.run.smithi161.stdout:(82/131): python3-oauthlib-2.1.0-1.el8.noarch.r 3.0 MB/s | 155 kB 00:00 2023-09-13T08:22:05.184 INFO:teuthology.orchestra.run.smithi161.stdout:(83/131): python3-cryptography-3.2.1-5.el8.x86_ 9.3 MB/s | 559 kB 00:00 2023-09-13T08:22:05.210 INFO:teuthology.orchestra.run.smithi161.stdout:(84/131): libverto-devel-0.3.0-5.el8.x86_64.rpm 304 kB/s | 18 kB 00:00 2023-09-13T08:22:05.618 INFO:teuthology.orchestra.run.smithi161.stdout:(85/131): ceph-test-18.0.0-6083.g4a754ac9.el8.x 8.5 MB/s | 49 MB 00:05 2023-09-13T08:22:05.652 INFO:teuthology.orchestra.run.smithi161.stdout:(86/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 538 kB/s | 238 kB 00:00 2023-09-13T08:22:05.685 INFO:teuthology.orchestra.run.smithi161.stdout:(87/131): pcre2-devel-10.32-2.el8.x86_64.rpm 1.2 MB/s | 605 kB 00:00 2023-09-13T08:22:05.702 INFO:teuthology.orchestra.run.smithi161.stdout:(88/131): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 1.6 MB/s | 72 kB 00:00 2023-09-13T08:22:05.728 INFO:teuthology.orchestra.run.smithi161.stdout:(89/131): fuse-2.9.7-15.el8.x86_64.rpm 1.9 MB/s | 83 kB 00:00 2023-09-13T08:22:05.753 INFO:teuthology.orchestra.run.smithi161.stdout:(90/131): elfutils-libelf-devel-0.186-1.el8.x86 1.2 MB/s | 60 kB 00:00 2023-09-13T08:22:05.778 INFO:teuthology.orchestra.run.smithi161.stdout:(91/131): libuuid-devel-2.32.1-35.el8.x86_64.rp 1.9 MB/s | 98 kB 00:00 2023-09-13T08:22:05.812 INFO:teuthology.orchestra.run.smithi161.stdout:(92/131): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 985 kB/s | 58 kB 00:00 2023-09-13T08:22:05.837 INFO:teuthology.orchestra.run.smithi161.stdout:(93/131): libcom_err-devel-1.45.6-4.el8.x86_64. 658 kB/s | 39 kB 00:00 2023-09-13T08:22:05.871 INFO:teuthology.orchestra.run.smithi161.stdout:(94/131): libgfortran-8.5.0-10.1.el8_6.x86_64.r 11 MB/s | 644 kB 00:00 2023-09-13T08:22:05.897 INFO:teuthology.orchestra.run.smithi161.stdout:(95/131): libquadmath-8.5.0-10.1.el8_6.x86_64.r 2.9 MB/s | 171 kB 00:00 2023-09-13T08:22:05.921 INFO:teuthology.orchestra.run.smithi161.stdout:(96/131): NetworkManager-initscripts-updown-1.3 2.7 MB/s | 138 kB 00:00 2023-09-13T08:22:05.988 INFO:teuthology.orchestra.run.smithi161.stdout:(97/131): openssl-devel-1.1.1k-7.el8_6.x86_64.r 6.3 MB/s | 2.3 MB 00:00 2023-09-13T08:22:06.005 INFO:teuthology.orchestra.run.smithi161.stdout:(98/131): python3-pyasn1-modules-0.3.7-6.el8.no 1.3 MB/s | 110 kB 00:00 2023-09-13T08:22:06.038 INFO:teuthology.orchestra.run.smithi161.stdout:(99/131): python3-pytz-2017.2-9.el8.noarch.rpm 1.6 MB/s | 54 kB 00:00 2023-09-13T08:22:06.064 INFO:teuthology.orchestra.run.smithi161.stdout:(100/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 4.3 MB/s | 259 kB 00:00 2023-09-13T08:22:06.097 INFO:teuthology.orchestra.run.smithi161.stdout:(101/131): socat-1.7.4.1-1.el8.x86_64.rpm 5.4 MB/s | 323 kB 00:00 2023-09-13T08:22:06.114 INFO:teuthology.orchestra.run.smithi161.stdout:(102/131): python3-markupsafe-0.23-19.el8.x86_6 771 kB/s | 39 kB 00:00 2023-09-13T08:22:06.156 INFO:teuthology.orchestra.run.smithi161.stdout:(103/131): bison-3.0.4-10.el8.x86_64.rpm 11 MB/s | 688 kB 00:00 2023-09-13T08:22:06.190 INFO:teuthology.orchestra.run.smithi161.stdout:(104/131): python3-jinja2-2.10.1-3.el8.noarch.r 7.0 MB/s | 538 kB 00:00 2023-09-13T08:22:06.212 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2023-09-13T08:22:06.215 INFO:teuthology.orchestra.run.smithi161.stdout:(105/131): python3-mako-1.0.6-13.el8.noarch.rpm 2.6 MB/s | 157 kB 00:00 2023-09-13T08:22:06.217 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2023-09-13T08:22:06.232 INFO:teuthology.orchestra.run.smithi161.stdout:(106/131): oniguruma-6.8.2-2.el8.x86_64.rpm 4.4 MB/s | 187 kB 00:00 2023-09-13T08:22:06.274 INFO:teuthology.orchestra.run.smithi161.stdout:(107/131): automake-1.16.1-7.el8.noarch.rpm 12 MB/s | 713 kB 00:00 2023-09-13T08:22:06.316 INFO:teuthology.orchestra.run.smithi161.stdout:(108/131): python3-jsonpatch-1.21-2.el8.noarch. 641 kB/s | 27 kB 00:00 2023-09-13T08:22:06.358 INFO:teuthology.orchestra.run.smithi161.stdout:(109/131): flex-2.6.1-9.el8.x86_64.rpm 7.5 MB/s | 320 kB 00:00 2023-09-13T08:22:06.400 INFO:teuthology.orchestra.run.smithi161.stdout:(110/131): python3-prettytable-0.7.2-14.el8.noa 1.0 MB/s | 44 kB 00:00 2023-09-13T08:22:06.484 INFO:teuthology.orchestra.run.smithi161.stdout:(111/131): python3-babel-2.5.1-7.el8.noarch.rpm 19 MB/s | 4.8 MB 00:00 2023-09-13T08:22:06.534 INFO:teuthology.orchestra.run.smithi161.stdout:(112/131): python3-werkzeug-0.12.2-4.el8.noarch 9.0 MB/s | 457 kB 00:00 2023-09-13T08:22:06.576 INFO:teuthology.orchestra.run.smithi161.stdout:(113/131): python3-numpy-f2py-1.14.3-10.el8.x86 5.3 MB/s | 225 kB 00:00 2023-09-13T08:22:06.671 INFO:teuthology.orchestra.run.smithi161.stdout:(114/131): python3-numpy-1.14.3-10.el8.x86_64.r 14 MB/s | 3.7 MB 00:00 2023-09-13T08:22:06.704 INFO:teuthology.orchestra.run.smithi161.stdout:(115/131): uuid-1.6.2-43.el8.x86_64.rpm 509 kB/s | 64 kB 00:00 2023-09-13T08:22:06.827 INFO:teuthology.orchestra.run.smithi161.stdout:(116/131): python3-scipy-1.0.0-21.module+el8.5. 15 MB/s | 14 MB 00:00 2023-09-13T08:22:06.852 INFO:teuthology.orchestra.run.smithi161.stdout:(117/131): python3-jsonpointer-1.10-11.el8.noar 133 kB/s | 20 kB 00:00 2023-09-13T08:22:06.877 INFO:teuthology.orchestra.run.smithi161.stdout:(118/131): python3-pyasn1-0.3.7-6.el8.noarch.rp 613 kB/s | 126 kB 00:00 2023-09-13T08:22:06.903 INFO:teuthology.orchestra.run.smithi161.stdout:(119/131): python3-pyOpenSSL-19.0.0-1.el8.noarc 1.3 MB/s | 103 kB 00:00 2023-09-13T08:22:06.936 INFO:teuthology.orchestra.run.smithi161.stdout:(120/131): libtool-2.4.6-25.el8.x86_64.rpm 8.2 MB/s | 709 kB 00:00 2023-09-13T08:22:06.961 INFO:teuthology.orchestra.run.smithi161.stdout:(121/131): libpq-13.5-1.el8.x86_64.rpm 3.3 MB/s | 198 kB 00:00 2023-09-13T08:22:07.028 INFO:teuthology.orchestra.run.smithi161.stdout:(122/131): jq-1.6-3.el8.x86_64.rpm 3.0 MB/s | 202 kB 00:00 2023-09-13T08:22:07.079 INFO:teuthology.orchestra.run.smithi161.stdout:(123/131): librdkafka-0.11.4-3.el8.x86_64.rpm 6.9 MB/s | 354 kB 00:00 2023-09-13T08:22:07.163 INFO:teuthology.orchestra.run.smithi161.stdout:(124/131): openblas-threads-0.3.15-3.el8.x86_64 17 MB/s | 4.9 MB 00:00 2023-09-13T08:22:07.238 INFO:teuthology.orchestra.run.smithi161.stdout:(125/131): openblas-0.3.15-3.el8.x86_64.rpm 16 MB/s | 4.7 MB 00:00 2023-09-13T08:22:07.280 INFO:teuthology.orchestra.run.smithi161.stdout:(126/131): postgresql-contrib-10.21-2.module+el 6.8 MB/s | 808 kB 00:00 2023-09-13T08:22:07.330 INFO:teuthology.orchestra.run.smithi161.stdout:(127/131): postgresql-10.21-2.module+el8.6.0+15 16 MB/s | 1.5 MB 00:00 2023-09-13T08:22:07.424 INFO:teuthology.orchestra.run.smithi161.stdout:(128/131): postgresql-server-10.21-2.module+el8 15 MB/s | 5.1 MB 00:00 2023-09-13T08:22:07.472 INFO:teuthology.orchestra.run.smithi161.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 16 MB/s | 798 kB 00:00 2023-09-13T08:22:07.922 INFO:teuthology.orchestra.run.smithi161.stdout:(130/131): librbd1-18.0.0-6083.g4a754ac9.el8.x8 6.3 MB/s | 3.7 MB 00:00 2023-09-13T08:22:07.981 INFO:teuthology.orchestra.run.smithi161.stdout:(131/131): librados2-18.0.0-6083.g4a754ac9.el8. 5.3 MB/s | 3.7 MB 00:00 2023-09-13T08:22:07.983 INFO:teuthology.orchestra.run.smithi161.stdout:-------------------------------------------------------------------------------- 2023-09-13T08:22:07.984 INFO:teuthology.orchestra.run.smithi161.stdout:Total 14 MB/s | 208 MB 00:14 2023-09-13T08:22:08.820 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction check 2023-09-13T08:22:08.938 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction check succeeded. 2023-09-13T08:22:08.938 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction test 2023-09-13T08:22:10.063 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction test succeeded. 2023-09-13T08:22:10.067 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction 2023-09-13T08:22:11.433 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2023-09-13T08:22:11.602 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-09-13T08:22:11.776 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-09-13T08:22:11.985 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-09-13T08:22:12.129 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-09-13T08:22:12.250 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-09-13T08:22:12.479 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-09-13T08:22:12.880 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-09-13T08:22:13.128 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : librados2-2:18.0.0-6083.g4a754ac9.el8.x86_64 6/134 2023-09-13T08:22:13.524 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librados2-2:18.0.0-6083.g4a754ac9.el8.x86_64 6/134 2023-09-13T08:22:13.745 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : librbd1-2:18.0.0-6083.g4a754ac9.el8.x86_64 7/134 2023-09-13T08:22:13.873 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librbd1-2:18.0.0-6083.g4a754ac9.el8.x86_64 7/134 2023-09-13T08:22:14.045 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libcephfs2-2:18.0.0-6083.g4a754ac9.el8.x86_64 8/134 2023-09-13T08:22:14.140 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libcephfs2-2:18.0.0-6083.g4a754ac9.el8.x86_64 8/134 2023-09-13T08:22:14.362 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-rados-2:18.0.0-6083.g4a754ac9.el8.x86_64 9/134 2023-09-13T08:22:14.657 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-09-13T08:22:14.856 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-09-13T08:22:14.939 INFO:teuthology.orchestra.run.smithi161.stdout: Preparing : 1/1 2023-09-13T08:22:15.114 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-09-13T08:22:15.281 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-09-13T08:22:15.322 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-09-13T08:22:15.491 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 3/134 2023-09-13T08:22:15.571 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-09-13T08:22:15.615 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 3/134 2023-09-13T08:22:15.761 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libcephsqlite-2:18.0.0-6083.g4a754ac9.el8.x86_64 14/134 2023-09-13T08:22:15.816 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-09-13T08:22:15.867 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6083.g4a754ac9.el8.x86_64 14/134 2023-09-13T08:22:16.045 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libradosstriper1-2:18.0.0-6083.g4a754ac9.el8.x86 15/134 2023-09-13T08:22:16.131 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6083.g4a754ac9.el8.x86 15/134 2023-09-13T08:22:16.251 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-09-13T08:22:16.252 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-09-13T08:22:16.382 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-09-13T08:22:16.449 INFO:teuthology.orchestra.run.smithi161.stdout: Upgrading : librados2-2:18.0.0-6083.g4a754ac9.el8.x86_64 5/134 2023-09-13T08:22:16.502 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-09-13T08:22:16.862 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: librados2-2:18.0.0-6083.g4a754ac9.el8.x86_64 5/134 2023-09-13T08:22:17.032 INFO:teuthology.orchestra.run.smithi161.stdout: Upgrading : librbd1-2:18.0.0-6083.g4a754ac9.el8.x86_64 6/134 2023-09-13T08:22:17.118 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-09-13T08:22:17.169 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: librbd1-2:18.0.0-6083.g4a754ac9.el8.x86_64 6/134 2023-09-13T08:22:17.302 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-09-13T08:22:17.374 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libcephfs2-2:18.0.0-6083.g4a754ac9.el8.x86_64 7/134 2023-09-13T08:22:17.469 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: libcephfs2-2:18.0.0-6083.g4a754ac9.el8.x86_64 7/134 2023-09-13T08:22:17.637 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-rados-2:18.0.0-6083.g4a754ac9.el8.x86_64 8/134 2023-09-13T08:22:17.829 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/134 2023-09-13T08:22:17.902 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-09-13T08:22:18.086 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-09-13T08:22:18.112 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-09-13T08:22:18.327 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-09-13T08:22:18.718 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-09-13T08:22:18.794 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-09-13T08:22:18.957 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-09-13T08:22:19.075 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-09-13T08:22:19.124 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libcephsqlite-2:18.0.0-6083.g4a754ac9.el8.x86_64 14/134 2023-09-13T08:22:19.229 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6083.g4a754ac9.el8.x86_64 14/134 2023-09-13T08:22:19.277 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-09-13T08:22:19.399 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libradosstriper1-2:18.0.0-6083.g4a754ac9.el8.x86 15/134 2023-09-13T08:22:19.472 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-09-13T08:22:19.653 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6083.g4a754ac9.el8.x86 15/134 2023-09-13T08:22:19.842 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-09-13T08:22:20.026 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-09-13T08:22:20.204 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 16/134 2023-09-13T08:22:20.273 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-09-13T08:22:20.381 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 17/134 2023-09-13T08:22:20.450 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-ceph-common-2:18.0.0-6083.g4a754ac9.el8. 26/134 2023-09-13T08:22:20.563 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 18/134 2023-09-13T08:22:20.571 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-ceph-argparse-2:18.0.0-6083.g4a754ac9.el 27/134 2023-09-13T08:22:20.706 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-09-13T08:22:20.858 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-09-13T08:22:21.015 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-09-13T08:22:21.462 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cephfs-2:18.0.0-6083.g4a754ac9.el8.x86_6 28/134 2023-09-13T08:22:21.637 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-09-13T08:22:21.790 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-09-13T08:22:21.823 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-09-13T08:22:22.056 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-09-13T08:22:22.294 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-09-13T08:22:22.422 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-09-13T08:22:22.518 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-09-13T08:22:22.623 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : openblas-0.3.15-3.el8.x86_64 22/134 2023-09-13T08:22:23.326 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 22/134 2023-09-13T08:22:23.581 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/134 2023-09-13T08:22:23.796 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 24/134 2023-09-13T08:22:24.025 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-09-13T08:22:24.188 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-ceph-common-2:18.0.0-6083.g4a754ac9.el8. 26/134 2023-09-13T08:22:24.273 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-09-13T08:22:24.317 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-ceph-argparse-2:18.0.0-6083.g4a754ac9.el 27/134 2023-09-13T08:22:24.586 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-cephfs-2:18.0.0-6083.g4a754ac9.el8.x86_6 28/134 2023-09-13T08:22:24.610 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-09-13T08:22:24.798 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-09-13T08:22:24.804 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-09-13T08:22:25.005 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-09-13T08:22:25.165 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-rbd-2:18.0.0-6083.g4a754ac9.el8.x86_64 36/134 2023-09-13T08:22:25.313 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : librados-devel-2:18.0.0-6083.g4a754ac9.el8.x86_6 37/134 2023-09-13T08:22:25.493 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-09-13T08:22:25.651 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-09-13T08:22:25.811 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-09-13T08:22:25.953 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-09-13T08:22:26.172 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-09-13T08:22:26.361 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-09-13T08:22:26.558 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-09-13T08:22:26.717 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-09-13T08:22:26.978 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-09-13T08:22:27.168 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-09-13T08:22:27.403 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-09-13T08:22:27.599 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 30/134 2023-09-13T08:22:27.638 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-09-13T08:22:27.904 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/134 2023-09-13T08:22:27.933 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-09-13T08:22:28.158 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/134 2023-09-13T08:22:28.183 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-09-13T08:22:28.366 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/134 2023-09-13T08:22:28.417 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-09-13T08:22:28.550 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-09-13T08:22:28.639 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-09-13T08:22:28.758 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-09-13T08:22:28.796 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-09-13T08:22:28.943 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-rbd-2:18.0.0-6083.g4a754ac9.el8.x86_64 36/134 2023-09-13T08:22:28.953 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-09-13T08:22:29.103 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : librados-devel-2:18.0.0-6083.g4a754ac9.el8.x86_6 37/134 2023-09-13T08:22:29.254 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 38/134 2023-09-13T08:22:29.283 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-09-13T08:22:29.431 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 39/134 2023-09-13T08:22:29.548 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-09-13T08:22:29.624 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : uuid-1.6.2-43.el8.x86_64 40/134 2023-09-13T08:22:29.694 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 40/134 2023-09-13T08:22:29.772 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-09-13T08:22:29.925 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 41/134 2023-09-13T08:22:29.998 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-09-13T08:22:30.168 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : automake-1.16.1-7.el8.noarch 42/134 2023-09-13T08:22:30.173 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-09-13T08:22:30.322 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 43/134 2023-09-13T08:22:30.388 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 43/134 2023-09-13T08:22:30.424 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-09-13T08:22:30.593 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : jq-1.6-3.el8.x86_64 44/134 2023-09-13T08:22:30.784 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 45/134 2023-09-13T08:22:30.816 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-09-13T08:22:30.875 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-09-13T08:22:30.957 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 46/134 2023-09-13T08:22:31.105 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-09-13T08:22:31.157 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 47/134 2023-09-13T08:22:31.319 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-09-13T08:22:31.324 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : fuse-2.9.7-15.el8.x86_64 48/134 2023-09-13T08:22:31.474 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-09-13T08:22:31.492 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 49/134 2023-09-13T08:22:31.553 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-09-13T08:22:31.695 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 50/134 2023-09-13T08:22:31.754 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-09-13T08:22:31.884 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 51/134 2023-09-13T08:22:31.942 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-09-13T08:22:32.107 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-09-13T08:22:32.230 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 52/134 2023-09-13T08:22:32.268 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-09-13T08:22:32.490 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 53/134 2023-09-13T08:22:32.515 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-09-13T08:22:32.699 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 54/134 2023-09-13T08:22:32.705 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-09-13T08:22:32.836 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-09-13T08:22:32.966 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 55/134 2023-09-13T08:22:32.975 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-09-13T08:22:33.181 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-09-13T08:22:33.218 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 56/134 2023-09-13T08:22:33.359 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-09-13T08:22:33.524 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-09-13T08:22:33.556 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 57/134 2023-09-13T08:22:33.660 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-09-13T08:22:33.787 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 58/134 2023-09-13T08:22:33.812 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-09-13T08:22:33.980 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 59/134 2023-09-13T08:22:34.006 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-09-13T08:22:34.185 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 60/134 2023-09-13T08:22:34.193 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-09-13T08:22:34.387 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 61/134 2023-09-13T08:22:34.412 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-09-13T08:22:34.566 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 62/134 2023-09-13T08:22:34.655 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-09-13T08:22:34.860 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 63/134 2023-09-13T08:22:34.872 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-09-13T08:22:35.037 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-09-13T08:22:35.160 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 64/134 2023-09-13T08:22:35.227 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-09-13T08:22:35.401 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 65/134 2023-09-13T08:22:35.614 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 66/134 2023-09-13T08:22:35.804 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-09-13T08:22:35.974 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-09-13T08:22:36.230 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-09-13T08:22:36.274 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-09-13T08:22:36.469 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-09-13T08:22:36.518 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-09-13T08:22:36.633 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-09-13T08:22:36.772 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-09-13T08:22:36.806 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-09-13T08:22:36.995 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-09-13T08:22:37.056 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-09-13T08:22:37.207 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-09-13T08:22:37.343 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-09-13T08:22:37.397 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-09-13T08:22:37.554 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-09-13T08:22:37.557 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-09-13T08:22:37.676 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-09-13T08:22:37.905 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-09-13T08:22:38.107 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-09-13T08:22:38.293 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-09-13T08:22:38.344 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-09-13T08:22:38.531 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-09-13T08:22:38.539 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : librgw2-2:18.0.0-6083.g4a754ac9.el8.x86_64 92/134 2023-09-13T08:22:38.596 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librgw2-2:18.0.0-6083.g4a754ac9.el8.x86_64 92/134 2023-09-13T08:22:38.740 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-rgw-2:18.0.0-6083.g4a754ac9.el8.x86_64 93/134 2023-09-13T08:22:38.753 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-09-13T08:22:38.927 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-09-13T08:22:39.149 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-09-13T08:22:40.242 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-09-13T08:22:40.525 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-09-13T08:22:40.795 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-09-13T08:22:41.080 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-09-13T08:22:41.354 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-09-13T08:22:41.582 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-09-13T08:22:42.366 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-09-13T08:22:42.450 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-common-2:18.0.0-6083.g4a754ac9.el8.x86_64 94/134 2023-09-13T08:22:42.537 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : librgw2-2:18.0.0-6083.g4a754ac9.el8.x86_64 92/134 2023-09-13T08:22:42.610 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: librgw2-2:18.0.0-6083.g4a754ac9.el8.x86_64 92/134 2023-09-13T08:22:42.664 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-common-2:18.0.0-6083.g4a754ac9.el8.x86_64 94/134 2023-09-13T08:22:42.763 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-rgw-2:18.0.0-6083.g4a754ac9.el8.x86_64 93/134 2023-09-13T08:22:43.267 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-common-2:18.0.0-6083.g4a754ac9.el8.x86_64 94/134 2023-09-13T08:22:43.528 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-base-2:18.0.0-6083.g4a754ac9.el8.x86_64 95/134 2023-09-13T08:22:43.638 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-base-2:18.0.0-6083.g4a754ac9.el8.x86_64 95/134 2023-09-13T08:22:43.796 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-selinux-2:18.0.0-6083.g4a754ac9.el8.x86_64 96/134 2023-09-13T08:22:46.435 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-common-2:18.0.0-6083.g4a754ac9.el8.x86_64 94/134 2023-09-13T08:22:46.679 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-common-2:18.0.0-6083.g4a754ac9.el8.x86_64 94/134 2023-09-13T08:22:47.273 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-common-2:18.0.0-6083.g4a754ac9.el8.x86_64 94/134 2023-09-13T08:22:47.546 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-base-2:18.0.0-6083.g4a754ac9.el8.x86_64 95/134 2023-09-13T08:22:47.628 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-base-2:18.0.0-6083.g4a754ac9.el8.x86_64 95/134 2023-09-13T08:22:47.786 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-selinux-2:18.0.0-6083.g4a754ac9.el8.x86_64 96/134 2023-09-13T08:23:02.678 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6083.g4a754ac9.el8.x86_64 96/134 2023-09-13T08:23:02.679 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /sys 2023-09-13T08:23:02.679 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /proc 2023-09-13T08:23:02.679 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /dev 2023-09-13T08:23:02.680 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /run 2023-09-13T08:23:02.680 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /mnt 2023-09-13T08:23:02.680 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /var/tmp 2023-09-13T08:23:02.680 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /home 2023-09-13T08:23:02.680 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /tmp 2023-09-13T08:23:02.681 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /dev 2023-09-13T08:23:02.681 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:23:03.001 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-volume-2:18.0.0-6083.g4a754ac9.el8.noarch 97/134 2023-09-13T08:23:04.602 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-volume-2:18.0.0-6083.g4a754ac9.el8.noarch 97/134 2023-09-13T08:23:04.757 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-osd-2:18.0.0-6083.g4a754ac9.el8.x86_64 98/134 2023-09-13T08:23:04.977 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-osd-2:18.0.0-6083.g4a754ac9.el8.x86_64 98/134 2023-09-13T08:23:05.159 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mds-2:18.0.0-6083.g4a754ac9.el8.x86_64 99/134 2023-09-13T08:23:05.612 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mds-2:18.0.0-6083.g4a754ac9.el8.x86_64 99/134 2023-09-13T08:23:05.808 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mon-2:18.0.0-6083.g4a754ac9.el8.x86_64 100/134 2023-09-13T08:23:05.826 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mon-2:18.0.0-6083.g4a754ac9.el8.x86_64 100/134 2023-09-13T08:23:06.376 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6083.g4a754ac9.el8.x86_64 96/134 2023-09-13T08:23:06.377 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /sys 2023-09-13T08:23:06.377 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /proc 2023-09-13T08:23:06.377 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /dev 2023-09-13T08:23:06.377 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /run 2023-09-13T08:23:06.377 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /mnt 2023-09-13T08:23:06.378 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /var/tmp 2023-09-13T08:23:06.378 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /home 2023-09-13T08:23:06.378 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /tmp 2023-09-13T08:23:06.378 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /dev 2023-09-13T08:23:06.378 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-09-13T08:23:06.708 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-volume-2:18.0.0-6083.g4a754ac9.el8.noarch 97/134 2023-09-13T08:23:07.634 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: cephadm-2:18.0.0-6083.g4a754ac9.el8.noarch 101/134 2023-09-13T08:23:07.827 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : cephadm-2:18.0.0-6083.g4a754ac9.el8.noarch 101/134 2023-09-13T08:23:07.940 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6083.g4a754ac9.e 102/134 2023-09-13T08:23:08.140 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6083.g4a754ac9. 103/134 2023-09-13T08:23:08.298 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-volume-2:18.0.0-6083.g4a754ac9.el8.noarch 97/134 2023-09-13T08:23:08.308 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6083.g4a754ac9.el8.noa 104/134 2023-09-13T08:23:08.460 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-osd-2:18.0.0-6083.g4a754ac9.el8.x86_64 98/134 2023-09-13T08:23:08.527 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6083.g4a754ac9.el8.noa 104/134 2023-09-13T08:23:08.681 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-osd-2:18.0.0-6083.g4a754ac9.el8.x86_64 98/134 2023-09-13T08:23:08.855 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6083.g4a754ac9.el8.n 105/134 2023-09-13T08:23:08.869 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mds-2:18.0.0-6083.g4a754ac9.el8.x86_64 99/134 2023-09-13T08:23:09.324 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-mds-2:18.0.0-6083.g4a754ac9.el8.x86_64 99/134 2023-09-13T08:23:09.508 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mon-2:18.0.0-6083.g4a754ac9.el8.x86_64 100/134 2023-09-13T08:23:09.525 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-mon-2:18.0.0-6083.g4a754ac9.el8.x86_64 100/134 2023-09-13T08:23:09.813 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6083.g4a754ac9.el8.n 105/134 2023-09-13T08:23:09.957 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6083.g4a7 106/134 2023-09-13T08:23:10.047 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6083.g4a7 106/134 2023-09-13T08:23:10.414 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6083.g4a754ac9.el 107/134 2023-09-13T08:23:10.597 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-2:18.0.0-6083.g4a754ac9.el8.x86_64 108/134 2023-09-13T08:23:10.632 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6083.g4a754ac9.el8.x86_64 108/134 2023-09-13T08:23:10.799 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-rook-2:18.0.0-6083.g4a754ac9.el8.noarch 109/134 2023-09-13T08:23:10.813 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6083.g4a754ac9.el8.noarch 109/134 2023-09-13T08:23:11.202 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: cephadm-2:18.0.0-6083.g4a754ac9.el8.noarch 101/134 2023-09-13T08:23:11.387 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : cephadm-2:18.0.0-6083.g4a754ac9.el8.noarch 101/134 2023-09-13T08:23:11.530 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6083.g4a754ac9.e 102/134 2023-09-13T08:23:11.728 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6083.g4a754ac9. 103/134 2023-09-13T08:23:11.923 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6083.g4a754ac9.el8.noa 104/134 2023-09-13T08:23:12.139 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-2:18.0.0-6083.g4a754ac9.el8.x86_64 110/134 2023-09-13T08:23:12.146 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6083.g4a754ac9.el8.noa 104/134 2023-09-13T08:23:12.365 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-radosgw-2:18.0.0-6083.g4a754ac9.el8.x86_64 111/134 2023-09-13T08:23:12.398 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6083.g4a754ac9.el8.x86_64 111/134 2023-09-13T08:23:12.475 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6083.g4a754ac9.el8.n 105/134 2023-09-13T08:23:12.557 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6083.g4a754 112/134 2023-09-13T08:23:12.599 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6083.g4a754 112/134 2023-09-13T08:23:12.782 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : cephfs-mirror-2:18.0.0-6083.g4a754ac9.el8.x86_64 113/134 2023-09-13T08:23:13.140 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6083.g4a754ac9.el8.x86_64 113/134 2023-09-13T08:23:13.307 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : rbd-mirror-2:18.0.0-6083.g4a754ac9.el8.x86_64 114/134 2023-09-13T08:23:13.442 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6083.g4a754ac9.el8.n 105/134 2023-09-13T08:23:13.582 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6083.g4a7 106/134 2023-09-13T08:23:13.674 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6083.g4a7 106/134 2023-09-13T08:23:14.076 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6083.g4a754ac9.el 107/134 2023-09-13T08:23:14.258 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mgr-2:18.0.0-6083.g4a754ac9.el8.x86_64 108/134 2023-09-13T08:23:14.294 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6083.g4a754ac9.el8.x86_64 108/134 2023-09-13T08:23:14.448 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mgr-rook-2:18.0.0-6083.g4a754ac9.el8.noarch 109/134 2023-09-13T08:23:14.460 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6083.g4a754ac9.el8.noarch 109/134 2023-09-13T08:23:15.805 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-2:18.0.0-6083.g4a754ac9.el8.x86_64 110/134 2023-09-13T08:23:16.042 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-radosgw-2:18.0.0-6083.g4a754ac9.el8.x86_64 111/134 2023-09-13T08:23:16.076 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6083.g4a754ac9.el8.x86_64 111/134 2023-09-13T08:23:16.240 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6083.g4a754 112/134 2023-09-13T08:23:16.282 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6083.g4a754 112/134 2023-09-13T08:23:16.440 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : cephfs-mirror-2:18.0.0-6083.g4a754ac9.el8.x86_64 113/134 2023-09-13T08:23:16.801 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6083.g4a754ac9.el8.x86_64 113/134 2023-09-13T08:23:16.948 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : rbd-mirror-2:18.0.0-6083.g4a754ac9.el8.x86_64 114/134 2023-09-13T08:23:17.907 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6083.g4a754ac9.el8.x86_64 114/134 2023-09-13T08:23:18.207 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-test-2:18.0.0-6083.g4a754ac9.el8.x86_64 115/134 2023-09-13T08:23:18.413 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-09-13T08:23:18.604 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-09-13T08:23:19.468 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-09-13T08:23:19.800 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-09-13T08:23:19.986 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-fuse-2:18.0.0-6083.g4a754ac9.el8.x86_64 119/134 2023-09-13T08:23:20.183 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-09-13T08:23:20.342 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libcephfs-devel-2:18.0.0-6083.g4a754ac9.el8.x86_ 121/134 2023-09-13T08:23:20.481 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-09-13T08:23:21.587 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6083.g4a754ac9.el8.x86_64 114/134 2023-09-13T08:23:22.486 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-test-2:18.0.0-6083.g4a754ac9.el8.x86_64 115/134 2023-09-13T08:23:22.706 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-09-13T08:23:22.817 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 116/134 2023-09-13T08:23:22.963 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-09-13T08:23:22.982 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-09-13T08:23:23.041 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-fuse-2:18.0.0-6083.g4a754ac9.el8.x86_64 117/134 2023-09-13T08:23:23.180 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : cephfs-top-2:18.0.0-6083.g4a754ac9.el8.noarch 124/134 2023-09-13T08:23:23.287 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 118/134 2023-09-13T08:23:23.437 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : rbd-fuse-2:18.0.0-6083.g4a754ac9.el8.x86_64 125/134 2023-09-13T08:23:23.438 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/134 2023-09-13T08:23:23.630 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/134 2023-09-13T08:23:23.731 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : rbd-nbd-2:18.0.0-6083.g4a754ac9.el8.x86_64 126/134 2023-09-13T08:23:23.876 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 120/134 2023-09-13T08:23:24.034 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libcephfs-devel-2:18.0.0-6083.g4a754ac9.el8.x86_ 121/134 2023-09-13T08:23:24.048 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-09-13T08:23:24.181 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-09-13T08:23:24.196 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-09-13T08:23:24.204 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-09-13T08:23:24.396 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-09-13T08:23:24.554 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-09-13T08:23:24.639 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-09-13T08:23:24.887 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-09-13T08:23:24.900 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-09-13T08:23:24.900 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-09-13T08:23:25.107 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-09-13T08:23:25.107 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-09-13T08:23:25.326 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-09-13T08:23:25.544 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-09-13T08:23:26.065 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-09-13T08:23:26.066 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-2:18.0.0-6083.g4a754ac9.el8.x86_64 1/134 2023-09-13T08:23:26.066 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-base-2:18.0.0-6083.g4a754ac9.el8.x86_64 2/134 2023-09-13T08:23:26.066 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-common-2:18.0.0-6083.g4a754ac9.el8.x86_64 3/134 2023-09-13T08:23:26.066 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-fuse-2:18.0.0-6083.g4a754ac9.el8.x86_64 4/134 2023-09-13T08:23:26.067 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6083.g4a754 5/134 2023-09-13T08:23:26.067 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mds-2:18.0.0-6083.g4a754ac9.el8.x86_64 6/134 2023-09-13T08:23:26.067 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-2:18.0.0-6083.g4a754ac9.el8.x86_64 7/134 2023-09-13T08:23:26.067 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mon-2:18.0.0-6083.g4a754ac9.el8.x86_64 8/134 2023-09-13T08:23:26.067 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-osd-2:18.0.0-6083.g4a754ac9.el8.x86_64 9/134 2023-09-13T08:23:26.067 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-radosgw-2:18.0.0-6083.g4a754ac9.el8.x86_64 10/134 2023-09-13T08:23:26.068 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-selinux-2:18.0.0-6083.g4a754ac9.el8.x86_64 11/134 2023-09-13T08:23:26.068 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-test-2:18.0.0-6083.g4a754ac9.el8.x86_64 12/134 2023-09-13T08:23:26.068 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : cephfs-mirror-2:18.0.0-6083.g4a754ac9.el8.x86_64 13/134 2023-09-13T08:23:26.068 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libcephfs-devel-2:18.0.0-6083.g4a754ac9.el8.x86_ 14/134 2023-09-13T08:23:26.068 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libcephfs2-2:18.0.0-6083.g4a754ac9.el8.x86_64 15/134 2023-09-13T08:23:26.069 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libcephsqlite-2:18.0.0-6083.g4a754ac9.el8.x86_64 16/134 2023-09-13T08:23:26.069 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librados-devel-2:18.0.0-6083.g4a754ac9.el8.x86_6 17/134 2023-09-13T08:23:26.069 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libradosstriper1-2:18.0.0-6083.g4a754ac9.el8.x86 18/134 2023-09-13T08:23:26.069 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librgw2-2:18.0.0-6083.g4a754ac9.el8.x86_64 19/134 2023-09-13T08:23:26.069 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6083.g4a754ac9.el 20/134 2023-09-13T08:23:26.070 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-ceph-common-2:18.0.0-6083.g4a754ac9.el8. 21/134 2023-09-13T08:23:26.070 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cephfs-2:18.0.0-6083.g4a754ac9.el8.x86_6 22/134 2023-09-13T08:23:26.070 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-rados-2:18.0.0-6083.g4a754ac9.el8.x86_64 23/134 2023-09-13T08:23:26.070 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-rbd-2:18.0.0-6083.g4a754ac9.el8.x86_64 24/134 2023-09-13T08:23:26.070 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-rgw-2:18.0.0-6083.g4a754ac9.el8.x86_64 25/134 2023-09-13T08:23:26.071 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : rbd-fuse-2:18.0.0-6083.g4a754ac9.el8.x86_64 26/134 2023-09-13T08:23:26.071 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : rbd-mirror-2:18.0.0-6083.g4a754ac9.el8.x86_64 27/134 2023-09-13T08:23:26.071 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : rbd-nbd-2:18.0.0-6083.g4a754ac9.el8.x86_64 28/134 2023-09-13T08:23:26.071 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6083.g4a754ac9. 29/134 2023-09-13T08:23:26.071 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6083.g4a754ac9.el8.noa 30/134 2023-09-13T08:23:26.072 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6083.g4a754ac9.el8.n 31/134 2023-09-13T08:23:26.072 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6083.g4a7 32/134 2023-09-13T08:23:26.072 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6083.g4a754ac9.el 33/134 2023-09-13T08:23:26.072 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6083.g4a754ac9.el8.noarch 34/134 2023-09-13T08:23:26.072 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6083.g4a754ac9.e 35/134 2023-09-13T08:23:26.073 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-volume-2:18.0.0-6083.g4a754ac9.el8.noarch 36/134 2023-09-13T08:23:26.073 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : cephadm-2:18.0.0-6083.g4a754ac9.el8.noarch 37/134 2023-09-13T08:23:26.073 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : cephfs-top-2:18.0.0-6083.g4a754ac9.el8.noarch 38/134 2023-09-13T08:23:26.073 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-09-13T08:23:26.073 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-09-13T08:23:26.074 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-09-13T08:23:26.074 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-09-13T08:23:26.074 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-09-13T08:23:26.074 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-09-13T08:23:26.074 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-09-13T08:23:26.075 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-09-13T08:23:26.075 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-09-13T08:23:26.075 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-09-13T08:23:26.075 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-09-13T08:23:26.075 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-09-13T08:23:26.076 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-09-13T08:23:26.076 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-09-13T08:23:26.076 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-09-13T08:23:26.076 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-09-13T08:23:26.076 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-09-13T08:23:26.077 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-09-13T08:23:26.077 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-09-13T08:23:26.077 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-09-13T08:23:26.077 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-09-13T08:23:26.077 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-09-13T08:23:26.077 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-09-13T08:23:26.078 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-09-13T08:23:26.078 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-09-13T08:23:26.078 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-09-13T08:23:26.078 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-09-13T08:23:26.078 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-09-13T08:23:26.079 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-09-13T08:23:26.079 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-09-13T08:23:26.079 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-09-13T08:23:26.079 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-09-13T08:23:26.079 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-09-13T08:23:26.080 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-09-13T08:23:26.080 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-09-13T08:23:26.080 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-09-13T08:23:26.080 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-09-13T08:23:26.080 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-09-13T08:23:26.081 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-09-13T08:23:26.081 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-09-13T08:23:26.081 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-09-13T08:23:26.081 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-09-13T08:23:26.081 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-09-13T08:23:26.082 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-09-13T08:23:26.082 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-09-13T08:23:26.082 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-09-13T08:23:26.082 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-09-13T08:23:26.082 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-09-13T08:23:26.083 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-09-13T08:23:26.083 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-09-13T08:23:26.083 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-09-13T08:23:26.083 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-09-13T08:23:26.083 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-09-13T08:23:26.084 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-09-13T08:23:26.084 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-09-13T08:23:26.084 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-09-13T08:23:26.084 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-09-13T08:23:26.084 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-09-13T08:23:26.085 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-09-13T08:23:26.085 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-09-13T08:23:26.085 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-09-13T08:23:26.085 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-09-13T08:23:26.086 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-09-13T08:23:26.086 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-09-13T08:23:26.086 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-09-13T08:23:26.086 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-09-13T08:23:26.086 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-09-13T08:23:26.087 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-09-13T08:23:26.087 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-09-13T08:23:26.087 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-09-13T08:23:26.087 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-09-13T08:23:26.087 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-09-13T08:23:26.088 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-09-13T08:23:26.088 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-09-13T08:23:26.088 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-09-13T08:23:26.088 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-09-13T08:23:26.088 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-09-13T08:23:26.088 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-09-13T08:23:26.089 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-09-13T08:23:26.089 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-09-13T08:23:26.089 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-09-13T08:23:26.089 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-09-13T08:23:26.089 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-09-13T08:23:26.090 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-09-13T08:23:26.090 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-09-13T08:23:26.090 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-09-13T08:23:26.090 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-09-13T08:23:26.091 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-09-13T08:23:26.091 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-09-13T08:23:26.091 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-09-13T08:23:26.091 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librados2-2:18.0.0-6083.g4a754ac9.el8.x86_64 129/134 2023-09-13T08:23:26.092 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-09-13T08:23:26.092 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librbd1-2:18.0.0-6083.g4a754ac9.el8.x86_64 131/134 2023-09-13T08:23:26.092 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-09-13T08:23:26.092 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-09-13T08:23:26.354 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-09-13T08:23:26.613 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-09-13T08:23:26.632 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-09-13T08:23:26.805 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : cephfs-top-2:18.0.0-6083.g4a754ac9.el8.noarch 124/134 2023-09-13T08:23:27.071 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : rbd-fuse-2:18.0.0-6083.g4a754ac9.el8.x86_64 125/134 2023-09-13T08:23:27.375 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : rbd-nbd-2:18.0.0-6083.g4a754ac9.el8.x86_64 126/134 2023-09-13T08:23:27.745 INFO:teuthology.orchestra.run.smithi161.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-09-13T08:23:27.921 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : flex-2.6.1-9.el8.x86_64 128/134 2023-09-13T08:23:28.027 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 128/134 2023-09-13T08:23:28.221 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : bison-3.0.4-10.el8.x86_64 129/134 2023-09-13T08:23:28.234 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 129/134 2023-09-13T08:23:28.371 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-09-13T08:23:28.380 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-09-13T08:23:28.527 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/134 2023-09-13T08:23:28.528 INFO:teuthology.orchestra.run.smithi161.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-09-13T08:23:28.705 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-09-13T08:23:28.705 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:01:48 ago on Wed 13 Sep 2023 08:21:40 AM UTC. 2023-09-13T08:23:28.741 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-09-13T08:23:28.741 INFO:teuthology.orchestra.run.smithi161.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-09-13T08:23:28.988 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-09-13T08:23:29.169 INFO:teuthology.orchestra.run.smithi161.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-09-13T08:23:29.670 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-09-13T08:23:29.671 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-2:18.0.0-6083.g4a754ac9.el8.x86_64 1/134 2023-09-13T08:23:29.671 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-base-2:18.0.0-6083.g4a754ac9.el8.x86_64 2/134 2023-09-13T08:23:29.671 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-common-2:18.0.0-6083.g4a754ac9.el8.x86_64 3/134 2023-09-13T08:23:29.671 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-fuse-2:18.0.0-6083.g4a754ac9.el8.x86_64 4/134 2023-09-13T08:23:29.671 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6083.g4a754 5/134 2023-09-13T08:23:29.672 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mds-2:18.0.0-6083.g4a754ac9.el8.x86_64 6/134 2023-09-13T08:23:29.672 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mgr-2:18.0.0-6083.g4a754ac9.el8.x86_64 7/134 2023-09-13T08:23:29.672 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mon-2:18.0.0-6083.g4a754ac9.el8.x86_64 8/134 2023-09-13T08:23:29.672 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-osd-2:18.0.0-6083.g4a754ac9.el8.x86_64 9/134 2023-09-13T08:23:29.672 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-radosgw-2:18.0.0-6083.g4a754ac9.el8.x86_64 10/134 2023-09-13T08:23:29.673 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-selinux-2:18.0.0-6083.g4a754ac9.el8.x86_64 11/134 2023-09-13T08:23:29.673 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-test-2:18.0.0-6083.g4a754ac9.el8.x86_64 12/134 2023-09-13T08:23:29.673 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : cephfs-mirror-2:18.0.0-6083.g4a754ac9.el8.x86_64 13/134 2023-09-13T08:23:29.673 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libcephfs-devel-2:18.0.0-6083.g4a754ac9.el8.x86_ 14/134 2023-09-13T08:23:29.684 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libcephfs2-2:18.0.0-6083.g4a754ac9.el8.x86_64 15/134 2023-09-13T08:23:29.684 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libcephsqlite-2:18.0.0-6083.g4a754ac9.el8.x86_64 16/134 2023-09-13T08:23:29.684 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librados-devel-2:18.0.0-6083.g4a754ac9.el8.x86_6 17/134 2023-09-13T08:23:29.684 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libradosstriper1-2:18.0.0-6083.g4a754ac9.el8.x86 18/134 2023-09-13T08:23:29.685 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librgw2-2:18.0.0-6083.g4a754ac9.el8.x86_64 19/134 2023-09-13T08:23:29.685 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6083.g4a754ac9.el 20/134 2023-09-13T08:23:29.685 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-ceph-common-2:18.0.0-6083.g4a754ac9.el8. 21/134 2023-09-13T08:23:29.685 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-cephfs-2:18.0.0-6083.g4a754ac9.el8.x86_6 22/134 2023-09-13T08:23:29.685 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-rados-2:18.0.0-6083.g4a754ac9.el8.x86_64 23/134 2023-09-13T08:23:29.686 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-rbd-2:18.0.0-6083.g4a754ac9.el8.x86_64 24/134 2023-09-13T08:23:29.686 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-rgw-2:18.0.0-6083.g4a754ac9.el8.x86_64 25/134 2023-09-13T08:23:29.686 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : rbd-fuse-2:18.0.0-6083.g4a754ac9.el8.x86_64 26/134 2023-09-13T08:23:29.686 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : rbd-mirror-2:18.0.0-6083.g4a754ac9.el8.x86_64 27/134 2023-09-13T08:23:29.687 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : rbd-nbd-2:18.0.0-6083.g4a754ac9.el8.x86_64 28/134 2023-09-13T08:23:29.687 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6083.g4a754ac9. 29/134 2023-09-13T08:23:29.687 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6083.g4a754ac9.el8.noa 30/134 2023-09-13T08:23:29.687 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6083.g4a754ac9.el8.n 31/134 2023-09-13T08:23:29.687 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6083.g4a7 32/134 2023-09-13T08:23:29.688 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6083.g4a754ac9.el 33/134 2023-09-13T08:23:29.688 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6083.g4a754ac9.el8.noarch 34/134 2023-09-13T08:23:29.688 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6083.g4a754ac9.e 35/134 2023-09-13T08:23:29.688 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-volume-2:18.0.0-6083.g4a754ac9.el8.noarch 36/134 2023-09-13T08:23:29.688 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : cephadm-2:18.0.0-6083.g4a754ac9.el8.noarch 37/134 2023-09-13T08:23:29.689 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : cephfs-top-2:18.0.0-6083.g4a754ac9.el8.noarch 38/134 2023-09-13T08:23:29.689 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-09-13T08:23:29.689 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-09-13T08:23:29.689 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-09-13T08:23:29.689 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-09-13T08:23:29.690 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-09-13T08:23:29.690 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-09-13T08:23:29.690 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-09-13T08:23:29.690 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-09-13T08:23:29.690 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-09-13T08:23:29.691 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-09-13T08:23:29.691 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-09-13T08:23:29.693 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-09-13T08:23:29.693 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-09-13T08:23:29.693 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-09-13T08:23:29.693 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-09-13T08:23:29.694 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-09-13T08:23:29.694 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-09-13T08:23:29.694 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-09-13T08:23:29.694 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-09-13T08:23:29.694 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-09-13T08:23:29.695 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-09-13T08:23:29.695 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-09-13T08:23:29.695 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-09-13T08:23:29.695 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-09-13T08:23:29.695 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-09-13T08:23:29.695 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-09-13T08:23:29.696 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-09-13T08:23:29.696 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-09-13T08:23:29.696 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-09-13T08:23:29.696 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-09-13T08:23:29.696 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-09-13T08:23:29.697 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-09-13T08:23:29.697 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-09-13T08:23:29.697 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 72/134 2023-09-13T08:23:29.697 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 73/134 2023-09-13T08:23:29.697 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/134 2023-09-13T08:23:29.698 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/134 2023-09-13T08:23:29.698 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 76/134 2023-09-13T08:23:29.698 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 77/134 2023-09-13T08:23:29.698 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/134 2023-09-13T08:23:29.698 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 79/134 2023-09-13T08:23:29.699 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/134 2023-09-13T08:23:29.699 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 81/134 2023-09-13T08:23:29.699 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 82/134 2023-09-13T08:23:29.699 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 83/134 2023-09-13T08:23:29.699 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 84/134 2023-09-13T08:23:29.700 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 85/134 2023-09-13T08:23:29.700 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 86/134 2023-09-13T08:23:29.700 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 87/134 2023-09-13T08:23:29.700 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 88/134 2023-09-13T08:23:29.700 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 89/134 2023-09-13T08:23:29.700 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 90/134 2023-09-13T08:23:29.701 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 91/134 2023-09-13T08:23:29.701 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 92/134 2023-09-13T08:23:29.701 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 93/134 2023-09-13T08:23:29.701 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 94/134 2023-09-13T08:23:29.701 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 95/134 2023-09-13T08:23:29.702 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 96/134 2023-09-13T08:23:29.702 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 97/134 2023-09-13T08:23:29.702 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 98/134 2023-09-13T08:23:29.702 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 99/134 2023-09-13T08:23:29.702 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 100/134 2023-09-13T08:23:29.703 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 101/134 2023-09-13T08:23:29.703 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 102/134 2023-09-13T08:23:29.703 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 103/134 2023-09-13T08:23:29.703 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : bison-3.0.4-10.el8.x86_64 104/134 2023-09-13T08:23:29.703 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 105/134 2023-09-13T08:23:29.704 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 106/134 2023-09-13T08:23:29.704 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/134 2023-09-13T08:23:29.704 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : automake-1.16.1-7.el8.noarch 108/134 2023-09-13T08:23:29.704 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 109/134 2023-09-13T08:23:29.704 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 110/134 2023-09-13T08:23:29.705 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : flex-2.6.1-9.el8.x86_64 111/134 2023-09-13T08:23:29.705 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 112/134 2023-09-13T08:23:29.705 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 113/134 2023-09-13T08:23:29.705 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 114/134 2023-09-13T08:23:29.705 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 115/134 2023-09-13T08:23:29.705 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 116/134 2023-09-13T08:23:29.706 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 117/134 2023-09-13T08:23:29.706 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 118/134 2023-09-13T08:23:29.706 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 119/134 2023-09-13T08:23:29.706 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 120/134 2023-09-13T08:23:29.706 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 121/134 2023-09-13T08:23:29.707 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libpq-13.5-1.el8.x86_64 122/134 2023-09-13T08:23:29.707 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 123/134 2023-09-13T08:23:29.707 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : jq-1.6-3.el8.x86_64 124/134 2023-09-13T08:23:29.707 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 125/134 2023-09-13T08:23:29.707 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 126/134 2023-09-13T08:23:29.708 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 127/134 2023-09-13T08:23:29.708 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 128/134 2023-09-13T08:23:29.708 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librados2-2:18.0.0-6083.g4a754ac9.el8.x86_64 129/134 2023-09-13T08:23:29.708 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-09-13T08:23:29.708 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librbd1-2:18.0.0-6083.g4a754ac9.el8.x86_64 131/134 2023-09-13T08:23:29.708 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-09-13T08:23:29.709 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-09-13T08:23:32.329 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-09-13T08:23:32.330 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:01:51 ago on Wed 13 Sep 2023 08:21:41 AM UTC. 2023-09-13T08:23:33.219 INFO:teuthology.orchestra.run.smithi084.stdout:Installed products updated. 2023-09-13T08:23:33.444 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:23:33.444 INFO:teuthology.orchestra.run.smithi084.stdout:Upgraded: 2023-09-13T08:23:33.444 INFO:teuthology.orchestra.run.smithi084.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-09-13T08:23:33.445 INFO:teuthology.orchestra.run.smithi084.stdout: librados2-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T08:23:33.445 INFO:teuthology.orchestra.run.smithi084.stdout: librbd1-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T08:23:33.445 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2023-09-13T08:23:33.445 INFO:teuthology.orchestra.run.smithi084.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-09-13T08:23:33.446 INFO:teuthology.orchestra.run.smithi084.stdout: automake-1.16.1-7.el8.noarch 2023-09-13T08:23:33.446 INFO:teuthology.orchestra.run.smithi084.stdout: bison-3.0.4-10.el8.x86_64 2023-09-13T08:23:33.446 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T08:23:33.447 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-base-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T08:23:33.447 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-common-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T08:23:33.447 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-fuse-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T08:23:33.447 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-grafana-dashboards-2:18.0.0-6083.g4a754ac9.el8.noarch 2023-09-13T08:23:33.447 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-immutable-object-cache-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T08:23:33.448 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mds-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T08:23:33.448 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T08:23:33.448 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-cephadm-2:18.0.0-6083.g4a754ac9.el8.noarch 2023-09-13T08:23:33.448 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-dashboard-2:18.0.0-6083.g4a754ac9.el8.noarch 2023-09-13T08:23:33.449 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6083.g4a754ac9.el8.noarch 2023-09-13T08:23:33.449 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-modules-core-2:18.0.0-6083.g4a754ac9.el8.noarch 2023-09-13T08:23:33.449 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-rook-2:18.0.0-6083.g4a754ac9.el8.noarch 2023-09-13T08:23:33.449 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mon-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T08:23:33.449 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-osd-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T08:23:33.450 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-prometheus-alerts-2:18.0.0-6083.g4a754ac9.el8.noarch 2023-09-13T08:23:33.450 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-radosgw-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T08:23:33.450 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-selinux-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T08:23:33.451 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-test-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T08:23:33.451 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-volume-2:18.0.0-6083.g4a754ac9.el8.noarch 2023-09-13T08:23:33.452 INFO:teuthology.orchestra.run.smithi084.stdout: cephadm-2:18.0.0-6083.g4a754ac9.el8.noarch 2023-09-13T08:23:33.452 INFO:teuthology.orchestra.run.smithi084.stdout: cephfs-mirror-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T08:23:33.452 INFO:teuthology.orchestra.run.smithi084.stdout: cephfs-top-2:18.0.0-6083.g4a754ac9.el8.noarch 2023-09-13T08:23:33.452 INFO:teuthology.orchestra.run.smithi084.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-09-13T08:23:33.453 INFO:teuthology.orchestra.run.smithi084.stdout: flex-2.6.1-9.el8.x86_64 2023-09-13T08:23:33.453 INFO:teuthology.orchestra.run.smithi084.stdout: fuse-2.9.7-15.el8.x86_64 2023-09-13T08:23:33.453 INFO:teuthology.orchestra.run.smithi084.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-09-13T08:23:33.454 INFO:teuthology.orchestra.run.smithi084.stdout: jq-1.6-3.el8.x86_64 2023-09-13T08:23:33.454 INFO:teuthology.orchestra.run.smithi084.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-09-13T08:23:33.454 INFO:teuthology.orchestra.run.smithi084.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-09-13T08:23:33.455 INFO:teuthology.orchestra.run.smithi084.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-09-13T08:23:33.455 INFO:teuthology.orchestra.run.smithi084.stdout: libcephfs-devel-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T08:23:33.455 INFO:teuthology.orchestra.run.smithi084.stdout: libcephfs2-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T08:23:33.455 INFO:teuthology.orchestra.run.smithi084.stdout: libcephsqlite-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T08:23:33.456 INFO:teuthology.orchestra.run.smithi084.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-09-13T08:23:33.456 INFO:teuthology.orchestra.run.smithi084.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-09-13T08:23:33.456 INFO:teuthology.orchestra.run.smithi084.stdout: liboath-2.6.2-3.el8.x86_64 2023-09-13T08:23:33.456 INFO:teuthology.orchestra.run.smithi084.stdout: libpq-13.5-1.el8.x86_64 2023-09-13T08:23:33.457 INFO:teuthology.orchestra.run.smithi084.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-09-13T08:23:33.457 INFO:teuthology.orchestra.run.smithi084.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-09-13T08:23:33.457 INFO:teuthology.orchestra.run.smithi084.stdout: librados-devel-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T08:23:33.458 INFO:teuthology.orchestra.run.smithi084.stdout: libradosstriper1-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T08:23:33.458 INFO:teuthology.orchestra.run.smithi084.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-09-13T08:23:33.458 INFO:teuthology.orchestra.run.smithi084.stdout: librgw2-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T08:23:33.459 INFO:teuthology.orchestra.run.smithi084.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-09-13T08:23:33.459 INFO:teuthology.orchestra.run.smithi084.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-09-13T08:23:33.459 INFO:teuthology.orchestra.run.smithi084.stdout: libtool-2.4.6-25.el8.x86_64 2023-09-13T08:23:33.459 INFO:teuthology.orchestra.run.smithi084.stdout: libunwind-1.3.1-3.el8.x86_64 2023-09-13T08:23:33.460 INFO:teuthology.orchestra.run.smithi084.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-09-13T08:23:33.460 INFO:teuthology.orchestra.run.smithi084.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-09-13T08:23:33.460 INFO:teuthology.orchestra.run.smithi084.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-09-13T08:23:33.460 INFO:teuthology.orchestra.run.smithi084.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-09-13T08:23:33.460 INFO:teuthology.orchestra.run.smithi084.stdout: openblas-0.3.15-3.el8.x86_64 2023-09-13T08:23:33.460 INFO:teuthology.orchestra.run.smithi084.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-09-13T08:23:33.461 INFO:teuthology.orchestra.run.smithi084.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-09-13T08:23:33.461 INFO:teuthology.orchestra.run.smithi084.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-09-13T08:23:33.462 INFO:teuthology.orchestra.run.smithi084.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-09-13T08:23:33.462 INFO:teuthology.orchestra.run.smithi084.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-09-13T08:23:33.462 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-09-13T08:23:33.462 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-09-13T08:23:33.462 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-09-13T08:23:33.463 INFO:teuthology.orchestra.run.smithi084.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-09-13T08:23:33.463 INFO:teuthology.orchestra.run.smithi084.stdout: python3-babel-2.5.1-7.el8.noarch 2023-09-13T08:23:33.463 INFO:teuthology.orchestra.run.smithi084.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-09-13T08:23:33.464 INFO:teuthology.orchestra.run.smithi084.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-09-13T08:23:33.464 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-09-13T08:23:33.464 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ceph-argparse-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T08:23:33.464 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ceph-common-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T08:23:33.465 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cephfs-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T08:23:33.465 INFO:teuthology.orchestra.run.smithi084.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-09-13T08:23:33.465 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-09-13T08:23:33.465 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-09-13T08:23:33.465 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-09-13T08:23:33.466 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-09-13T08:23:33.466 INFO:teuthology.orchestra.run.smithi084.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-09-13T08:23:33.466 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-6.2-6.el8.noarch 2023-09-13T08:23:33.466 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-09-13T08:23:33.466 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-09-13T08:23:33.467 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-09-13T08:23:33.467 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-09-13T08:23:33.467 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-09-13T08:23:33.467 INFO:teuthology.orchestra.run.smithi084.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-09-13T08:23:33.467 INFO:teuthology.orchestra.run.smithi084.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-09-13T08:23:33.468 INFO:teuthology.orchestra.run.smithi084.stdout: python3-mako-1.0.6-13.el8.noarch 2023-09-13T08:23:33.468 INFO:teuthology.orchestra.run.smithi084.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-09-13T08:23:33.468 INFO:teuthology.orchestra.run.smithi084.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-09-13T08:23:33.468 INFO:teuthology.orchestra.run.smithi084.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-09-13T08:23:33.468 INFO:teuthology.orchestra.run.smithi084.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-09-13T08:23:33.469 INFO:teuthology.orchestra.run.smithi084.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-09-13T08:23:33.469 INFO:teuthology.orchestra.run.smithi084.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-09-13T08:23:33.469 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-09-13T08:23:33.469 INFO:teuthology.orchestra.run.smithi084.stdout: python3-portend-2.6-1.el8.noarch 2023-09-13T08:23:33.469 INFO:teuthology.orchestra.run.smithi084.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-09-13T08:23:33.470 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-09-13T08:23:33.470 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-09-13T08:23:33.470 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-09-13T08:23:33.470 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pycparser-2.14-14.el8.noarch 2023-09-13T08:23:33.470 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pytz-2017.2-9.el8.noarch 2023-09-13T08:23:33.471 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rados-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T08:23:33.471 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rbd-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T08:23:33.471 INFO:teuthology.orchestra.run.smithi084.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-09-13T08:23:33.472 INFO:teuthology.orchestra.run.smithi084.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-09-13T08:23:33.472 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rgw-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T08:23:33.472 INFO:teuthology.orchestra.run.smithi084.stdout: python3-routes-2.4.1-12.el8.noarch 2023-09-13T08:23:33.472 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rsa-4.9-2.el8.noarch 2023-09-13T08:23:33.473 INFO:teuthology.orchestra.run.smithi084.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-09-13T08:23:33.473 INFO:teuthology.orchestra.run.smithi084.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-09-13T08:23:33.473 INFO:teuthology.orchestra.run.smithi084.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-09-13T08:23:33.473 INFO:teuthology.orchestra.run.smithi084.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-09-13T08:23:33.474 INFO:teuthology.orchestra.run.smithi084.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-09-13T08:23:33.474 INFO:teuthology.orchestra.run.smithi084.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-09-13T08:23:33.474 INFO:teuthology.orchestra.run.smithi084.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-09-13T08:23:33.475 INFO:teuthology.orchestra.run.smithi084.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-09-13T08:23:33.475 INFO:teuthology.orchestra.run.smithi084.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-09-13T08:23:33.475 INFO:teuthology.orchestra.run.smithi084.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-09-13T08:23:33.475 INFO:teuthology.orchestra.run.smithi084.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-09-13T08:23:33.475 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-fuse-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T08:23:33.476 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-mirror-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T08:23:33.476 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-nbd-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T08:23:33.476 INFO:teuthology.orchestra.run.smithi084.stdout: socat-1.7.4.1-1.el8.x86_64 2023-09-13T08:23:33.476 INFO:teuthology.orchestra.run.smithi084.stdout: thrift-0.13.0-2.el8.x86_64 2023-09-13T08:23:33.476 INFO:teuthology.orchestra.run.smithi084.stdout: uuid-1.6.2-43.el8.x86_64 2023-09-13T08:23:33.476 INFO:teuthology.orchestra.run.smithi084.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-09-13T08:23:33.477 INFO:teuthology.orchestra.run.smithi084.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-09-13T08:23:33.477 INFO:teuthology.orchestra.run.smithi084.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-09-13T08:23:33.477 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:23:33.478 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2023-09-13T08:23:33.627 DEBUG:teuthology.parallel:result is None 2023-09-13T08:23:38.351 INFO:teuthology.orchestra.run.smithi161.stdout:Installed products updated. 2023-09-13T08:23:38.573 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-09-13T08:23:38.574 INFO:teuthology.orchestra.run.smithi161.stdout:Upgraded: 2023-09-13T08:23:38.574 INFO:teuthology.orchestra.run.smithi161.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-09-13T08:23:38.574 INFO:teuthology.orchestra.run.smithi161.stdout: librados2-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T08:23:38.574 INFO:teuthology.orchestra.run.smithi161.stdout: librbd1-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T08:23:38.575 INFO:teuthology.orchestra.run.smithi161.stdout:Installed: 2023-09-13T08:23:38.575 INFO:teuthology.orchestra.run.smithi161.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-09-13T08:23:38.575 INFO:teuthology.orchestra.run.smithi161.stdout: automake-1.16.1-7.el8.noarch 2023-09-13T08:23:38.575 INFO:teuthology.orchestra.run.smithi161.stdout: bison-3.0.4-10.el8.x86_64 2023-09-13T08:23:38.575 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T08:23:38.576 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-base-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T08:23:38.576 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-common-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T08:23:38.576 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-fuse-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T08:23:38.576 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-grafana-dashboards-2:18.0.0-6083.g4a754ac9.el8.noarch 2023-09-13T08:23:38.576 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-immutable-object-cache-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T08:23:38.577 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mds-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T08:23:38.577 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T08:23:38.577 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-cephadm-2:18.0.0-6083.g4a754ac9.el8.noarch 2023-09-13T08:23:38.577 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-dashboard-2:18.0.0-6083.g4a754ac9.el8.noarch 2023-09-13T08:23:38.577 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6083.g4a754ac9.el8.noarch 2023-09-13T08:23:38.578 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-modules-core-2:18.0.0-6083.g4a754ac9.el8.noarch 2023-09-13T08:23:38.578 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-rook-2:18.0.0-6083.g4a754ac9.el8.noarch 2023-09-13T08:23:38.578 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mon-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T08:23:38.578 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-osd-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T08:23:38.578 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-prometheus-alerts-2:18.0.0-6083.g4a754ac9.el8.noarch 2023-09-13T08:23:38.579 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-radosgw-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T08:23:38.579 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-selinux-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T08:23:38.579 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-test-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T08:23:38.579 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-volume-2:18.0.0-6083.g4a754ac9.el8.noarch 2023-09-13T08:23:38.579 INFO:teuthology.orchestra.run.smithi161.stdout: cephadm-2:18.0.0-6083.g4a754ac9.el8.noarch 2023-09-13T08:23:38.580 INFO:teuthology.orchestra.run.smithi161.stdout: cephfs-mirror-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T08:23:38.580 INFO:teuthology.orchestra.run.smithi161.stdout: cephfs-top-2:18.0.0-6083.g4a754ac9.el8.noarch 2023-09-13T08:23:38.580 INFO:teuthology.orchestra.run.smithi161.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-09-13T08:23:38.580 INFO:teuthology.orchestra.run.smithi161.stdout: flex-2.6.1-9.el8.x86_64 2023-09-13T08:23:38.580 INFO:teuthology.orchestra.run.smithi161.stdout: fuse-2.9.7-15.el8.x86_64 2023-09-13T08:23:38.580 INFO:teuthology.orchestra.run.smithi161.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-09-13T08:23:38.581 INFO:teuthology.orchestra.run.smithi161.stdout: jq-1.6-3.el8.x86_64 2023-09-13T08:23:38.581 INFO:teuthology.orchestra.run.smithi161.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-09-13T08:23:38.581 INFO:teuthology.orchestra.run.smithi161.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-09-13T08:23:38.581 INFO:teuthology.orchestra.run.smithi161.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-09-13T08:23:38.581 INFO:teuthology.orchestra.run.smithi161.stdout: libcephfs-devel-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T08:23:38.582 INFO:teuthology.orchestra.run.smithi161.stdout: libcephfs2-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T08:23:38.582 INFO:teuthology.orchestra.run.smithi161.stdout: libcephsqlite-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T08:23:38.582 INFO:teuthology.orchestra.run.smithi161.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-09-13T08:23:38.582 INFO:teuthology.orchestra.run.smithi161.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-09-13T08:23:38.582 INFO:teuthology.orchestra.run.smithi161.stdout: liboath-2.6.2-3.el8.x86_64 2023-09-13T08:23:38.583 INFO:teuthology.orchestra.run.smithi161.stdout: libpq-13.5-1.el8.x86_64 2023-09-13T08:23:38.583 INFO:teuthology.orchestra.run.smithi161.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-09-13T08:23:38.583 INFO:teuthology.orchestra.run.smithi161.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-09-13T08:23:38.583 INFO:teuthology.orchestra.run.smithi161.stdout: librados-devel-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T08:23:38.583 INFO:teuthology.orchestra.run.smithi161.stdout: libradosstriper1-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T08:23:38.584 INFO:teuthology.orchestra.run.smithi161.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-09-13T08:23:38.584 INFO:teuthology.orchestra.run.smithi161.stdout: librgw2-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T08:23:38.584 INFO:teuthology.orchestra.run.smithi161.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-09-13T08:23:38.584 INFO:teuthology.orchestra.run.smithi161.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-09-13T08:23:38.584 INFO:teuthology.orchestra.run.smithi161.stdout: libtool-2.4.6-25.el8.x86_64 2023-09-13T08:23:38.585 INFO:teuthology.orchestra.run.smithi161.stdout: libunwind-1.3.1-3.el8.x86_64 2023-09-13T08:23:38.585 INFO:teuthology.orchestra.run.smithi161.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-09-13T08:23:38.585 INFO:teuthology.orchestra.run.smithi161.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-09-13T08:23:38.585 INFO:teuthology.orchestra.run.smithi161.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-09-13T08:23:38.585 INFO:teuthology.orchestra.run.smithi161.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-09-13T08:23:38.586 INFO:teuthology.orchestra.run.smithi161.stdout: openblas-0.3.15-3.el8.x86_64 2023-09-13T08:23:38.586 INFO:teuthology.orchestra.run.smithi161.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-09-13T08:23:38.586 INFO:teuthology.orchestra.run.smithi161.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-09-13T08:23:38.586 INFO:teuthology.orchestra.run.smithi161.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-09-13T08:23:38.586 INFO:teuthology.orchestra.run.smithi161.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-09-13T08:23:38.587 INFO:teuthology.orchestra.run.smithi161.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-09-13T08:23:38.587 INFO:teuthology.orchestra.run.smithi161.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-09-13T08:23:38.587 INFO:teuthology.orchestra.run.smithi161.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-09-13T08:23:38.587 INFO:teuthology.orchestra.run.smithi161.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-09-13T08:23:38.587 INFO:teuthology.orchestra.run.smithi161.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-09-13T08:23:38.587 INFO:teuthology.orchestra.run.smithi161.stdout: python3-babel-2.5.1-7.el8.noarch 2023-09-13T08:23:38.588 INFO:teuthology.orchestra.run.smithi161.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-09-13T08:23:38.588 INFO:teuthology.orchestra.run.smithi161.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-09-13T08:23:38.588 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-09-13T08:23:38.588 INFO:teuthology.orchestra.run.smithi161.stdout: python3-ceph-argparse-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T08:23:38.588 INFO:teuthology.orchestra.run.smithi161.stdout: python3-ceph-common-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T08:23:38.589 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cephfs-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T08:23:38.589 INFO:teuthology.orchestra.run.smithi161.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-09-13T08:23:38.589 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-09-13T08:23:38.589 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-09-13T08:23:38.589 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-09-13T08:23:38.590 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-09-13T08:23:38.590 INFO:teuthology.orchestra.run.smithi161.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-09-13T08:23:38.590 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco-6.2-6.el8.noarch 2023-09-13T08:23:38.590 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-09-13T08:23:38.590 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-09-13T08:23:38.591 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-09-13T08:23:38.591 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-09-13T08:23:38.591 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-09-13T08:23:38.591 INFO:teuthology.orchestra.run.smithi161.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-09-13T08:23:38.591 INFO:teuthology.orchestra.run.smithi161.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-09-13T08:23:38.592 INFO:teuthology.orchestra.run.smithi161.stdout: python3-mako-1.0.6-13.el8.noarch 2023-09-13T08:23:38.592 INFO:teuthology.orchestra.run.smithi161.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-09-13T08:23:38.592 INFO:teuthology.orchestra.run.smithi161.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-09-13T08:23:38.592 INFO:teuthology.orchestra.run.smithi161.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-09-13T08:23:38.592 INFO:teuthology.orchestra.run.smithi161.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-09-13T08:23:38.592 INFO:teuthology.orchestra.run.smithi161.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-09-13T08:23:38.593 INFO:teuthology.orchestra.run.smithi161.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-09-13T08:23:38.593 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-09-13T08:23:38.593 INFO:teuthology.orchestra.run.smithi161.stdout: python3-portend-2.6-1.el8.noarch 2023-09-13T08:23:38.593 INFO:teuthology.orchestra.run.smithi161.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-09-13T08:23:38.593 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-09-13T08:23:38.594 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-09-13T08:23:38.594 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-09-13T08:23:38.594 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pycparser-2.14-14.el8.noarch 2023-09-13T08:23:38.594 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pytz-2017.2-9.el8.noarch 2023-09-13T08:23:38.594 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rados-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T08:23:38.595 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rbd-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T08:23:38.595 INFO:teuthology.orchestra.run.smithi161.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-09-13T08:23:38.595 INFO:teuthology.orchestra.run.smithi161.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-09-13T08:23:38.595 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rgw-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T08:23:38.595 INFO:teuthology.orchestra.run.smithi161.stdout: python3-routes-2.4.1-12.el8.noarch 2023-09-13T08:23:38.596 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rsa-4.9-2.el8.noarch 2023-09-13T08:23:38.596 INFO:teuthology.orchestra.run.smithi161.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-09-13T08:23:38.596 INFO:teuthology.orchestra.run.smithi161.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-09-13T08:23:38.596 INFO:teuthology.orchestra.run.smithi161.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-09-13T08:23:38.596 INFO:teuthology.orchestra.run.smithi161.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-09-13T08:23:38.597 INFO:teuthology.orchestra.run.smithi161.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-09-13T08:23:38.597 INFO:teuthology.orchestra.run.smithi161.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-09-13T08:23:38.597 INFO:teuthology.orchestra.run.smithi161.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-09-13T08:23:38.597 INFO:teuthology.orchestra.run.smithi161.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-09-13T08:23:38.597 INFO:teuthology.orchestra.run.smithi161.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-09-13T08:23:38.598 INFO:teuthology.orchestra.run.smithi161.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-09-13T08:23:38.598 INFO:teuthology.orchestra.run.smithi161.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-09-13T08:23:38.598 INFO:teuthology.orchestra.run.smithi161.stdout: rbd-fuse-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T08:23:38.598 INFO:teuthology.orchestra.run.smithi161.stdout: rbd-mirror-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T08:23:38.598 INFO:teuthology.orchestra.run.smithi161.stdout: rbd-nbd-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T08:23:38.599 INFO:teuthology.orchestra.run.smithi161.stdout: socat-1.7.4.1-1.el8.x86_64 2023-09-13T08:23:38.599 INFO:teuthology.orchestra.run.smithi161.stdout: thrift-0.13.0-2.el8.x86_64 2023-09-13T08:23:38.599 INFO:teuthology.orchestra.run.smithi161.stdout: uuid-1.6.2-43.el8.x86_64 2023-09-13T08:23:38.599 INFO:teuthology.orchestra.run.smithi161.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-09-13T08:23:38.599 INFO:teuthology.orchestra.run.smithi161.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-09-13T08:23:38.600 INFO:teuthology.orchestra.run.smithi161.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-09-13T08:23:38.600 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-09-13T08:23:38.600 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2023-09-13T08:23:38.750 DEBUG:teuthology.parallel:result is None 2023-09-13T08:23:38.751 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 2023-09-13T08:23:38.980 DEBUG:teuthology.orchestra.run.smithi084:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-09-13T08:23:39.008 INFO:teuthology.orchestra.run.smithi084.stdout:18.0.0-6083.g4a754ac9.el8 2023-09-13T08:23:39.009 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6083.g4a754ac9.el8 2023-09-13T08:23:39.009 INFO:teuthology.task.install:The correct ceph version 18.0.0-6083.g4a754ac9 is installed. 2023-09-13T08:23:39.010 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 2023-09-13T08:23:39.146 DEBUG:teuthology.orchestra.run.smithi161:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-09-13T08:23:39.174 INFO:teuthology.orchestra.run.smithi161.stdout:18.0.0-6083.g4a754ac9.el8 2023-09-13T08:23:39.174 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6083.g4a754ac9.el8 2023-09-13T08:23:39.175 INFO:teuthology.task.install:The correct ceph version 18.0.0-6083.g4a754ac9 is installed. 2023-09-13T08:23:39.175 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-09-13T08:23:39.176 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-09-13T08:23:39.176 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-09-13T08:23:39.238 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-09-13T08:23:39.239 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-09-13T08:23:39.280 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-09-13T08:23:39.291 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-09-13T08:23:39.291 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/usr/bin/daemon-helper 2023-09-13T08:23:39.321 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-09-13T08:23:39.390 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-09-13T08:23:39.391 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/usr/bin/daemon-helper 2023-09-13T08:23:39.418 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-09-13T08:23:39.486 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-09-13T08:23:39.486 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-09-13T08:23:39.487 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/usr/bin/adjust-ulimits 2023-09-13T08:23:39.515 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-09-13T08:23:39.582 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-09-13T08:23:39.582 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/usr/bin/adjust-ulimits 2023-09-13T08:23:39.609 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-09-13T08:23:39.676 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-09-13T08:23:39.677 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-09-13T08:23:39.677 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/usr/bin/stdin-killer 2023-09-13T08:23:39.704 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-09-13T08:23:39.773 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-09-13T08:23:39.773 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/usr/bin/stdin-killer 2023-09-13T08:23:39.800 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-09-13T08:23:39.867 INFO:teuthology.run_tasks:Running task ceph... 2023-09-13T08:23:39.957 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-09-13T08:23:39.958 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 777 /var/log/ceph 2023-09-13T08:23:39.960 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 777 /var/log/ceph 2023-09-13T08:23:39.987 INFO:tasks.ceph:Disabling ceph logrotate... 2023-09-13T08:23:39.988 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -f -- /etc/logrotate.d/ceph 2023-09-13T08:23:40.027 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -f -- /etc/logrotate.d/ceph 2023-09-13T08:23:40.054 INFO:tasks.ceph:Creating extra log directories... 2023-09-13T08:23:40.055 DEBUG:teuthology.orchestra.run.smithi084:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-09-13T08:23:40.093 DEBUG:teuthology.orchestra.run.smithi161:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-09-13T08:23:40.144 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-09-13T08:23:40.146 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-09-13T08:23:40.149 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-09-13T08:23:40.149 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-09-13T08:23:40.150 DEBUG:teuthology.orchestra.run.smithi084:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-09-13T08:23:40.174 DEBUG:teuthology.orchestra.run.smithi084:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-09-13T08:23:40.307 DEBUG:teuthology.orchestra.run.smithi084:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-09-13T08:23:40.334 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-09-13T08:23:40.334 DEBUG:teuthology.orchestra.run.smithi161:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-09-13T08:23:40.351 DEBUG:teuthology.orchestra.run.smithi161:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-09-13T08:23:40.515 DEBUG:teuthology.orchestra.run.smithi161:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-09-13T08:23:40.546 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-09-13T08:23:40.547 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-09-13T08:23:40.547 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2023-09-12_12:12:15-fs-wip-rishabh-2023sep12-b2-testing-default-smithi/7394882', 'branch': 'wip-rishabh-2023sep12-b2', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev}', 'email': None, 'first_in_suite': False, 'job_id': '7394882', 'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': 'fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'rishabh-2023-09-12_12:12:15-fs-wip-rishabh-2023sep12-b2-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.6', 'overrides': {'admin_socket': {'branch': 'wip-rishabh-2023sep12-b2'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5'}}, 'kclient': {'syntax': 'v1'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rishabh-2023sep12-b2', 'sha1': '4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 80, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 2531, 'sha1': '4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5', 'sleep_before_teardown': 0, 'subset': '165/256', 'suite': 'fs', 'suite_branch': 'wip-rishabh-2023sep12-b2', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi084.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs=', 'smithi161.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': 'fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.tests_from_xfstests_dev']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '54e62bcbac4e53d9685e08328b790d3b20d71cae', 'timestamp': '2023-09-12_12:12:15', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.1394'} 2023-09-13T08:23:40.548 DEBUG:teuthology.orchestra.run.smithi084:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-09-13T08:23:40.550 DEBUG:teuthology.orchestra.run.smithi161:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-09-13T08:23:40.598 DEBUG:teuthology.orchestra.run.smithi084:> sudo install -d -m0777 -- /var/run/ceph 2023-09-13T08:23:40.607 DEBUG:teuthology.orchestra.run.smithi161:> sudo install -d -m0777 -- /var/run/ceph 2023-09-13T08:23:40.665 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-09-13T08:23:40.665 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/scratch_devs of=/dev/stdout 2023-09-13T08:23:40.689 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-09-13T08:23:40.689 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_1 2023-09-13T08:23:40.745 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-09-13T08:23:40.745 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-13T08:23:40.745 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 6h/6d Inode: 391288 Links: 1 2023-09-13T08:23:40.746 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-13T08:23:40.746 INFO:teuthology.orchestra.run.smithi084.stdout:Context: system_u:object_r:device_t:s0 2023-09-13T08:23:40.746 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2023-09-13 08:23:25.759636327 +0000 2023-09-13T08:23:40.746 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2023-09-13 08:20:52.220132115 +0000 2023-09-13T08:23:40.746 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2023-09-13 08:20:52.220132115 +0000 2023-09-13T08:23:40.747 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: - 2023-09-13T08:23:40.747 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-09-13T08:23:40.810 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2023-09-13T08:23:40.810 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2023-09-13T08:23:40.810 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.00026314 s, 1.9 MB/s 2023-09-13T08:23:40.812 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-09-13T08:23:40.869 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_2 2023-09-13T08:23:40.926 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-09-13T08:23:40.926 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-13T08:23:40.927 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 6h/6d Inode: 391426 Links: 1 2023-09-13T08:23:40.927 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-13T08:23:40.927 INFO:teuthology.orchestra.run.smithi084.stdout:Context: system_u:object_r:device_t:s0 2023-09-13T08:23:40.927 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2023-09-13 08:23:25.759636327 +0000 2023-09-13T08:23:40.927 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2023-09-13 08:20:52.741122734 +0000 2023-09-13T08:23:40.928 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2023-09-13 08:20:52.741122734 +0000 2023-09-13T08:23:40.928 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: - 2023-09-13T08:23:40.928 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-09-13T08:23:40.991 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2023-09-13T08:23:40.991 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2023-09-13T08:23:40.991 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000214761 s, 2.4 MB/s 2023-09-13T08:23:40.992 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-09-13T08:23:41.050 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_3 2023-09-13T08:23:41.107 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-09-13T08:23:41.108 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-13T08:23:41.108 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 6h/6d Inode: 391611 Links: 1 2023-09-13T08:23:41.108 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-13T08:23:41.108 INFO:teuthology.orchestra.run.smithi084.stdout:Context: system_u:object_r:device_t:s0 2023-09-13T08:23:41.108 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2023-09-13 08:23:25.759636327 +0000 2023-09-13T08:23:41.109 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2023-09-13 08:20:53.240113749 +0000 2023-09-13T08:23:41.109 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2023-09-13 08:20:53.240113749 +0000 2023-09-13T08:23:41.109 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: - 2023-09-13T08:23:41.109 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-09-13T08:23:41.172 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2023-09-13T08:23:41.172 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2023-09-13T08:23:41.172 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000240474 s, 2.1 MB/s 2023-09-13T08:23:41.173 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-09-13T08:23:41.231 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_4 2023-09-13T08:23:41.288 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-09-13T08:23:41.288 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-13T08:23:41.289 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 6h/6d Inode: 390359 Links: 1 2023-09-13T08:23:41.289 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-13T08:23:41.289 INFO:teuthology.orchestra.run.smithi084.stdout:Context: system_u:object_r:device_t:s0 2023-09-13T08:23:41.289 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2023-09-13 08:23:25.759636327 +0000 2023-09-13T08:23:41.289 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2023-09-13 08:20:53.742104711 +0000 2023-09-13T08:23:41.289 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2023-09-13 08:20:53.742104711 +0000 2023-09-13T08:23:41.290 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: - 2023-09-13T08:23:41.290 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-09-13T08:23:41.352 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2023-09-13T08:23:41.353 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2023-09-13T08:23:41.353 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000196974 s, 2.6 MB/s 2023-09-13T08:23:41.354 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-09-13T08:23:41.410 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-09-13T08:23:41.411 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-09-13T08:23:41.411 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/scratch_devs of=/dev/stdout 2023-09-13T08:23:41.432 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-09-13T08:23:41.432 DEBUG:teuthology.orchestra.run.smithi161:> stat /dev/vg_nvme/lv_1 2023-09-13T08:23:41.493 INFO:teuthology.orchestra.run.smithi161.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-09-13T08:23:41.493 INFO:teuthology.orchestra.run.smithi161.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-13T08:23:41.493 INFO:teuthology.orchestra.run.smithi161.stdout:Device: 6h/6d Inode: 381948 Links: 1 2023-09-13T08:23:41.494 INFO:teuthology.orchestra.run.smithi161.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-13T08:23:41.494 INFO:teuthology.orchestra.run.smithi161.stdout:Context: system_u:object_r:device_t:s0 2023-09-13T08:23:41.494 INFO:teuthology.orchestra.run.smithi161.stdout:Access: 2023-09-13 08:23:29.375183131 +0000 2023-09-13T08:23:41.494 INFO:teuthology.orchestra.run.smithi161.stdout:Modify: 2023-09-13 08:20:52.230487679 +0000 2023-09-13T08:23:41.494 INFO:teuthology.orchestra.run.smithi161.stdout:Change: 2023-09-13 08:20:52.230487679 +0000 2023-09-13T08:23:41.495 INFO:teuthology.orchestra.run.smithi161.stdout: Birth: - 2023-09-13T08:23:41.495 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-09-13T08:23:41.563 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records in 2023-09-13T08:23:41.563 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records out 2023-09-13T08:23:41.563 INFO:teuthology.orchestra.run.smithi161.stderr:512 bytes copied, 0.000284834 s, 1.8 MB/s 2023-09-13T08:23:41.565 DEBUG:teuthology.orchestra.run.smithi161:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-09-13T08:23:41.626 DEBUG:teuthology.orchestra.run.smithi161:> stat /dev/vg_nvme/lv_2 2023-09-13T08:23:41.684 INFO:teuthology.orchestra.run.smithi161.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-09-13T08:23:41.685 INFO:teuthology.orchestra.run.smithi161.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-13T08:23:41.685 INFO:teuthology.orchestra.run.smithi161.stdout:Device: 6h/6d Inode: 379825 Links: 1 2023-09-13T08:23:41.685 INFO:teuthology.orchestra.run.smithi161.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-13T08:23:41.686 INFO:teuthology.orchestra.run.smithi161.stdout:Context: system_u:object_r:device_t:s0 2023-09-13T08:23:41.686 INFO:teuthology.orchestra.run.smithi161.stdout:Access: 2023-09-13 08:23:29.375183131 +0000 2023-09-13T08:23:41.686 INFO:teuthology.orchestra.run.smithi161.stdout:Modify: 2023-09-13 08:20:52.753476438 +0000 2023-09-13T08:23:41.686 INFO:teuthology.orchestra.run.smithi161.stdout:Change: 2023-09-13 08:20:52.753476438 +0000 2023-09-13T08:23:41.686 INFO:teuthology.orchestra.run.smithi161.stdout: Birth: - 2023-09-13T08:23:41.687 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-09-13T08:23:41.752 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records in 2023-09-13T08:23:41.752 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records out 2023-09-13T08:23:41.752 INFO:teuthology.orchestra.run.smithi161.stderr:512 bytes copied, 0.000227808 s, 2.2 MB/s 2023-09-13T08:23:41.754 DEBUG:teuthology.orchestra.run.smithi161:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-09-13T08:23:41.812 DEBUG:teuthology.orchestra.run.smithi161:> stat /dev/vg_nvme/lv_3 2023-09-13T08:23:41.869 INFO:teuthology.orchestra.run.smithi161.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-09-13T08:23:41.869 INFO:teuthology.orchestra.run.smithi161.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-13T08:23:41.870 INFO:teuthology.orchestra.run.smithi161.stdout:Device: 6h/6d Inode: 390314 Links: 1 2023-09-13T08:23:41.870 INFO:teuthology.orchestra.run.smithi161.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-13T08:23:41.870 INFO:teuthology.orchestra.run.smithi161.stdout:Context: system_u:object_r:device_t:s0 2023-09-13T08:23:41.870 INFO:teuthology.orchestra.run.smithi161.stdout:Access: 2023-09-13 08:23:29.375183131 +0000 2023-09-13T08:23:41.870 INFO:teuthology.orchestra.run.smithi161.stdout:Modify: 2023-09-13 08:20:53.249465778 +0000 2023-09-13T08:23:41.871 INFO:teuthology.orchestra.run.smithi161.stdout:Change: 2023-09-13 08:20:53.249465778 +0000 2023-09-13T08:23:41.871 INFO:teuthology.orchestra.run.smithi161.stdout: Birth: - 2023-09-13T08:23:41.871 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-09-13T08:23:41.936 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records in 2023-09-13T08:23:41.936 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records out 2023-09-13T08:23:41.936 INFO:teuthology.orchestra.run.smithi161.stderr:512 bytes copied, 0.000240749 s, 2.1 MB/s 2023-09-13T08:23:41.937 DEBUG:teuthology.orchestra.run.smithi161:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-09-13T08:23:41.995 DEBUG:teuthology.orchestra.run.smithi161:> stat /dev/vg_nvme/lv_4 2023-09-13T08:23:42.053 INFO:teuthology.orchestra.run.smithi161.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-09-13T08:23:42.054 INFO:teuthology.orchestra.run.smithi161.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-13T08:23:42.054 INFO:teuthology.orchestra.run.smithi161.stdout:Device: 6h/6d Inode: 393319 Links: 1 2023-09-13T08:23:42.054 INFO:teuthology.orchestra.run.smithi161.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-13T08:23:42.054 INFO:teuthology.orchestra.run.smithi161.stdout:Context: system_u:object_r:device_t:s0 2023-09-13T08:23:42.054 INFO:teuthology.orchestra.run.smithi161.stdout:Access: 2023-09-13 08:23:29.376183110 +0000 2023-09-13T08:23:42.055 INFO:teuthology.orchestra.run.smithi161.stdout:Modify: 2023-09-13 08:20:53.763454730 +0000 2023-09-13T08:23:42.055 INFO:teuthology.orchestra.run.smithi161.stdout:Change: 2023-09-13 08:20:53.763454730 +0000 2023-09-13T08:23:42.055 INFO:teuthology.orchestra.run.smithi161.stdout: Birth: - 2023-09-13T08:23:42.055 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-09-13T08:23:42.119 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records in 2023-09-13T08:23:42.120 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records out 2023-09-13T08:23:42.120 INFO:teuthology.orchestra.run.smithi161.stderr:512 bytes copied, 0.000215683 s, 2.4 MB/s 2023-09-13T08:23:42.121 DEBUG:teuthology.orchestra.run.smithi161:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-09-13T08:23:42.179 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-09-13T08:23:42.180 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi084.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi161.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-09-13T08:23:42.180 INFO:tasks.ceph:Generating config... 2023-09-13T08:23:42.192 INFO:tasks.ceph:[client] client mount timeout = 600 2023-09-13T08:23:42.192 INFO:tasks.ceph:[client] debug client = 20 2023-09-13T08:23:42.193 INFO:tasks.ceph:[client] debug ms = 1 2023-09-13T08:23:42.193 INFO:tasks.ceph:[client] pid file = 2023-09-13T08:23:42.193 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-09-13T08:23:42.194 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-09-13T08:23:42.194 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-09-13T08:23:42.194 INFO:tasks.ceph:[mds] debug mds = 20 2023-09-13T08:23:42.195 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-09-13T08:23:42.195 INFO:tasks.ceph:[mds] debug ms = 1 2023-09-13T08:23:42.195 INFO:tasks.ceph:[mds] mds debug frag = True 2023-09-13T08:23:42.195 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-09-13T08:23:42.196 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-09-13T08:23:42.196 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-09-13T08:23:42.196 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-09-13T08:23:42.196 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-09-13T08:23:42.197 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-09-13T08:23:42.197 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-09-13T08:23:42.197 INFO:tasks.ceph:[mgr] debug ms = 1 2023-09-13T08:23:42.197 INFO:tasks.ceph:[mon] debug mon = 20 2023-09-13T08:23:42.198 INFO:tasks.ceph:[mon] debug ms = 1 2023-09-13T08:23:42.198 INFO:tasks.ceph:[mon] debug paxos = 20 2023-09-13T08:23:42.198 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-09-13T08:23:42.199 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-09-13T08:23:42.199 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-09-13T08:23:42.199 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-09-13T08:23:42.199 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-09-13T08:23:42.200 INFO:tasks.ceph:[osd] debug ms = 1 2023-09-13T08:23:42.200 INFO:tasks.ceph:[osd] debug osd = 20 2023-09-13T08:23:42.200 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-09-13T08:23:42.200 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-09-13T08:23:42.201 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-09-13T08:23:42.201 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-09-13T08:23:42.201 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-09-13T08:23:42.202 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-09-13T08:23:42.202 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-09-13T08:23:42.202 INFO:tasks.ceph:Setting up mon.a... 2023-09-13T08:23:42.203 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-09-13T08:23:42.257 INFO:teuthology.orchestra.run.smithi084.stdout:creating /etc/ceph/ceph.keyring 2023-09-13T08:23:42.260 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-09-13T08:23:42.307 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-09-13T08:23:42.334 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.84'), ('mon.b', '172.21.15.161'), ('mon.c', '[v2:172.21.15.161:3301,v1:172.21.15.161:6790]')] 2023-09-13T08:23:42.335 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.84,172.21.15.161,[v2:172.21.15.161:3301,v1:172.21.15.161:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-09-13T08:23:42.336 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-09-13T08:23:42.336 DEBUG:teuthology.orchestra.run.smithi084:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-09-13T08:23:42.391 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.84 --add b 172.21.15.161 --addv c '[v2:172.21.15.161:3301,v1:172.21.15.161:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-09-13T08:23:42.479 INFO:teuthology.orchestra.run.smithi084.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-09-13T08:23:42.479 INFO:teuthology.orchestra.run.smithi084.stdout:monmaptool: generated fsid 0107440b-b634-42c5-a643-5d31ea826116 2023-09-13T08:23:42.479 INFO:teuthology.orchestra.run.smithi084.stdout:setting min_mon_release = pacific 2023-09-13T08:23:42.480 INFO:teuthology.orchestra.run.smithi084.stdout:epoch 0 2023-09-13T08:23:42.480 INFO:teuthology.orchestra.run.smithi084.stdout:fsid 0107440b-b634-42c5-a643-5d31ea826116 2023-09-13T08:23:42.480 INFO:teuthology.orchestra.run.smithi084.stdout:last_changed 2023-09-13T08:23:42.480417+0000 2023-09-13T08:23:42.480 INFO:teuthology.orchestra.run.smithi084.stdout:created 2023-09-13T08:23:42.480417+0000 2023-09-13T08:23:42.480 INFO:teuthology.orchestra.run.smithi084.stdout:min_mon_release 16 (pacific) 2023-09-13T08:23:42.481 INFO:teuthology.orchestra.run.smithi084.stdout:election_strategy: 1 2023-09-13T08:23:42.481 INFO:teuthology.orchestra.run.smithi084.stdout:0: [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] mon.a 2023-09-13T08:23:42.481 INFO:teuthology.orchestra.run.smithi084.stdout:1: [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] mon.b 2023-09-13T08:23:42.481 INFO:teuthology.orchestra.run.smithi084.stdout:2: [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] mon.c 2023-09-13T08:23:42.481 INFO:teuthology.orchestra.run.smithi084.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-09-13T08:23:42.483 DEBUG:teuthology.orchestra.run.smithi084:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-09-13T08:23:42.499 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 0107440b-b634-42c5-a643-5d31ea826116... 2023-09-13T08:23:42.500 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-09-13T08:23:42.541 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-09-13T08:23:42.583 INFO:teuthology.orchestra.run.smithi084.stdout:[global] 2023-09-13T08:23:42.583 INFO:teuthology.orchestra.run.smithi084.stdout: chdir = "" 2023-09-13T08:23:42.584 INFO:teuthology.orchestra.run.smithi084.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-09-13T08:23:42.584 INFO:teuthology.orchestra.run.smithi084.stdout: auth supported = cephx 2023-09-13T08:23:42.584 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:23:42.584 INFO:teuthology.orchestra.run.smithi084.stdout: filestore xattr use omap = true 2023-09-13T08:23:42.584 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:23:42.585 INFO:teuthology.orchestra.run.smithi084.stdout: mon clock drift allowed = 1.000 2023-09-13T08:23:42.585 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:23:42.585 INFO:teuthology.orchestra.run.smithi084.stdout: osd crush chooseleaf type = 0 2023-09-13T08:23:42.585 INFO:teuthology.orchestra.run.smithi084.stdout: auth debug = true 2023-09-13T08:23:42.585 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:23:42.586 INFO:teuthology.orchestra.run.smithi084.stdout: ms die on old message = true 2023-09-13T08:23:42.586 INFO:teuthology.orchestra.run.smithi084.stdout: ms die on bug = true 2023-09-13T08:23:42.586 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:23:42.586 INFO:teuthology.orchestra.run.smithi084.stdout: mon max pg per osd = 10000 # >= luminous 2023-09-13T08:23:42.586 INFO:teuthology.orchestra.run.smithi084.stdout: mon pg warn max object skew = 0 2023-09-13T08:23:42.587 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:23:42.587 INFO:teuthology.orchestra.run.smithi084.stdout: # disable pg_autoscaler by default for new pools 2023-09-13T08:23:42.587 INFO:teuthology.orchestra.run.smithi084.stdout: osd_pool_default_pg_autoscale_mode = off 2023-09-13T08:23:42.587 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:23:42.587 INFO:teuthology.orchestra.run.smithi084.stdout: osd pool default size = 2 2023-09-13T08:23:42.588 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:23:42.588 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd allow primary affinity = true 2023-09-13T08:23:42.588 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd allow pg remap = true 2023-09-13T08:23:42.588 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on legacy crush tunables = false 2023-09-13T08:23:42.588 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on crush straw calc version zero = false 2023-09-13T08:23:42.588 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on no sortbitwise = false 2023-09-13T08:23:42.589 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on osd down out interval zero = false 2023-09-13T08:23:42.589 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on too few osds = false 2023-09-13T08:23:42.589 INFO:teuthology.orchestra.run.smithi084.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-09-13T08:23:42.589 INFO:teuthology.orchestra.run.smithi084.stdout: mon_warn_on_pool_no_redundancy = false 2023-09-13T08:23:42.589 INFO:teuthology.orchestra.run.smithi084.stdout: mon_allow_pool_size_one = true 2023-09-13T08:23:42.590 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:23:42.590 INFO:teuthology.orchestra.run.smithi084.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-09-13T08:23:42.590 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:23:42.590 INFO:teuthology.orchestra.run.smithi084.stdout: osd default data pool replay window = 5 2023-09-13T08:23:42.590 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:23:42.591 INFO:teuthology.orchestra.run.smithi084.stdout: mon allow pool delete = true 2023-09-13T08:23:42.591 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:23:42.591 INFO:teuthology.orchestra.run.smithi084.stdout: mon cluster log file level = debug 2023-09-13T08:23:42.591 INFO:teuthology.orchestra.run.smithi084.stdout: debug asserts on shutdown = true 2023-09-13T08:23:42.591 INFO:teuthology.orchestra.run.smithi084.stdout: mon health detail to clog = false 2023-09-13T08:23:42.592 INFO:teuthology.orchestra.run.smithi084.stdout: mon host = "172.21.15.84,172.21.15.161,[v2:172.21.15.161:3301,v1:172.21.15.161:6790]" 2023-09-13T08:23:42.592 INFO:teuthology.orchestra.run.smithi084.stdout: ms die on skipped message = False 2023-09-13T08:23:42.592 INFO:teuthology.orchestra.run.smithi084.stdout: fsid = 0107440b-b634-42c5-a643-5d31ea826116 2023-09-13T08:23:42.592 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:23:42.592 INFO:teuthology.orchestra.run.smithi084.stdout:[osd] 2023-09-13T08:23:42.592 INFO:teuthology.orchestra.run.smithi084.stdout: osd journal size = 100 2023-09-13T08:23:42.593 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:23:42.593 INFO:teuthology.orchestra.run.smithi084.stdout: osd scrub load threshold = 5.0 2023-09-13T08:23:42.593 INFO:teuthology.orchestra.run.smithi084.stdout: osd scrub max interval = 600 2023-09-13T08:23:42.593 INFO:teuthology.orchestra.run.smithi084.stdout: osd mclock profile = high_recovery_ops 2023-09-13T08:23:42.593 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:23:42.594 INFO:teuthology.orchestra.run.smithi084.stdout: osd recover clone overlap = true 2023-09-13T08:23:42.594 INFO:teuthology.orchestra.run.smithi084.stdout: osd recovery max chunk = 1048576 2023-09-13T08:23:42.594 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:23:42.594 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug shutdown = true 2023-09-13T08:23:42.594 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug op order = true 2023-09-13T08:23:42.595 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug verify stray on activate = true 2023-09-13T08:23:42.595 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:23:42.595 INFO:teuthology.orchestra.run.smithi084.stdout: osd open classes on start = true 2023-09-13T08:23:42.595 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug pg log writeout = true 2023-09-13T08:23:42.595 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:23:42.596 INFO:teuthology.orchestra.run.smithi084.stdout: osd deep scrub update digest min age = 30 2023-09-13T08:23:42.596 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:23:42.596 INFO:teuthology.orchestra.run.smithi084.stdout: osd map max advance = 10 2023-09-13T08:23:42.596 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:23:42.596 INFO:teuthology.orchestra.run.smithi084.stdout: journal zero on create = true 2023-09-13T08:23:42.596 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:23:42.597 INFO:teuthology.orchestra.run.smithi084.stdout: filestore ondisk finisher threads = 3 2023-09-13T08:23:42.597 INFO:teuthology.orchestra.run.smithi084.stdout: filestore apply finisher threads = 3 2023-09-13T08:23:42.597 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:23:42.597 INFO:teuthology.orchestra.run.smithi084.stdout: bdev debug aio = true 2023-09-13T08:23:42.597 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug misdirected ops = true 2023-09-13T08:23:42.598 INFO:teuthology.orchestra.run.smithi084.stdout: bluestore block size = 96636764160 2023-09-13T08:23:42.598 INFO:teuthology.orchestra.run.smithi084.stdout: bluestore fsck on mount = True 2023-09-13T08:23:42.598 INFO:teuthology.orchestra.run.smithi084.stdout: debug bluefs = 20 2023-09-13T08:23:42.598 INFO:teuthology.orchestra.run.smithi084.stdout: debug bluestore = 20 2023-09-13T08:23:42.598 INFO:teuthology.orchestra.run.smithi084.stdout: debug ms = 1 2023-09-13T08:23:42.599 INFO:teuthology.orchestra.run.smithi084.stdout: debug osd = 20 2023-09-13T08:23:42.599 INFO:teuthology.orchestra.run.smithi084.stdout: debug rocksdb = 10 2023-09-13T08:23:42.599 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd backfillfull_ratio = 0.85 2023-09-13T08:23:42.599 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd full ratio = 0.9 2023-09-13T08:23:42.599 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd nearfull ratio = 0.8 2023-09-13T08:23:42.600 INFO:teuthology.orchestra.run.smithi084.stdout: osd failsafe full ratio = 0.95 2023-09-13T08:23:42.600 INFO:teuthology.orchestra.run.smithi084.stdout: osd objectstore = bluestore 2023-09-13T08:23:42.600 INFO:teuthology.orchestra.run.smithi084.stdout: osd op complaint time = 180 2023-09-13T08:23:42.600 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:23:42.600 INFO:teuthology.orchestra.run.smithi084.stdout:[mgr] 2023-09-13T08:23:42.601 INFO:teuthology.orchestra.run.smithi084.stdout: debug ms = 1 2023-09-13T08:23:42.601 INFO:teuthology.orchestra.run.smithi084.stdout: debug mgr = 20 2023-09-13T08:23:42.601 INFO:teuthology.orchestra.run.smithi084.stdout: debug mon = 20 2023-09-13T08:23:42.601 INFO:teuthology.orchestra.run.smithi084.stdout: debug auth = 20 2023-09-13T08:23:42.601 INFO:teuthology.orchestra.run.smithi084.stdout: mon reweight min pgs per osd = 4 2023-09-13T08:23:42.601 INFO:teuthology.orchestra.run.smithi084.stdout: mon reweight min bytes per osd = 10 2023-09-13T08:23:42.602 INFO:teuthology.orchestra.run.smithi084.stdout: mgr/telemetry/nag = false 2023-09-13T08:23:42.602 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:23:42.602 INFO:teuthology.orchestra.run.smithi084.stdout:[mon] 2023-09-13T08:23:42.602 INFO:teuthology.orchestra.run.smithi084.stdout: debug ms = 1 2023-09-13T08:23:42.602 INFO:teuthology.orchestra.run.smithi084.stdout: debug mon = 20 2023-09-13T08:23:42.603 INFO:teuthology.orchestra.run.smithi084.stdout: debug paxos = 20 2023-09-13T08:23:42.603 INFO:teuthology.orchestra.run.smithi084.stdout: debug auth = 20 2023-09-13T08:23:42.603 INFO:teuthology.orchestra.run.smithi084.stdout: mon data avail warn = 5 2023-09-13T08:23:42.603 INFO:teuthology.orchestra.run.smithi084.stdout: mon mgr mkfs grace = 240 2023-09-13T08:23:42.603 INFO:teuthology.orchestra.run.smithi084.stdout: mon reweight min pgs per osd = 4 2023-09-13T08:23:42.604 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd reporter subtree level = osd 2023-09-13T08:23:42.604 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd prime pg temp = true 2023-09-13T08:23:42.604 INFO:teuthology.orchestra.run.smithi084.stdout: mon reweight min bytes per osd = 10 2023-09-13T08:23:42.604 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:23:42.604 INFO:teuthology.orchestra.run.smithi084.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-09-13T08:23:42.605 INFO:teuthology.orchestra.run.smithi084.stdout: auth mon ticket ttl = 660 # 11m 2023-09-13T08:23:42.605 INFO:teuthology.orchestra.run.smithi084.stdout: auth service ticket ttl = 240 # 4m 2023-09-13T08:23:42.605 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:23:42.605 INFO:teuthology.orchestra.run.smithi084.stdout: # don't complain about insecure global_id in the test suite 2023-09-13T08:23:42.605 INFO:teuthology.orchestra.run.smithi084.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-09-13T08:23:42.605 INFO:teuthology.orchestra.run.smithi084.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-09-13T08:23:42.606 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:23:42.606 INFO:teuthology.orchestra.run.smithi084.stdout: # 1m isn't quite enough 2023-09-13T08:23:42.606 INFO:teuthology.orchestra.run.smithi084.stdout: mon_down_mkfs_grace = 2m 2023-09-13T08:23:42.606 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:23:42.606 INFO:teuthology.orchestra.run.smithi084.stdout: mon_warn_on_filestore_osds = false 2023-09-13T08:23:42.607 INFO:teuthology.orchestra.run.smithi084.stdout: mon op complaint time = 120 2023-09-13T08:23:42.607 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:23:42.607 INFO:teuthology.orchestra.run.smithi084.stdout:[client] 2023-09-13T08:23:42.607 INFO:teuthology.orchestra.run.smithi084.stdout: rgw cache enabled = true 2023-09-13T08:23:42.607 INFO:teuthology.orchestra.run.smithi084.stdout: rgw enable ops log = true 2023-09-13T08:23:42.608 INFO:teuthology.orchestra.run.smithi084.stdout: rgw enable usage log = true 2023-09-13T08:23:42.608 INFO:teuthology.orchestra.run.smithi084.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-09-13T08:23:42.608 INFO:teuthology.orchestra.run.smithi084.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-09-13T08:23:42.608 INFO:teuthology.orchestra.run.smithi084.stdout: client mount timeout = 600 2023-09-13T08:23:42.608 INFO:teuthology.orchestra.run.smithi084.stdout: debug client = 20 2023-09-13T08:23:42.608 INFO:teuthology.orchestra.run.smithi084.stdout: debug ms = 1 2023-09-13T08:23:42.609 INFO:teuthology.orchestra.run.smithi084.stdout: pid file = "" 2023-09-13T08:23:42.609 INFO:teuthology.orchestra.run.smithi084.stdout: rados mon op timeout = 900 2023-09-13T08:23:42.609 INFO:teuthology.orchestra.run.smithi084.stdout: rados osd op timeout = 900 2023-09-13T08:23:42.609 INFO:teuthology.orchestra.run.smithi084.stdout:[mon.a] 2023-09-13T08:23:42.609 INFO:teuthology.orchestra.run.smithi084.stdout:[mon.b] 2023-09-13T08:23:42.610 INFO:teuthology.orchestra.run.smithi084.stdout:[mon.c] 2023-09-13T08:23:42.610 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.a] 2023-09-13T08:23:42.610 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.c] 2023-09-13T08:23:42.610 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.b] 2023-09-13T08:23:42.610 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.d] 2023-09-13T08:23:42.611 INFO:teuthology.orchestra.run.smithi084.stdout:[mds] 2023-09-13T08:23:42.611 INFO:teuthology.orchestra.run.smithi084.stdout: debug mds = 20 2023-09-13T08:23:42.611 INFO:teuthology.orchestra.run.smithi084.stdout: debug mds balancer = 20 2023-09-13T08:23:42.611 INFO:teuthology.orchestra.run.smithi084.stdout: debug ms = 1 2023-09-13T08:23:42.611 INFO:teuthology.orchestra.run.smithi084.stdout: mds debug frag = True 2023-09-13T08:23:42.611 INFO:teuthology.orchestra.run.smithi084.stdout: mds debug scatterstat = True 2023-09-13T08:23:42.612 INFO:teuthology.orchestra.run.smithi084.stdout: mds op complaint time = 180 2023-09-13T08:23:42.612 INFO:teuthology.orchestra.run.smithi084.stdout: mds verify scatter = True 2023-09-13T08:23:42.612 INFO:teuthology.orchestra.run.smithi084.stdout: osd op complaint time = 180 2023-09-13T08:23:42.612 INFO:teuthology.orchestra.run.smithi084.stdout: rados mon op timeout = 900 2023-09-13T08:23:42.612 INFO:teuthology.orchestra.run.smithi084.stdout: rados osd op timeout = 900 2023-09-13T08:23:42.614 INFO:teuthology.orchestra.run.smithi161.stdout:[global] 2023-09-13T08:23:42.614 INFO:teuthology.orchestra.run.smithi161.stdout: chdir = "" 2023-09-13T08:23:42.614 INFO:teuthology.orchestra.run.smithi161.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-09-13T08:23:42.615 INFO:teuthology.orchestra.run.smithi161.stdout: auth supported = cephx 2023-09-13T08:23:42.615 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-09-13T08:23:42.615 INFO:teuthology.orchestra.run.smithi161.stdout: filestore xattr use omap = true 2023-09-13T08:23:42.615 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-09-13T08:23:42.615 INFO:teuthology.orchestra.run.smithi161.stdout: mon clock drift allowed = 1.000 2023-09-13T08:23:42.616 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-09-13T08:23:42.616 INFO:teuthology.orchestra.run.smithi161.stdout: osd crush chooseleaf type = 0 2023-09-13T08:23:42.616 INFO:teuthology.orchestra.run.smithi161.stdout: auth debug = true 2023-09-13T08:23:42.616 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-09-13T08:23:42.616 INFO:teuthology.orchestra.run.smithi161.stdout: ms die on old message = true 2023-09-13T08:23:42.616 INFO:teuthology.orchestra.run.smithi161.stdout: ms die on bug = true 2023-09-13T08:23:42.617 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-09-13T08:23:42.617 INFO:teuthology.orchestra.run.smithi161.stdout: mon max pg per osd = 10000 # >= luminous 2023-09-13T08:23:42.617 INFO:teuthology.orchestra.run.smithi161.stdout: mon pg warn max object skew = 0 2023-09-13T08:23:42.617 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-09-13T08:23:42.617 INFO:teuthology.orchestra.run.smithi161.stdout: # disable pg_autoscaler by default for new pools 2023-09-13T08:23:42.618 INFO:teuthology.orchestra.run.smithi161.stdout: osd_pool_default_pg_autoscale_mode = off 2023-09-13T08:23:42.618 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-09-13T08:23:42.618 INFO:teuthology.orchestra.run.smithi161.stdout: osd pool default size = 2 2023-09-13T08:23:42.618 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-09-13T08:23:42.618 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd allow primary affinity = true 2023-09-13T08:23:42.619 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd allow pg remap = true 2023-09-13T08:23:42.619 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on legacy crush tunables = false 2023-09-13T08:23:42.619 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on crush straw calc version zero = false 2023-09-13T08:23:42.619 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on no sortbitwise = false 2023-09-13T08:23:42.619 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on osd down out interval zero = false 2023-09-13T08:23:42.619 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on too few osds = false 2023-09-13T08:23:42.620 INFO:teuthology.orchestra.run.smithi161.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-09-13T08:23:42.620 INFO:teuthology.orchestra.run.smithi161.stdout: mon_warn_on_pool_no_redundancy = false 2023-09-13T08:23:42.620 INFO:teuthology.orchestra.run.smithi161.stdout: mon_allow_pool_size_one = true 2023-09-13T08:23:42.620 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-09-13T08:23:42.620 INFO:teuthology.orchestra.run.smithi161.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-09-13T08:23:42.621 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-09-13T08:23:42.621 INFO:teuthology.orchestra.run.smithi161.stdout: osd default data pool replay window = 5 2023-09-13T08:23:42.621 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-09-13T08:23:42.621 INFO:teuthology.orchestra.run.smithi161.stdout: mon allow pool delete = true 2023-09-13T08:23:42.621 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-09-13T08:23:42.622 INFO:teuthology.orchestra.run.smithi161.stdout: mon cluster log file level = debug 2023-09-13T08:23:42.622 INFO:teuthology.orchestra.run.smithi161.stdout: debug asserts on shutdown = true 2023-09-13T08:23:42.622 INFO:teuthology.orchestra.run.smithi161.stdout: mon health detail to clog = false 2023-09-13T08:23:42.622 INFO:teuthology.orchestra.run.smithi161.stdout: mon host = "172.21.15.84,172.21.15.161,[v2:172.21.15.161:3301,v1:172.21.15.161:6790]" 2023-09-13T08:23:42.622 INFO:teuthology.orchestra.run.smithi161.stdout: ms die on skipped message = False 2023-09-13T08:23:42.622 INFO:teuthology.orchestra.run.smithi161.stdout: fsid = 0107440b-b634-42c5-a643-5d31ea826116 2023-09-13T08:23:42.623 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-09-13T08:23:42.623 INFO:teuthology.orchestra.run.smithi161.stdout:[osd] 2023-09-13T08:23:42.623 INFO:teuthology.orchestra.run.smithi161.stdout: osd journal size = 100 2023-09-13T08:23:42.623 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-09-13T08:23:42.623 INFO:teuthology.orchestra.run.smithi161.stdout: osd scrub load threshold = 5.0 2023-09-13T08:23:42.624 INFO:teuthology.orchestra.run.smithi161.stdout: osd scrub max interval = 600 2023-09-13T08:23:42.624 INFO:teuthology.orchestra.run.smithi161.stdout: osd mclock profile = high_recovery_ops 2023-09-13T08:23:42.624 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-09-13T08:23:42.624 INFO:teuthology.orchestra.run.smithi161.stdout: osd recover clone overlap = true 2023-09-13T08:23:42.624 INFO:teuthology.orchestra.run.smithi161.stdout: osd recovery max chunk = 1048576 2023-09-13T08:23:42.625 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-09-13T08:23:42.625 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug shutdown = true 2023-09-13T08:23:42.625 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug op order = true 2023-09-13T08:23:42.625 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug verify stray on activate = true 2023-09-13T08:23:42.625 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-09-13T08:23:42.626 INFO:teuthology.orchestra.run.smithi161.stdout: osd open classes on start = true 2023-09-13T08:23:42.626 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug pg log writeout = true 2023-09-13T08:23:42.626 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-09-13T08:23:42.626 INFO:teuthology.orchestra.run.smithi161.stdout: osd deep scrub update digest min age = 30 2023-09-13T08:23:42.626 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-09-13T08:23:42.627 INFO:teuthology.orchestra.run.smithi161.stdout: osd map max advance = 10 2023-09-13T08:23:42.627 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-09-13T08:23:42.627 INFO:teuthology.orchestra.run.smithi161.stdout: journal zero on create = true 2023-09-13T08:23:42.627 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-09-13T08:23:42.627 INFO:teuthology.orchestra.run.smithi161.stdout: filestore ondisk finisher threads = 3 2023-09-13T08:23:42.628 INFO:teuthology.orchestra.run.smithi161.stdout: filestore apply finisher threads = 3 2023-09-13T08:23:42.628 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-09-13T08:23:42.628 INFO:teuthology.orchestra.run.smithi161.stdout: bdev debug aio = true 2023-09-13T08:23:42.628 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug misdirected ops = true 2023-09-13T08:23:42.628 INFO:teuthology.orchestra.run.smithi161.stdout: bluestore block size = 96636764160 2023-09-13T08:23:42.628 INFO:teuthology.orchestra.run.smithi161.stdout: bluestore fsck on mount = True 2023-09-13T08:23:42.629 INFO:teuthology.orchestra.run.smithi161.stdout: debug bluefs = 20 2023-09-13T08:23:42.629 INFO:teuthology.orchestra.run.smithi161.stdout: debug bluestore = 20 2023-09-13T08:23:42.629 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 1 2023-09-13T08:23:42.629 INFO:teuthology.orchestra.run.smithi161.stdout: debug osd = 20 2023-09-13T08:23:42.629 INFO:teuthology.orchestra.run.smithi161.stdout: debug rocksdb = 10 2023-09-13T08:23:42.630 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd backfillfull_ratio = 0.85 2023-09-13T08:23:42.630 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd full ratio = 0.9 2023-09-13T08:23:42.630 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd nearfull ratio = 0.8 2023-09-13T08:23:42.630 INFO:teuthology.orchestra.run.smithi161.stdout: osd failsafe full ratio = 0.95 2023-09-13T08:23:42.630 INFO:teuthology.orchestra.run.smithi161.stdout: osd objectstore = bluestore 2023-09-13T08:23:42.630 INFO:teuthology.orchestra.run.smithi161.stdout: osd op complaint time = 180 2023-09-13T08:23:42.631 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-09-13T08:23:42.631 INFO:teuthology.orchestra.run.smithi161.stdout:[mgr] 2023-09-13T08:23:42.631 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 1 2023-09-13T08:23:42.631 INFO:teuthology.orchestra.run.smithi161.stdout: debug mgr = 20 2023-09-13T08:23:42.631 INFO:teuthology.orchestra.run.smithi161.stdout: debug mon = 20 2023-09-13T08:23:42.632 INFO:teuthology.orchestra.run.smithi161.stdout: debug auth = 20 2023-09-13T08:23:42.632 INFO:teuthology.orchestra.run.smithi161.stdout: mon reweight min pgs per osd = 4 2023-09-13T08:23:42.632 INFO:teuthology.orchestra.run.smithi161.stdout: mon reweight min bytes per osd = 10 2023-09-13T08:23:42.632 INFO:teuthology.orchestra.run.smithi161.stdout: mgr/telemetry/nag = false 2023-09-13T08:23:42.632 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-09-13T08:23:42.633 INFO:teuthology.orchestra.run.smithi161.stdout:[mon] 2023-09-13T08:23:42.633 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 1 2023-09-13T08:23:42.633 INFO:teuthology.orchestra.run.smithi161.stdout: debug mon = 20 2023-09-13T08:23:42.633 INFO:teuthology.orchestra.run.smithi161.stdout: debug paxos = 20 2023-09-13T08:23:42.633 INFO:teuthology.orchestra.run.smithi161.stdout: debug auth = 20 2023-09-13T08:23:42.634 INFO:teuthology.orchestra.run.smithi161.stdout: mon data avail warn = 5 2023-09-13T08:23:42.634 INFO:teuthology.orchestra.run.smithi161.stdout: mon mgr mkfs grace = 240 2023-09-13T08:23:42.634 INFO:teuthology.orchestra.run.smithi161.stdout: mon reweight min pgs per osd = 4 2023-09-13T08:23:42.634 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd reporter subtree level = osd 2023-09-13T08:23:42.634 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd prime pg temp = true 2023-09-13T08:23:42.635 INFO:teuthology.orchestra.run.smithi161.stdout: mon reweight min bytes per osd = 10 2023-09-13T08:23:42.635 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-09-13T08:23:42.635 INFO:teuthology.orchestra.run.smithi161.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-09-13T08:23:42.635 INFO:teuthology.orchestra.run.smithi161.stdout: auth mon ticket ttl = 660 # 11m 2023-09-13T08:23:42.635 INFO:teuthology.orchestra.run.smithi161.stdout: auth service ticket ttl = 240 # 4m 2023-09-13T08:23:42.636 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-09-13T08:23:42.636 INFO:teuthology.orchestra.run.smithi161.stdout: # don't complain about insecure global_id in the test suite 2023-09-13T08:23:42.636 INFO:teuthology.orchestra.run.smithi161.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-09-13T08:23:42.636 INFO:teuthology.orchestra.run.smithi161.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-09-13T08:23:42.636 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-09-13T08:23:42.636 INFO:teuthology.orchestra.run.smithi161.stdout: # 1m isn't quite enough 2023-09-13T08:23:42.637 INFO:teuthology.orchestra.run.smithi161.stdout: mon_down_mkfs_grace = 2m 2023-09-13T08:23:42.637 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-09-13T08:23:42.637 INFO:teuthology.orchestra.run.smithi161.stdout: mon_warn_on_filestore_osds = false 2023-09-13T08:23:42.637 INFO:teuthology.orchestra.run.smithi161.stdout: mon op complaint time = 120 2023-09-13T08:23:42.637 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-09-13T08:23:42.638 INFO:teuthology.orchestra.run.smithi161.stdout:[client] 2023-09-13T08:23:42.638 INFO:teuthology.orchestra.run.smithi161.stdout: rgw cache enabled = true 2023-09-13T08:23:42.638 INFO:teuthology.orchestra.run.smithi161.stdout: rgw enable ops log = true 2023-09-13T08:23:42.638 INFO:teuthology.orchestra.run.smithi161.stdout: rgw enable usage log = true 2023-09-13T08:23:42.638 INFO:teuthology.orchestra.run.smithi161.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-09-13T08:23:42.638 INFO:teuthology.orchestra.run.smithi161.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-09-13T08:23:42.639 INFO:teuthology.orchestra.run.smithi161.stdout: client mount timeout = 600 2023-09-13T08:23:42.639 INFO:teuthology.orchestra.run.smithi161.stdout: debug client = 20 2023-09-13T08:23:42.639 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 1 2023-09-13T08:23:42.639 INFO:teuthology.orchestra.run.smithi161.stdout: pid file = "" 2023-09-13T08:23:42.639 INFO:teuthology.orchestra.run.smithi161.stdout: rados mon op timeout = 900 2023-09-13T08:23:42.640 INFO:teuthology.orchestra.run.smithi161.stdout: rados osd op timeout = 900 2023-09-13T08:23:42.640 INFO:teuthology.orchestra.run.smithi161.stdout:[mon.a] 2023-09-13T08:23:42.640 INFO:teuthology.orchestra.run.smithi161.stdout:[mon.b] 2023-09-13T08:23:42.640 INFO:teuthology.orchestra.run.smithi161.stdout:[mon.c] 2023-09-13T08:23:42.640 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.a] 2023-09-13T08:23:42.640 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.c] 2023-09-13T08:23:42.641 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.b] 2023-09-13T08:23:42.641 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.d] 2023-09-13T08:23:42.641 INFO:teuthology.orchestra.run.smithi161.stdout:[mds] 2023-09-13T08:23:42.641 INFO:teuthology.orchestra.run.smithi161.stdout: debug mds = 20 2023-09-13T08:23:42.641 INFO:teuthology.orchestra.run.smithi161.stdout: debug mds balancer = 20 2023-09-13T08:23:42.641 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 1 2023-09-13T08:23:42.642 INFO:teuthology.orchestra.run.smithi161.stdout: mds debug frag = True 2023-09-13T08:23:42.642 INFO:teuthology.orchestra.run.smithi161.stdout: mds debug scatterstat = True 2023-09-13T08:23:42.642 INFO:teuthology.orchestra.run.smithi161.stdout: mds op complaint time = 180 2023-09-13T08:23:42.642 INFO:teuthology.orchestra.run.smithi161.stdout: mds verify scatter = True 2023-09-13T08:23:42.642 INFO:teuthology.orchestra.run.smithi161.stdout: osd op complaint time = 180 2023-09-13T08:23:42.643 INFO:teuthology.orchestra.run.smithi161.stdout: rados mon op timeout = 900 2023-09-13T08:23:42.643 INFO:teuthology.orchestra.run.smithi161.stdout: rados osd op timeout = 900 2023-09-13T08:23:42.643 INFO:tasks.ceph:Creating admin key on mon.a... 2023-09-13T08:23:42.643 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-09-13T08:23:42.712 INFO:tasks.ceph:Copying monmap to all nodes... 2023-09-13T08:23:42.712 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-09-13T08:23:42.713 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-09-13T08:23:42.729 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-09-13T08:23:42.730 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-09-13T08:23:42.785 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi084.front.sepia.ceph.com 2023-09-13T08:23:42.786 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-09-13T08:23:42.786 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/etc/ceph/ceph.keyring 2023-09-13T08:23:42.787 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-09-13T08:23:42.861 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-09-13T08:23:42.862 DEBUG:teuthology.orchestra.run.smithi084:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-09-13T08:23:42.918 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi161.front.sepia.ceph.com 2023-09-13T08:23:42.918 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-09-13T08:23:42.919 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/etc/ceph/ceph.keyring 2023-09-13T08:23:42.919 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-09-13T08:23:42.957 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-09-13T08:23:42.957 DEBUG:teuthology.orchestra.run.smithi161:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-09-13T08:23:43.014 INFO:tasks.ceph:Setting up mon nodes... 2023-09-13T08:23:43.014 INFO:tasks.ceph:Setting up mgr nodes... 2023-09-13T08:23:43.015 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-09-13T08:23:43.068 INFO:teuthology.orchestra.run.smithi084.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-09-13T08:23:43.071 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-09-13T08:23:43.153 INFO:teuthology.orchestra.run.smithi161.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-09-13T08:23:43.156 INFO:tasks.ceph:Setting up mds nodes... 2023-09-13T08:23:43.156 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-09-13T08:23:43.210 INFO:teuthology.orchestra.run.smithi084.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-09-13T08:23:43.213 DEBUG:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-09-13T08:23:43.239 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-09-13T08:23:43.332 INFO:teuthology.orchestra.run.smithi084.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-09-13T08:23:43.334 DEBUG:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-09-13T08:23:43.361 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-09-13T08:23:43.414 INFO:teuthology.orchestra.run.smithi161.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-09-13T08:23:43.417 DEBUG:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-09-13T08:23:43.443 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-09-13T08:23:43.538 INFO:teuthology.orchestra.run.smithi161.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-09-13T08:23:43.541 DEBUG:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-09-13T08:23:43.567 INFO:tasks.ceph_client:Setting up client nodes... 2023-09-13T08:23:43.568 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-09-13T08:23:43.612 INFO:teuthology.orchestra.run.smithi084.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-09-13T08:23:43.625 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-09-13T08:23:43.668 INFO:teuthology.orchestra.run.smithi084.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-09-13T08:23:43.680 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-09-13T08:23:43.724 INFO:teuthology.orchestra.run.smithi161.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-09-13T08:23:43.736 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-09-13T08:23:43.779 INFO:teuthology.orchestra.run.smithi161.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-09-13T08:23:43.792 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-09-13T08:23:43.793 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi084.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi161.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-09-13T08:23:43.793 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-09-13T08:23:43.820 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-09-13T08:23:43.821 INFO:tasks.ceph:role: osd.0 2023-09-13T08:23:43.821 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi084.front.sepia.ceph.com 2023-09-13T08:23:43.821 DEBUG:teuthology.orchestra.run.smithi084:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-09-13T08:23:43.894 INFO:teuthology.orchestra.run.smithi084.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-09-13T08:23:43.894 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-13T08:23:43.894 INFO:teuthology.orchestra.run.smithi084.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-13T08:23:43.895 INFO:teuthology.orchestra.run.smithi084.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-09-13T08:23:43.895 INFO:teuthology.orchestra.run.smithi084.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-13T08:23:43.895 INFO:teuthology.orchestra.run.smithi084.stdout: = sunit=0 swidth=0 blks 2023-09-13T08:23:43.895 INFO:teuthology.orchestra.run.smithi084.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-13T08:23:43.895 INFO:teuthology.orchestra.run.smithi084.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-13T08:23:43.896 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-13T08:23:43.896 INFO:teuthology.orchestra.run.smithi084.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-13T08:23:44.318 INFO:teuthology.orchestra.run.smithi084.stdout:Discarding blocks...Done. 2023-09-13T08:23:44.320 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi084.front.sepia.ceph.com -o noatime 2023-09-13T08:23:44.320 DEBUG:teuthology.orchestra.run.smithi084:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-09-13T08:23:44.503 DEBUG:teuthology.orchestra.run.smithi084:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-09-13T08:23:44.537 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-09-13T08:23:44.606 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-09-13T08:23:44.607 INFO:tasks.ceph:role: osd.1 2023-09-13T08:23:44.607 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi084.front.sepia.ceph.com 2023-09-13T08:23:44.607 DEBUG:teuthology.orchestra.run.smithi084:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-09-13T08:23:44.682 INFO:teuthology.orchestra.run.smithi084.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-09-13T08:23:44.683 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-13T08:23:44.683 INFO:teuthology.orchestra.run.smithi084.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-13T08:23:44.683 INFO:teuthology.orchestra.run.smithi084.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-09-13T08:23:44.684 INFO:teuthology.orchestra.run.smithi084.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-13T08:23:44.684 INFO:teuthology.orchestra.run.smithi084.stdout: = sunit=0 swidth=0 blks 2023-09-13T08:23:44.684 INFO:teuthology.orchestra.run.smithi084.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-13T08:23:44.685 INFO:teuthology.orchestra.run.smithi084.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-13T08:23:44.685 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-13T08:23:44.685 INFO:teuthology.orchestra.run.smithi084.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-13T08:23:45.109 INFO:teuthology.orchestra.run.smithi084.stdout:Discarding blocks...Done. 2023-09-13T08:23:45.111 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi084.front.sepia.ceph.com -o noatime 2023-09-13T08:23:45.111 DEBUG:teuthology.orchestra.run.smithi084:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-09-13T08:23:45.219 DEBUG:teuthology.orchestra.run.smithi084:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-09-13T08:23:45.253 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-09-13T08:23:45.322 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-09-13T08:23:45.323 INFO:tasks.ceph:role: osd.2 2023-09-13T08:23:45.323 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi084.front.sepia.ceph.com 2023-09-13T08:23:45.324 DEBUG:teuthology.orchestra.run.smithi084:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-09-13T08:23:45.398 INFO:teuthology.orchestra.run.smithi084.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-09-13T08:23:45.398 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-13T08:23:45.398 INFO:teuthology.orchestra.run.smithi084.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-13T08:23:45.398 INFO:teuthology.orchestra.run.smithi084.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-09-13T08:23:45.399 INFO:teuthology.orchestra.run.smithi084.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-13T08:23:45.399 INFO:teuthology.orchestra.run.smithi084.stdout: = sunit=0 swidth=0 blks 2023-09-13T08:23:45.399 INFO:teuthology.orchestra.run.smithi084.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-13T08:23:45.399 INFO:teuthology.orchestra.run.smithi084.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-13T08:23:45.399 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-13T08:23:45.400 INFO:teuthology.orchestra.run.smithi084.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-13T08:23:45.842 INFO:teuthology.orchestra.run.smithi084.stdout:Discarding blocks...Done. 2023-09-13T08:23:45.845 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi084.front.sepia.ceph.com -o noatime 2023-09-13T08:23:45.845 DEBUG:teuthology.orchestra.run.smithi084:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-09-13T08:23:46.001 DEBUG:teuthology.orchestra.run.smithi084:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-09-13T08:23:46.038 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-09-13T08:23:46.107 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-09-13T08:23:46.108 INFO:tasks.ceph:role: osd.3 2023-09-13T08:23:46.108 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi084.front.sepia.ceph.com 2023-09-13T08:23:46.109 DEBUG:teuthology.orchestra.run.smithi084:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-09-13T08:23:46.185 INFO:teuthology.orchestra.run.smithi084.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-09-13T08:23:46.186 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-13T08:23:46.186 INFO:teuthology.orchestra.run.smithi084.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-13T08:23:46.186 INFO:teuthology.orchestra.run.smithi084.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-09-13T08:23:46.186 INFO:teuthology.orchestra.run.smithi084.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-13T08:23:46.187 INFO:teuthology.orchestra.run.smithi084.stdout: = sunit=0 swidth=0 blks 2023-09-13T08:23:46.187 INFO:teuthology.orchestra.run.smithi084.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-13T08:23:46.187 INFO:teuthology.orchestra.run.smithi084.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-13T08:23:46.187 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-13T08:23:46.188 INFO:teuthology.orchestra.run.smithi084.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-13T08:23:46.622 INFO:teuthology.orchestra.run.smithi084.stdout:Discarding blocks...Done. 2023-09-13T08:23:46.624 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi084.front.sepia.ceph.com -o noatime 2023-09-13T08:23:46.624 DEBUG:teuthology.orchestra.run.smithi084:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-09-13T08:23:46.814 DEBUG:teuthology.orchestra.run.smithi084:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-09-13T08:23:46.850 DEBUG:teuthology.orchestra.run.smithi084:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-13T08:23:46.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:23:46.963+0000 7f025c3b8640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-09-13T08:23:46.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:23:46.963+0000 7f025c3b8640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-09-13T08:23:46.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:23:46.963+0000 7f025c3b8640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-09-13T08:23:46.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:23:46.963+0000 7f025c3b8640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-09-13T08:23:46.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:23:46.963+0000 7f025c3b8640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-09-13T08:23:46.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:23:46.964+0000 7f025c3b8640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-09-13T08:23:49.847 DEBUG:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-09-13T08:23:49.879 DEBUG:teuthology.orchestra.run.smithi084:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-13T08:23:49.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:23:49.976+0000 7fc277648640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-09-13T08:23:49.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:23:49.976+0000 7fc277648640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-09-13T08:23:49.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:23:49.976+0000 7fc277648640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-09-13T08:23:49.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:23:49.976+0000 7fc277648640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-09-13T08:23:49.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:23:49.976+0000 7fc277648640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-09-13T08:23:49.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:23:49.976+0000 7fc277648640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-09-13T08:23:52.835 DEBUG:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-09-13T08:23:52.867 DEBUG:teuthology.orchestra.run.smithi084:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-13T08:23:52.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:23:52.958+0000 7fd504733640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-09-13T08:23:52.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:23:52.958+0000 7fd504733640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-09-13T08:23:52.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:23:52.958+0000 7fd504733640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-09-13T08:23:52.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:23:52.958+0000 7fd504733640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-09-13T08:23:52.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:23:52.958+0000 7fd504733640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-09-13T08:23:52.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:23:52.959+0000 7fd504733640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-09-13T08:23:55.824 DEBUG:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-09-13T08:23:55.855 DEBUG:teuthology.orchestra.run.smithi084:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-13T08:23:55.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:23:55.948+0000 7f09d52a5640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-09-13T08:23:55.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:23:55.948+0000 7f09d52a5640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-09-13T08:23:55.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:23:55.948+0000 7f09d52a5640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-09-13T08:23:55.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:23:55.948+0000 7f09d52a5640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-09-13T08:23:55.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:23:55.948+0000 7f09d52a5640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-09-13T08:23:55.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:23:55.949+0000 7f09d52a5640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-09-13T08:23:58.814 DEBUG:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-09-13T08:23:58.846 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-09-13T08:23:58.879 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-09-13T08:23:58.880 INFO:tasks.ceph:role: osd.4 2023-09-13T08:23:58.880 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi161.front.sepia.ceph.com 2023-09-13T08:23:58.880 DEBUG:teuthology.orchestra.run.smithi161:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-09-13T08:23:58.957 INFO:teuthology.orchestra.run.smithi161.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-09-13T08:23:58.958 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-13T08:23:58.958 INFO:teuthology.orchestra.run.smithi161.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-13T08:23:58.958 INFO:teuthology.orchestra.run.smithi161.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-09-13T08:23:58.958 INFO:teuthology.orchestra.run.smithi161.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-13T08:23:58.959 INFO:teuthology.orchestra.run.smithi161.stdout: = sunit=0 swidth=0 blks 2023-09-13T08:23:58.959 INFO:teuthology.orchestra.run.smithi161.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-13T08:23:58.959 INFO:teuthology.orchestra.run.smithi161.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-13T08:23:58.959 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-13T08:23:58.959 INFO:teuthology.orchestra.run.smithi161.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-13T08:23:59.386 INFO:teuthology.orchestra.run.smithi161.stdout:Discarding blocks...Done. 2023-09-13T08:23:59.388 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi161.front.sepia.ceph.com -o noatime 2023-09-13T08:23:59.388 DEBUG:teuthology.orchestra.run.smithi161:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-09-13T08:23:59.542 DEBUG:teuthology.orchestra.run.smithi161:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-09-13T08:23:59.580 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-09-13T08:23:59.651 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-09-13T08:23:59.651 INFO:tasks.ceph:role: osd.5 2023-09-13T08:23:59.652 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi161.front.sepia.ceph.com 2023-09-13T08:23:59.652 DEBUG:teuthology.orchestra.run.smithi161:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-09-13T08:23:59.727 INFO:teuthology.orchestra.run.smithi161.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-09-13T08:23:59.727 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-13T08:23:59.727 INFO:teuthology.orchestra.run.smithi161.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-13T08:23:59.727 INFO:teuthology.orchestra.run.smithi161.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-09-13T08:23:59.728 INFO:teuthology.orchestra.run.smithi161.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-13T08:23:59.728 INFO:teuthology.orchestra.run.smithi161.stdout: = sunit=0 swidth=0 blks 2023-09-13T08:23:59.728 INFO:teuthology.orchestra.run.smithi161.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-13T08:23:59.728 INFO:teuthology.orchestra.run.smithi161.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-13T08:23:59.729 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-13T08:23:59.729 INFO:teuthology.orchestra.run.smithi161.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-13T08:24:00.147 INFO:teuthology.orchestra.run.smithi161.stdout:Discarding blocks...Done. 2023-09-13T08:24:00.149 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi161.front.sepia.ceph.com -o noatime 2023-09-13T08:24:00.149 DEBUG:teuthology.orchestra.run.smithi161:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-09-13T08:24:00.254 DEBUG:teuthology.orchestra.run.smithi161:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-09-13T08:24:00.287 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-09-13T08:24:00.356 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-09-13T08:24:00.357 INFO:tasks.ceph:role: osd.6 2023-09-13T08:24:00.357 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi161.front.sepia.ceph.com 2023-09-13T08:24:00.357 DEBUG:teuthology.orchestra.run.smithi161:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-09-13T08:24:00.432 INFO:teuthology.orchestra.run.smithi161.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-09-13T08:24:00.432 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-13T08:24:00.432 INFO:teuthology.orchestra.run.smithi161.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-13T08:24:00.433 INFO:teuthology.orchestra.run.smithi161.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-09-13T08:24:00.433 INFO:teuthology.orchestra.run.smithi161.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-13T08:24:00.433 INFO:teuthology.orchestra.run.smithi161.stdout: = sunit=0 swidth=0 blks 2023-09-13T08:24:00.433 INFO:teuthology.orchestra.run.smithi161.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-13T08:24:00.433 INFO:teuthology.orchestra.run.smithi161.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-13T08:24:00.434 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-13T08:24:00.434 INFO:teuthology.orchestra.run.smithi161.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-13T08:24:00.871 INFO:teuthology.orchestra.run.smithi161.stdout:Discarding blocks...Done. 2023-09-13T08:24:00.873 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi161.front.sepia.ceph.com -o noatime 2023-09-13T08:24:00.874 DEBUG:teuthology.orchestra.run.smithi161:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-09-13T08:24:01.030 DEBUG:teuthology.orchestra.run.smithi161:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-09-13T08:24:01.064 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-09-13T08:24:01.133 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-09-13T08:24:01.134 INFO:tasks.ceph:role: osd.7 2023-09-13T08:24:01.134 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi161.front.sepia.ceph.com 2023-09-13T08:24:01.134 DEBUG:teuthology.orchestra.run.smithi161:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-09-13T08:24:01.209 INFO:teuthology.orchestra.run.smithi161.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-09-13T08:24:01.209 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-13T08:24:01.210 INFO:teuthology.orchestra.run.smithi161.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-13T08:24:01.210 INFO:teuthology.orchestra.run.smithi161.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-09-13T08:24:01.210 INFO:teuthology.orchestra.run.smithi161.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-13T08:24:01.210 INFO:teuthology.orchestra.run.smithi161.stdout: = sunit=0 swidth=0 blks 2023-09-13T08:24:01.211 INFO:teuthology.orchestra.run.smithi161.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-13T08:24:01.211 INFO:teuthology.orchestra.run.smithi161.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-13T08:24:01.211 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-13T08:24:01.211 INFO:teuthology.orchestra.run.smithi161.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-13T08:24:01.649 INFO:teuthology.orchestra.run.smithi161.stdout:Discarding blocks...Done. 2023-09-13T08:24:01.651 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi161.front.sepia.ceph.com -o noatime 2023-09-13T08:24:01.652 DEBUG:teuthology.orchestra.run.smithi161:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-09-13T08:24:01.837 DEBUG:teuthology.orchestra.run.smithi161:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-09-13T08:24:01.873 DEBUG:teuthology.orchestra.run.smithi161:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-13T08:24:01.980 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:01.980+0000 7eff0a7fa640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-09-13T08:24:01.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:01.980+0000 7eff0a7fa640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-09-13T08:24:01.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:01.980+0000 7eff0a7fa640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-09-13T08:24:01.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:01.980+0000 7eff0a7fa640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-09-13T08:24:01.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:01.980+0000 7eff0a7fa640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-09-13T08:24:01.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:01.980+0000 7eff0a7fa640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-09-13T08:24:04.841 DEBUG:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-09-13T08:24:04.873 DEBUG:teuthology.orchestra.run.smithi161:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-13T08:24:04.964 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:04.964+0000 7f2ce7e8c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-09-13T08:24:04.965 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:04.964+0000 7f2ce7e8c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-09-13T08:24:04.965 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:04.964+0000 7f2ce7e8c640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-09-13T08:24:04.965 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:04.964+0000 7f2ce7e8c640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-09-13T08:24:04.965 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:04.964+0000 7f2ce7e8c640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-09-13T08:24:04.965 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:04.964+0000 7f2ce7e8c640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-09-13T08:24:07.826 DEBUG:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-09-13T08:24:07.858 DEBUG:teuthology.orchestra.run.smithi161:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-13T08:24:07.949 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:07.949+0000 7f4bcda7e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-09-13T08:24:07.950 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:07.949+0000 7f4bcda7e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-09-13T08:24:07.950 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:07.949+0000 7f4bcda7e640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-09-13T08:24:07.950 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:07.949+0000 7f4bcda7e640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-09-13T08:24:07.950 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:07.949+0000 7f4bcda7e640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-09-13T08:24:07.951 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:07.950+0000 7f4bcda7e640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-09-13T08:24:10.552 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:24:10.556 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:24:10.813 DEBUG:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-09-13T08:24:10.852 DEBUG:teuthology.orchestra.run.smithi161:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-13T08:24:10.946 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:10.945+0000 7fc6e3067640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-09-13T08:24:10.946 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:10.945+0000 7fc6e3067640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-09-13T08:24:10.947 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:10.945+0000 7fc6e3067640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-09-13T08:24:10.947 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:10.945+0000 7fc6e3067640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-09-13T08:24:10.947 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:10.945+0000 7fc6e3067640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-09-13T08:24:10.947 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:10.946+0000 7fc6e3067640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-09-13T08:24:13.803 DEBUG:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-09-13T08:24:13.872 INFO:tasks.ceph:Reading keys from all nodes... 2023-09-13T08:24:13.872 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-09-13T08:24:13.873 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-09-13T08:24:13.905 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-09-13T08:24:13.905 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-09-13T08:24:13.974 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-09-13T08:24:13.975 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-09-13T08:24:14.043 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-09-13T08:24:14.044 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-09-13T08:24:14.111 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-09-13T08:24:14.112 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-09-13T08:24:14.178 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-09-13T08:24:14.179 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-09-13T08:24:14.245 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-09-13T08:24:14.246 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-09-13T08:24:14.312 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-09-13T08:24:14.312 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-09-13T08:24:14.344 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-09-13T08:24:14.345 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-09-13T08:24:14.415 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-09-13T08:24:14.415 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-09-13T08:24:14.485 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-09-13T08:24:14.485 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-09-13T08:24:14.554 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-09-13T08:24:14.555 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-09-13T08:24:14.624 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-09-13T08:24:14.624 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-09-13T08:24:14.693 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-09-13T08:24:14.693 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-09-13T08:24:14.760 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-09-13T08:24:14.760 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-09-13T08:24:14.779 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-09-13T08:24:14.780 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-09-13T08:24:14.837 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-09-13T08:24:14.837 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-09-13T08:24:14.855 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-09-13T08:24:14.856 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-09-13T08:24:14.913 INFO:tasks.ceph:Adding keys to all mons... 2023-09-13T08:24:14.914 DEBUG:teuthology.orchestra.run.smithi084:> sudo tee -a /etc/ceph/ceph.keyring 2023-09-13T08:24:14.917 DEBUG:teuthology.orchestra.run.smithi161:> sudo tee -a /etc/ceph/ceph.keyring 2023-09-13T08:24:14.957 INFO:teuthology.orchestra.run.smithi084.stdout:[mgr.y] 2023-09-13T08:24:14.957 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQCPcQFlE6IpBBAA29jyBsRyFE46WTWA2h9CCA== 2023-09-13T08:24:14.957 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.a] 2023-09-13T08:24:14.957 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQCPcQFlctWjDBAAjv8Ie2euiQ6pyxzgFW1YnA== 2023-09-13T08:24:14.958 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.c] 2023-09-13T08:24:14.958 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQCPcQFldCLlExAAHorwgOqe8i2PhYeiMwS1QQ== 2023-09-13T08:24:14.958 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.0] 2023-09-13T08:24:14.958 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQCScQFlxmZ/ORAAjoQuoNbStmNRKDzKQMdqrQ== 2023-09-13T08:24:14.959 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.1] 2023-09-13T08:24:14.959 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQCVcQFlcLw9OhAAU/UJ6t85Q1OD/BbCc5T41g== 2023-09-13T08:24:14.959 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.2] 2023-09-13T08:24:14.959 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQCYcQFlkGswORAAUlpF3Wr0ig2bFZHgkp2eUA== 2023-09-13T08:24:14.959 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.3] 2023-09-13T08:24:14.960 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQCbcQFlF4KYOBAAy4SV9QpY5jSl9Z65Kvg6ew== 2023-09-13T08:24:14.960 INFO:teuthology.orchestra.run.smithi084.stdout:[mgr.x] 2023-09-13T08:24:14.960 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQCPcQFlNckxCRAAzT6vm5n688QBgYwOYbFjDQ== 2023-09-13T08:24:14.960 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.b] 2023-09-13T08:24:14.961 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQCPcQFliCDLGBAA7Gj7Wn2u3MdhIL2IN9Q0sw== 2023-09-13T08:24:14.961 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.d] 2023-09-13T08:24:14.961 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQCPcQFleskvIBAA2eW3D23vDpEs4fHiCUi/Hw== 2023-09-13T08:24:14.961 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.4] 2023-09-13T08:24:14.961 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQChcQFlbop8OhAAGPG1rHs6gxDr1NKhzBZpCg== 2023-09-13T08:24:14.962 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.5] 2023-09-13T08:24:14.962 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQCkcQFlTQ+KORAA44V7Ff4R2Lep1GSgbR14hg== 2023-09-13T08:24:14.962 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.6] 2023-09-13T08:24:14.962 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQCncQFlXoqqOBAAhKHSELMXASOuwRf+HNFNTQ== 2023-09-13T08:24:14.962 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.7] 2023-09-13T08:24:14.963 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQCqcQFl41hvOBAAWug1ynxu8FPe+VasDEj7bg== 2023-09-13T08:24:14.963 INFO:teuthology.orchestra.run.smithi084.stdout:[client.0] 2023-09-13T08:24:14.963 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQCPcQFlYASSJBAAizLV8EZeo+kCkamPephtLA== 2023-09-13T08:24:14.963 INFO:teuthology.orchestra.run.smithi084.stdout:[client.2] 2023-09-13T08:24:14.963 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQCPcQFlKVPiJxAAKS+vqTzaRhG5mWy7VHIJSg== 2023-09-13T08:24:14.964 INFO:teuthology.orchestra.run.smithi084.stdout:[client.1] 2023-09-13T08:24:14.964 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQCPcQFl4Ds8KxAAKDNxtu4ME9yAx0MkKURXyg== 2023-09-13T08:24:14.964 INFO:teuthology.orchestra.run.smithi084.stdout:[client.3] 2023-09-13T08:24:14.964 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQCPcQFlvMGOLhAAbUG2OYs/pRmbOykXCcRGGQ== 2023-09-13T08:24:14.979 INFO:teuthology.orchestra.run.smithi161.stdout:[mgr.y] 2023-09-13T08:24:14.980 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQCPcQFlE6IpBBAA29jyBsRyFE46WTWA2h9CCA== 2023-09-13T08:24:14.980 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.a] 2023-09-13T08:24:14.980 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQCPcQFlctWjDBAAjv8Ie2euiQ6pyxzgFW1YnA== 2023-09-13T08:24:14.980 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.c] 2023-09-13T08:24:14.981 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQCPcQFldCLlExAAHorwgOqe8i2PhYeiMwS1QQ== 2023-09-13T08:24:14.981 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.0] 2023-09-13T08:24:14.981 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQCScQFlxmZ/ORAAjoQuoNbStmNRKDzKQMdqrQ== 2023-09-13T08:24:14.981 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.1] 2023-09-13T08:24:14.982 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQCVcQFlcLw9OhAAU/UJ6t85Q1OD/BbCc5T41g== 2023-09-13T08:24:14.982 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.2] 2023-09-13T08:24:14.982 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQCYcQFlkGswORAAUlpF3Wr0ig2bFZHgkp2eUA== 2023-09-13T08:24:14.982 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.3] 2023-09-13T08:24:14.983 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQCbcQFlF4KYOBAAy4SV9QpY5jSl9Z65Kvg6ew== 2023-09-13T08:24:14.983 INFO:teuthology.orchestra.run.smithi161.stdout:[mgr.x] 2023-09-13T08:24:14.983 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQCPcQFlNckxCRAAzT6vm5n688QBgYwOYbFjDQ== 2023-09-13T08:24:14.983 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.b] 2023-09-13T08:24:14.984 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQCPcQFliCDLGBAA7Gj7Wn2u3MdhIL2IN9Q0sw== 2023-09-13T08:24:14.984 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.d] 2023-09-13T08:24:14.984 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQCPcQFleskvIBAA2eW3D23vDpEs4fHiCUi/Hw== 2023-09-13T08:24:14.984 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.4] 2023-09-13T08:24:14.984 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQChcQFlbop8OhAAGPG1rHs6gxDr1NKhzBZpCg== 2023-09-13T08:24:14.985 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.5] 2023-09-13T08:24:14.985 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQCkcQFlTQ+KORAA44V7Ff4R2Lep1GSgbR14hg== 2023-09-13T08:24:14.985 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.6] 2023-09-13T08:24:14.985 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQCncQFlXoqqOBAAhKHSELMXASOuwRf+HNFNTQ== 2023-09-13T08:24:14.985 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.7] 2023-09-13T08:24:14.986 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQCqcQFl41hvOBAAWug1ynxu8FPe+VasDEj7bg== 2023-09-13T08:24:14.986 INFO:teuthology.orchestra.run.smithi161.stdout:[client.0] 2023-09-13T08:24:14.986 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQCPcQFlYASSJBAAizLV8EZeo+kCkamPephtLA== 2023-09-13T08:24:14.986 INFO:teuthology.orchestra.run.smithi161.stdout:[client.2] 2023-09-13T08:24:14.987 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQCPcQFlKVPiJxAAKS+vqTzaRhG5mWy7VHIJSg== 2023-09-13T08:24:14.988 INFO:teuthology.orchestra.run.smithi161.stdout:[client.1] 2023-09-13T08:24:14.988 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQCPcQFl4Ds8KxAAKDNxtu4ME9yAx0MkKURXyg== 2023-09-13T08:24:14.988 INFO:teuthology.orchestra.run.smithi161.stdout:[client.3] 2023-09-13T08:24:14.988 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQCPcQFlvMGOLhAAbUG2OYs/pRmbOykXCcRGGQ== 2023-09-13T08:24:14.989 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-09-13T08:24:15.008 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-09-13T08:24:15.083 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-13T08:24:15.086 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-13T08:24:15.142 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-13T08:24:15.144 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-13T08:24:15.202 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-13T08:24:15.205 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-13T08:24:15.258 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-13T08:24:15.260 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-13T08:24:15.313 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-13T08:24:15.316 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-13T08:24:15.369 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-13T08:24:15.371 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-13T08:24:15.424 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-09-13T08:24:15.426 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-09-13T08:24:15.479 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-13T08:24:15.481 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-13T08:24:15.538 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-13T08:24:15.540 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-13T08:24:15.596 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-13T08:24:15.599 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-13T08:24:15.653 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-13T08:24:15.655 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-13T08:24:15.708 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-13T08:24:15.711 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-13T08:24:15.764 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-13T08:24:15.766 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-13T08:24:15.819 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-13T08:24:15.822 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-13T08:24:15.879 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-13T08:24:15.881 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-13T08:24:15.937 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-13T08:24:15.940 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-13T08:24:15.997 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-13T08:24:15.999 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-13T08:24:16.055 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-09-13T08:24:16.056 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-09-13T08:24:16.083 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-09-13T08:24:16.180 DEBUG:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-09-13T08:24:16.207 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-09-13T08:24:16.234 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-09-13T08:24:16.333 DEBUG:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-09-13T08:24:16.359 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-09-13T08:24:16.426 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-09-13T08:24:16.525 DEBUG:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-09-13T08:24:16.552 DEBUG:teuthology.orchestra.run.smithi084:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-09-13T08:24:16.555 DEBUG:teuthology.orchestra.run.smithi161:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-09-13T08:24:16.609 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-09-13T08:24:16.610 INFO:tasks.ceph.mon.a:Restarting daemon 2023-09-13T08:24:16.610 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-09-13T08:24:16.613 INFO:tasks.ceph.mon.a:Started 2023-09-13T08:24:16.613 INFO:tasks.ceph.mon.b:Restarting daemon 2023-09-13T08:24:16.613 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-09-13T08:24:16.652 INFO:tasks.ceph.mon.b:Started 2023-09-13T08:24:16.652 INFO:tasks.ceph.mon.c:Restarting daemon 2023-09-13T08:24:16.653 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-09-13T08:24:16.655 INFO:tasks.ceph.mon.c:Started 2023-09-13T08:24:16.655 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-09-13T08:24:16.655 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-09-13T08:24:16.656 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-09-13T08:24:16.658 INFO:tasks.ceph.mgr.y:Started 2023-09-13T08:24:16.658 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-09-13T08:24:16.658 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-09-13T08:24:16.660 INFO:tasks.ceph.mgr.x:Started 2023-09-13T08:24:16.661 INFO:tasks.ceph:Setting crush tunables to default 2023-09-13T08:24:16.661 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph osd crush tunables default 2023-09-13T08:24:16.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:16.783+0000 7f8017d05700 1 Processor -- start 2023-09-13T08:24:16.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:16.784+0000 7f8017d05700 1 -- start start 2023-09-13T08:24:16.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:16.784+0000 7f8017d05700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f8010152320 0x7f80100cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:16.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:16.784+0000 7f8017d05700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f80100b3230 0x7f80100d00d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:16.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:16.784+0000 7f8017d05700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8010152700 con 0x7f801006fc90 2023-09-13T08:24:16.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:16.784+0000 7f8017d05700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f801015b940 con 0x7f80100b3230 2023-09-13T08:24:16.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:16.784+0000 7f8017d05700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f801015bc20 con 0x7f8010152320 2023-09-13T08:24:16.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:16.785+0000 7f80162a2700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f80100b3230 0x7f80100d00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:16.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:16.785+0000 7f80152a0700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f801006fc90 0x7f80100b2b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:45256/0 (socket says 172.21.15.84:45256) 2023-09-13T08:24:16.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:16.785+0000 7f80162a2700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f80100b3230 0x7f80100d00d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42612/0 (socket says 172.21.15.84:42612) 2023-09-13T08:24:16.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:16.785+0000 7f80152a0700 1 -- 172.21.15.84:0/1757444204 learned_addr learned my addr 172.21.15.84:0/1757444204 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:24:16.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:16.785+0000 7f80162a2700 1 -- 172.21.15.84:0/1757444204 >> v2:172.21.15.84:3300/0 conn(0x7f80100b3230 msgr2=0x7f80100d00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-09-13T08:24:16.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:16.785+0000 7f80162a2700 1 -- 172.21.15.84:0/1757444204 >> v2:172.21.15.84:3300/0 conn(0x7f80100b3230 msgr2=0x7f80100d00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-13T08:24:16.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:16.785+0000 7f80162a2700 1 --2- 172.21.15.84:0/1757444204 >> v2:172.21.15.84:3300/0 conn(0x7f80100b3230 0x7f80100d00d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-09-13T08:24:16.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:16.785+0000 7f8015aa1700 1 --2- 172.21.15.84:0/1757444204 >> v2:172.21.15.161:3300/0 conn(0x7f8010152320 0x7f80100cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:16.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:16.785+0000 7f80162a2700 1 --2- 172.21.15.84:0/1757444204 >> v2:172.21.15.84:3300/0 conn(0x7f80100b3230 0x7f80100d00d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-09-13T08:24:16.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:16.785+0000 7f8015aa1700 1 -- 172.21.15.84:0/1757444204 >> v2:172.21.15.161:3300/0 conn(0x7f8010152320 msgr2=0x7f80100cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-09-13T08:24:16.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:16.785+0000 7f8015aa1700 1 -- 172.21.15.84:0/1757444204 >> v2:172.21.15.161:3300/0 conn(0x7f8010152320 msgr2=0x7f80100cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-13T08:24:16.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:16.785+0000 7f8015aa1700 1 --2- 172.21.15.84:0/1757444204 >> v2:172.21.15.161:3300/0 conn(0x7f8010152320 0x7f80100cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-09-13T08:24:16.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:16.785+0000 7f8015aa1700 1 --2- 172.21.15.84:0/1757444204 >> v2:172.21.15.161:3300/0 conn(0x7f8010152320 0x7f80100cb6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-09-13T08:24:16.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:16.956+0000 7f8014a9f700 1 -- 172.21.15.84:0/1757444204 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1121341252 0 0) 0x7f8010152700 con 0x7f801006fc90 2023-09-13T08:24:16.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:16.956+0000 7f8014a9f700 1 -- 172.21.15.84:0/1757444204 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ffc0035b0 con 0x7f801006fc90 2023-09-13T08:24:16.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:16.956+0000 7f8014a9f700 1 -- 172.21.15.84:0/1757444204 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 867959191 0 0) 0x7f7ffc0035b0 con 0x7f801006fc90 2023-09-13T08:24:16.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:16.956+0000 7f8014a9f700 1 -- 172.21.15.84:0/1757444204 >> v2:172.21.15.161:3300/0 conn(0x7f8010152320 msgr2=0x7f80100cb6f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-13T08:24:16.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:16.956+0000 7f8014a9f700 1 --2- 172.21.15.84:0/1757444204 >> v2:172.21.15.161:3300/0 conn(0x7f8010152320 0x7f80100cb6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:16.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:16.956+0000 7f8014a9f700 1 -- 172.21.15.84:0/1757444204 >> v2:172.21.15.84:3300/0 conn(0x7f80100b3230 msgr2=0x7f80100d00d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-13T08:24:16.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:16.956+0000 7f8014a9f700 1 --2- 172.21.15.84:0/1757444204 >> v2:172.21.15.84:3300/0 conn(0x7f80100b3230 0x7f80100d00d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:16.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:16.956+0000 7f8014a9f700 1 -- 172.21.15.84:0/1757444204 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f801015bf00 con 0x7f801006fc90 2023-09-13T08:24:16.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:16.956+0000 7f8014a9f700 1 -- 172.21.15.84:0/1757444204 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2302733408 0 0) 0x7f8000001670 con 0x7f801006fc90 2023-09-13T08:24:16.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:16.957+0000 7f8014a9f700 1 -- 172.21.15.84:0/1757444204 >> v1:172.21.15.84:6789/0 conn(0x7f801006fc90 legacy=0x7f80100b2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:16.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:16.957+0000 7f8014a9f700 1 --2- 172.21.15.84:0/1757444204 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7ffc003a00 0x7f7ffc003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:16.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:16.957+0000 7f8014a9f700 1 --2- 172.21.15.84:0/1757444204 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7ffc004850 0x7f7ffc004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:16.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:16.957+0000 7f8014a9f700 1 --2- 172.21.15.84:0/1757444204 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ffc005210 0x7f7ffc00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:16.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:16.957+0000 7f8014a9f700 1 -- 172.21.15.84:0/1757444204 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f801015b940 con 0x7f7ffc005210 2023-09-13T08:24:16.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:16.957+0000 7f8014a9f700 1 -- 172.21.15.84:0/1757444204 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f801015bc20 con 0x7f7ffc003a00 2023-09-13T08:24:16.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:16.957+0000 7f8014a9f700 1 -- 172.21.15.84:0/1757444204 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ffc00c110 con 0x7f7ffc004850 2023-09-13T08:24:16.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:16.957+0000 7f80162a2700 1 --2- 172.21.15.84:0/1757444204 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ffc005210 0x7f7ffc00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:16.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:16.957+0000 7f8015aa1700 1 --2- 172.21.15.84:0/1757444204 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7ffc003a00 0x7f7ffc003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:16.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:16.957+0000 7f80152a0700 1 --2- 172.21.15.84:0/1757444204 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7ffc004850 0x7f7ffc004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:16.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:16.957+0000 7f80162a2700 1 -- 172.21.15.84:0/1757444204 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7ffc004850 msgr2=0x7f7ffc004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:24:16.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:16.957+0000 7f80162a2700 1 --2- 172.21.15.84:0/1757444204 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7ffc004850 0x7f7ffc004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:16.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:16.957+0000 7f80162a2700 1 -- 172.21.15.84:0/1757444204 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7ffc003a00 msgr2=0x7f7ffc003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:24:16.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:16.957+0000 7f80162a2700 1 --2- 172.21.15.84:0/1757444204 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7ffc003a00 0x7f7ffc003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:16.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:16.957+0000 7f80162a2700 1 -- 172.21.15.84:0/1757444204 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ffc0035b0 con 0x7f7ffc005210 2023-09-13T08:24:16.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:16.957+0000 7f80162a2700 1 -- 172.21.15.84:0/1757444204 reap_dead start 2023-09-13T08:24:16.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:16.957+0000 7f80162a2700 1 --2- 172.21.15.84:0/1757444204 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ffc005210 0x7f7ffc00ba10 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f800c009890 tx=0x7f7ffc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47996f19b63579e9 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:16.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:16.957+0000 7f8014a9f700 1 -- 172.21.15.84:0/1757444204 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f800c00c070 con 0x7f7ffc005210 2023-09-13T08:24:16.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:16.957+0000 7f8014a9f700 1 -- 172.21.15.84:0/1757444204 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f800c004020 con 0x7f7ffc005210 2023-09-13T08:24:16.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:16.957+0000 7f8014a9f700 1 -- 172.21.15.84:0/1757444204 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f800c0043b0 con 0x7f7ffc005210 2023-09-13T08:24:16.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:16.958+0000 7f8017d05700 1 -- 172.21.15.84:0/1757444204 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ffc005210 msgr2=0x7f7ffc00ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:16.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:16.958+0000 7f8017d05700 1 --2- 172.21.15.84:0/1757444204 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ffc005210 0x7f7ffc00ba10 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f800c009890 tx=0x7f7ffc005880 comp rx=0 tx=0).stop 2023-09-13T08:24:16.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:16.958+0000 7f8017d05700 1 -- 172.21.15.84:0/1757444204 shutdown_connections 2023-09-13T08:24:16.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:16.958+0000 7f8017d05700 1 --2- 172.21.15.84:0/1757444204 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ffc005210 0x7f7ffc00ba10 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:16.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:16.958+0000 7f8017d05700 1 -- 172.21.15.84:0/1757444204 >> 172.21.15.84:0/1757444204 conn(0x7f80100cdb20 msgr2=0x7f80100cdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:16.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:16.958+0000 7f8017d05700 1 -- 172.21.15.84:0/1757444204 shutdown_connections 2023-09-13T08:24:16.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:16.958+0000 7f8017d05700 1 -- 172.21.15.84:0/1757444204 wait complete. 2023-09-13T08:24:16.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:16.960+0000 7f8017d05700 1 Processor -- start 2023-09-13T08:24:16.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:16.960+0000 7f8017d05700 1 -- start start 2023-09-13T08:24:16.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:16.961+0000 7f8017d05700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ffc005210 0x7f801006c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:16.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:16.961+0000 7f8017d05700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8010151360 0x7f801015a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:16.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:16.961+0000 7f8017d05700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f80101517e0 0x7f801015a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:16.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:16.961+0000 7f8017d05700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80100cffc0 con 0x7f7ffc005210 2023-09-13T08:24:16.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:16.961+0000 7f8017d05700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80100c7140 con 0x7f8010151360 2023-09-13T08:24:16.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:16.961+0000 7f8017d05700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80100c7420 con 0x7f80101517e0 2023-09-13T08:24:16.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:16.961+0000 7f8015aa1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ffc005210 0x7f801006c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:16.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:16.961+0000 7f8015aa1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ffc005210 0x7f801006c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42640/0 (socket says 172.21.15.84:42640) 2023-09-13T08:24:16.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:16.961+0000 7f8015aa1700 1 -- 172.21.15.84:0/3059604119 learned_addr learned my addr 172.21.15.84:0/3059604119 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:24:16.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:16.961+0000 7f80152a0700 1 --2- 172.21.15.84:0/3059604119 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8010151360 0x7f801015a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:16.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:16.961+0000 7f80162a2700 1 --2- 172.21.15.84:0/3059604119 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f80101517e0 0x7f801015a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:16.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:16.961+0000 7f8015aa1700 1 -- 172.21.15.84:0/3059604119 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f80101517e0 msgr2=0x7f801015a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:16.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:16.961+0000 7f8015aa1700 1 --2- 172.21.15.84:0/3059604119 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f80101517e0 0x7f801015a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:16.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:16.961+0000 7f8015aa1700 1 -- 172.21.15.84:0/3059604119 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8010151360 msgr2=0x7f801015a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:16.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:16.961+0000 7f8015aa1700 1 --2- 172.21.15.84:0/3059604119 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8010151360 0x7f801015a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:16.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:16.961+0000 7f8015aa1700 1 -- 172.21.15.84:0/3059604119 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80100c7700 con 0x7f7ffc005210 2023-09-13T08:24:16.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:16.961+0000 7f8015aa1700 1 --2- 172.21.15.84:0/3059604119 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ffc005210 0x7f801006c140 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f800800afc0 tx=0x7f800800f430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:16.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:16.962+0000 7f80067fc700 1 -- 172.21.15.84:0/3059604119 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f800800fe60 con 0x7f7ffc005210 2023-09-13T08:24:16.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:16.962+0000 7f80067fc700 1 -- 172.21.15.84:0/3059604119 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8008015470 con 0x7f7ffc005210 2023-09-13T08:24:16.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:16.962+0000 7f8017d05700 1 -- 172.21.15.84:0/3059604119 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f801006c680 con 0x7f7ffc005210 2023-09-13T08:24:16.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:16.962+0000 7f80067fc700 1 -- 172.21.15.84:0/3059604119 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8008015820 con 0x7f7ffc005210 2023-09-13T08:24:16.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:16.962+0000 7f8017d05700 1 -- 172.21.15.84:0/3059604119 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80100c4c20 con 0x7f7ffc005210 2023-09-13T08:24:16.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:16.962+0000 7f80067fc700 1 -- 172.21.15.84:0/3059604119 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f8008015980 con 0x7f7ffc005210 2023-09-13T08:24:16.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:16.962+0000 7f80067fc700 1 -- 172.21.15.84:0/3059604119 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f800801fbb0 con 0x7f7ffc005210 2023-09-13T08:24:16.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:16.963+0000 7f8017d05700 1 -- 172.21.15.84:0/3059604119 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f801004e9b0 con 0x7f7ffc005210 2023-09-13T08:24:16.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:16.967+0000 7f80067fc700 1 -- 172.21.15.84:0/3059604119 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f800801f460 con 0x7f7ffc005210 2023-09-13T08:24:17.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:17.041+0000 7f8017d05700 1 -- 172.21.15.84:0/3059604119 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f80100b39d0 con 0x7f7ffc005210 2023-09-13T08:24:17.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:17.044+0000 7f80067fc700 1 -- 172.21.15.84:0/3059604119 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f800801f600 con 0x7f7ffc005210 2023-09-13T08:24:17.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:17.045+0000 7f8017d05700 1 -- 172.21.15.84:0/3059604119 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ffc005210 msgr2=0x7f801006c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:17.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:17.045+0000 7f8017d05700 1 --2- 172.21.15.84:0/3059604119 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ffc005210 0x7f801006c140 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f800800afc0 tx=0x7f800800f430 comp rx=0 tx=0).stop 2023-09-13T08:24:17.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:17.045+0000 7f8017d05700 1 -- 172.21.15.84:0/3059604119 shutdown_connections 2023-09-13T08:24:17.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:17.045+0000 7f8017d05700 1 --2- 172.21.15.84:0/3059604119 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f80101517e0 0x7f801015a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:17.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:17.045+0000 7f8017d05700 1 --2- 172.21.15.84:0/3059604119 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ffc005210 0x7f801006c140 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:17.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:17.045+0000 7f8017d05700 1 --2- 172.21.15.84:0/3059604119 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8010151360 0x7f801015a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:17.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:17.045+0000 7f8017d05700 1 -- 172.21.15.84:0/3059604119 >> 172.21.15.84:0/3059604119 conn(0x7f80100cdb20 msgr2=0x7f801015db70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:17.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:17.045+0000 7f8017d05700 1 -- 172.21.15.84:0/3059604119 shutdown_connections 2023-09-13T08:24:17.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:17.045+0000 7f8017d05700 1 -- 172.21.15.84:0/3059604119 wait complete. 2023-09-13T08:24:17.047 INFO:teuthology.orchestra.run.smithi084.stderr:adjusted tunables profile to default 2023-09-13T08:24:17.058 INFO:tasks.ceph:check_enable_crimson: False 2023-09-13T08:24:17.058 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-09-13T08:24:17.059 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-09-13T08:24:17.059 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-09-13T08:24:17.075 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-09-13T08:24:17.075+0000 7f8171dec200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-09-13T08:24:17.085 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-09-13T08:24:17.086 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-09-13T08:24:17.143 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-09-13T08:24:17.143+0000 7f8171dec200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-09-13T08:24:17.153 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-09-13T08:24:17.153 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-09-13T08:24:17.219 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-09-13T08:24:17.220 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-09-13T08:24:17.225 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-09-13T08:24:17.225+0000 7f8171dec200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-09-13T08:24:17.250 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-09-13T08:24:17.251 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-09-13T08:24:17.278 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-09-13T08:24:17.279 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-09-13T08:24:17.308 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-09-13T08:24:17.308+0000 7f8171dec200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-09-13T08:24:17.346 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-09-13T08:24:17.346 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-09-13T08:24:17.412 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-09-13T08:24:17.412 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-09-13T08:24:17.450 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-09-13T08:24:17.451+0000 7f8171dec200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-09-13T08:24:17.458 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-09-13T08:24:17.459+0000 7ffa520cb200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-09-13T08:24:17.478 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph --cluster ceph osd new 4a53ec12-1469-4356-b4e1-2b8fc9b7c0f8 0 2023-09-13T08:24:17.527 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-09-13T08:24:17.527+0000 7ffa520cb200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-09-13T08:24:17.609 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-09-13T08:24:17.609+0000 7ffa520cb200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-09-13T08:24:17.641 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.641+0000 7eff930bb700 1 Processor -- start 2023-09-13T08:24:17.642 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.641+0000 7eff930bb700 1 -- start start 2023-09-13T08:24:17.644 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.642+0000 7eff930bb700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7eff8c152320 0x7eff8c0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:17.644 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.642+0000 7eff930bb700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff8c152700 con 0x7eff8c0b3230 2023-09-13T08:24:17.645 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.642+0000 7eff930bb700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff8c15b940 con 0x7eff8c06fc90 2023-09-13T08:24:17.645 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.642+0000 7eff930bb700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff8c15bc20 con 0x7eff8c152320 2023-09-13T08:24:17.645 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.642+0000 7eff90e57700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7eff8c152320 0x7eff8c0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:17.645 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.642+0000 7eff8bfff700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7eff8c06fc90 0x7eff8c0b2b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:45412/0 (socket says 172.21.15.161:45412) 2023-09-13T08:24:17.645 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.642+0000 7eff8bfff700 1 -- 172.21.15.161:0/1487313916 learned_addr learned my addr 172.21.15.161:0/1487313916 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-09-13T08:24:17.646 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.642+0000 7eff8b7fe700 1 -- 172.21.15.161:0/1487313916 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1242579154 0 0) 0x7eff8c15b940 con 0x7eff8c06fc90 2023-09-13T08:24:17.646 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.642+0000 7eff8b7fe700 1 -- 172.21.15.161:0/1487313916 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff7c0035b0 con 0x7eff8c06fc90 2023-09-13T08:24:17.646 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.642+0000 7eff90e57700 1 -- 172.21.15.161:0/1487313916 >> v1:172.21.15.161:6789/0 conn(0x7eff8c06fc90 legacy=0x7eff8c0b2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:17.646 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.642+0000 7eff90e57700 1 -- 172.21.15.161:0/1487313916 >> v1:172.21.15.84:6789/0 conn(0x7eff8c0b3230 legacy=0x7eff8c0d00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:17.647 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.642+0000 7eff90e57700 1 -- 172.21.15.161:0/1487313916 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff8c15bf00 con 0x7eff8c152320 2023-09-13T08:24:17.647 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.642+0000 7eff90e57700 1 --2- 172.21.15.161:0/1487313916 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff8c152320 0x7eff8c0cb6f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7eff80009840 tx=0x7eff80009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f75bd7adffee3229 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:17.647 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.643+0000 7eff8b7fe700 1 -- 172.21.15.161:0/1487313916 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff80011830 con 0x7eff8c152320 2023-09-13T08:24:17.648 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.643+0000 7eff8b7fe700 1 -- 172.21.15.161:0/1487313916 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff80011990 con 0x7eff8c152320 2023-09-13T08:24:17.648 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.643+0000 7eff8b7fe700 1 -- 172.21.15.161:0/1487313916 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff80011d20 con 0x7eff8c152320 2023-09-13T08:24:17.648 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.643+0000 7eff930bb700 1 -- 172.21.15.161:0/1487313916 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff8c152320 msgr2=0x7eff8c0cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:17.648 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.643+0000 7eff930bb700 1 --2- 172.21.15.161:0/1487313916 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff8c152320 0x7eff8c0cb6f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7eff80009840 tx=0x7eff80009b50 comp rx=0 tx=0).stop 2023-09-13T08:24:17.649 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.643+0000 7eff930bb700 1 -- 172.21.15.161:0/1487313916 shutdown_connections 2023-09-13T08:24:17.649 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.643+0000 7eff930bb700 1 --2- 172.21.15.161:0/1487313916 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff8c152320 0x7eff8c0cb6f0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:17.649 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.643+0000 7eff930bb700 1 -- 172.21.15.161:0/1487313916 >> 172.21.15.161:0/1487313916 conn(0x7eff8c0cdb20 msgr2=0x7eff8c0cdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:17.649 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.643+0000 7eff930bb700 1 -- 172.21.15.161:0/1487313916 shutdown_connections 2023-09-13T08:24:17.650 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.643+0000 7eff930bb700 1 -- 172.21.15.161:0/1487313916 wait complete. 2023-09-13T08:24:17.650 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.644+0000 7eff930bb700 1 Processor -- start 2023-09-13T08:24:17.650 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.644+0000 7eff930bb700 1 -- start start 2023-09-13T08:24:17.654 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.645+0000 7eff930bb700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff8c06fc90 0x7eff8c14c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:17.654 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.645+0000 7eff930bb700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7eff8c0b3230 0x7eff8c1528c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:17.654 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.645+0000 7eff930bb700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff8c152320 0x7eff8c0c9880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:17.655 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.645+0000 7eff930bb700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff8c14cbc0 con 0x7eff8c06fc90 2023-09-13T08:24:17.655 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.645+0000 7eff930bb700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff8c153380 con 0x7eff8c152320 2023-09-13T08:24:17.655 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.645+0000 7eff930bb700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff8c153660 con 0x7eff8c0b3230 2023-09-13T08:24:17.656 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.645+0000 7eff8bfff700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7eff8c0b3230 0x7eff8c1528c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:17.656 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.645+0000 7eff91658700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff8c152320 0x7eff8c0c9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:17.656 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.645+0000 7eff91658700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff8c152320 0x7eff8c0c9880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:55550/0 (socket says 172.21.15.161:55550) 2023-09-13T08:24:17.656 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.645+0000 7eff91658700 1 -- 172.21.15.161:0/366585458 learned_addr learned my addr 172.21.15.161:0/366585458 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-09-13T08:24:17.657 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.645+0000 7eff8bfff700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7eff8c0b3230 0x7eff8c1528c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.161:50534/0 (socket says 172.21.15.161:50534) 2023-09-13T08:24:17.657 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.645+0000 7eff90e57700 1 --2- 172.21.15.161:0/366585458 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff8c06fc90 0x7eff8c14c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:17.657 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.646+0000 7eff91658700 1 -- 172.21.15.161:0/366585458 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7eff8c0b3230 msgr2=0x7eff8c1528c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:17.657 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.646+0000 7eff91658700 1 --2- 172.21.15.161:0/366585458 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7eff8c0b3230 0x7eff8c1528c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:17.659 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.646+0000 7eff91658700 1 -- 172.21.15.161:0/366585458 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff8c06fc90 msgr2=0x7eff8c14c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:17.659 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.646+0000 7eff91658700 1 --2- 172.21.15.161:0/366585458 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff8c06fc90 0x7eff8c14c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:17.659 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.646+0000 7eff91658700 1 -- 172.21.15.161:0/366585458 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff800094a0 con 0x7eff8c152320 2023-09-13T08:24:17.660 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.646+0000 7eff91658700 1 --2- 172.21.15.161:0/366585458 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff8c152320 0x7eff8c0c9880 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7eff8400cc50 tx=0x7eff8400cf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:17.660 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.646+0000 7eff897fa700 1 -- 172.21.15.161:0/366585458 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff84003c00 con 0x7eff8c152320 2023-09-13T08:24:17.660 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.646+0000 7eff897fa700 1 -- 172.21.15.161:0/366585458 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff84003d60 con 0x7eff8c152320 2023-09-13T08:24:17.660 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.646+0000 7eff930bb700 1 -- 172.21.15.161:0/366585458 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff8c153940 con 0x7eff8c152320 2023-09-13T08:24:17.661 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.646+0000 7eff897fa700 1 -- 172.21.15.161:0/366585458 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff8400aab0 con 0x7eff8c152320 2023-09-13T08:24:17.662 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.646+0000 7eff930bb700 1 -- 172.21.15.161:0/366585458 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff8c153f00 con 0x7eff8c152320 2023-09-13T08:24:17.662 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.646+0000 7eff897fa700 1 -- 172.21.15.161:0/366585458 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7eff840050d0 con 0x7eff8c152320 2023-09-13T08:24:17.662 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.646+0000 7eff897fa700 1 -- 172.21.15.161:0/366585458 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7eff84012940 con 0x7eff8c152320 2023-09-13T08:24:17.663 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.647+0000 7eff930bb700 1 -- 172.21.15.161:0/366585458 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff8c04e9b0 con 0x7eff8c152320 2023-09-13T08:24:17.663 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.649+0000 7eff897fa700 1 -- 172.21.15.161:0/366585458 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7eff84012b50 con 0x7eff8c152320 2023-09-13T08:24:17.695 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-09-13T08:24:17.696+0000 7ffa520cb200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-09-13T08:24:17.735 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.735+0000 7eff930bb700 1 -- 172.21.15.161:0/366585458 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd new", "uuid": "4a53ec12-1469-4356-b4e1-2b8fc9b7c0f8", "id": 0} v 0) v1 -- 0x7eff8c0b39d0 con 0x7eff8c152320 2023-09-13T08:24:17.740 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.740+0000 7eff897fa700 1 -- 172.21.15.161:0/366585458 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4a53ec12-1469-4356-b4e1-2b8fc9b7c0f8", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7eff84012cf0 con 0x7eff8c152320 2023-09-13T08:24:17.741 INFO:teuthology.orchestra.run.smithi161.stdout:0 2023-09-13T08:24:17.741 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.741+0000 7eff930bb700 1 -- 172.21.15.161:0/366585458 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff8c152320 msgr2=0x7eff8c0c9880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:17.742 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.741+0000 7eff930bb700 1 --2- 172.21.15.161:0/366585458 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff8c152320 0x7eff8c0c9880 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7eff8400cc50 tx=0x7eff8400cf60 comp rx=0 tx=0).stop 2023-09-13T08:24:17.742 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.741+0000 7eff930bb700 1 -- 172.21.15.161:0/366585458 shutdown_connections 2023-09-13T08:24:17.742 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.741+0000 7eff930bb700 1 --2- 172.21.15.161:0/366585458 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff8c152320 0x7eff8c0c9880 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:17.742 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.741+0000 7eff930bb700 1 --2- 172.21.15.161:0/366585458 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff8c06fc90 0x7eff8c14c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:17.743 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.741+0000 7eff930bb700 1 --2- 172.21.15.161:0/366585458 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7eff8c0b3230 0x7eff8c1528c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:17.743 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.741+0000 7eff930bb700 1 -- 172.21.15.161:0/366585458 >> 172.21.15.161:0/366585458 conn(0x7eff8c0cdb20 msgr2=0x7eff8c0c8410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:17.743 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.742+0000 7eff930bb700 1 -- 172.21.15.161:0/366585458 shutdown_connections 2023-09-13T08:24:17.743 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.742+0000 7eff930bb700 1 -- 172.21.15.161:0/366585458 wait complete. 2023-09-13T08:24:17.754 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph --cluster ceph osd new 11e964a0-b80c-4afc-bfbf-e2067969db29 1 2023-09-13T08:24:17.829 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-09-13T08:24:17.829+0000 7f8171dec200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-09-13T08:24:17.845 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-09-13T08:24:17.845+0000 7ffa520cb200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-09-13T08:24:17.917 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.917+0000 7f6ae9d88700 1 Processor -- start 2023-09-13T08:24:17.918 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.917+0000 7f6ae9d88700 1 -- start start 2023-09-13T08:24:17.920 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.918+0000 7f6ae9d88700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6ae4160b70 0x7f6ae406a620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:17.920 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.918+0000 7f6ae9d88700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f6ae4072000 0x7f6ae406ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:17.921 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.918+0000 7f6ae9d88700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ae41610e0 con 0x7f6ae4161e10 2023-09-13T08:24:17.921 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.918+0000 7f6ae9d88700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ae40af300 con 0x7f6ae4072000 2023-09-13T08:24:17.921 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.918+0000 7f6ae9d88700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae4072540 con 0x7f6ae4160b70 2023-09-13T08:24:17.921 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.918+0000 7f6ae3fff700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f6ae4072000 0x7f6ae406ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:17.922 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.918+0000 7f6ae3fff700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f6ae4072000 0x7f6ae406ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:55554/0 (socket says 172.21.15.161:55554) 2023-09-13T08:24:17.922 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.918+0000 7f6ae37fe700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6ae4160b70 0x7f6ae406a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:17.922 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.918+0000 7f6ae3fff700 1 -- 172.21.15.161:0/215198512 learned_addr learned my addr 172.21.15.161:0/215198512 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-09-13T08:24:17.922 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.919+0000 7f6ae3fff700 1 -- 172.21.15.161:0/215198512 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6ae4160b70 msgr2=0x7f6ae406a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:24:17.922 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.919+0000 7f6ae3fff700 1 --2- 172.21.15.161:0/215198512 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6ae4160b70 0x7f6ae406a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:17.923 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.919+0000 7f6ae3fff700 1 -- 172.21.15.161:0/215198512 >> v1:172.21.15.84:6789/0 conn(0x7f6ae4161e10 legacy=0x7f6ae40718f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:17.923 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.919+0000 7f6ae3fff700 1 -- 172.21.15.161:0/215198512 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ae4161330 con 0x7f6ae4072000 2023-09-13T08:24:17.923 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.919+0000 7f6ae3fff700 1 --2- 172.21.15.161:0/215198512 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ae4072000 0x7f6ae406ab60 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6adc009e50 tx=0x7f6adc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97c934bd56289e84 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:17.923 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.919+0000 7f6ae27fc700 1 -- 172.21.15.161:0/215198512 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6adc00e070 con 0x7f6ae4072000 2023-09-13T08:24:17.924 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.919+0000 7f6ae27fc700 1 -- 172.21.15.161:0/215198512 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6adc00b910 con 0x7f6ae4072000 2023-09-13T08:24:17.924 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.919+0000 7f6ae27fc700 1 -- 172.21.15.161:0/215198512 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6adc00bcc0 con 0x7f6ae4072000 2023-09-13T08:24:17.924 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.920+0000 7f6ae9d88700 1 -- 172.21.15.161:0/215198512 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ae4072000 msgr2=0x7f6ae406ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:17.925 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.920+0000 7f6ae9d88700 1 --2- 172.21.15.161:0/215198512 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ae4072000 0x7f6ae406ab60 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6adc009e50 tx=0x7f6adc00b330 comp rx=0 tx=0).stop 2023-09-13T08:24:17.925 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.920+0000 7f6ae9d88700 1 -- 172.21.15.161:0/215198512 shutdown_connections 2023-09-13T08:24:17.926 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.920+0000 7f6ae9d88700 1 --2- 172.21.15.161:0/215198512 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6ae4160b70 0x7f6ae406a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:17.926 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.920+0000 7f6ae9d88700 1 --2- 172.21.15.161:0/215198512 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ae4072000 0x7f6ae406ab60 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:17.926 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.920+0000 7f6ae9d88700 1 -- 172.21.15.161:0/215198512 >> 172.21.15.161:0/215198512 conn(0x7f6ae40ccab0 msgr2=0x7f6ae40ccec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:17.926 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.920+0000 7f6ae9d88700 1 -- 172.21.15.161:0/215198512 shutdown_connections 2023-09-13T08:24:17.927 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.920+0000 7f6ae9d88700 1 -- 172.21.15.161:0/215198512 wait complete. 2023-09-13T08:24:17.930 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.921+0000 7f6ae9d88700 1 Processor -- start 2023-09-13T08:24:17.930 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.921+0000 7f6ae9d88700 1 -- start start 2023-09-13T08:24:17.931 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.922+0000 7f6ae9d88700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ae4072000 0x7f6ae4157ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:17.931 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.922+0000 7f6ae9d88700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6ae4160b70 0x7f6ae41f3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:17.931 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.922+0000 7f6ae9d88700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ae4161e10 0x7f6ae40afa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:17.932 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.922+0000 7f6ae9d88700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae41f2e50 con 0x7f6ae4161e10 2023-09-13T08:24:17.932 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.922+0000 7f6ae9d88700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae40b0cb0 con 0x7f6ae4072000 2023-09-13T08:24:17.932 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.922+0000 7f6ae9d88700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae40b0f90 con 0x7f6ae4160b70 2023-09-13T08:24:17.932 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.922+0000 7f6ae37fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ae4072000 0x7f6ae4157ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:17.932 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.922+0000 7f6ae37fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ae4072000 0x7f6ae4157ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:55556/0 (socket says 172.21.15.161:55556) 2023-09-13T08:24:17.933 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.922+0000 7f6ae37fe700 1 -- 172.21.15.161:0/3139663599 learned_addr learned my addr 172.21.15.161:0/3139663599 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-09-13T08:24:17.933 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.923+0000 7f6ae3fff700 1 --2- 172.21.15.161:0/3139663599 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ae4161e10 0x7f6ae40afa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:17.933 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.923+0000 7f6ae2ffd700 1 --2- 172.21.15.161:0/3139663599 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6ae4160b70 0x7f6ae41f3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:17.933 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.923+0000 7f6ae37fe700 1 -- 172.21.15.161:0/3139663599 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6ae4160b70 msgr2=0x7f6ae41f3610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:17.933 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.923+0000 7f6ae37fe700 1 --2- 172.21.15.161:0/3139663599 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6ae4160b70 0x7f6ae41f3610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:17.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.923+0000 7f6ae37fe700 1 -- 172.21.15.161:0/3139663599 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ae4161e10 msgr2=0x7f6ae40afa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:17.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.923+0000 7f6ae37fe700 1 --2- 172.21.15.161:0/3139663599 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ae4161e10 0x7f6ae40afa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:17.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.923+0000 7f6ae37fe700 1 -- 172.21.15.161:0/3139663599 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6adc009b30 con 0x7f6ae4072000 2023-09-13T08:24:17.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.923+0000 7f6ae37fe700 1 --2- 172.21.15.161:0/3139663599 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ae4072000 0x7f6ae4157ba0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6ad400e9b0 tx=0x7f6ad400ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:17.935 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.923+0000 7f6acbfff700 1 -- 172.21.15.161:0/3139663599 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad4009710 con 0x7f6ae4072000 2023-09-13T08:24:17.935 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.923+0000 7f6acbfff700 1 -- 172.21.15.161:0/3139663599 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ad400ee50 con 0x7f6ae4072000 2023-09-13T08:24:17.935 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.923+0000 7f6acbfff700 1 -- 172.21.15.161:0/3139663599 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad400ca50 con 0x7f6ae4072000 2023-09-13T08:24:17.936 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.923+0000 7f6ae9d88700 1 -- 172.21.15.161:0/3139663599 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ae41f30f0 con 0x7f6ae4072000 2023-09-13T08:24:17.936 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.923+0000 7f6ae9d88700 1 -- 172.21.15.161:0/3139663599 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ae41f3b50 con 0x7f6ae4072000 2023-09-13T08:24:17.936 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.923+0000 7f6acbfff700 1 -- 172.21.15.161:0/3139663599 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6ad4005a20 con 0x7f6ae4072000 2023-09-13T08:24:17.936 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.923+0000 7f6acbfff700 1 -- 172.21.15.161:0/3139663599 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f6ad4013820 con 0x7f6ae4072000 2023-09-13T08:24:17.937 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.924+0000 7f6ae9d88700 1 -- 172.21.15.161:0/3139663599 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ae41f3330 con 0x7f6ae4072000 2023-09-13T08:24:17.937 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:17.926+0000 7f6acbfff700 1 -- 172.21.15.161:0/3139663599 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f6ae41f3330 con 0x7f6ae4072000 2023-09-13T08:24:17.945 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-09-13T08:24:17.945+0000 7f8171dec200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-09-13T08:24:18.011 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.011+0000 7f6ae9d88700 1 -- 172.21.15.161:0/3139663599 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd new", "uuid": "11e964a0-b80c-4afc-bfbf-e2067969db29", "id": 1} v 0) v1 -- 0x7f6ae404e9b0 con 0x7f6ae4072000 2023-09-13T08:24:18.018 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.019+0000 7f6acbfff700 1 -- 172.21.15.161:0/3139663599 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "11e964a0-b80c-4afc-bfbf-e2067969db29", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6ad4021060 con 0x7f6ae4072000 2023-09-13T08:24:18.019 INFO:teuthology.orchestra.run.smithi161.stdout:1 2023-09-13T08:24:18.020 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.020+0000 7f6ae9d88700 1 -- 172.21.15.161:0/3139663599 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ae4072000 msgr2=0x7f6ae4157ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:18.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.020+0000 7f6ae9d88700 1 --2- 172.21.15.161:0/3139663599 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ae4072000 0x7f6ae4157ba0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6ad400e9b0 tx=0x7f6ad400ecc0 comp rx=0 tx=0).stop 2023-09-13T08:24:18.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.020+0000 7f6ae9d88700 1 -- 172.21.15.161:0/3139663599 shutdown_connections 2023-09-13T08:24:18.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.020+0000 7f6ae9d88700 1 --2- 172.21.15.161:0/3139663599 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ae4161e10 0x7f6ae40afa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:18.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.020+0000 7f6ae9d88700 1 --2- 172.21.15.161:0/3139663599 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ae4072000 0x7f6ae4157ba0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:18.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.020+0000 7f6ae9d88700 1 --2- 172.21.15.161:0/3139663599 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6ae4160b70 0x7f6ae41f3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:18.022 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.020+0000 7f6ae9d88700 1 -- 172.21.15.161:0/3139663599 >> 172.21.15.161:0/3139663599 conn(0x7f6ae40ccab0 msgr2=0x7f6ae40ce0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:18.022 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.020+0000 7f6ae9d88700 1 -- 172.21.15.161:0/3139663599 shutdown_connections 2023-09-13T08:24:18.022 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.020+0000 7f6ae9d88700 1 -- 172.21.15.161:0/3139663599 wait complete. 2023-09-13T08:24:18.032 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph --cluster ceph osd new 3ce74529-4dd1-44c7-9576-968f5fdc0c25 2 2023-09-13T08:24:18.048 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-09-13T08:24:18.049+0000 7f8171dec200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-09-13T08:24:18.136 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-09-13T08:24:18.137+0000 7f8171dec200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-09-13T08:24:18.153 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.153+0000 7f0ea27a2700 1 Processor -- start 2023-09-13T08:24:18.153 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.153+0000 7f0ea27a2700 1 -- start start 2023-09-13T08:24:18.155 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.154+0000 7f0ea27a2700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0e9c06ad30 0x7f0e9c160d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:18.156 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.154+0000 7f0ea27a2700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f0e9c1612c0 0x7f0e9c0adb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:18.156 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.154+0000 7f0ea27a2700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e9c071520 con 0x7f0e9c15d170 2023-09-13T08:24:18.156 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.154+0000 7f0ea27a2700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e9c1616d0 con 0x7f0e9c06ad30 2023-09-13T08:24:18.156 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.154+0000 7f0ea27a2700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e9c161960 con 0x7f0e9c1612c0 2023-09-13T08:24:18.156 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.154+0000 7f0ea1fa1700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f0e9c1612c0 0x7f0e9c0adb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:18.157 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.154+0000 7f0ea1fa1700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f0e9c1612c0 0x7f0e9c0adb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:55566/0 (socket says 172.21.15.161:55566) 2023-09-13T08:24:18.157 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.154+0000 7f0ea1fa1700 1 -- 172.21.15.161:0/3842648391 learned_addr learned my addr 172.21.15.161:0/3842648391 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-09-13T08:24:18.157 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.154+0000 7f0ea0f9f700 1 --2- 172.21.15.161:0/3842648391 >> v2:172.21.15.84:3300/0 conn(0x7f0e9c06ad30 0x7f0e9c160d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:18.157 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.154+0000 7f0ea1fa1700 1 -- 172.21.15.161:0/3842648391 >> v2:172.21.15.84:3300/0 conn(0x7f0e9c06ad30 msgr2=0x7f0e9c160d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:24:18.157 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.154+0000 7f0ea1fa1700 1 --2- 172.21.15.161:0/3842648391 >> v2:172.21.15.84:3300/0 conn(0x7f0e9c06ad30 0x7f0e9c160d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:18.158 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.154+0000 7f0ea1fa1700 1 -- 172.21.15.161:0/3842648391 >> v1:172.21.15.84:6789/0 conn(0x7f0e9c15d170 legacy=0x7f0e9c06a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:18.158 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.154+0000 7f0ea1fa1700 1 -- 172.21.15.161:0/3842648391 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e9c0cdaa0 con 0x7f0e9c1612c0 2023-09-13T08:24:18.158 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.154+0000 7f0ea1fa1700 1 --2- 172.21.15.161:0/3842648391 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0e9c1612c0 0x7f0e9c0adb90 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c0cfde0 tx=0x7f0e9400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e06d649cda281e7 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:18.158 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.154+0000 7f0e93fff700 1 -- 172.21.15.161:0/3842648391 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e9400e070 con 0x7f0e9c1612c0 2023-09-13T08:24:18.158 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.155+0000 7f0e93fff700 1 -- 172.21.15.161:0/3842648391 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e9400b910 con 0x7f0e9c1612c0 2023-09-13T08:24:18.159 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.155+0000 7f0e93fff700 1 -- 172.21.15.161:0/3842648391 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e9400bcc0 con 0x7f0e9c1612c0 2023-09-13T08:24:18.159 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.155+0000 7f0ea27a2700 1 -- 172.21.15.161:0/3842648391 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0e9c1612c0 msgr2=0x7f0e9c0adb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:18.159 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.155+0000 7f0ea27a2700 1 --2- 172.21.15.161:0/3842648391 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0e9c1612c0 0x7f0e9c0adb90 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c0cfde0 tx=0x7f0e9400b330 comp rx=0 tx=0).stop 2023-09-13T08:24:18.159 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.155+0000 7f0ea27a2700 1 -- 172.21.15.161:0/3842648391 shutdown_connections 2023-09-13T08:24:18.159 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.155+0000 7f0ea27a2700 1 --2- 172.21.15.161:0/3842648391 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0e9c1612c0 0x7f0e9c0adb90 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:18.160 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.155+0000 7f0ea27a2700 1 --2- 172.21.15.161:0/3842648391 >> v2:172.21.15.84:3300/0 conn(0x7f0e9c06ad30 0x7f0e9c160d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:18.160 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.155+0000 7f0ea27a2700 1 -- 172.21.15.161:0/3842648391 >> 172.21.15.161:0/3842648391 conn(0x7f0e9c0cfe30 msgr2=0x7f0e9c0d0210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:18.160 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.155+0000 7f0ea27a2700 1 -- 172.21.15.161:0/3842648391 shutdown_connections 2023-09-13T08:24:18.160 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.155+0000 7f0ea27a2700 1 -- 172.21.15.161:0/3842648391 wait complete. 2023-09-13T08:24:18.163 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.156+0000 7f0ea27a2700 1 Processor -- start 2023-09-13T08:24:18.163 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.156+0000 7f0ea27a2700 1 -- start start 2023-09-13T08:24:18.163 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.157+0000 7f0ea27a2700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0e9c06ad30 0x7f0e9c1f2e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:18.163 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.157+0000 7f0ea27a2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e9c15d170 0x7f0e9c0c5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:18.163 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.157+0000 7f0ea27a2700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0e9c1612c0 0x7f0e9c156230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:18.164 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.157+0000 7f0ea27a2700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9c0c5c00 con 0x7f0e9c15d170 2023-09-13T08:24:18.164 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.157+0000 7f0ea27a2700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9c0c5ee0 con 0x7f0e9c1612c0 2023-09-13T08:24:18.164 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.157+0000 7f0ea27a2700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9c0c61c0 con 0x7f0e9c06ad30 2023-09-13T08:24:18.164 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.157+0000 7f0ea1fa1700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0e9c1612c0 0x7f0e9c156230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:18.164 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.157+0000 7f0ea1fa1700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0e9c1612c0 0x7f0e9c156230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:55572/0 (socket says 172.21.15.161:55572) 2023-09-13T08:24:18.165 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.157+0000 7f0ea17a0700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0e9c06ad30 0x7f0e9c1f2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:18.165 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.157+0000 7f0ea1fa1700 1 -- 172.21.15.161:0/3055404603 learned_addr learned my addr 172.21.15.161:0/3055404603 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-09-13T08:24:18.165 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.157+0000 7f0ea0f9f700 1 --2- 172.21.15.161:0/3055404603 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e9c15d170 0x7f0e9c0c5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:18.165 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.157+0000 7f0ea17a0700 1 -- 172.21.15.161:0/3055404603 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0e9c1612c0 msgr2=0x7f0e9c156230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:18.165 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.157+0000 7f0ea17a0700 1 --2- 172.21.15.161:0/3055404603 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0e9c1612c0 0x7f0e9c156230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:18.166 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.157+0000 7f0ea17a0700 1 -- 172.21.15.161:0/3055404603 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e9c15d170 msgr2=0x7f0e9c0c5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:18.166 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.158+0000 7f0ea17a0700 1 --2- 172.21.15.161:0/3055404603 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e9c15d170 0x7f0e9c0c5120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:18.166 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.158+0000 7f0ea17a0700 1 -- 172.21.15.161:0/3055404603 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e94009b30 con 0x7f0e9c06ad30 2023-09-13T08:24:18.166 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.158+0000 7f0ea1fa1700 1 --2- 172.21.15.161:0/3055404603 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0e9c1612c0 0x7f0e9c156230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T08:24:18.166 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.158+0000 7f0ea17a0700 1 --2- 172.21.15.161:0/3055404603 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0e9c06ad30 0x7f0e9c1f2e20 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0e98000f60 tx=0x7f0e9800c6e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:18.167 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.158+0000 7f0e91ffb700 1 -- 172.21.15.161:0/3055404603 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e980052d0 con 0x7f0e9c06ad30 2023-09-13T08:24:18.167 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.158+0000 7f0e91ffb700 1 -- 172.21.15.161:0/3055404603 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e98005430 con 0x7f0e9c06ad30 2023-09-13T08:24:18.167 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.158+0000 7f0ea27a2700 1 -- 172.21.15.161:0/3055404603 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e9c0c64a0 con 0x7f0e9c06ad30 2023-09-13T08:24:18.167 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.158+0000 7f0e91ffb700 1 -- 172.21.15.161:0/3055404603 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e980038c0 con 0x7f0e9c06ad30 2023-09-13T08:24:18.167 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.158+0000 7f0e91ffb700 1 -- 172.21.15.161:0/3055404603 <== mon.2 v2:172.21.15.161:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0e98003d20 con 0x7f0e9c06ad30 2023-09-13T08:24:18.168 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.158+0000 7f0ea27a2700 1 -- 172.21.15.161:0/3055404603 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e9c1f3360 con 0x7f0e9c06ad30 2023-09-13T08:24:18.168 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.158+0000 7f0e91ffb700 1 -- 172.21.15.161:0/3055404603 <== mon.2 v2:172.21.15.161:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f0e98012840 con 0x7f0e9c06ad30 2023-09-13T08:24:18.168 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.159+0000 7f0ea27a2700 1 -- 172.21.15.161:0/3055404603 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e9c1f34f0 con 0x7f0e9c06ad30 2023-09-13T08:24:18.168 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.161+0000 7f0e91ffb700 1 -- 172.21.15.161:0/3055404603 <== mon.2 v2:172.21.15.161:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f0e98017070 con 0x7f0e9c06ad30 2023-09-13T08:24:18.244 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.244+0000 7f0ea27a2700 1 -- 172.21.15.161:0/3055404603 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "osd new", "uuid": "3ce74529-4dd1-44c7-9576-968f5fdc0c25", "id": 2} v 0) v1 -- 0x7f0e9c067d60 con 0x7f0e9c06ad30 2023-09-13T08:24:18.252 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.252+0000 7f0e91ffb700 1 -- 172.21.15.161:0/3055404603 <== mon.2 v2:172.21.15.161:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3ce74529-4dd1-44c7-9576-968f5fdc0c25", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0e9c071520 con 0x7f0e9c06ad30 2023-09-13T08:24:18.253 INFO:teuthology.orchestra.run.smithi161.stdout:2 2023-09-13T08:24:18.254 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.253+0000 7f0ea27a2700 1 -- 172.21.15.161:0/3055404603 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0e9c06ad30 msgr2=0x7f0e9c1f2e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:18.254 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.253+0000 7f0ea27a2700 1 --2- 172.21.15.161:0/3055404603 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0e9c06ad30 0x7f0e9c1f2e20 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0e98000f60 tx=0x7f0e9800c6e0 comp rx=0 tx=0).stop 2023-09-13T08:24:18.254 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.253+0000 7f0ea27a2700 1 -- 172.21.15.161:0/3055404603 shutdown_connections 2023-09-13T08:24:18.254 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.253+0000 7f0ea27a2700 1 --2- 172.21.15.161:0/3055404603 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0e9c1612c0 0x7f0e9c156230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:18.254 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.253+0000 7f0ea27a2700 1 --2- 172.21.15.161:0/3055404603 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0e9c06ad30 0x7f0e9c1f2e20 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:18.255 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.253+0000 7f0ea27a2700 1 --2- 172.21.15.161:0/3055404603 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0e9c15d170 0x7f0e9c0c5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:18.255 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.253+0000 7f0ea27a2700 1 -- 172.21.15.161:0/3055404603 >> 172.21.15.161:0/3055404603 conn(0x7f0e9c0cfe30 msgr2=0x7f0e9c0b10e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:18.255 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.253+0000 7f0ea27a2700 1 -- 172.21.15.161:0/3055404603 shutdown_connections 2023-09-13T08:24:18.255 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.253+0000 7f0ea27a2700 1 -- 172.21.15.161:0/3055404603 wait complete. 2023-09-13T08:24:18.265 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph --cluster ceph osd new 460cb5c5-590a-4d06-a4d9-5bac2fdf33b3 3 2023-09-13T08:24:18.266 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-09-13T08:24:18.267+0000 7ffa520cb200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-09-13T08:24:18.388 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.388+0000 7f0c5c816700 1 Processor -- start 2023-09-13T08:24:18.389 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.388+0000 7f0c5c816700 1 -- start start 2023-09-13T08:24:18.391 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.389+0000 7f0c5c816700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c5806a890 0x7f0c58155420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:18.391 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.389+0000 7f0c5c816700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0c580b2250 0x7f0c58155960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:18.391 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.389+0000 7f0c5c816700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c580b2670 con 0x7f0c5806ac70 2023-09-13T08:24:18.392 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.389+0000 7f0c5c816700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c5815ff00 con 0x7f0c580b2250 2023-09-13T08:24:18.392 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.389+0000 7f0c5c816700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c580b28e0 con 0x7f0c5806a890 2023-09-13T08:24:18.392 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.390+0000 7f0c5659c700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c5806a890 0x7f0c58155420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:18.392 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.390+0000 7f0c5659c700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c5806a890 0x7f0c58155420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.161:50560/0 (socket says 172.21.15.161:50560) 2023-09-13T08:24:18.392 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.390+0000 7f0c5659c700 1 -- 172.21.15.161:0/3010793247 learned_addr learned my addr 172.21.15.161:0/3010793247 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-09-13T08:24:18.393 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.390+0000 7f0c56d9d700 1 --2- 172.21.15.161:0/3010793247 >> v2:172.21.15.84:3300/0 conn(0x7f0c580b2250 0x7f0c58155960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:18.393 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.390+0000 7f0c5659c700 1 -- 172.21.15.161:0/3010793247 >> v2:172.21.15.84:3300/0 conn(0x7f0c580b2250 msgr2=0x7f0c58155960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:24:18.393 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.390+0000 7f0c5659c700 1 --2- 172.21.15.161:0/3010793247 >> v2:172.21.15.84:3300/0 conn(0x7f0c580b2250 0x7f0c58155960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:18.393 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.390+0000 7f0c5659c700 1 -- 172.21.15.161:0/3010793247 >> v1:172.21.15.84:6789/0 conn(0x7f0c5806ac70 legacy=0x7f0c580b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:18.394 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.390+0000 7f0c5659c700 1 -- 172.21.15.161:0/3010793247 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c5815ba10 con 0x7f0c5806a890 2023-09-13T08:24:18.395 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.390+0000 7f0c5659c700 1 --2- 172.21.15.161:0/3010793247 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c5806a890 0x7f0c58155420 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0c480098f0 tx=0x7f0c48009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c864c907800722e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:18.395 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.390+0000 7f0c5559a700 1 -- 172.21.15.161:0/3010793247 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c48011830 con 0x7f0c5806a890 2023-09-13T08:24:18.395 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.390+0000 7f0c5559a700 1 -- 172.21.15.161:0/3010793247 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c48011990 con 0x7f0c5806a890 2023-09-13T08:24:18.395 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.390+0000 7f0c5559a700 1 -- 172.21.15.161:0/3010793247 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c48011d20 con 0x7f0c5806a890 2023-09-13T08:24:18.396 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.391+0000 7f0c5c816700 1 -- 172.21.15.161:0/3010793247 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c5806a890 msgr2=0x7f0c58155420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:18.396 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.391+0000 7f0c5c816700 1 --2- 172.21.15.161:0/3010793247 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c5806a890 0x7f0c58155420 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0c480098f0 tx=0x7f0c48009c00 comp rx=0 tx=0).stop 2023-09-13T08:24:18.396 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.391+0000 7f0c5c816700 1 -- 172.21.15.161:0/3010793247 shutdown_connections 2023-09-13T08:24:18.396 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.391+0000 7f0c5c816700 1 --2- 172.21.15.161:0/3010793247 >> v2:172.21.15.84:3300/0 conn(0x7f0c580b2250 0x7f0c58155960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:18.396 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.391+0000 7f0c5c816700 1 --2- 172.21.15.161:0/3010793247 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c5806a890 0x7f0c58155420 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:18.397 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.391+0000 7f0c5c816700 1 -- 172.21.15.161:0/3010793247 >> 172.21.15.161:0/3010793247 conn(0x7f0c580ccab0 msgr2=0x7f0c580ccec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:18.397 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.391+0000 7f0c5c816700 1 -- 172.21.15.161:0/3010793247 shutdown_connections 2023-09-13T08:24:18.397 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.391+0000 7f0c5c816700 1 -- 172.21.15.161:0/3010793247 wait complete. 2023-09-13T08:24:18.398 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-09-13T08:24:18.392+0000 7ffa520cb200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-09-13T08:24:18.400 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.393+0000 7f0c5c816700 1 Processor -- start 2023-09-13T08:24:18.400 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.393+0000 7f0c5c816700 1 -- start start 2023-09-13T08:24:18.401 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.393+0000 7f0c5c816700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0c5806a890 0x7f0c580cb440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:18.401 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.393+0000 7f0c5c816700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c5806ac70 0x7f0c581f61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:18.401 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.394+0000 7f0c5c816700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c580b2250 0x7f0c581f6730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:18.401 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.394+0000 7f0c5c816700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5815e610 con 0x7f0c5806a890 2023-09-13T08:24:18.401 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.394+0000 7f0c5c816700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5815d720 con 0x7f0c5806ac70 2023-09-13T08:24:18.402 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.394+0000 7f0c5c816700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5815da00 con 0x7f0c580b2250 2023-09-13T08:24:18.402 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.394+0000 7f0c56d9d700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c580b2250 0x7f0c581f6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:18.402 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.394+0000 7f0c56d9d700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c580b2250 0x7f0c581f6730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.161:50568/0 (socket says 172.21.15.161:50568) 2023-09-13T08:24:18.403 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.394+0000 7f0c56d9d700 1 -- 172.21.15.161:0/895978884 learned_addr learned my addr 172.21.15.161:0/895978884 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-09-13T08:24:18.403 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.394+0000 7f0c55d9b700 1 --2- 172.21.15.161:0/895978884 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c5806ac70 0x7f0c581f61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:18.403 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.394+0000 7f0c5659c700 1 --2- 172.21.15.161:0/895978884 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0c5806a890 0x7f0c580cb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:18.403 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.394+0000 7f0c56d9d700 1 -- 172.21.15.161:0/895978884 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c5806ac70 msgr2=0x7f0c581f61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:18.404 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.394+0000 7f0c56d9d700 1 --2- 172.21.15.161:0/895978884 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c5806ac70 0x7f0c581f61f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:18.404 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.394+0000 7f0c56d9d700 1 -- 172.21.15.161:0/895978884 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0c5806a890 msgr2=0x7f0c580cb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:18.404 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.394+0000 7f0c56d9d700 1 --2- 172.21.15.161:0/895978884 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0c5806a890 0x7f0c580cb440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:18.404 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.394+0000 7f0c56d9d700 1 -- 172.21.15.161:0/895978884 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c48009550 con 0x7f0c580b2250 2023-09-13T08:24:18.404 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.394+0000 7f0c56d9d700 1 --2- 172.21.15.161:0/895978884 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c580b2250 0x7f0c581f6730 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0c5000efc0 tx=0x7f0c5000c0c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:18.405 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.394+0000 7f0c46ffd700 1 -- 172.21.15.161:0/895978884 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c5000cad0 con 0x7f0c580b2250 2023-09-13T08:24:18.405 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.394+0000 7f0c46ffd700 1 -- 172.21.15.161:0/895978884 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c5000f040 con 0x7f0c580b2250 2023-09-13T08:24:18.405 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.394+0000 7f0c5c816700 1 -- 172.21.15.161:0/895978884 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c5815dce0 con 0x7f0c580b2250 2023-09-13T08:24:18.405 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.394+0000 7f0c46ffd700 1 -- 172.21.15.161:0/895978884 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c5000ce70 con 0x7f0c580b2250 2023-09-13T08:24:18.405 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.394+0000 7f0c5c816700 1 -- 172.21.15.161:0/895978884 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c5815e2a0 con 0x7f0c580b2250 2023-09-13T08:24:18.406 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.394+0000 7f0c46ffd700 1 -- 172.21.15.161:0/895978884 <== mon.2 v2:172.21.15.161:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0c50014780 con 0x7f0c580b2250 2023-09-13T08:24:18.406 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.395+0000 7f0c46ffd700 1 -- 172.21.15.161:0/895978884 <== mon.2 v2:172.21.15.161:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f0c5001dd90 con 0x7f0c580b2250 2023-09-13T08:24:18.409 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.396+0000 7f0c5c816700 1 -- 172.21.15.161:0/895978884 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c5804e9b0 con 0x7f0c580b2250 2023-09-13T08:24:18.409 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.398+0000 7f0c46ffd700 1 -- 172.21.15.161:0/895978884 <== mon.2 v2:172.21.15.161:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f0c5003bb20 con 0x7f0c580b2250 2023-09-13T08:24:18.481 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.482+0000 7f0c5c816700 1 -- 172.21.15.161:0/895978884 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "osd new", "uuid": "460cb5c5-590a-4d06-a4d9-5bac2fdf33b3", "id": 3} v 0) v1 -- 0x7f0c5815bfa0 con 0x7f0c580b2250 2023-09-13T08:24:18.482 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-09-13T08:24:18.483+0000 7ffa520cb200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-09-13T08:24:18.489 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.489+0000 7f0c46ffd700 1 -- 172.21.15.161:0/895978884 <== mon.2 v2:172.21.15.161:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "460cb5c5-590a-4d06-a4d9-5bac2fdf33b3", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0c5002a070 con 0x7f0c580b2250 2023-09-13T08:24:18.489 INFO:teuthology.orchestra.run.smithi161.stdout:3 2023-09-13T08:24:18.490 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.490+0000 7f0c5c816700 1 -- 172.21.15.161:0/895978884 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c580b2250 msgr2=0x7f0c581f6730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:18.491 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.490+0000 7f0c5c816700 1 --2- 172.21.15.161:0/895978884 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c580b2250 0x7f0c581f6730 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0c5000efc0 tx=0x7f0c5000c0c0 comp rx=0 tx=0).stop 2023-09-13T08:24:18.491 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.490+0000 7f0c5c816700 1 -- 172.21.15.161:0/895978884 shutdown_connections 2023-09-13T08:24:18.491 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.490+0000 7f0c5c816700 1 --2- 172.21.15.161:0/895978884 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c580b2250 0x7f0c581f6730 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:18.491 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.490+0000 7f0c5c816700 1 --2- 172.21.15.161:0/895978884 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0c5806a890 0x7f0c580cb440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:18.492 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.490+0000 7f0c5c816700 1 --2- 172.21.15.161:0/895978884 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c5806ac70 0x7f0c581f61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:18.492 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.490+0000 7f0c5c816700 1 -- 172.21.15.161:0/895978884 >> 172.21.15.161:0/895978884 conn(0x7f0c580ccab0 msgr2=0x7f0c580adfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:18.492 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.490+0000 7f0c5c816700 1 -- 172.21.15.161:0/895978884 shutdown_connections 2023-09-13T08:24:18.492 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.490+0000 7f0c5c816700 1 -- 172.21.15.161:0/895978884 wait complete. 2023-09-13T08:24:18.502 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph --cluster ceph osd new bf237dd0-3ebd-44b5-8078-24a63e00d792 4 2023-09-13T08:24:18.569 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-09-13T08:24:18.569+0000 7ffa520cb200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-09-13T08:24:18.584 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-09-13T08:24:18.585+0000 7f8171dec200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-09-13T08:24:18.624 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.624+0000 7fd39f4fd700 1 Processor -- start 2023-09-13T08:24:18.624 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.624+0000 7fd39f4fd700 1 -- start start 2023-09-13T08:24:18.627 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.625+0000 7fd39f4fd700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd39806a890 0x7fd398155420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:18.627 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.625+0000 7fd39f4fd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd39806ac70 0x7fd398155960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:18.627 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.625+0000 7fd39f4fd700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3980b28e0 con 0x7fd3980b1b40 2023-09-13T08:24:18.628 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.625+0000 7fd39f4fd700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd39815ff00 con 0x7fd39806ac70 2023-09-13T08:24:18.628 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.625+0000 7fd39f4fd700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3980b26c0 con 0x7fd39806a890 2023-09-13T08:24:18.628 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.625+0000 7fd39d299700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd39806a890 0x7fd398155420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:18.628 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.625+0000 7fd39da9a700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fd3980b1b40 0x7fd3980b1fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:45458/0 (socket says 172.21.15.161:45458) 2023-09-13T08:24:18.629 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.625+0000 7fd39da9a700 1 -- 172.21.15.161:0/1460253884 learned_addr learned my addr 172.21.15.161:0/1460253884 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-09-13T08:24:18.629 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.625+0000 7fd39ca98700 1 --2- 172.21.15.161:0/1460253884 >> v2:172.21.15.84:3300/0 conn(0x7fd39806ac70 0x7fd398155960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:18.629 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.625+0000 7fd39d299700 1 -- 172.21.15.161:0/1460253884 >> v2:172.21.15.84:3300/0 conn(0x7fd39806ac70 msgr2=0x7fd398155960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:24:18.629 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.625+0000 7fd39d299700 1 --2- 172.21.15.161:0/1460253884 >> v2:172.21.15.84:3300/0 conn(0x7fd39806ac70 0x7fd398155960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:18.629 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.625+0000 7fd39d299700 1 -- 172.21.15.161:0/1460253884 >> v1:172.21.15.161:6789/0 conn(0x7fd3980b1b40 legacy=0x7fd3980b1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:18.630 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.625+0000 7fd38ffff700 1 -- 172.21.15.161:0/1460253884 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2323045364 0 0) 0x7fd3980b28e0 con 0x7fd3980b1b40 2023-09-13T08:24:18.630 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.625+0000 7fd39d299700 1 -- 172.21.15.161:0/1460253884 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd39815ba10 con 0x7fd39806a890 2023-09-13T08:24:18.630 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.626+0000 7fd39d299700 1 --2- 172.21.15.161:0/1460253884 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd39806a890 0x7fd398155420 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd3980b2bb0 tx=0x7fd394009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eaa85f3f7d6cc9b1 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:18.631 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.626+0000 7fd38ffff700 1 -- 172.21.15.161:0/1460253884 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd394011830 con 0x7fd39806a890 2023-09-13T08:24:18.631 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.626+0000 7fd38ffff700 1 -- 172.21.15.161:0/1460253884 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd394011990 con 0x7fd39806a890 2023-09-13T08:24:18.631 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.626+0000 7fd38ffff700 1 -- 172.21.15.161:0/1460253884 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd394011d20 con 0x7fd39806a890 2023-09-13T08:24:18.631 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.626+0000 7fd39f4fd700 1 -- 172.21.15.161:0/1460253884 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd39806a890 msgr2=0x7fd398155420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:18.631 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.626+0000 7fd39f4fd700 1 --2- 172.21.15.161:0/1460253884 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd39806a890 0x7fd398155420 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd3980b2bb0 tx=0x7fd394009b20 comp rx=0 tx=0).stop 2023-09-13T08:24:18.631 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.626+0000 7fd39f4fd700 1 -- 172.21.15.161:0/1460253884 shutdown_connections 2023-09-13T08:24:18.632 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.626+0000 7fd39f4fd700 1 --2- 172.21.15.161:0/1460253884 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd39806a890 0x7fd398155420 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:18.632 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.626+0000 7fd39f4fd700 1 --2- 172.21.15.161:0/1460253884 >> v2:172.21.15.84:3300/0 conn(0x7fd39806ac70 0x7fd398155960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:18.632 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.626+0000 7fd39f4fd700 1 -- 172.21.15.161:0/1460253884 >> 172.21.15.161:0/1460253884 conn(0x7fd3980ccab0 msgr2=0x7fd3980ccec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:18.632 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.626+0000 7fd39f4fd700 1 -- 172.21.15.161:0/1460253884 shutdown_connections 2023-09-13T08:24:18.632 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.627+0000 7fd39f4fd700 1 -- 172.21.15.161:0/1460253884 wait complete. 2023-09-13T08:24:18.635 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.628+0000 7fd39f4fd700 1 Processor -- start 2023-09-13T08:24:18.635 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.628+0000 7fd39f4fd700 1 -- start start 2023-09-13T08:24:18.636 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.628+0000 7fd39f4fd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd39806a890 0x7fd398156490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:18.636 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.628+0000 7fd39f4fd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd39806ac70 0x7fd3980b4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:18.636 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.628+0000 7fd39f4fd700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd3980b1b40 0x7fd398158310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:18.636 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.628+0000 7fd39f4fd700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3980c8b70 con 0x7fd39806ac70 2023-09-13T08:24:18.636 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.628+0000 7fd39f4fd700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3980b5100 con 0x7fd39806a890 2023-09-13T08:24:18.637 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.628+0000 7fd39f4fd700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3980b3e00 con 0x7fd3980b1b40 2023-09-13T08:24:18.637 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.628+0000 7fd39d299700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd39806a890 0x7fd398156490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:18.637 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.629+0000 7fd39d299700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd39806a890 0x7fd398156490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:55590/0 (socket says 172.21.15.161:55590) 2023-09-13T08:24:18.637 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.629+0000 7fd39da9a700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd3980b1b40 0x7fd398158310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:18.637 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.629+0000 7fd39d299700 1 -- 172.21.15.161:0/2565620476 learned_addr learned my addr 172.21.15.161:0/2565620476 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-09-13T08:24:18.638 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.629+0000 7fd39ca98700 1 --2- 172.21.15.161:0/2565620476 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd39806ac70 0x7fd3980b4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:18.638 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.629+0000 7fd39d299700 1 -- 172.21.15.161:0/2565620476 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd3980b1b40 msgr2=0x7fd398158310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:18.638 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.629+0000 7fd39d299700 1 --2- 172.21.15.161:0/2565620476 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd3980b1b40 0x7fd398158310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:18.638 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.629+0000 7fd39d299700 1 -- 172.21.15.161:0/2565620476 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd39806ac70 msgr2=0x7fd3980b4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:18.638 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.629+0000 7fd39d299700 1 --2- 172.21.15.161:0/2565620476 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd39806ac70 0x7fd3980b4bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:18.639 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.629+0000 7fd39d299700 1 -- 172.21.15.161:0/2565620476 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3940094a0 con 0x7fd39806a890 2023-09-13T08:24:18.639 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.629+0000 7fd39d299700 1 --2- 172.21.15.161:0/2565620476 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd39806a890 0x7fd398156490 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd394014040 tx=0x7fd394004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:18.639 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.629+0000 7fd38dffb700 1 -- 172.21.15.161:0/2565620476 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd39401a7e0 con 0x7fd39806a890 2023-09-13T08:24:18.639 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.629+0000 7fd38dffb700 1 -- 172.21.15.161:0/2565620476 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd39401a940 con 0x7fd39806a890 2023-09-13T08:24:18.639 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.629+0000 7fd38dffb700 1 -- 172.21.15.161:0/2565620476 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd39401acd0 con 0x7fd39806a890 2023-09-13T08:24:18.640 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.629+0000 7fd39f4fd700 1 -- 172.21.15.161:0/2565620476 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3980b40e0 con 0x7fd39806a890 2023-09-13T08:24:18.640 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.629+0000 7fd39f4fd700 1 -- 172.21.15.161:0/2565620476 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3980b46a0 con 0x7fd39806a890 2023-09-13T08:24:18.640 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.629+0000 7fd38dffb700 1 -- 172.21.15.161:0/2565620476 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fd394022070 con 0x7fd39806a890 2023-09-13T08:24:18.640 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.630+0000 7fd38dffb700 1 -- 172.21.15.161:0/2565620476 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fd394024930 con 0x7fd39806a890 2023-09-13T08:24:18.640 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.630+0000 7fd39f4fd700 1 -- 172.21.15.161:0/2565620476 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd39806f140 con 0x7fd39806a890 2023-09-13T08:24:18.641 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.634+0000 7fd38dffb700 1 -- 172.21.15.161:0/2565620476 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7fd394029070 con 0x7fd39806a890 2023-09-13T08:24:18.717 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.717+0000 7fd39f4fd700 1 -- 172.21.15.161:0/2565620476 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd new", "uuid": "bf237dd0-3ebd-44b5-8078-24a63e00d792", "id": 4} v 0) v1 -- 0x7fd39815bcc0 con 0x7fd39806a890 2023-09-13T08:24:18.724 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.724+0000 7fd38dffb700 1 -- 172.21.15.161:0/2565620476 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "bf237dd0-3ebd-44b5-8078-24a63e00d792", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd394015020 con 0x7fd39806a890 2023-09-13T08:24:18.725 INFO:teuthology.orchestra.run.smithi161.stdout:4 2023-09-13T08:24:18.726 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.725+0000 7fd39f4fd700 1 -- 172.21.15.161:0/2565620476 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd39806a890 msgr2=0x7fd398156490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:18.726 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.725+0000 7fd39f4fd700 1 --2- 172.21.15.161:0/2565620476 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd39806a890 0x7fd398156490 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd394014040 tx=0x7fd394004750 comp rx=0 tx=0).stop 2023-09-13T08:24:18.726 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.725+0000 7fd39f4fd700 1 -- 172.21.15.161:0/2565620476 shutdown_connections 2023-09-13T08:24:18.726 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.725+0000 7fd39f4fd700 1 --2- 172.21.15.161:0/2565620476 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd3980b1b40 0x7fd398158310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:18.727 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.725+0000 7fd39f4fd700 1 --2- 172.21.15.161:0/2565620476 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd39806a890 0x7fd398156490 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:18.727 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.725+0000 7fd39f4fd700 1 --2- 172.21.15.161:0/2565620476 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd39806ac70 0x7fd3980b4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:18.727 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.725+0000 7fd39f4fd700 1 -- 172.21.15.161:0/2565620476 >> 172.21.15.161:0/2565620476 conn(0x7fd3980ccab0 msgr2=0x7fd3980b1fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:18.727 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.726+0000 7fd39f4fd700 1 -- 172.21.15.161:0/2565620476 shutdown_connections 2023-09-13T08:24:18.727 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.726+0000 7fd39f4fd700 1 -- 172.21.15.161:0/2565620476 wait complete. 2023-09-13T08:24:18.737 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph --cluster ceph osd new e1e538e0-5844-456b-8c6e-434d3a914af1 5 2023-09-13T08:24:18.857 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.857+0000 7f77ea6a7700 1 Processor -- start 2023-09-13T08:24:18.858 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.857+0000 7f77ea6a7700 1 -- start start 2023-09-13T08:24:18.863 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.858+0000 7f77ea6a7700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f77e415d4b0 0x7f77e40b8c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:18.864 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.858+0000 7f77ea6a7700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f77e40ce800 0x7f77e40b6460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:18.864 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.858+0000 7f77ea6a7700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f77e40d32c0 0x7f77e40d3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:18.864 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.858+0000 7f77ea6a7700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77e40d3c50 con 0x7f77e40ce800 2023-09-13T08:24:18.864 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.858+0000 7f77ea6a7700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77e40ce070 con 0x7f77e415d4b0 2023-09-13T08:24:18.865 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.858+0000 7f77ea6a7700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77e40cdab0 con 0x7f77e40d32c0 2023-09-13T08:24:18.865 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.858+0000 7f77e3fff700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f77e415d4b0 0x7f77e40b8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:18.865 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.858+0000 7f77e8c44700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f77e40d32c0 0x7f77e40d3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:18.866 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.858+0000 7f77e3fff700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f77e415d4b0 0x7f77e40b8c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:55596/0 (socket says 172.21.15.161:55596) 2023-09-13T08:24:18.866 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.858+0000 7f77e3fff700 1 -- 172.21.15.161:0/2793127839 learned_addr learned my addr 172.21.15.161:0/2793127839 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-09-13T08:24:18.866 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.858+0000 7f77e37fe700 1 --2- 172.21.15.161:0/2793127839 >> v2:172.21.15.84:3300/0 conn(0x7f77e40ce800 0x7f77e40b6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:18.866 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.858+0000 7f77e3fff700 1 -- 172.21.15.161:0/2793127839 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f77e40d32c0 msgr2=0x7f77e40d3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:24:18.867 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.858+0000 7f77e3fff700 1 --2- 172.21.15.161:0/2793127839 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f77e40d32c0 0x7f77e40d3710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:18.867 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.858+0000 7f77e3fff700 1 -- 172.21.15.161:0/2793127839 >> v2:172.21.15.84:3300/0 conn(0x7f77e40ce800 msgr2=0x7f77e40b6460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:24:18.867 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.858+0000 7f77e3fff700 1 --2- 172.21.15.161:0/2793127839 >> v2:172.21.15.84:3300/0 conn(0x7f77e40ce800 0x7f77e40b6460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:18.867 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.858+0000 7f77e3fff700 1 -- 172.21.15.161:0/2793127839 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77e40cdd90 con 0x7f77e415d4b0 2023-09-13T08:24:18.867 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.858+0000 7f77e8c44700 1 --2- 172.21.15.161:0/2793127839 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f77e40d32c0 0x7f77e40d3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T08:24:18.868 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.858+0000 7f77e37fe700 1 --2- 172.21.15.161:0/2793127839 >> v2:172.21.15.84:3300/0 conn(0x7f77e40ce800 0x7f77e40b6460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T08:24:18.868 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.858+0000 7f77e3fff700 1 --2- 172.21.15.161:0/2793127839 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77e415d4b0 0x7f77e40b8c50 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f77e40d3290 tx=0x7f77d8009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ffef88bd0e3a57f1 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:18.868 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.858+0000 7f77e2ffd700 1 -- 172.21.15.161:0/2793127839 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d8011830 con 0x7f77e415d4b0 2023-09-13T08:24:18.868 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.859+0000 7f77e2ffd700 1 -- 172.21.15.161:0/2793127839 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77d8011990 con 0x7f77e415d4b0 2023-09-13T08:24:18.868 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.859+0000 7f77e2ffd700 1 -- 172.21.15.161:0/2793127839 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d8011d20 con 0x7f77e415d4b0 2023-09-13T08:24:18.869 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.859+0000 7f77ea6a7700 1 -- 172.21.15.161:0/2793127839 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77e415d4b0 msgr2=0x7f77e40b8c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:18.869 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.859+0000 7f77ea6a7700 1 --2- 172.21.15.161:0/2793127839 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77e415d4b0 0x7f77e40b8c50 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f77e40d3290 tx=0x7f77d8009bd0 comp rx=0 tx=0).stop 2023-09-13T08:24:18.869 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.859+0000 7f77ea6a7700 1 -- 172.21.15.161:0/2793127839 shutdown_connections 2023-09-13T08:24:18.869 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.859+0000 7f77ea6a7700 1 --2- 172.21.15.161:0/2793127839 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f77e40d32c0 0x7f77e40d3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:18.869 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.859+0000 7f77ea6a7700 1 --2- 172.21.15.161:0/2793127839 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77e415d4b0 0x7f77e40b8c50 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:18.870 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.859+0000 7f77ea6a7700 1 --2- 172.21.15.161:0/2793127839 >> v2:172.21.15.84:3300/0 conn(0x7f77e40ce800 0x7f77e40b6460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:18.870 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.859+0000 7f77ea6a7700 1 -- 172.21.15.161:0/2793127839 >> 172.21.15.161:0/2793127839 conn(0x7f77e4072170 msgr2=0x7f77e4072580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:18.870 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.859+0000 7f77ea6a7700 1 -- 172.21.15.161:0/2793127839 shutdown_connections 2023-09-13T08:24:18.870 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.859+0000 7f77ea6a7700 1 -- 172.21.15.161:0/2793127839 wait complete. 2023-09-13T08:24:18.870 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.860+0000 7f77ea6a7700 1 Processor -- start 2023-09-13T08:24:18.871 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.861+0000 7f77ea6a7700 1 -- start start 2023-09-13T08:24:18.871 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.861+0000 7f77ea6a7700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77e40ce800 0x7f77e41597a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:18.871 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.861+0000 7f77ea6a7700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f77e40d32c0 0x7f77e41f2de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:18.871 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.861+0000 7f77ea6a7700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77e415d4b0 0x7f77e40aa6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:18.871 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.861+0000 7f77ea6a7700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e40b3860 con 0x7f77e40ce800 2023-09-13T08:24:18.872 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.861+0000 7f77ea6a7700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e4159ce0 con 0x7f77e415d4b0 2023-09-13T08:24:18.872 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.861+0000 7f77ea6a7700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77e40b2f30 con 0x7f77e40d32c0 2023-09-13T08:24:18.872 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.861+0000 7f77e37fe700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f77e40d32c0 0x7f77e41f2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:18.872 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.862+0000 7f77e37fe700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f77e40d32c0 0x7f77e41f2de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.161:50590/0 (socket says 172.21.15.161:50590) 2023-09-13T08:24:18.872 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.862+0000 7f77e37fe700 1 -- 172.21.15.161:0/3851901708 learned_addr learned my addr 172.21.15.161:0/3851901708 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-09-13T08:24:18.873 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.862+0000 7f77e8c44700 1 --2- 172.21.15.161:0/3851901708 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77e415d4b0 0x7f77e40aa6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:18.873 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.862+0000 7f77e3fff700 1 --2- 172.21.15.161:0/3851901708 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77e40ce800 0x7f77e41597a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:18.873 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.862+0000 7f77e37fe700 1 -- 172.21.15.161:0/3851901708 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77e415d4b0 msgr2=0x7f77e40aa6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:18.873 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.862+0000 7f77e37fe700 1 --2- 172.21.15.161:0/3851901708 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77e415d4b0 0x7f77e40aa6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:18.873 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.862+0000 7f77e37fe700 1 -- 172.21.15.161:0/3851901708 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77e40ce800 msgr2=0x7f77e41597a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:18.874 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.862+0000 7f77e37fe700 1 --2- 172.21.15.161:0/3851901708 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77e40ce800 0x7f77e41597a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:18.874 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.862+0000 7f77e37fe700 1 -- 172.21.15.161:0/3851901708 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77dc009a70 con 0x7f77e40d32c0 2023-09-13T08:24:18.874 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.862+0000 7f77e37fe700 1 --2- 172.21.15.161:0/3851901708 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f77e40d32c0 0x7f77e41f2de0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f77d400e810 tx=0x7f77d400eb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:18.874 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.862+0000 7f77e0ff9700 1 -- 172.21.15.161:0/3851901708 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d4013610 con 0x7f77e40d32c0 2023-09-13T08:24:18.874 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.862+0000 7f77e0ff9700 1 -- 172.21.15.161:0/3851901708 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77d4013770 con 0x7f77e40d32c0 2023-09-13T08:24:18.875 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.862+0000 7f77e0ff9700 1 -- 172.21.15.161:0/3851901708 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d4013b20 con 0x7f77e40d32c0 2023-09-13T08:24:18.875 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.862+0000 7f77ea6a7700 1 -- 172.21.15.161:0/3851901708 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77d8009550 con 0x7f77e40d32c0 2023-09-13T08:24:18.875 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.862+0000 7f77ea6a7700 1 -- 172.21.15.161:0/3851901708 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77e40b34f0 con 0x7f77e40d32c0 2023-09-13T08:24:18.875 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.862+0000 7f77e0ff9700 1 -- 172.21.15.161:0/3851901708 <== mon.2 v2:172.21.15.161:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f77d401c450 con 0x7f77e40d32c0 2023-09-13T08:24:18.875 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.862+0000 7f77e0ff9700 1 -- 172.21.15.161:0/3851901708 <== mon.2 v2:172.21.15.161:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f77d40129e0 con 0x7f77e40d32c0 2023-09-13T08:24:18.876 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.863+0000 7f77ea6a7700 1 -- 172.21.15.161:0/3851901708 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77e404e9b0 con 0x7f77e40d32c0 2023-09-13T08:24:18.876 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.865+0000 7f77e0ff9700 1 -- 172.21.15.161:0/3851901708 <== mon.2 v2:172.21.15.161:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f77d4021060 con 0x7f77e40d32c0 2023-09-13T08:24:18.949 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.949+0000 7f77ea6a7700 1 -- 172.21.15.161:0/3851901708 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "osd new", "uuid": "e1e538e0-5844-456b-8c6e-434d3a914af1", "id": 5} v 0) v1 -- 0x7f77e40b76e0 con 0x7f77e40d32c0 2023-09-13T08:24:18.961 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.961+0000 7f77e0ff9700 1 -- 172.21.15.161:0/3851901708 <== mon.2 v2:172.21.15.161:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e1e538e0-5844-456b-8c6e-434d3a914af1", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f77d4017070 con 0x7f77e40d32c0 2023-09-13T08:24:18.962 INFO:teuthology.orchestra.run.smithi161.stdout:5 2023-09-13T08:24:18.963 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.962+0000 7f77ea6a7700 1 -- 172.21.15.161:0/3851901708 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f77e40d32c0 msgr2=0x7f77e41f2de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:18.963 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.962+0000 7f77ea6a7700 1 --2- 172.21.15.161:0/3851901708 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f77e40d32c0 0x7f77e41f2de0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f77d400e810 tx=0x7f77d400eb20 comp rx=0 tx=0).stop 2023-09-13T08:24:18.963 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.962+0000 7f77ea6a7700 1 -- 172.21.15.161:0/3851901708 shutdown_connections 2023-09-13T08:24:18.964 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.962+0000 7f77ea6a7700 1 --2- 172.21.15.161:0/3851901708 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77e415d4b0 0x7f77e40aa6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:18.964 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.962+0000 7f77ea6a7700 1 --2- 172.21.15.161:0/3851901708 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77e40ce800 0x7f77e41597a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:18.964 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.962+0000 7f77ea6a7700 1 --2- 172.21.15.161:0/3851901708 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f77e40d32c0 0x7f77e41f2de0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:18.964 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.962+0000 7f77ea6a7700 1 -- 172.21.15.161:0/3851901708 >> 172.21.15.161:0/3851901708 conn(0x7f77e4072170 msgr2=0x7f77e415fae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:18.964 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.962+0000 7f77ea6a7700 1 -- 172.21.15.161:0/3851901708 shutdown_connections 2023-09-13T08:24:18.965 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:18.962+0000 7f77ea6a7700 1 -- 172.21.15.161:0/3851901708 wait complete. 2023-09-13T08:24:18.974 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph --cluster ceph osd new 5cb1785e-960f-4dd4-b295-9e21b2c3f875 6 2023-09-13T08:24:19.042 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-09-13T08:24:19.042+0000 7ffa520cb200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-09-13T08:24:19.098 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.098+0000 7fb8e21e5700 1 Processor -- start 2023-09-13T08:24:19.099 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.098+0000 7fb8e21e5700 1 -- start start 2023-09-13T08:24:19.102 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.099+0000 7fb8e21e5700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb8dc160b70 0x7fb8dc06a620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:19.102 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.099+0000 7fb8e21e5700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb8dc072000 0x7fb8dc06ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:19.102 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.099+0000 7fb8e21e5700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8dc1610e0 con 0x7fb8dc161e10 2023-09-13T08:24:19.103 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.099+0000 7fb8e21e5700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8dc0af300 con 0x7fb8dc160b70 2023-09-13T08:24:19.103 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.099+0000 7fb8e21e5700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8dc072540 con 0x7fb8dc072000 2023-09-13T08:24:19.103 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.099+0000 7fb8dbfff700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb8dc072000 0x7fb8dc06ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:19.103 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.099+0000 7fb8dbfff700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb8dc072000 0x7fb8dc06ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:55612/0 (socket says 172.21.15.161:55612) 2023-09-13T08:24:19.103 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.099+0000 7fb8dbfff700 1 -- 172.21.15.161:0/1215723204 learned_addr learned my addr 172.21.15.161:0/1215723204 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-09-13T08:24:19.104 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.100+0000 7fb8db7fe700 1 --2- 172.21.15.161:0/1215723204 >> v2:172.21.15.84:3300/0 conn(0x7fb8dc160b70 0x7fb8dc06a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:19.104 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.100+0000 7fb8dbfff700 1 -- 172.21.15.161:0/1215723204 >> v2:172.21.15.84:3300/0 conn(0x7fb8dc160b70 msgr2=0x7fb8dc06a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:24:19.104 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.100+0000 7fb8dbfff700 1 --2- 172.21.15.161:0/1215723204 >> v2:172.21.15.84:3300/0 conn(0x7fb8dc160b70 0x7fb8dc06a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:19.104 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.100+0000 7fb8dbfff700 1 -- 172.21.15.161:0/1215723204 >> v1:172.21.15.84:6789/0 conn(0x7fb8dc161e10 legacy=0x7fb8dc0718f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:19.104 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.100+0000 7fb8dbfff700 1 -- 172.21.15.161:0/1215723204 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8dc161330 con 0x7fb8dc072000 2023-09-13T08:24:19.105 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.100+0000 7fb8dbfff700 1 --2- 172.21.15.161:0/1215723204 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8dc072000 0x7fb8dc06ab60 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb8dc0cca50 tx=0x7fb8d400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54dc3545b6eb95e1 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:19.105 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.100+0000 7fb8da7fc700 1 -- 172.21.15.161:0/1215723204 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d400e070 con 0x7fb8dc072000 2023-09-13T08:24:19.105 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.100+0000 7fb8da7fc700 1 -- 172.21.15.161:0/1215723204 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8d400b910 con 0x7fb8dc072000 2023-09-13T08:24:19.105 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.100+0000 7fb8da7fc700 1 -- 172.21.15.161:0/1215723204 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d400bcc0 con 0x7fb8dc072000 2023-09-13T08:24:19.105 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.101+0000 7fb8e21e5700 1 -- 172.21.15.161:0/1215723204 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8dc072000 msgr2=0x7fb8dc06ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:19.106 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.101+0000 7fb8e21e5700 1 --2- 172.21.15.161:0/1215723204 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8dc072000 0x7fb8dc06ab60 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb8dc0cca50 tx=0x7fb8d400b330 comp rx=0 tx=0).stop 2023-09-13T08:24:19.106 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.101+0000 7fb8e21e5700 1 -- 172.21.15.161:0/1215723204 shutdown_connections 2023-09-13T08:24:19.106 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.101+0000 7fb8e21e5700 1 --2- 172.21.15.161:0/1215723204 >> v2:172.21.15.84:3300/0 conn(0x7fb8dc160b70 0x7fb8dc06a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:19.106 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.101+0000 7fb8e21e5700 1 --2- 172.21.15.161:0/1215723204 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8dc072000 0x7fb8dc06ab60 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:19.106 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.101+0000 7fb8e21e5700 1 -- 172.21.15.161:0/1215723204 >> 172.21.15.161:0/1215723204 conn(0x7fb8dc0ccab0 msgr2=0x7fb8dc0ccec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:19.107 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.101+0000 7fb8e21e5700 1 -- 172.21.15.161:0/1215723204 shutdown_connections 2023-09-13T08:24:19.107 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.101+0000 7fb8e21e5700 1 -- 172.21.15.161:0/1215723204 wait complete. 2023-09-13T08:24:19.107 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.102+0000 7fb8e21e5700 1 Processor -- start 2023-09-13T08:24:19.107 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.102+0000 7fb8e21e5700 1 -- start start 2023-09-13T08:24:19.110 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.103+0000 7fb8e21e5700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8dc072000 0x7fb8dc1f2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:19.111 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.103+0000 7fb8e21e5700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8dc160b70 0x7fb8dc150590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:19.111 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.103+0000 7fb8e21e5700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb8dc161e10 0x7fb8dc15f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:19.111 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.103+0000 7fb8e21e5700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8dc0c7100 con 0x7fb8dc160b70 2023-09-13T08:24:19.111 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.103+0000 7fb8e21e5700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8dc0c7350 con 0x7fb8dc072000 2023-09-13T08:24:19.111 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.103+0000 7fb8e21e5700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8dc0c7630 con 0x7fb8dc161e10 2023-09-13T08:24:19.112 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.103+0000 7fb8db7fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8dc072000 0x7fb8dc1f2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:19.112 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.103+0000 7fb8dbfff700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb8dc161e10 0x7fb8dc15f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:19.112 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.103+0000 7fb8db7fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8dc072000 0x7fb8dc1f2ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:55614/0 (socket says 172.21.15.161:55614) 2023-09-13T08:24:19.112 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.103+0000 7fb8db7fe700 1 -- 172.21.15.161:0/1508274163 learned_addr learned my addr 172.21.15.161:0/1508274163 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-09-13T08:24:19.112 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.103+0000 7fb8daffd700 1 --2- 172.21.15.161:0/1508274163 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8dc160b70 0x7fb8dc150590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:19.113 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.103+0000 7fb8dbfff700 1 -- 172.21.15.161:0/1508274163 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8dc072000 msgr2=0x7fb8dc1f2ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:19.113 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.103+0000 7fb8dbfff700 1 --2- 172.21.15.161:0/1508274163 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8dc072000 0x7fb8dc1f2ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:19.113 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.103+0000 7fb8dbfff700 1 -- 172.21.15.161:0/1508274163 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8dc160b70 msgr2=0x7fb8dc150590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:19.113 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.103+0000 7fb8dbfff700 1 --2- 172.21.15.161:0/1508274163 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8dc160b70 0x7fb8dc150590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:19.113 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.103+0000 7fb8dbfff700 1 -- 172.21.15.161:0/1508274163 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8d4009b30 con 0x7fb8dc161e10 2023-09-13T08:24:19.114 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.103+0000 7fb8db7fe700 1 --2- 172.21.15.161:0/1508274163 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8dc072000 0x7fb8dc1f2ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T08:24:19.114 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.104+0000 7fb8dbfff700 1 --2- 172.21.15.161:0/1508274163 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb8dc161e10 0x7fb8dc15f1b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb8d4015000 tx=0x7fb8d4004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:19.114 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.104+0000 7fb8c3fff700 1 -- 172.21.15.161:0/1508274163 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d4004880 con 0x7fb8dc161e10 2023-09-13T08:24:19.114 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.104+0000 7fb8c3fff700 1 -- 172.21.15.161:0/1508274163 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8d40099b0 con 0x7fb8dc161e10 2023-09-13T08:24:19.114 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.104+0000 7fb8e21e5700 1 -- 172.21.15.161:0/1508274163 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8dc0c7910 con 0x7fb8dc161e10 2023-09-13T08:24:19.115 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.104+0000 7fb8c3fff700 1 -- 172.21.15.161:0/1508274163 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d401c680 con 0x7fb8dc161e10 2023-09-13T08:24:19.115 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.104+0000 7fb8e21e5700 1 -- 172.21.15.161:0/1508274163 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8dc150ad0 con 0x7fb8dc161e10 2023-09-13T08:24:19.115 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.104+0000 7fb8c3fff700 1 -- 172.21.15.161:0/1508274163 <== mon.2 v2:172.21.15.161:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb8d401cae0 con 0x7fb8dc161e10 2023-09-13T08:24:19.115 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.104+0000 7fb8c3fff700 1 -- 172.21.15.161:0/1508274163 <== mon.2 v2:172.21.15.161:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fb8d4025e00 con 0x7fb8dc161e10 2023-09-13T08:24:19.115 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.105+0000 7fb8e21e5700 1 -- 172.21.15.161:0/1508274163 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8dc150c60 con 0x7fb8dc161e10 2023-09-13T08:24:19.116 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.107+0000 7fb8c3fff700 1 -- 172.21.15.161:0/1508274163 <== mon.2 v2:172.21.15.161:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7fb8d4043b20 con 0x7fb8dc161e10 2023-09-13T08:24:19.191 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.191+0000 7fb8e21e5700 1 -- 172.21.15.161:0/1508274163 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "osd new", "uuid": "5cb1785e-960f-4dd4-b295-9e21b2c3f875", "id": 6} v 0) v1 -- 0x7fb8dc0c7490 con 0x7fb8dc161e10 2023-09-13T08:24:19.198 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.198+0000 7fb8c3fff700 1 -- 172.21.15.161:0/1508274163 <== mon.2 v2:172.21.15.161:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5cb1785e-960f-4dd4-b295-9e21b2c3f875", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb8dc0c7490 con 0x7fb8dc161e10 2023-09-13T08:24:19.199 INFO:teuthology.orchestra.run.smithi161.stdout:6 2023-09-13T08:24:19.200 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.199+0000 7fb8e21e5700 1 -- 172.21.15.161:0/1508274163 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb8dc161e10 msgr2=0x7fb8dc15f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:19.200 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.199+0000 7fb8e21e5700 1 --2- 172.21.15.161:0/1508274163 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb8dc161e10 0x7fb8dc15f1b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb8d4015000 tx=0x7fb8d4004ad0 comp rx=0 tx=0).stop 2023-09-13T08:24:19.201 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.199+0000 7fb8e21e5700 1 -- 172.21.15.161:0/1508274163 shutdown_connections 2023-09-13T08:24:19.201 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.199+0000 7fb8e21e5700 1 --2- 172.21.15.161:0/1508274163 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb8dc161e10 0x7fb8dc15f1b0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:19.201 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.199+0000 7fb8e21e5700 1 --2- 172.21.15.161:0/1508274163 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8dc072000 0x7fb8dc1f2ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:19.201 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.199+0000 7fb8e21e5700 1 --2- 172.21.15.161:0/1508274163 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8dc160b70 0x7fb8dc150590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:19.202 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.199+0000 7fb8e21e5700 1 -- 172.21.15.161:0/1508274163 >> 172.21.15.161:0/1508274163 conn(0x7fb8dc0ccab0 msgr2=0x7fb8dc06eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:19.202 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.199+0000 7fb8e21e5700 1 -- 172.21.15.161:0/1508274163 shutdown_connections 2023-09-13T08:24:19.202 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.199+0000 7fb8e21e5700 1 -- 172.21.15.161:0/1508274163 wait complete. 2023-09-13T08:24:19.211 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph --cluster ceph osd new 5acb6619-e933-4b46-b1c2-60af30acb839 7 2023-09-13T08:24:19.219 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-09-13T08:24:19.219+0000 7f8171dec200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-09-13T08:24:19.287 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-09-13T08:24:19.287+0000 7f8171dec200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-09-13T08:24:19.331 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.331+0000 7f2d4ce4e700 1 Processor -- start 2023-09-13T08:24:19.331 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.331+0000 7f2d4ce4e700 1 -- start start 2023-09-13T08:24:19.339 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.332+0000 7f2d4ce4e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2d48160b70 0x7f2d4806a620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:19.339 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.332+0000 7f2d4ce4e700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d481610e0 con 0x7f2d48161e10 2023-09-13T08:24:19.339 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.332+0000 7f2d4ce4e700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d48072540 con 0x7f2d48072000 2023-09-13T08:24:19.340 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.332+0000 7f2d4ce4e700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d480af300 con 0x7f2d48160b70 2023-09-13T08:24:19.340 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.332+0000 7f2d46d9d700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f2d48072000 0x7f2d480ca680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:45494/0 (socket says 172.21.15.161:45494) 2023-09-13T08:24:19.340 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.332+0000 7f2d46d9d700 1 -- 172.21.15.161:0/555544229 learned_addr learned my addr 172.21.15.161:0/555544229 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-09-13T08:24:19.340 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.332+0000 7f2d4659c700 1 --2- 172.21.15.161:0/555544229 >> v2:172.21.15.84:3300/0 conn(0x7f2d48160b70 0x7f2d4806a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:19.341 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.333+0000 7f2d4559a700 1 -- 172.21.15.161:0/555544229 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2393032560 0 0) 0x7f2d48072540 con 0x7f2d48072000 2023-09-13T08:24:19.341 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.333+0000 7f2d4559a700 1 -- 172.21.15.161:0/555544229 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d300035b0 con 0x7f2d48072000 2023-09-13T08:24:19.341 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.333+0000 7f2d4559a700 1 -- 172.21.15.161:0/555544229 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1704056764 0 0) 0x7f2d481610e0 con 0x7f2d48161e10 2023-09-13T08:24:19.341 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.333+0000 7f2d4559a700 1 -- 172.21.15.161:0/555544229 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d48072540 con 0x7f2d48161e10 2023-09-13T08:24:19.342 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.333+0000 7f2d4659c700 1 -- 172.21.15.161:0/555544229 >> v1:172.21.15.161:6789/0 conn(0x7f2d48072000 legacy=0x7f2d480ca680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:19.342 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.333+0000 7f2d4659c700 1 -- 172.21.15.161:0/555544229 >> v1:172.21.15.84:6789/0 conn(0x7f2d48161e10 legacy=0x7f2d480718f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:19.342 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.333+0000 7f2d4659c700 1 -- 172.21.15.161:0/555544229 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d48161330 con 0x7f2d48160b70 2023-09-13T08:24:19.343 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.333+0000 7f2d4659c700 1 --2- 172.21.15.161:0/555544229 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d48160b70 0x7f2d4806a620 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2d38009840 tx=0x7f2d38009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e8ae740e87e835d server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:19.343 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.333+0000 7f2d4559a700 1 -- 172.21.15.161:0/555544229 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d38011830 con 0x7f2d48160b70 2023-09-13T08:24:19.343 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.333+0000 7f2d4559a700 1 -- 172.21.15.161:0/555544229 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d38011990 con 0x7f2d48160b70 2023-09-13T08:24:19.343 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.333+0000 7f2d4559a700 1 -- 172.21.15.161:0/555544229 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d38011d20 con 0x7f2d48160b70 2023-09-13T08:24:19.344 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.334+0000 7f2d4ce4e700 1 -- 172.21.15.161:0/555544229 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d48160b70 msgr2=0x7f2d4806a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:19.344 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.334+0000 7f2d4ce4e700 1 --2- 172.21.15.161:0/555544229 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d48160b70 0x7f2d4806a620 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2d38009840 tx=0x7f2d38009b50 comp rx=0 tx=0).stop 2023-09-13T08:24:19.344 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.334+0000 7f2d4ce4e700 1 -- 172.21.15.161:0/555544229 shutdown_connections 2023-09-13T08:24:19.345 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.334+0000 7f2d4ce4e700 1 --2- 172.21.15.161:0/555544229 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d48160b70 0x7f2d4806a620 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:19.345 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.334+0000 7f2d4ce4e700 1 -- 172.21.15.161:0/555544229 >> 172.21.15.161:0/555544229 conn(0x7f2d480ccab0 msgr2=0x7f2d480ccec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:19.345 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.334+0000 7f2d4ce4e700 1 -- 172.21.15.161:0/555544229 shutdown_connections 2023-09-13T08:24:19.345 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.334+0000 7f2d4ce4e700 1 -- 172.21.15.161:0/555544229 wait complete. 2023-09-13T08:24:19.345 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.335+0000 7f2d4ce4e700 1 Processor -- start 2023-09-13T08:24:19.346 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.335+0000 7f2d4ce4e700 1 -- start start 2023-09-13T08:24:19.346 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.336+0000 7f2d4ce4e700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2d48072000 0x7f2d48157830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:19.347 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.336+0000 7f2d4ce4e700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2d48160b70 0x7f2d481f40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:19.347 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.336+0000 7f2d4ce4e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d48161e10 0x7f2d480b2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:19.347 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.336+0000 7f2d4ce4e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d480b0740 con 0x7f2d48161e10 2023-09-13T08:24:19.347 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.336+0000 7f2d4ce4e700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d480c8110 con 0x7f2d48160b70 2023-09-13T08:24:19.347 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.336+0000 7f2d4ce4e700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d480afb30 con 0x7f2d48072000 2023-09-13T08:24:19.348 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.336+0000 7f2d4659c700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2d48072000 0x7f2d48157830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:19.348 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.336+0000 7f2d45d9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2d48160b70 0x7f2d481f40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:19.348 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.336+0000 7f2d4659c700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2d48072000 0x7f2d48157830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.161:50612/0 (socket says 172.21.15.161:50612) 2023-09-13T08:24:19.348 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.336+0000 7f2d4659c700 1 -- 172.21.15.161:0/1754346254 learned_addr learned my addr 172.21.15.161:0/1754346254 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-09-13T08:24:19.349 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.336+0000 7f2d46d9d700 1 --2- 172.21.15.161:0/1754346254 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d48161e10 0x7f2d480b2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:19.349 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.337+0000 7f2d4659c700 1 -- 172.21.15.161:0/1754346254 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2d48160b70 msgr2=0x7f2d481f40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:19.349 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.337+0000 7f2d4659c700 1 --2- 172.21.15.161:0/1754346254 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2d48160b70 0x7f2d481f40e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:19.349 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.337+0000 7f2d4659c700 1 -- 172.21.15.161:0/1754346254 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d48161e10 msgr2=0x7f2d480b2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:19.350 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.337+0000 7f2d4659c700 1 --2- 172.21.15.161:0/1754346254 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d48161e10 0x7f2d480b2080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:19.350 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.337+0000 7f2d4659c700 1 -- 172.21.15.161:0/1754346254 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d380094a0 con 0x7f2d48072000 2023-09-13T08:24:19.350 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.337+0000 7f2d45d9b700 1 --2- 172.21.15.161:0/1754346254 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2d48160b70 0x7f2d481f40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T08:24:19.351 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.337+0000 7f2d4659c700 1 --2- 172.21.15.161:0/1754346254 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2d48072000 0x7f2d48157830 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2d380090b0 tx=0x7f2d38004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:19.351 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.337+0000 7f2d36ffd700 1 -- 172.21.15.161:0/1754346254 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d3801a6e0 con 0x7f2d48072000 2023-09-13T08:24:19.351 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.337+0000 7f2d36ffd700 1 -- 172.21.15.161:0/1754346254 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d3801a840 con 0x7f2d48072000 2023-09-13T08:24:19.352 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.337+0000 7f2d4ce4e700 1 -- 172.21.15.161:0/1754346254 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d480afe10 con 0x7f2d48072000 2023-09-13T08:24:19.352 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.337+0000 7f2d36ffd700 1 -- 172.21.15.161:0/1754346254 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d3801abb0 con 0x7f2d48072000 2023-09-13T08:24:19.352 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.337+0000 7f2d4ce4e700 1 -- 172.21.15.161:0/1754346254 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d480b03d0 con 0x7f2d48072000 2023-09-13T08:24:19.352 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.337+0000 7f2d36ffd700 1 -- 172.21.15.161:0/1754346254 <== mon.2 v2:172.21.15.161:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f2d38022070 con 0x7f2d48072000 2023-09-13T08:24:19.353 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.337+0000 7f2d36ffd700 1 -- 172.21.15.161:0/1754346254 <== mon.2 v2:172.21.15.161:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f2d3802eda0 con 0x7f2d48072000 2023-09-13T08:24:19.353 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.338+0000 7f2d4ce4e700 1 -- 172.21.15.161:0/1754346254 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d4804e9b0 con 0x7f2d48072000 2023-09-13T08:24:19.354 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.340+0000 7f2d36ffd700 1 -- 172.21.15.161:0/1754346254 <== mon.2 v2:172.21.15.161:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f2d38029070 con 0x7f2d48072000 2023-09-13T08:24:19.423 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.423+0000 7f2d4ce4e700 1 -- 172.21.15.161:0/1754346254 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "osd new", "uuid": "5acb6619-e933-4b46-b1c2-60af30acb839", "id": 7} v 0) v1 -- 0x7f2d480713f0 con 0x7f2d48072000 2023-09-13T08:24:19.431 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.431+0000 7f2d36ffd700 1 -- 172.21.15.161:0/1754346254 <== mon.2 v2:172.21.15.161:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5acb6619-e933-4b46-b1c2-60af30acb839", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2d38015020 con 0x7f2d48072000 2023-09-13T08:24:19.432 INFO:teuthology.orchestra.run.smithi161.stdout:7 2023-09-13T08:24:19.433 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.432+0000 7f2d4ce4e700 1 -- 172.21.15.161:0/1754346254 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2d48072000 msgr2=0x7f2d48157830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:19.433 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.432+0000 7f2d4ce4e700 1 --2- 172.21.15.161:0/1754346254 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2d48072000 0x7f2d48157830 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2d380090b0 tx=0x7f2d38004750 comp rx=0 tx=0).stop 2023-09-13T08:24:19.434 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.432+0000 7f2d4ce4e700 1 -- 172.21.15.161:0/1754346254 shutdown_connections 2023-09-13T08:24:19.434 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.432+0000 7f2d4ce4e700 1 --2- 172.21.15.161:0/1754346254 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d48161e10 0x7f2d480b2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:19.435 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.432+0000 7f2d4ce4e700 1 --2- 172.21.15.161:0/1754346254 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2d48072000 0x7f2d48157830 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:19.435 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.432+0000 7f2d4ce4e700 1 --2- 172.21.15.161:0/1754346254 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2d48160b70 0x7f2d481f40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:19.435 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.432+0000 7f2d4ce4e700 1 -- 172.21.15.161:0/1754346254 >> 172.21.15.161:0/1754346254 conn(0x7f2d480ccab0 msgr2=0x7f2d480ad510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:19.435 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.432+0000 7f2d4ce4e700 1 -- 172.21.15.161:0/1754346254 shutdown_connections 2023-09-13T08:24:19.436 INFO:teuthology.orchestra.run.smithi161.stderr:2023-09-13T08:24:19.432+0000 7f2d4ce4e700 1 -- 172.21.15.161:0/1754346254 wait complete. 2023-09-13T08:24:19.446 INFO:tasks.ceph.osd.0:Restarting daemon 2023-09-13T08:24:19.447 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-09-13T08:24:19.450 INFO:tasks.ceph.osd.0:Started 2023-09-13T08:24:19.450 INFO:tasks.ceph.osd.1:Restarting daemon 2023-09-13T08:24:19.450 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-09-13T08:24:19.452 INFO:tasks.ceph.osd.1:Started 2023-09-13T08:24:19.453 INFO:tasks.ceph.osd.2:Restarting daemon 2023-09-13T08:24:19.453 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-09-13T08:24:19.456 INFO:tasks.ceph.osd.2:Started 2023-09-13T08:24:19.456 INFO:tasks.ceph.osd.3:Restarting daemon 2023-09-13T08:24:19.456 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-09-13T08:24:19.459 INFO:tasks.ceph.osd.3:Started 2023-09-13T08:24:19.459 INFO:tasks.ceph.osd.4:Restarting daemon 2023-09-13T08:24:19.459 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-09-13T08:24:19.464 INFO:tasks.ceph.osd.4:Started 2023-09-13T08:24:19.464 INFO:tasks.ceph.osd.5:Restarting daemon 2023-09-13T08:24:19.465 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-09-13T08:24:19.467 INFO:tasks.ceph.osd.5:Started 2023-09-13T08:24:19.467 INFO:tasks.ceph.osd.6:Restarting daemon 2023-09-13T08:24:19.468 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-09-13T08:24:19.470 INFO:tasks.ceph.osd.6:Started 2023-09-13T08:24:19.470 INFO:tasks.ceph.osd.7:Restarting daemon 2023-09-13T08:24:19.471 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-09-13T08:24:19.474 INFO:tasks.ceph.osd.7:Started 2023-09-13T08:24:19.474 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T08:24:19.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:19.623+0000 7fabbb612700 1 Processor -- start 2023-09-13T08:24:19.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:19.624+0000 7fabbb612700 1 -- start start 2023-09-13T08:24:19.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:19.624+0000 7fabbb612700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fabb4159a50 0x7fabb40b1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:19.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:19.624+0000 7fabbb612700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fabb40cb020 0x7fabb40cb480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:19.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:19.624+0000 7fabbb612700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabb40cb9c0 con 0x7fabb40b1580 2023-09-13T08:24:19.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:19.624+0000 7fabbb612700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabb4159e30 con 0x7fabb40cb020 2023-09-13T08:24:19.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:19.624+0000 7fabbb612700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabb415e090 con 0x7fabb4159a50 2023-09-13T08:24:19.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:19.625+0000 7fabb9baf700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fabb40cb020 0x7fabb40cb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:19.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:19.625+0000 7fabb93ae700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fabb4159a50 0x7fabb40b1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:19.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:19.625+0000 7fabb8bad700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fabb40b1580 0x7fabb415d520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.84:59720/0 (socket says 172.21.15.84:59720) 2023-09-13T08:24:19.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:19.625+0000 7fabb8bad700 1 -- 172.21.15.84:0/725669000 learned_addr learned my addr 172.21.15.84:0/725669000 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:24:19.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:19.625+0000 7fabb93ae700 1 -- 172.21.15.84:0/725669000 >> v2:172.21.15.161:3300/0 conn(0x7fabb40cb020 msgr2=0x7fabb40cb480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:24:19.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:19.625+0000 7fabb93ae700 1 --2- 172.21.15.84:0/725669000 >> v2:172.21.15.161:3300/0 conn(0x7fabb40cb020 0x7fabb40cb480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:19.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:19.625+0000 7fabb93ae700 1 -- 172.21.15.84:0/725669000 >> v1:172.21.15.161:6789/0 conn(0x7fabb40b1580 legacy=0x7fabb415d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:19.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:19.625+0000 7fabb93ae700 1 -- 172.21.15.84:0/725669000 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabb40b0560 con 0x7fabb4159a50 2023-09-13T08:24:19.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:19.625+0000 7fabb9baf700 1 --2- 172.21.15.84:0/725669000 >> v2:172.21.15.161:3300/0 conn(0x7fabb40cb020 0x7fabb40cb480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T08:24:19.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:19.625+0000 7fabb93ae700 1 --2- 172.21.15.84:0/725669000 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fabb4159a50 0x7fabb40b1040 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7faba4009840 tx=0x7faba4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f842767dc5f56b2 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:19.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:19.625+0000 7fababfff700 1 -- 172.21.15.84:0/725669000 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faba4011830 con 0x7fabb4159a50 2023-09-13T08:24:19.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:19.625+0000 7fababfff700 1 -- 172.21.15.84:0/725669000 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faba4011990 con 0x7fabb4159a50 2023-09-13T08:24:19.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:19.625+0000 7fababfff700 1 -- 172.21.15.84:0/725669000 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faba4011d20 con 0x7fabb4159a50 2023-09-13T08:24:19.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:19.626+0000 7fabbb612700 1 -- 172.21.15.84:0/725669000 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fabb4159a50 msgr2=0x7fabb40b1040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:19.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:19.626+0000 7fabbb612700 1 --2- 172.21.15.84:0/725669000 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fabb4159a50 0x7fabb40b1040 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7faba4009840 tx=0x7faba4009b50 comp rx=0 tx=0).stop 2023-09-13T08:24:19.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:19.626+0000 7fabbb612700 1 -- 172.21.15.84:0/725669000 shutdown_connections 2023-09-13T08:24:19.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:19.626+0000 7fabbb612700 1 --2- 172.21.15.84:0/725669000 >> v2:172.21.15.161:3300/0 conn(0x7fabb40cb020 0x7fabb40cb480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:19.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:19.626+0000 7fabbb612700 1 --2- 172.21.15.84:0/725669000 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fabb4159a50 0x7fabb40b1040 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:19.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:19.626+0000 7fabbb612700 1 -- 172.21.15.84:0/725669000 >> 172.21.15.84:0/725669000 conn(0x7fabb40cc230 msgr2=0x7fabb40cc640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:19.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:19.626+0000 7fabbb612700 1 -- 172.21.15.84:0/725669000 shutdown_connections 2023-09-13T08:24:19.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:19.626+0000 7fabbb612700 1 -- 172.21.15.84:0/725669000 wait complete. 2023-09-13T08:24:19.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:19.627+0000 7fabbb612700 1 Processor -- start 2023-09-13T08:24:19.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:19.627+0000 7fabbb612700 1 -- start start 2023-09-13T08:24:19.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:19.628+0000 7fabbb612700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fabb40b1580 0x7fabb40c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:19.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:19.628+0000 7fabbb612700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fabb40cb020 0x7fabb40c32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:19.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:19.628+0000 7fabbb612700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fabb4159a50 0x7fabb414f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:19.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:19.628+0000 7fabbb612700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabb40c7190 con 0x7fabb4159a50 2023-09-13T08:24:19.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:19.628+0000 7fabbb612700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabb414f7c0 con 0x7fabb40cb020 2023-09-13T08:24:19.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:19.628+0000 7fabbb612700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabb40c6880 con 0x7fabb40b1580 2023-09-13T08:24:19.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:19.628+0000 7fabb9baf700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fabb4159a50 0x7fabb414f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:19.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:19.628+0000 7fabb9baf700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fabb4159a50 0x7fabb414f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42680/0 (socket says 172.21.15.84:42680) 2023-09-13T08:24:19.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:19.628+0000 7fabb9baf700 1 -- 172.21.15.84:0/3809466247 learned_addr learned my addr 172.21.15.84:0/3809466247 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:24:19.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:19.628+0000 7fabb93ae700 1 --2- 172.21.15.84:0/3809466247 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fabb40b1580 0x7fabb40c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:19.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:19.628+0000 7fabb8bad700 1 --2- 172.21.15.84:0/3809466247 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fabb40cb020 0x7fabb40c32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:19.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:19.628+0000 7fabb9baf700 1 -- 172.21.15.84:0/3809466247 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fabb40b1580 msgr2=0x7fabb40c75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:19.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:19.628+0000 7fabb9baf700 1 --2- 172.21.15.84:0/3809466247 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fabb40b1580 0x7fabb40c75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:19.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:19.628+0000 7fabb9baf700 1 -- 172.21.15.84:0/3809466247 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fabb40cb020 msgr2=0x7fabb40c32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:19.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:19.628+0000 7fabb9baf700 1 --2- 172.21.15.84:0/3809466247 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fabb40cb020 0x7fabb40c32e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:19.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:19.628+0000 7fabb9baf700 1 -- 172.21.15.84:0/3809466247 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabac00ab80 con 0x7fabb4159a50 2023-09-13T08:24:19.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:19.629+0000 7fabb9baf700 1 --2- 172.21.15.84:0/3809466247 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fabb4159a50 0x7fabb414f280 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fabac009f30 tx=0x7fabac0074d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:19.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:19.629+0000 7faba9ffb700 1 -- 172.21.15.84:0/3809466247 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabac018070 con 0x7fabb4159a50 2023-09-13T08:24:19.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:19.629+0000 7faba9ffb700 1 -- 172.21.15.84:0/3809466247 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabac010040 con 0x7fabb4159a50 2023-09-13T08:24:19.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:19.629+0000 7fabbb612700 1 -- 172.21.15.84:0/3809466247 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faba40094a0 con 0x7fabb4159a50 2023-09-13T08:24:19.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:19.629+0000 7faba9ffb700 1 -- 172.21.15.84:0/3809466247 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabac007e20 con 0x7fabb4159a50 2023-09-13T08:24:19.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:19.629+0000 7faba9ffb700 1 -- 172.21.15.84:0/3809466247 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fabac003d20 con 0x7fabb4159a50 2023-09-13T08:24:19.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:19.629+0000 7fabbb612700 1 -- 172.21.15.84:0/3809466247 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabb40c6ad0 con 0x7fabb4159a50 2023-09-13T08:24:19.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:19.629+0000 7faba9ffb700 1 -- 172.21.15.84:0/3809466247 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fabac003fd0 con 0x7fabb4159a50 2023-09-13T08:24:19.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:19.630+0000 7fabbb612700 1 -- 172.21.15.84:0/3809466247 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabb40c72d0 con 0x7fabb4159a50 2023-09-13T08:24:19.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:19.632+0000 7faba9ffb700 1 -- 172.21.15.84:0/3809466247 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7fabac004520 con 0x7fabb4159a50 2023-09-13T08:24:19.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:19.701+0000 7fabbb612700 1 -- 172.21.15.84:0/3809466247 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fabb404e9b0 con 0x7fabb4159a50 2023-09-13T08:24:19.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:19.701+0000 7faba9ffb700 1 -- 172.21.15.84:0/3809466247 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fabac02c090 con 0x7fabb4159a50 2023-09-13T08:24:19.702 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:24:19.703 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"fsid":"0107440b-b634-42c5-a643-5d31ea826116","created":"2023-09-13T08:24:16.931917+0000","modified":"2023-09-13T08:24:19.425578+0000","last_up_change":"0.000000","last_in_change":"2023-09-13T08:24:19.425578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"4a53ec12-1469-4356-b4e1-2b8fc9b7c0f8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"11e964a0-b80c-4afc-bfbf-e2067969db29","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3ce74529-4dd1-44c7-9576-968f5fdc0c25","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"460cb5c5-590a-4d06-a4d9-5bac2fdf33b3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"bf237dd0-3ebd-44b5-8078-24a63e00d792","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"e1e538e0-5844-456b-8c6e-434d3a914af1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"5cb1785e-960f-4dd4-b295-9e21b2c3f875","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"5acb6619-e933-4b46-b1c2-60af30acb839","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T08:24:19.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:19.702+0000 7fabbb612700 1 -- 172.21.15.84:0/3809466247 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fabb4159a50 msgr2=0x7fabb414f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:19.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:19.702+0000 7fabbb612700 1 --2- 172.21.15.84:0/3809466247 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fabb4159a50 0x7fabb414f280 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fabac009f30 tx=0x7fabac0074d0 comp rx=0 tx=0).stop 2023-09-13T08:24:19.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:19.703+0000 7fabbb612700 1 -- 172.21.15.84:0/3809466247 shutdown_connections 2023-09-13T08:24:19.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:19.703+0000 7fabbb612700 1 --2- 172.21.15.84:0/3809466247 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fabb4159a50 0x7fabb414f280 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:19.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:19.703+0000 7fabbb612700 1 --2- 172.21.15.84:0/3809466247 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fabb40b1580 0x7fabb40c75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:19.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:19.703+0000 7fabbb612700 1 --2- 172.21.15.84:0/3809466247 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fabb40cb020 0x7fabb40c32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:19.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:19.703+0000 7fabbb612700 1 -- 172.21.15.84:0/3809466247 >> 172.21.15.84:0/3809466247 conn(0x7fabb40cc230 msgr2=0x7fabb40cd360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:19.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:19.703+0000 7fabbb612700 1 -- 172.21.15.84:0/3809466247 shutdown_connections 2023-09-13T08:24:19.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:19.703+0000 7fabbb612700 1 -- 172.21.15.84:0/3809466247 wait complete. 2023-09-13T08:24:19.718 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-09-13T08:24:19.719 INFO:tasks.ceph:Waiting for OSDs to come up 2023-09-13T08:24:19.770 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-09-13T08:24:19.770+0000 7ffa520cb200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-09-13T08:24:19.839 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-09-13T08:24:19.840+0000 7ffa520cb200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-09-13T08:24:20.031 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-09-13T08:24:20.031+0000 7f8171dec200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-09-13T08:24:20.084 INFO:tasks.ceph.osd.3.smithi084.stderr:2023-09-13T08:24:20.084+0000 7f243e93e640 -1 Falling back to public interface 2023-09-13T08:24:20.085 INFO:tasks.ceph.osd.2.smithi084.stderr:2023-09-13T08:24:20.085+0000 7f45a543f640 -1 Falling back to public interface 2023-09-13T08:24:20.086 INFO:tasks.ceph.osd.4.smithi161.stderr:2023-09-13T08:24:20.085+0000 7f74bfff9640 -1 Falling back to public interface 2023-09-13T08:24:20.089 INFO:tasks.ceph.osd.0.smithi084.stderr:2023-09-13T08:24:20.089+0000 7f41f52b9640 -1 Falling back to public interface 2023-09-13T08:24:20.094 INFO:tasks.ceph.osd.1.smithi084.stderr:2023-09-13T08:24:20.094+0000 7f778ad4b640 -1 Falling back to public interface 2023-09-13T08:24:20.098 INFO:tasks.ceph.osd.6.smithi161.stderr:2023-09-13T08:24:20.098+0000 7f1a5c755640 -1 Falling back to public interface 2023-09-13T08:24:20.106 INFO:tasks.ceph.osd.5.smithi161.stderr:2023-09-13T08:24:20.106+0000 7ffba7e71640 -1 Falling back to public interface 2023-09-13T08:24:20.107 INFO:tasks.ceph.osd.7.smithi161.stderr:2023-09-13T08:24:20.106+0000 7f01aef65640 -1 Falling back to public interface 2023-09-13T08:24:20.113 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-09-13T08:24:20.113+0000 7f8171dec200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-09-13T08:24:20.253 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-09-13T08:24:20.253+0000 7f8171dec200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-09-13T08:24:20.487 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-09-13T08:24:20.487+0000 7f8171dec200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-09-13T08:24:20.525 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-09-13T08:24:20.537 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-09-13T08:24:20.538+0000 7ffa520cb200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-09-13T08:24:20.614 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-09-13T08:24:20.615+0000 7ffa520cb200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-09-13T08:24:20.640 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:20.640+0000 7f790179f700 1 Processor -- start 2023-09-13T08:24:20.640 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:20.640+0000 7f790179f700 1 -- start start 2023-09-13T08:24:20.642 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:20.641+0000 7f790179f700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f78fc0b7970 0x7f78fc0d31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:20.643 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:20.641+0000 7f790179f700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78fc0d3800 con 0x7f78fc0d0a10 2023-09-13T08:24:20.643 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:20.641+0000 7f790179f700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78fc0d3ae0 con 0x7f78fc15d470 2023-09-13T08:24:20.643 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:20.641+0000 7f790179f700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78fc0d3dc0 con 0x7f78fc0b7970 2023-09-13T08:24:20.643 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:20.641+0000 7f78fa7fc700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f78fc0d0a10 0x7f78fc0d2ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:45330/0 (socket says 172.21.15.84:45330) 2023-09-13T08:24:20.643 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:20.641+0000 7f78fa7fc700 1 -- 172.21.15.84:0/3114564031 learned_addr learned my addr 172.21.15.84:0/3114564031 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:24:20.644 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:20.641+0000 7f78fb7fe700 1 --2- 172.21.15.84:0/3114564031 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f78fc0b7970 0x7f78fc0d31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:20.644 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:20.641+0000 7f78f9ffb700 1 -- 172.21.15.84:0/3114564031 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2185830117 0 0) 0x7f78fc0d3800 con 0x7f78fc0d0a10 2023-09-13T08:24:20.644 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:20.641+0000 7f78f9ffb700 1 -- 172.21.15.84:0/3114564031 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78e40035b0 con 0x7f78fc0d0a10 2023-09-13T08:24:20.644 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:20.641+0000 7f78f9ffb700 1 -- 172.21.15.84:0/3114564031 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 132969583 0 0) 0x7f78fc0d3ae0 con 0x7f78fc15d470 2023-09-13T08:24:20.644 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:20.641+0000 7f78f9ffb700 1 -- 172.21.15.84:0/3114564031 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78fc0d3800 con 0x7f78fc15d470 2023-09-13T08:24:20.645 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:20.641+0000 7f78fb7fe700 1 -- 172.21.15.84:0/3114564031 >> v1:172.21.15.161:6789/0 conn(0x7f78fc15d470 legacy=0x7f78fc0d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:20.645 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:20.641+0000 7f78fb7fe700 1 -- 172.21.15.84:0/3114564031 >> v1:172.21.15.84:6789/0 conn(0x7f78fc0d0a10 legacy=0x7f78fc0d2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:20.645 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:20.641+0000 7f78fb7fe700 1 -- 172.21.15.84:0/3114564031 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78fc0d40a0 con 0x7f78fc0b7970 2023-09-13T08:24:20.645 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:20.642+0000 7f78fb7fe700 1 --2- 172.21.15.84:0/3114564031 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f78fc0b7970 0x7f78fc0d31c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f78f4009dc0 tx=0x7f78f400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=afa788c4816cd7ab server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:20.645 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:20.642+0000 7f78f9ffb700 1 -- 172.21.15.84:0/3114564031 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f400e070 con 0x7f78fc0b7970 2023-09-13T08:24:20.646 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:20.642+0000 7f78f9ffb700 1 -- 172.21.15.84:0/3114564031 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78f400bb20 con 0x7f78fc0b7970 2023-09-13T08:24:20.646 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:20.642+0000 7f78f9ffb700 1 -- 172.21.15.84:0/3114564031 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f4012430 con 0x7f78fc0b7970 2023-09-13T08:24:20.646 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:20.642+0000 7f790179f700 1 -- 172.21.15.84:0/3114564031 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f78fc0b7970 msgr2=0x7f78fc0d31c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:20.646 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:20.642+0000 7f790179f700 1 --2- 172.21.15.84:0/3114564031 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f78fc0b7970 0x7f78fc0d31c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f78f4009dc0 tx=0x7f78f400b330 comp rx=0 tx=0).stop 2023-09-13T08:24:20.646 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:20.642+0000 7f790179f700 1 -- 172.21.15.84:0/3114564031 shutdown_connections 2023-09-13T08:24:20.647 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:20.642+0000 7f790179f700 1 --2- 172.21.15.84:0/3114564031 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f78fc0b7970 0x7f78fc0d31c0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:20.647 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:20.642+0000 7f790179f700 1 -- 172.21.15.84:0/3114564031 >> 172.21.15.84:0/3114564031 conn(0x7f78fc072200 msgr2=0x7f78fc072610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:20.647 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:20.642+0000 7f790179f700 1 -- 172.21.15.84:0/3114564031 shutdown_connections 2023-09-13T08:24:20.647 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:20.642+0000 7f790179f700 1 -- 172.21.15.84:0/3114564031 wait complete. 2023-09-13T08:24:20.650 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:20.645+0000 7f790179f700 1 Processor -- start 2023-09-13T08:24:20.650 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:20.645+0000 7f790179f700 1 -- start start 2023-09-13T08:24:20.650 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:20.646+0000 7f790179f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78fc0b7970 0x7f78fc151b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:20.650 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:20.646+0000 7f790179f700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f78fc0d0a10 0x7f78fc0d1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:20.650 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:20.646+0000 7f790179f700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f78fc15d470 0x7f78fc0d2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:20.651 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:20.646+0000 7f790179f700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78fc152060 con 0x7f78fc0b7970 2023-09-13T08:24:20.651 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:20.646+0000 7f790179f700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78fc0c7a00 con 0x7f78fc15d470 2023-09-13T08:24:20.651 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:20.646+0000 7f790179f700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78fc0c7ca0 con 0x7f78fc0d0a10 2023-09-13T08:24:20.651 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:20.646+0000 7f78faffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78fc0b7970 0x7f78fc151b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:20.651 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:20.646+0000 7f78faffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78fc0b7970 0x7f78fc151b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42688/0 (socket says 172.21.15.84:42688) 2023-09-13T08:24:20.652 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:20.646+0000 7f78faffd700 1 -- 172.21.15.84:0/3451402496 learned_addr learned my addr 172.21.15.84:0/3451402496 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:24:20.652 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:20.646+0000 7f78fa7fc700 1 --2- 172.21.15.84:0/3451402496 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f78fc0d0a10 0x7f78fc0d1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:20.652 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:20.646+0000 7f78fb7fe700 1 --2- 172.21.15.84:0/3451402496 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f78fc15d470 0x7f78fc0d2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:20.652 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:20.647+0000 7f78faffd700 1 -- 172.21.15.84:0/3451402496 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f78fc0d0a10 msgr2=0x7f78fc0d1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:20.653 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:20.647+0000 7f78faffd700 1 --2- 172.21.15.84:0/3451402496 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f78fc0d0a10 0x7f78fc0d1be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:20.653 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:20.647+0000 7f78faffd700 1 -- 172.21.15.84:0/3451402496 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f78fc15d470 msgr2=0x7f78fc0d2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:20.653 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:20.647+0000 7f78faffd700 1 --2- 172.21.15.84:0/3451402496 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f78fc15d470 0x7f78fc0d2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:20.653 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:20.647+0000 7f78faffd700 1 -- 172.21.15.84:0/3451402496 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78f4009a70 con 0x7f78fc0b7970 2023-09-13T08:24:20.653 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:20.647+0000 7f78fa7fc700 1 --2- 172.21.15.84:0/3451402496 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f78fc0d0a10 0x7f78fc0d1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T08:24:20.654 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:20.647+0000 7f78fb7fe700 1 --2- 172.21.15.84:0/3451402496 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f78fc15d470 0x7f78fc0d2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T08:24:20.654 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:20.647+0000 7f78faffd700 1 --2- 172.21.15.84:0/3451402496 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78fc0b7970 0x7f78fc151b20 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f78ec00c500 tx=0x7f78ec00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:20.654 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:20.647+0000 7f78e37fe700 1 -- 172.21.15.84:0/3451402496 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ec0052d0 con 0x7f78fc0b7970 2023-09-13T08:24:20.654 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:20.647+0000 7f790179f700 1 -- 172.21.15.84:0/3451402496 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78fc0c7f80 con 0x7f78fc0b7970 2023-09-13T08:24:20.654 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:20.647+0000 7f78e37fe700 1 -- 172.21.15.84:0/3451402496 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78ec005450 con 0x7f78fc0b7970 2023-09-13T08:24:20.655 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:20.647+0000 7f78e37fe700 1 -- 172.21.15.84:0/3451402496 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ec0038c0 con 0x7f78fc0b7970 2023-09-13T08:24:20.655 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:20.647+0000 7f790179f700 1 -- 172.21.15.84:0/3451402496 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78fc0c8540 con 0x7f78fc0b7970 2023-09-13T08:24:20.655 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:20.647+0000 7f78e37fe700 1 -- 172.21.15.84:0/3451402496 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f78ec003d20 con 0x7f78fc0b7970 2023-09-13T08:24:20.655 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:20.647+0000 7f78e37fe700 1 -- 172.21.15.84:0/3451402496 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f78ec011db0 con 0x7f78fc0b7970 2023-09-13T08:24:20.655 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:20.648+0000 7f790179f700 1 -- 172.21.15.84:0/3451402496 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78fc04e9b0 con 0x7f78fc0b7970 2023-09-13T08:24:20.656 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:20.653+0000 7f78e37fe700 1 -- 172.21.15.84:0/3451402496 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f78ec017070 con 0x7f78fc0b7970 2023-09-13T08:24:20.702 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-09-13T08:24:20.703+0000 7f8171dec200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-09-13T08:24:20.723 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:20.723+0000 7f790179f700 1 -- 172.21.15.84:0/3451402496 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f78fc154750 con 0x7f78fc0b7970 2023-09-13T08:24:20.723 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:20.723+0000 7f78e37fe700 1 -- 172.21.15.84:0/3451402496 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f78ec011590 con 0x7f78fc0b7970 2023-09-13T08:24:20.724 INFO:teuthology.misc.health.smithi084.stdout: 2023-09-13T08:24:20.724 INFO:teuthology.misc.health.smithi084.stdout:{"epoch":10,"fsid":"0107440b-b634-42c5-a643-5d31ea826116","created":"2023-09-13T08:24:16.931917+0000","modified":"2023-09-13T08:24:19.425578+0000","last_up_change":"0.000000","last_in_change":"2023-09-13T08:24:19.425578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"4a53ec12-1469-4356-b4e1-2b8fc9b7c0f8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"11e964a0-b80c-4afc-bfbf-e2067969db29","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3ce74529-4dd1-44c7-9576-968f5fdc0c25","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"460cb5c5-590a-4d06-a4d9-5bac2fdf33b3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"bf237dd0-3ebd-44b5-8078-24a63e00d792","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"e1e538e0-5844-456b-8c6e-434d3a914af1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"5cb1785e-960f-4dd4-b295-9e21b2c3f875","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"5acb6619-e933-4b46-b1c2-60af30acb839","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T08:24:20.725 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:20.724+0000 7f790179f700 1 -- 172.21.15.84:0/3451402496 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78fc0b7970 msgr2=0x7f78fc151b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:20.725 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:20.724+0000 7f790179f700 1 --2- 172.21.15.84:0/3451402496 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78fc0b7970 0x7f78fc151b20 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f78ec00c500 tx=0x7f78ec00c810 comp rx=0 tx=0).stop 2023-09-13T08:24:20.725 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:20.724+0000 7f790179f700 1 -- 172.21.15.84:0/3451402496 shutdown_connections 2023-09-13T08:24:20.726 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:20.724+0000 7f790179f700 1 --2- 172.21.15.84:0/3451402496 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f78fc15d470 0x7f78fc0d2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:20.726 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:20.724+0000 7f790179f700 1 --2- 172.21.15.84:0/3451402496 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78fc0b7970 0x7f78fc151b20 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:20.726 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:20.724+0000 7f790179f700 1 --2- 172.21.15.84:0/3451402496 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f78fc0d0a10 0x7f78fc0d1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:20.726 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:20.724+0000 7f790179f700 1 -- 172.21.15.84:0/3451402496 >> 172.21.15.84:0/3451402496 conn(0x7f78fc072200 msgr2=0x7f78fc152ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:20.726 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:20.724+0000 7f790179f700 1 -- 172.21.15.84:0/3451402496 shutdown_connections 2023-09-13T08:24:20.727 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:20.724+0000 7f790179f700 1 -- 172.21.15.84:0/3451402496 wait complete. 2023-09-13T08:24:20.737 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-09-13T08:24:20.758 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-09-13T08:24:20.760+0000 7ffa520cb200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-09-13T08:24:20.836 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-09-13T08:24:20.836+0000 7f8171dec200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-09-13T08:24:20.995 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-09-13T08:24:20.996+0000 7ffa520cb200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-09-13T08:24:21.054 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-09-13T08:24:21.054+0000 7f8171dec200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-09-13T08:24:21.206 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-09-13T08:24:21.206+0000 7f8171dec200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-09-13T08:24:21.208 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-09-13T08:24:21.209+0000 7ffa520cb200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-09-13T08:24:21.320 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-09-13T08:24:21.320+0000 7f8171dec200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-09-13T08:24:21.342 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-09-13T08:24:21.343+0000 7ffa520cb200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-09-13T08:24:21.563 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-09-13T08:24:21.564+0000 7ffa520cb200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-09-13T08:24:21.639 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-09-13T08:24:21.639+0000 7f8171dec200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-09-13T08:24:21.718 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-09-13T08:24:21.719+0000 7ffa520cb200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-09-13T08:24:21.738 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-09-13T08:24:21.739+0000 7f8171dec200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-09-13T08:24:21.836 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-09-13T08:24:21.837+0000 7ffa520cb200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-09-13T08:24:21.924 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-09-13T08:24:21.925+0000 7f8171dec200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-09-13T08:24:22.162 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-09-13T08:24:22.163+0000 7ffa520cb200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-09-13T08:24:22.261 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-09-13T08:24:22.262+0000 7ffa520cb200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-09-13T08:24:22.450 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-09-13T08:24:22.451+0000 7ffa520cb200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-09-13T08:24:22.518 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-09-13T08:24:22.518+0000 7f8171dec200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-09-13T08:24:23.123 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-09-13T08:24:23.124+0000 7ffa520cb200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-09-13T08:24:23.542 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-09-13T08:24:23.542+0000 7f8129d53700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-09-13T08:24:23.543 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-09-13T08:24:23.543+0000 7f8129d53700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-09-13T08:24:23.604 INFO:tasks.ceph.osd.4.smithi161.stderr:2023-09-13T08:24:23.605+0000 7f74bfff9640 -1 osd.4 0 log_to_monitors true 2023-09-13T08:24:23.622 INFO:tasks.ceph.osd.3.smithi084.stderr:2023-09-13T08:24:23.622+0000 7f243e93e640 -1 osd.3 0 log_to_monitors true 2023-09-13T08:24:23.626 INFO:tasks.ceph.osd.2.smithi084.stderr:2023-09-13T08:24:23.626+0000 7f45a543f640 -1 osd.2 0 log_to_monitors true 2023-09-13T08:24:23.634 INFO:tasks.ceph.osd.0.smithi084.stderr:2023-09-13T08:24:23.634+0000 7f41f52b9640 -1 osd.0 0 log_to_monitors true 2023-09-13T08:24:23.636 INFO:tasks.ceph.osd.1.smithi084.stderr:2023-09-13T08:24:23.637+0000 7f778ad4b640 -1 osd.1 0 log_to_monitors true 2023-09-13T08:24:23.655 INFO:tasks.ceph.osd.7.smithi161.stderr:2023-09-13T08:24:23.656+0000 7f01aef65640 -1 osd.7 0 log_to_monitors true 2023-09-13T08:24:23.680 INFO:tasks.ceph.osd.6.smithi161.stderr:2023-09-13T08:24:23.682+0000 7f1a5c755640 -1 osd.6 0 log_to_monitors true 2023-09-13T08:24:23.703 INFO:tasks.ceph.osd.5.smithi161.stderr:2023-09-13T08:24:23.704+0000 7ffba7e71640 -1 osd.5 0 log_to_monitors true 2023-09-13T08:24:27.415 INFO:tasks.ceph.osd.0.smithi084.stderr:2023-09-13T08:24:27.413+0000 7f41e9671700 -1 osd.0 0 waiting for initial osdmap 2023-09-13T08:24:27.430 INFO:tasks.ceph.osd.0.smithi084.stderr:2023-09-13T08:24:27.431+0000 7f41e124b700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-13T08:24:27.438 INFO:tasks.ceph.osd.7.smithi161.stderr:2023-09-13T08:24:27.438+0000 7f01a331d700 -1 osd.7 0 waiting for initial osdmap 2023-09-13T08:24:27.454 INFO:tasks.ceph.osd.7.smithi161.stderr:2023-09-13T08:24:27.454+0000 7f019aef7700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-13T08:24:27.513 INFO:tasks.ceph.osd.6.smithi161.stderr:2023-09-13T08:24:27.514+0000 7f1a50b0d700 -1 osd.6 0 waiting for initial osdmap 2023-09-13T08:24:27.516 INFO:tasks.ceph.osd.2.smithi084.stderr:2023-09-13T08:24:27.516+0000 7f4599ff8700 -1 osd.2 0 waiting for initial osdmap 2023-09-13T08:24:27.528 INFO:tasks.ceph.osd.2.smithi084.stderr:2023-09-13T08:24:27.529+0000 7f45913d1700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-13T08:24:27.529 INFO:tasks.ceph.osd.6.smithi161.stderr:2023-09-13T08:24:27.529+0000 7f1a486e7700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-13T08:24:27.545 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-09-13T08:24:27.567 INFO:tasks.ceph.osd.5.smithi161.stderr:2023-09-13T08:24:27.566+0000 7ffb9c229700 -1 osd.5 0 waiting for initial osdmap 2023-09-13T08:24:27.581 INFO:tasks.ceph.osd.5.smithi161.stderr:2023-09-13T08:24:27.582+0000 7ffb93e03700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-13T08:24:27.583 INFO:tasks.ceph.osd.3.smithi084.stderr:2023-09-13T08:24:27.583+0000 7f2432cf6700 -1 osd.3 0 waiting for initial osdmap 2023-09-13T08:24:27.592 INFO:tasks.ceph.osd.1.smithi084.stderr:2023-09-13T08:24:27.593+0000 7f777f103700 -1 osd.1 0 waiting for initial osdmap 2023-09-13T08:24:27.599 INFO:tasks.ceph.osd.3.smithi084.stderr:2023-09-13T08:24:27.600+0000 7f242a8d0700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-13T08:24:27.607 INFO:tasks.ceph.osd.1.smithi084.stderr:2023-09-13T08:24:27.608+0000 7f7776cdd700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-13T08:24:27.615 INFO:tasks.ceph.osd.4.smithi161.stderr:2023-09-13T08:24:27.616+0000 7f74b43b1700 -1 osd.4 0 waiting for initial osdmap 2023-09-13T08:24:27.629 INFO:tasks.ceph.osd.4.smithi161.stderr:2023-09-13T08:24:27.629+0000 7f74abf8b700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-13T08:24:27.665 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:27.665+0000 7f127babb700 1 Processor -- start 2023-09-13T08:24:27.666 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:27.666+0000 7f127babb700 1 -- start start 2023-09-13T08:24:27.668 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:27.666+0000 7f127babb700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1274146f60 0x7f127415e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:27.668 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:27.667+0000 7f127babb700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f127406adc0 0x7f127406eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:27.669 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:27.667+0000 7f127babb700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f127415ea10 con 0x7f1274071da0 2023-09-13T08:24:27.669 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:27.667+0000 7f127babb700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1274072360 con 0x7f1274146f60 2023-09-13T08:24:27.669 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:27.667+0000 7f127babb700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12740c9450 con 0x7f127406adc0 2023-09-13T08:24:27.669 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:27.667+0000 7f1279857700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1274146f60 0x7f127415e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:27.670 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:27.667+0000 7f1279056700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f1274071da0 0x7f127406a6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:45440/0 (socket says 172.21.15.84:45440) 2023-09-13T08:24:27.670 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:27.667+0000 7f1279056700 1 -- 172.21.15.84:0/2617764618 learned_addr learned my addr 172.21.15.84:0/2617764618 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:24:27.670 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:27.667+0000 7f127a058700 1 --2- 172.21.15.84:0/2617764618 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f127406adc0 0x7f127406eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:27.670 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:27.667+0000 7f1279857700 1 -- 172.21.15.84:0/2617764618 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f127406adc0 msgr2=0x7f127406eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:24:27.670 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:27.667+0000 7f1279857700 1 --2- 172.21.15.84:0/2617764618 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f127406adc0 0x7f127406eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:27.671 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:27.667+0000 7f1279857700 1 -- 172.21.15.84:0/2617764618 >> v1:172.21.15.84:6789/0 conn(0x7f1274071da0 legacy=0x7f127406a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:27.671 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:27.667+0000 7f1278855700 1 -- 172.21.15.84:0/2617764618 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1640944934 0 0) 0x7f127415ea10 con 0x7f1274071da0 2023-09-13T08:24:27.671 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:27.667+0000 7f1279857700 1 -- 172.21.15.84:0/2617764618 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12740c9730 con 0x7f1274146f60 2023-09-13T08:24:27.671 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:27.667+0000 7f1279857700 1 --2- 172.21.15.84:0/2617764618 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1274146f60 0x7f127415e4d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1264009840 tx=0x7f1264009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36bd3e7e29af8784 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:27.671 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:27.667+0000 7f1278855700 1 -- 172.21.15.84:0/2617764618 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1264011830 con 0x7f1274146f60 2023-09-13T08:24:27.672 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:27.667+0000 7f1278855700 1 -- 172.21.15.84:0/2617764618 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1264011990 con 0x7f1274146f60 2023-09-13T08:24:27.672 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:27.667+0000 7f1278855700 1 -- 172.21.15.84:0/2617764618 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1264011d20 con 0x7f1274146f60 2023-09-13T08:24:27.672 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:27.668+0000 7f127babb700 1 -- 172.21.15.84:0/2617764618 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1274146f60 msgr2=0x7f127415e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:27.672 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:27.668+0000 7f127babb700 1 --2- 172.21.15.84:0/2617764618 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1274146f60 0x7f127415e4d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1264009840 tx=0x7f1264009b50 comp rx=0 tx=0).stop 2023-09-13T08:24:27.672 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:27.668+0000 7f127babb700 1 -- 172.21.15.84:0/2617764618 shutdown_connections 2023-09-13T08:24:27.673 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:27.668+0000 7f127babb700 1 --2- 172.21.15.84:0/2617764618 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f127406adc0 0x7f127406eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:27.673 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:27.668+0000 7f127babb700 1 --2- 172.21.15.84:0/2617764618 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1274146f60 0x7f127415e4d0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:27.673 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:27.668+0000 7f127babb700 1 -- 172.21.15.84:0/2617764618 >> 172.21.15.84:0/2617764618 conn(0x7f12740b1dd0 msgr2=0x7f12740b21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:27.673 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:27.668+0000 7f127babb700 1 -- 172.21.15.84:0/2617764618 shutdown_connections 2023-09-13T08:24:27.673 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:27.668+0000 7f127babb700 1 -- 172.21.15.84:0/2617764618 wait complete. 2023-09-13T08:24:27.676 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:27.669+0000 7f127babb700 1 Processor -- start 2023-09-13T08:24:27.676 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:27.669+0000 7f127babb700 1 -- start start 2023-09-13T08:24:27.676 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:27.670+0000 7f127babb700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f127406adc0 0x7f12740b0f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:27.676 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:27.670+0000 7f127babb700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1274071da0 0x7f127415c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:27.677 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:27.670+0000 7f127babb700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1274146f60 0x7f127415ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:27.677 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:27.670+0000 7f127babb700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f127415d340 con 0x7f1274071da0 2023-09-13T08:24:27.677 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:27.670+0000 7f127babb700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12741447e0 con 0x7f127406adc0 2023-09-13T08:24:27.677 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:27.670+0000 7f127babb700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f127413f5a0 con 0x7f1274146f60 2023-09-13T08:24:27.677 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:27.670+0000 7f1279056700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1274071da0 0x7f127415c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:27.678 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:27.670+0000 7f1279056700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1274071da0 0x7f127415c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42800/0 (socket says 172.21.15.84:42800) 2023-09-13T08:24:27.678 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:27.670+0000 7f1279056700 1 -- 172.21.15.84:0/650665078 learned_addr learned my addr 172.21.15.84:0/650665078 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:24:27.678 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:27.670+0000 7f1279857700 1 --2- 172.21.15.84:0/650665078 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f127406adc0 0x7f12740b0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:27.678 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:27.670+0000 7f127a058700 1 --2- 172.21.15.84:0/650665078 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1274146f60 0x7f127415ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:27.678 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:27.670+0000 7f1279056700 1 -- 172.21.15.84:0/650665078 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1274146f60 msgr2=0x7f127415ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:27.679 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:27.670+0000 7f1279056700 1 --2- 172.21.15.84:0/650665078 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1274146f60 0x7f127415ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:27.679 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:27.670+0000 7f1279056700 1 -- 172.21.15.84:0/650665078 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f127406adc0 msgr2=0x7f12740b0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:27.679 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:27.670+0000 7f1279056700 1 --2- 172.21.15.84:0/650665078 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f127406adc0 0x7f12740b0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:27.679 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:27.670+0000 7f1279056700 1 -- 172.21.15.84:0/650665078 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12640094a0 con 0x7f1274071da0 2023-09-13T08:24:27.679 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:27.670+0000 7f1279056700 1 --2- 172.21.15.84:0/650665078 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1274071da0 0x7f127415c8c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f127000c750 tx=0x7f127000ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:27.680 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:27.670+0000 7f126a7fc700 1 -- 172.21.15.84:0/650665078 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1270004c80 con 0x7f1274071da0 2023-09-13T08:24:27.680 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:27.670+0000 7f126a7fc700 1 -- 172.21.15.84:0/650665078 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1270004e00 con 0x7f1274071da0 2023-09-13T08:24:27.680 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:27.670+0000 7f127babb700 1 -- 172.21.15.84:0/650665078 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f127413f880 con 0x7f1274071da0 2023-09-13T08:24:27.680 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:27.670+0000 7f126a7fc700 1 -- 172.21.15.84:0/650665078 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1270007310 con 0x7f1274071da0 2023-09-13T08:24:27.680 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:27.671+0000 7f127babb700 1 -- 172.21.15.84:0/650665078 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f127413fe40 con 0x7f1274071da0 2023-09-13T08:24:27.681 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:27.672+0000 7f127babb700 1 -- 172.21.15.84:0/650665078 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f127404e9b0 con 0x7f1274071da0 2023-09-13T08:24:27.681 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:27.672+0000 7f126a7fc700 1 -- 172.21.15.84:0/650665078 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 88677+0+0 (secure 0 0 0) 0x7f1270007470 con 0x7f1274071da0 2023-09-13T08:24:27.681 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:27.672+0000 7f126a7fc700 1 --2- 172.21.15.84:0/650665078 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f125806a4f0 0x7f125806c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:27.681 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:27.672+0000 7f1279857700 1 --2- 172.21.15.84:0/650665078 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f125806a4f0 0x7f125806c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:27.681 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:27.672+0000 7f126a7fc700 1 -- 172.21.15.84:0/650665078 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f12700877b0 con 0x7f1274071da0 2023-09-13T08:24:27.682 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:27.673+0000 7f1279857700 1 --2- 172.21.15.84:0/650665078 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f125806a4f0 0x7f125806c9b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f12640090b0 tx=0x7f126401c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:27.682 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:27.677+0000 7f126a7fc700 1 -- 172.21.15.84:0/650665078 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f1270053b90 con 0x7f1274071da0 2023-09-13T08:24:27.869 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:27.869+0000 7f127babb700 1 -- 172.21.15.84:0/650665078 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f12740af740 con 0x7f1274071da0 2023-09-13T08:24:27.870 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:27.870+0000 7f126a7fc700 1 -- 172.21.15.84:0/650665078 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f12700571b0 con 0x7f1274071da0 2023-09-13T08:24:27.870 INFO:teuthology.misc.health.smithi084.stdout: 2023-09-13T08:24:27.870 INFO:teuthology.misc.health.smithi084.stdout:{"epoch":12,"fsid":"0107440b-b634-42c5-a643-5d31ea826116","created":"2023-09-13T08:24:16.931917+0000","modified":"2023-09-13T08:24:25.539065+0000","last_up_change":"0.000000","last_in_change":"2023-09-13T08:24:19.425578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"4a53ec12-1469-4356-b4e1-2b8fc9b7c0f8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"11e964a0-b80c-4afc-bfbf-e2067969db29","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3ce74529-4dd1-44c7-9576-968f5fdc0c25","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"460cb5c5-590a-4d06-a4d9-5bac2fdf33b3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"bf237dd0-3ebd-44b5-8078-24a63e00d792","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"e1e538e0-5844-456b-8c6e-434d3a914af1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"5cb1785e-960f-4dd4-b295-9e21b2c3f875","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"5acb6619-e933-4b46-b1c2-60af30acb839","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T08:24:27.873 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:27.872+0000 7f127babb700 1 -- 172.21.15.84:0/650665078 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f125806a4f0 msgr2=0x7f125806c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:27.873 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:27.872+0000 7f127babb700 1 --2- 172.21.15.84:0/650665078 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f125806a4f0 0x7f125806c9b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f12640090b0 tx=0x7f126401c040 comp rx=0 tx=0).stop 2023-09-13T08:24:27.874 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:27.872+0000 7f127babb700 1 -- 172.21.15.84:0/650665078 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1274071da0 msgr2=0x7f127415c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:27.874 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:27.872+0000 7f127babb700 1 --2- 172.21.15.84:0/650665078 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1274071da0 0x7f127415c8c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f127000c750 tx=0x7f127000ca60 comp rx=0 tx=0).stop 2023-09-13T08:24:27.875 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:27.872+0000 7f127babb700 1 -- 172.21.15.84:0/650665078 shutdown_connections 2023-09-13T08:24:27.875 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:27.872+0000 7f127babb700 1 --2- 172.21.15.84:0/650665078 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1274146f60 0x7f127415ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:27.875 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:27.872+0000 7f127babb700 1 --2- 172.21.15.84:0/650665078 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f125806a4f0 0x7f125806c9b0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:27.876 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:27.872+0000 7f127babb700 1 --2- 172.21.15.84:0/650665078 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f127406adc0 0x7f12740b0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:27.876 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:27.872+0000 7f127babb700 1 --2- 172.21.15.84:0/650665078 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1274071da0 0x7f127415c8c0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:27.877 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:27.872+0000 7f127babb700 1 -- 172.21.15.84:0/650665078 >> 172.21.15.84:0/650665078 conn(0x7f12740b1dd0 msgr2=0x7f1274141f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:27.877 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:27.872+0000 7f127babb700 1 -- 172.21.15.84:0/650665078 shutdown_connections 2023-09-13T08:24:27.877 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:27.872+0000 7f127babb700 1 -- 172.21.15.84:0/650665078 wait complete. 2023-09-13T08:24:27.883 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-09-13T08:24:34.690 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-09-13T08:24:34.813 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:34.813+0000 7f9c2c587700 1 Processor -- start 2023-09-13T08:24:34.813 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:34.813+0000 7f9c2c587700 1 -- start start 2023-09-13T08:24:34.816 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:34.814+0000 7f9c2c587700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9c24143e10 0x7f9c2415a810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:34.816 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:34.814+0000 7f9c2c587700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9c24071440 0x7f9c2406eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:34.816 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:34.814+0000 7f9c2c587700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9c2406eff0 0x7f9c2415de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:34.816 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:34.814+0000 7f9c2c587700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c2406f460 con 0x7f9c2406eff0 2023-09-13T08:24:34.817 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:34.814+0000 7f9c2c587700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c24071c90 con 0x7f9c24143e10 2023-09-13T08:24:34.817 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:34.814+0000 7f9c2c587700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c24071f70 con 0x7f9c24071440 2023-09-13T08:24:34.817 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:34.814+0000 7f9c2ab24700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9c2406eff0 0x7f9c2415de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:34.817 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:34.814+0000 7f9c2ab24700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9c2406eff0 0x7f9c2415de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43028/0 (socket says 172.21.15.84:43028) 2023-09-13T08:24:34.817 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:34.814+0000 7f9c2ab24700 1 -- 172.21.15.84:0/1226054174 learned_addr learned my addr 172.21.15.84:0/1226054174 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:24:34.818 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:34.814+0000 7f9c2a323700 1 --2- 172.21.15.84:0/1226054174 >> v2:172.21.15.161:3300/0 conn(0x7f9c24143e10 0x7f9c2415a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:34.818 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:34.814+0000 7f9c29b22700 1 --2- 172.21.15.84:0/1226054174 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9c24071440 0x7f9c2406eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:34.818 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:34.814+0000 7f9c2ab24700 1 -- 172.21.15.84:0/1226054174 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9c24071440 msgr2=0x7f9c2406eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:24:34.818 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:34.814+0000 7f9c2ab24700 1 --2- 172.21.15.84:0/1226054174 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9c24071440 0x7f9c2406eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:34.818 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:34.814+0000 7f9c2ab24700 1 -- 172.21.15.84:0/1226054174 >> v2:172.21.15.161:3300/0 conn(0x7f9c24143e10 msgr2=0x7f9c2415a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:24:34.819 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:34.814+0000 7f9c2ab24700 1 --2- 172.21.15.84:0/1226054174 >> v2:172.21.15.161:3300/0 conn(0x7f9c24143e10 0x7f9c2415a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:34.819 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:34.814+0000 7f9c2ab24700 1 -- 172.21.15.84:0/1226054174 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c24072250 con 0x7f9c2406eff0 2023-09-13T08:24:34.819 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:34.814+0000 7f9c2a323700 1 --2- 172.21.15.84:0/1226054174 >> v2:172.21.15.161:3300/0 conn(0x7f9c24143e10 0x7f9c2415a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T08:24:34.819 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:34.814+0000 7f9c2ab24700 1 --2- 172.21.15.84:0/1226054174 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c2406eff0 0x7f9c2415de00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9c24079a10 tx=0x7f9c1c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6515d847e5fecb19 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:34.819 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:34.815+0000 7f9c29321700 1 -- 172.21.15.84:0/1226054174 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c1c00e070 con 0x7f9c2406eff0 2023-09-13T08:24:34.820 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:34.815+0000 7f9c29321700 1 -- 172.21.15.84:0/1226054174 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c1c00b9c0 con 0x7f9c2406eff0 2023-09-13T08:24:34.820 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:34.815+0000 7f9c29321700 1 -- 172.21.15.84:0/1226054174 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c1c00bd70 con 0x7f9c2406eff0 2023-09-13T08:24:34.820 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:34.815+0000 7f9c2c587700 1 -- 172.21.15.84:0/1226054174 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c2406eff0 msgr2=0x7f9c2415de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:34.820 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:34.815+0000 7f9c2c587700 1 --2- 172.21.15.84:0/1226054174 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c2406eff0 0x7f9c2415de00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9c24079a10 tx=0x7f9c1c00b330 comp rx=0 tx=0).stop 2023-09-13T08:24:34.820 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:34.815+0000 7f9c2c587700 1 -- 172.21.15.84:0/1226054174 shutdown_connections 2023-09-13T08:24:34.820 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:34.815+0000 7f9c2c587700 1 --2- 172.21.15.84:0/1226054174 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c2406eff0 0x7f9c2415de00 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:34.821 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:34.815+0000 7f9c2c587700 1 --2- 172.21.15.84:0/1226054174 >> v2:172.21.15.161:3300/0 conn(0x7f9c24143e10 0x7f9c2415a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:34.821 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:34.815+0000 7f9c2c587700 1 --2- 172.21.15.84:0/1226054174 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9c24071440 0x7f9c2406eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:34.821 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:34.815+0000 7f9c2c587700 1 -- 172.21.15.84:0/1226054174 >> 172.21.15.84:0/1226054174 conn(0x7f9c240b1dd0 msgr2=0x7f9c240b21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:34.821 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:34.815+0000 7f9c2c587700 1 -- 172.21.15.84:0/1226054174 shutdown_connections 2023-09-13T08:24:34.822 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:34.815+0000 7f9c2c587700 1 -- 172.21.15.84:0/1226054174 wait complete. 2023-09-13T08:24:34.826 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:34.816+0000 7f9c2c587700 1 Processor -- start 2023-09-13T08:24:34.826 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:34.817+0000 7f9c2c587700 1 -- start start 2023-09-13T08:24:34.826 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:34.817+0000 7f9c2c587700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9c2406eff0 0x7f9c240c5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:34.826 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:34.817+0000 7f9c2c587700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c24071440 0x7f9c241f4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:34.826 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:34.817+0000 7f9c2c587700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9c24143e10 0x7f9c2415de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:34.827 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:34.817+0000 7f9c2c587700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c241f5000 con 0x7f9c24071440 2023-09-13T08:24:34.827 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:34.817+0000 7f9c2c587700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c240c56c0 con 0x7f9c2406eff0 2023-09-13T08:24:34.827 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:34.817+0000 7f9c2c587700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c2414dac0 con 0x7f9c24143e10 2023-09-13T08:24:34.827 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:34.817+0000 7f9c29b22700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c24071440 0x7f9c241f4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:34.827 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:34.817+0000 7f9c29b22700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c24071440 0x7f9c241f4ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43032/0 (socket says 172.21.15.84:43032) 2023-09-13T08:24:34.828 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:34.817+0000 7f9c29b22700 1 -- 172.21.15.84:0/1326676976 learned_addr learned my addr 172.21.15.84:0/1326676976 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:24:34.828 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:34.817+0000 7f9c2a323700 1 --2- 172.21.15.84:0/1326676976 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9c2406eff0 0x7f9c240c5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:34.828 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:34.817+0000 7f9c2ab24700 1 --2- 172.21.15.84:0/1326676976 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9c24143e10 0x7f9c2415de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:34.828 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:34.818+0000 7f9c29b22700 1 -- 172.21.15.84:0/1326676976 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9c24143e10 msgr2=0x7f9c2415de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:34.828 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:34.818+0000 7f9c29b22700 1 --2- 172.21.15.84:0/1326676976 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9c24143e10 0x7f9c2415de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:34.829 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:34.818+0000 7f9c29b22700 1 -- 172.21.15.84:0/1326676976 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9c2406eff0 msgr2=0x7f9c240c5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:34.829 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:34.818+0000 7f9c29b22700 1 --2- 172.21.15.84:0/1326676976 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9c2406eff0 0x7f9c240c5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:34.829 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:34.818+0000 7f9c29b22700 1 -- 172.21.15.84:0/1326676976 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c1c009b30 con 0x7f9c24071440 2023-09-13T08:24:34.830 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:34.818+0000 7f9c29b22700 1 --2- 172.21.15.84:0/1326676976 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c24071440 0x7f9c241f4ac0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9c1400e810 tx=0x7f9c1400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:34.830 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:34.818+0000 7f9c1affd700 1 -- 172.21.15.84:0/1326676976 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c1400c070 con 0x7f9c24071440 2023-09-13T08:24:34.830 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:34.818+0000 7f9c1affd700 1 -- 172.21.15.84:0/1326676976 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c14013610 con 0x7f9c24071440 2023-09-13T08:24:34.830 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:34.818+0000 7f9c2c587700 1 -- 172.21.15.84:0/1326676976 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c2414dda0 con 0x7f9c24071440 2023-09-13T08:24:34.830 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:34.818+0000 7f9c1affd700 1 -- 172.21.15.84:0/1326676976 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c140139a0 con 0x7f9c24071440 2023-09-13T08:24:34.831 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:34.818+0000 7f9c2c587700 1 -- 172.21.15.84:0/1326676976 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c2414e360 con 0x7f9c24071440 2023-09-13T08:24:34.831 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:34.819+0000 7f9c2c587700 1 -- 172.21.15.84:0/1326676976 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c2404e9b0 con 0x7f9c24071440 2023-09-13T08:24:34.831 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:34.819+0000 7f9c1affd700 1 -- 172.21.15.84:0/1326676976 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f9c14013b00 con 0x7f9c24071440 2023-09-13T08:24:34.831 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:34.820+0000 7f9c1affd700 1 --2- 172.21.15.84:0/1326676976 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f9c0806a580 0x7f9c0806ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:34.831 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:34.820+0000 7f9c1affd700 1 -- 172.21.15.84:0/1326676976 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9c14088350 con 0x7f9c24071440 2023-09-13T08:24:34.832 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:34.820+0000 7f9c2a323700 1 --2- 172.21.15.84:0/1326676976 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f9c0806a580 0x7f9c0806ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:34.832 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:34.820+0000 7f9c2a323700 1 --2- 172.21.15.84:0/1326676976 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f9c0806a580 0x7f9c0806ca40 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9c2000c940 tx=0x7f9c20008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:34.832 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:34.825+0000 7f9c1affd700 1 -- 172.21.15.84:0/1326676976 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f9c14053c20 con 0x7f9c24071440 2023-09-13T08:24:35.014 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:35.014+0000 7f9c2c587700 1 -- 172.21.15.84:0/1326676976 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9c240cdc40 con 0x7f9c24071440 2023-09-13T08:24:35.016 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:35.015+0000 7f9c1affd700 1 -- 172.21.15.84:0/1326676976 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12826 (secure 0 0 0) 0x7f9c240cdc40 con 0x7f9c24071440 2023-09-13T08:24:35.016 INFO:teuthology.misc.health.smithi084.stdout: 2023-09-13T08:24:35.017 INFO:teuthology.misc.health.smithi084.stdout:{"epoch":16,"fsid":"0107440b-b634-42c5-a643-5d31ea826116","created":"2023-09-13T08:24:16.931917+0000","modified":"2023-09-13T08:24:31.479515+0000","last_up_change":"2023-09-13T08:24:28.422631+0000","last_in_change":"2023-09-13T08:24:19.425578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T08:24:28.583720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4a53ec12-1469-4356-b4e1-2b8fc9b7c0f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6817","nonce":1599532366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6819","nonce":1599532366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6823","nonce":1599532366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6821","nonce":1599532366}]},"public_addr":"172.21.15.84:6817/1599532366","cluster_addr":"172.21.15.84:6819/1599532366","heartbeat_back_addr":"172.21.15.84:6823/1599532366","heartbeat_front_addr":"172.21.15.84:6821/1599532366","state":["exists","up"]},{"osd":1,"uuid":"11e964a0-b80c-4afc-bfbf-e2067969db29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6825","nonce":461860977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6827","nonce":461860977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6831","nonce":461860977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6829","nonce":461860977}]},"public_addr":"172.21.15.84:6825/461860977","cluster_addr":"172.21.15.84:6827/461860977","heartbeat_back_addr":"172.21.15.84:6831/461860977","heartbeat_front_addr":"172.21.15.84:6829/461860977","state":["exists","up"]},{"osd":2,"uuid":"3ce74529-4dd1-44c7-9576-968f5fdc0c25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6809","nonce":1168316165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6811","nonce":1168316165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6815","nonce":1168316165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6813","nonce":1168316165}]},"public_addr":"172.21.15.84:6809/1168316165","cluster_addr":"172.21.15.84:6811/1168316165","heartbeat_back_addr":"172.21.15.84:6815/1168316165","heartbeat_front_addr":"172.21.15.84:6813/1168316165","state":["exists","up"]},{"osd":3,"uuid":"460cb5c5-590a-4d06-a4d9-5bac2fdf33b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6801","nonce":1661609810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6803","nonce":1661609810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6807","nonce":1661609810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6805","nonce":1661609810}]},"public_addr":"172.21.15.84:6801/1661609810","cluster_addr":"172.21.15.84:6803/1661609810","heartbeat_back_addr":"172.21.15.84:6807/1661609810","heartbeat_front_addr":"172.21.15.84:6805/1661609810","state":["exists","up"]},{"osd":4,"uuid":"bf237dd0-3ebd-44b5-8078-24a63e00d792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6801","nonce":1303562374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6803","nonce":1303562374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6807","nonce":1303562374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6805","nonce":1303562374}]},"public_addr":"172.21.15.161:6801/1303562374","cluster_addr":"172.21.15.161:6803/1303562374","heartbeat_back_addr":"172.21.15.161:6807/1303562374","heartbeat_front_addr":"172.21.15.161:6805/1303562374","state":["exists","up"]},{"osd":5,"uuid":"e1e538e0-5844-456b-8c6e-434d3a914af1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6818","nonce":961120854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6822","nonce":961120854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6830","nonce":961120854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6826","nonce":961120854}]},"public_addr":"172.21.15.161:6818/961120854","cluster_addr":"172.21.15.161:6822/961120854","heartbeat_back_addr":"172.21.15.161:6830/961120854","heartbeat_front_addr":"172.21.15.161:6826/961120854","state":["exists","up"]},{"osd":6,"uuid":"5cb1785e-960f-4dd4-b295-9e21b2c3f875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6809","nonce":980533466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6811","nonce":980533466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6815","nonce":980533466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6813","nonce":980533466}]},"public_addr":"172.21.15.161:6809/980533466","cluster_addr":"172.21.15.161:6811/980533466","heartbeat_back_addr":"172.21.15.161:6815/980533466","heartbeat_front_addr":"172.21.15.161:6813/980533466","state":["exists","up"]},{"osd":7,"uuid":"5acb6619-e933-4b46-b1c2-60af30acb839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6817","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6819","nonce":2479691549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6821","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6823","nonce":2479691549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6829","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6831","nonce":2479691549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6825","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6827","nonce":2479691549}]},"public_addr":"172.21.15.161:6819/2479691549","cluster_addr":"172.21.15.161:6823/2479691549","heartbeat_back_addr":"172.21.15.161:6831/2479691549","heartbeat_front_addr":"172.21.15.161:6827/2479691549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.678857+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.685341+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.613603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.634940+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.564387+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.697347+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.637437+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.619397+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T08:24:35.019 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:35.017+0000 7f9c2c587700 1 -- 172.21.15.84:0/1326676976 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f9c0806a580 msgr2=0x7f9c0806ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:35.019 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:35.017+0000 7f9c2c587700 1 --2- 172.21.15.84:0/1326676976 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f9c0806a580 0x7f9c0806ca40 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9c2000c940 tx=0x7f9c20008040 comp rx=0 tx=0).stop 2023-09-13T08:24:35.019 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:35.017+0000 7f9c2c587700 1 -- 172.21.15.84:0/1326676976 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c24071440 msgr2=0x7f9c241f4ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:35.020 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:35.017+0000 7f9c2c587700 1 --2- 172.21.15.84:0/1326676976 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c24071440 0x7f9c241f4ac0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9c1400e810 tx=0x7f9c1400eb20 comp rx=0 tx=0).stop 2023-09-13T08:24:35.020 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:35.017+0000 7f9c2c587700 1 -- 172.21.15.84:0/1326676976 shutdown_connections 2023-09-13T08:24:35.021 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:35.017+0000 7f9c2c587700 1 --2- 172.21.15.84:0/1326676976 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9c24143e10 0x7f9c2415de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:35.021 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:35.017+0000 7f9c2c587700 1 --2- 172.21.15.84:0/1326676976 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f9c0806a580 0x7f9c0806ca40 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:35.021 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:35.017+0000 7f9c2c587700 1 --2- 172.21.15.84:0/1326676976 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9c2406eff0 0x7f9c240c5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:35.022 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:35.017+0000 7f9c2c587700 1 --2- 172.21.15.84:0/1326676976 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c24071440 0x7f9c241f4ac0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:35.022 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:35.017+0000 7f9c2c587700 1 -- 172.21.15.84:0/1326676976 >> 172.21.15.84:0/1326676976 conn(0x7f9c240b1dd0 msgr2=0x7f9c2413e440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:35.022 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:35.018+0000 7f9c2c587700 1 -- 172.21.15.84:0/1326676976 shutdown_connections 2023-09-13T08:24:35.023 INFO:teuthology.misc.health.smithi084.stderr:2023-09-13T08:24:35.018+0000 7f9c2c587700 1 -- 172.21.15.84:0/1326676976 wait complete. 2023-09-13T08:24:35.029 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-09-13T08:24:35.030 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-09-13T08:24:35.031 INFO:tasks.ceph.mds.a:Restarting daemon 2023-09-13T08:24:35.031 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-09-13T08:24:35.034 INFO:tasks.ceph.mds.a:Started 2023-09-13T08:24:35.034 INFO:tasks.ceph.mds.c:Restarting daemon 2023-09-13T08:24:35.035 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-09-13T08:24:35.037 INFO:tasks.ceph.mds.c:Started 2023-09-13T08:24:35.037 INFO:tasks.ceph.mds.b:Restarting daemon 2023-09-13T08:24:35.038 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-09-13T08:24:35.041 INFO:tasks.ceph.mds.b:Started 2023-09-13T08:24:35.042 INFO:tasks.ceph.mds.d:Restarting daemon 2023-09-13T08:24:35.042 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-09-13T08:24:35.045 INFO:tasks.ceph.mds.d:Started 2023-09-13T08:24:35.045 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-09-13T08:24:35.046 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T08:24:35.112 INFO:tasks.ceph.mds.a.smithi084.stdout:starting mds.a at 2023-09-13T08:24:35.114 INFO:tasks.ceph.mds.c.smithi084.stdout:starting mds.c at 2023-09-13T08:24:35.131 INFO:tasks.ceph.mds.d.smithi161.stdout:starting mds.d at 2023-09-13T08:24:35.132 INFO:tasks.ceph.mds.b.smithi161.stdout:starting mds.b at 2023-09-13T08:24:35.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.174+0000 7f078b12d700 1 Processor -- start 2023-09-13T08:24:35.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.174+0000 7f078b12d700 1 -- start start 2023-09-13T08:24:35.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.175+0000 7f078b12d700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f078415eb80 0x7f078415afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:35.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.175+0000 7f078b12d700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f078415b690 con 0x7f0784071ac0 2023-09-13T08:24:35.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.175+0000 7f078b12d700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f078415e0a0 con 0x7f07840cc340 2023-09-13T08:24:35.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.175+0000 7f078b12d700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f078415b970 con 0x7f078415eb80 2023-09-13T08:24:35.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.175+0000 7f0783fff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f0784071ac0 0x7f078415a8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:45710/0 (socket says 172.21.15.84:45710) 2023-09-13T08:24:35.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.175+0000 7f0783fff700 1 -- 172.21.15.84:0/2348009378 learned_addr learned my addr 172.21.15.84:0/2348009378 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:24:35.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.175+0000 7f07896ca700 1 --2- 172.21.15.84:0/2348009378 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f078415eb80 0x7f078415afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:35.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.175+0000 7f07837fe700 1 -- 172.21.15.84:0/2348009378 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 244437881 0 0) 0x7f078415b690 con 0x7f0784071ac0 2023-09-13T08:24:35.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.175+0000 7f07837fe700 1 -- 172.21.15.84:0/2348009378 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07700035b0 con 0x7f0784071ac0 2023-09-13T08:24:35.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.175+0000 7f07837fe700 1 -- 172.21.15.84:0/2348009378 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2118587941 0 0) 0x7f07700035b0 con 0x7f0784071ac0 2023-09-13T08:24:35.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.175+0000 7f07837fe700 1 -- 172.21.15.84:0/2348009378 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f078415eb80 msgr2=0x7f078415afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:24:35.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.175+0000 7f07837fe700 1 --2- 172.21.15.84:0/2348009378 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f078415eb80 0x7f078415afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:35.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.175+0000 7f07837fe700 1 -- 172.21.15.84:0/2348009378 >> v1:172.21.15.161:6789/0 conn(0x7f07840cc340 legacy=0x7f07840713b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:35.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.175+0000 7f07837fe700 1 -- 172.21.15.84:0/2348009378 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f078415e380 con 0x7f0784071ac0 2023-09-13T08:24:35.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.175+0000 7f07837fe700 1 -- 172.21.15.84:0/2348009378 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2302733408 0 0) 0x7f076c001670 con 0x7f0784071ac0 2023-09-13T08:24:35.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.175+0000 7f07837fe700 1 -- 172.21.15.84:0/2348009378 >> v1:172.21.15.84:6789/0 conn(0x7f0784071ac0 legacy=0x7f078415a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:35.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.176+0000 7f07837fe700 1 --2- 172.21.15.84:0/2348009378 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0770003a30 0x7f0770003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:35.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.176+0000 7f07837fe700 1 --2- 172.21.15.84:0/2348009378 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0770004850 0x7f0770004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:35.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.176+0000 7f07837fe700 1 --2- 172.21.15.84:0/2348009378 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f078415eb80 0x7f0770005250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:35.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.176+0000 7f07837fe700 1 -- 172.21.15.84:0/2348009378 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f078415b970 con 0x7f0770003a30 2023-09-13T08:24:35.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.176+0000 7f07837fe700 1 -- 172.21.15.84:0/2348009378 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f077000dd50 con 0x7f0770004850 2023-09-13T08:24:35.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.176+0000 7f07837fe700 1 -- 172.21.15.84:0/2348009378 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f077000df10 con 0x7f078415eb80 2023-09-13T08:24:35.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.176+0000 7f0788ec9700 1 --2- 172.21.15.84:0/2348009378 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0770003a30 0x7f0770003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:35.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.176+0000 7f0783fff700 1 --2- 172.21.15.84:0/2348009378 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0770004850 0x7f0770004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:35.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.176+0000 7f07896ca700 1 --2- 172.21.15.84:0/2348009378 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f078415eb80 0x7f0770005250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:35.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.176+0000 7f0788ec9700 1 -- 172.21.15.84:0/2348009378 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f078415eb80 msgr2=0x7f0770005250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:24:35.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.176+0000 7f0788ec9700 1 --2- 172.21.15.84:0/2348009378 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f078415eb80 0x7f0770005250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:35.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.176+0000 7f0788ec9700 1 -- 172.21.15.84:0/2348009378 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0770004850 msgr2=0x7f0770004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:24:35.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.176+0000 7f0788ec9700 1 --2- 172.21.15.84:0/2348009378 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0770004850 0x7f0770004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:35.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.176+0000 7f0788ec9700 1 -- 172.21.15.84:0/2348009378 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07700035b0 con 0x7f0770003a30 2023-09-13T08:24:35.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.176+0000 7f0788ec9700 1 --2- 172.21.15.84:0/2348009378 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0770003a30 0x7f0770003e50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f077c00c190 tx=0x7f0770005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f674b3c6f5e240a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:35.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.176+0000 7f07837fe700 1 -- 172.21.15.84:0/2348009378 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f077c001db0 con 0x7f0770003a30 2023-09-13T08:24:35.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.176+0000 7f07837fe700 1 -- 172.21.15.84:0/2348009378 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f077c00ccd0 con 0x7f0770003a30 2023-09-13T08:24:35.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.176+0000 7f07837fe700 1 -- 172.21.15.84:0/2348009378 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f077c003c40 con 0x7f0770003a30 2023-09-13T08:24:35.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.177+0000 7f078b12d700 1 -- 172.21.15.84:0/2348009378 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0770003a30 msgr2=0x7f0770003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:35.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.177+0000 7f078b12d700 1 --2- 172.21.15.84:0/2348009378 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0770003a30 0x7f0770003e50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f077c00c190 tx=0x7f0770005880 comp rx=0 tx=0).stop 2023-09-13T08:24:35.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.177+0000 7f07896ca700 1 -- 172.21.15.84:0/2348009378 reap_dead start 2023-09-13T08:24:35.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.177+0000 7f078b12d700 1 -- 172.21.15.84:0/2348009378 shutdown_connections 2023-09-13T08:24:35.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.177+0000 7f078b12d700 1 -- 172.21.15.84:0/2348009378 >> 172.21.15.84:0/2348009378 conn(0x7f07840d00c0 msgr2=0x7f07840d04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:35.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.177+0000 7f078b12d700 1 -- 172.21.15.84:0/2348009378 shutdown_connections 2023-09-13T08:24:35.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.177+0000 7f078b12d700 1 -- 172.21.15.84:0/2348009378 wait complete. 2023-09-13T08:24:35.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.178+0000 7f078b12d700 1 Processor -- start 2023-09-13T08:24:35.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.178+0000 7f078b12d700 1 -- start start 2023-09-13T08:24:35.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.179+0000 7f078b12d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0770003a30 0x7f078413f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:35.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.179+0000 7f078b12d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f07840b51e0 0x7f07840b5660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:35.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.179+0000 7f078b12d700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f078406ed90 0x7f078406f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:35.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.179+0000 7f078b12d700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f078406f780 con 0x7f0770003a30 2023-09-13T08:24:35.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.179+0000 7f078b12d700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f078413fe90 con 0x7f07840b51e0 2023-09-13T08:24:35.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.179+0000 7f078b12d700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f078413f990 con 0x7f078406ed90 2023-09-13T08:24:35.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.179+0000 7f0788ec9700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0770003a30 0x7f078413f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:35.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.179+0000 7f0788ec9700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0770003a30 0x7f078413f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43074/0 (socket says 172.21.15.84:43074) 2023-09-13T08:24:35.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.179+0000 7f0788ec9700 1 -- 172.21.15.84:0/1257519440 learned_addr learned my addr 172.21.15.84:0/1257519440 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:24:35.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.179+0000 7f0783fff700 1 --2- 172.21.15.84:0/1257519440 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f07840b51e0 0x7f07840b5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:35.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.179+0000 7f07896ca700 1 --2- 172.21.15.84:0/1257519440 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f078406ed90 0x7f078406f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:35.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.179+0000 7f0788ec9700 1 -- 172.21.15.84:0/1257519440 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f078406ed90 msgr2=0x7f078406f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:35.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.179+0000 7f0788ec9700 1 --2- 172.21.15.84:0/1257519440 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f078406ed90 0x7f078406f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:35.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.179+0000 7f0788ec9700 1 -- 172.21.15.84:0/1257519440 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f07840b51e0 msgr2=0x7f07840b5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:35.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.179+0000 7f0788ec9700 1 --2- 172.21.15.84:0/1257519440 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f07840b51e0 0x7f07840b5660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:35.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.179+0000 7f0788ec9700 1 -- 172.21.15.84:0/1257519440 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f078415c4c0 con 0x7f0770003a30 2023-09-13T08:24:35.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.179+0000 7f0788ec9700 1 --2- 172.21.15.84:0/1257519440 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0770003a30 0x7f078413f450 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f077000dd20 tx=0x7f077c0014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:35.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.179+0000 7f07817fa700 1 -- 172.21.15.84:0/1257519440 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f077c0052e0 con 0x7f0770003a30 2023-09-13T08:24:35.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.179+0000 7f07817fa700 1 -- 172.21.15.84:0/1257519440 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f077c005460 con 0x7f0770003a30 2023-09-13T08:24:35.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.179+0000 7f07817fa700 1 -- 172.21.15.84:0/1257519440 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f077c005610 con 0x7f0770003a30 2023-09-13T08:24:35.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.179+0000 7f078b12d700 1 -- 172.21.15.84:0/1257519440 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f078415c710 con 0x7f0770003a30 2023-09-13T08:24:35.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.179+0000 7f078b12d700 1 -- 172.21.15.84:0/1257519440 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f078415ccd0 con 0x7f0770003a30 2023-09-13T08:24:35.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.180+0000 7f078b12d700 1 -- 172.21.15.84:0/1257519440 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f078404e9b0 con 0x7f0770003a30 2023-09-13T08:24:35.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.181+0000 7f07817fa700 1 -- 172.21.15.84:0/1257519440 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f077c019070 con 0x7f0770003a30 2023-09-13T08:24:35.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.181+0000 7f07817fa700 1 --2- 172.21.15.84:0/1257519440 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f076406a580 0x7f076406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:35.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.181+0000 7f07817fa700 1 -- 172.21.15.84:0/1257519440 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f077c089ac0 con 0x7f0770003a30 2023-09-13T08:24:35.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.181+0000 7f0783fff700 1 --2- 172.21.15.84:0/1257519440 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f076406a580 0x7f076406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:35.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.181+0000 7f0783fff700 1 --2- 172.21.15.84:0/1257519440 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f076406a580 0x7f076406ca40 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f07841401b0 tx=0x7f076c001bd0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:35.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.186+0000 7f07817fa700 1 -- 172.21.15.84:0/1257519440 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f077c055420 con 0x7f0770003a30 2023-09-13T08:24:35.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.377+0000 7f078b12d700 1 -- 172.21.15.84:0/1257519440 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f07840b6040 con 0x7f0770003a30 2023-09-13T08:24:35.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.378+0000 7f07817fa700 1 -- 172.21.15.84:0/1257519440 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12826 (secure 0 0 0) 0x7f077c058a40 con 0x7f0770003a30 2023-09-13T08:24:35.378 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:24:35.378 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":16,"fsid":"0107440b-b634-42c5-a643-5d31ea826116","created":"2023-09-13T08:24:16.931917+0000","modified":"2023-09-13T08:24:31.479515+0000","last_up_change":"2023-09-13T08:24:28.422631+0000","last_in_change":"2023-09-13T08:24:19.425578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T08:24:28.583720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4a53ec12-1469-4356-b4e1-2b8fc9b7c0f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6817","nonce":1599532366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6819","nonce":1599532366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6823","nonce":1599532366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6821","nonce":1599532366}]},"public_addr":"172.21.15.84:6817/1599532366","cluster_addr":"172.21.15.84:6819/1599532366","heartbeat_back_addr":"172.21.15.84:6823/1599532366","heartbeat_front_addr":"172.21.15.84:6821/1599532366","state":["exists","up"]},{"osd":1,"uuid":"11e964a0-b80c-4afc-bfbf-e2067969db29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6825","nonce":461860977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6827","nonce":461860977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6831","nonce":461860977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6829","nonce":461860977}]},"public_addr":"172.21.15.84:6825/461860977","cluster_addr":"172.21.15.84:6827/461860977","heartbeat_back_addr":"172.21.15.84:6831/461860977","heartbeat_front_addr":"172.21.15.84:6829/461860977","state":["exists","up"]},{"osd":2,"uuid":"3ce74529-4dd1-44c7-9576-968f5fdc0c25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6809","nonce":1168316165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6811","nonce":1168316165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6815","nonce":1168316165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6813","nonce":1168316165}]},"public_addr":"172.21.15.84:6809/1168316165","cluster_addr":"172.21.15.84:6811/1168316165","heartbeat_back_addr":"172.21.15.84:6815/1168316165","heartbeat_front_addr":"172.21.15.84:6813/1168316165","state":["exists","up"]},{"osd":3,"uuid":"460cb5c5-590a-4d06-a4d9-5bac2fdf33b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6801","nonce":1661609810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6803","nonce":1661609810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6807","nonce":1661609810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6805","nonce":1661609810}]},"public_addr":"172.21.15.84:6801/1661609810","cluster_addr":"172.21.15.84:6803/1661609810","heartbeat_back_addr":"172.21.15.84:6807/1661609810","heartbeat_front_addr":"172.21.15.84:6805/1661609810","state":["exists","up"]},{"osd":4,"uuid":"bf237dd0-3ebd-44b5-8078-24a63e00d792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6801","nonce":1303562374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6803","nonce":1303562374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6807","nonce":1303562374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6805","nonce":1303562374}]},"public_addr":"172.21.15.161:6801/1303562374","cluster_addr":"172.21.15.161:6803/1303562374","heartbeat_back_addr":"172.21.15.161:6807/1303562374","heartbeat_front_addr":"172.21.15.161:6805/1303562374","state":["exists","up"]},{"osd":5,"uuid":"e1e538e0-5844-456b-8c6e-434d3a914af1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6818","nonce":961120854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6822","nonce":961120854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6830","nonce":961120854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6826","nonce":961120854}]},"public_addr":"172.21.15.161:6818/961120854","cluster_addr":"172.21.15.161:6822/961120854","heartbeat_back_addr":"172.21.15.161:6830/961120854","heartbeat_front_addr":"172.21.15.161:6826/961120854","state":["exists","up"]},{"osd":6,"uuid":"5cb1785e-960f-4dd4-b295-9e21b2c3f875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6809","nonce":980533466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6811","nonce":980533466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6815","nonce":980533466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6813","nonce":980533466}]},"public_addr":"172.21.15.161:6809/980533466","cluster_addr":"172.21.15.161:6811/980533466","heartbeat_back_addr":"172.21.15.161:6815/980533466","heartbeat_front_addr":"172.21.15.161:6813/980533466","state":["exists","up"]},{"osd":7,"uuid":"5acb6619-e933-4b46-b1c2-60af30acb839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6817","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6819","nonce":2479691549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6821","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6823","nonce":2479691549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6829","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6831","nonce":2479691549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6825","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6827","nonce":2479691549}]},"public_addr":"172.21.15.161:6819/2479691549","cluster_addr":"172.21.15.161:6823/2479691549","heartbeat_back_addr":"172.21.15.161:6831/2479691549","heartbeat_front_addr":"172.21.15.161:6827/2479691549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.678857+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.685341+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.613603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.634940+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.564387+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.697347+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.637437+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.619397+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T08:24:35.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.380+0000 7f078b12d700 1 -- 172.21.15.84:0/1257519440 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f076406a580 msgr2=0x7f076406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:35.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.380+0000 7f078b12d700 1 --2- 172.21.15.84:0/1257519440 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f076406a580 0x7f076406ca40 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f07841401b0 tx=0x7f076c001bd0 comp rx=0 tx=0).stop 2023-09-13T08:24:35.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.380+0000 7f078b12d700 1 -- 172.21.15.84:0/1257519440 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0770003a30 msgr2=0x7f078413f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:35.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.380+0000 7f078b12d700 1 --2- 172.21.15.84:0/1257519440 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0770003a30 0x7f078413f450 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f077000dd20 tx=0x7f077c0014a0 comp rx=0 tx=0).stop 2023-09-13T08:24:35.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.380+0000 7f078b12d700 1 -- 172.21.15.84:0/1257519440 shutdown_connections 2023-09-13T08:24:35.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.380+0000 7f078b12d700 1 --2- 172.21.15.84:0/1257519440 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f078406ed90 0x7f078406f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:35.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.380+0000 7f078b12d700 1 --2- 172.21.15.84:0/1257519440 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0770003a30 0x7f078413f450 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:35.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.380+0000 7f078b12d700 1 --2- 172.21.15.84:0/1257519440 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f076406a580 0x7f076406ca40 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:35.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.380+0000 7f078b12d700 1 --2- 172.21.15.84:0/1257519440 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f07840b51e0 0x7f07840b5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:35.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.380+0000 7f078b12d700 1 -- 172.21.15.84:0/1257519440 >> 172.21.15.84:0/1257519440 conn(0x7f07840d00c0 msgr2=0x7f0784151e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:35.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.380+0000 7f078b12d700 1 -- 172.21.15.84:0/1257519440 shutdown_connections 2023-09-13T08:24:35.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.380+0000 7f078b12d700 1 -- 172.21.15.84:0/1257519440 wait complete. 2023-09-13T08:24:35.392 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T08:24:28.583720+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-13T08:24:35.392 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T08:24:35.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.514+0000 7fd9d3a26700 1 Processor -- start 2023-09-13T08:24:35.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.515+0000 7fd9d3a26700 1 -- start start 2023-09-13T08:24:35.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.515+0000 7fd9d3a26700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd9cc15e910 0x7fd9cc0cf570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:35.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.515+0000 7fd9d3a26700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd9cc0cd590 0x7fd9cc0cdbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:35.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.515+0000 7fd9d3a26700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9cc15e480 con 0x7fd9cc0ca8e0 2023-09-13T08:24:35.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.515+0000 7fd9d3a26700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9cc0cfbe0 con 0x7fd9cc15e910 2023-09-13T08:24:35.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.515+0000 7fd9d3a26700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9cc15de30 con 0x7fd9cc0cd590 2023-09-13T08:24:35.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.515+0000 7fd9d0fc1700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd9cc15e910 0x7fd9cc0cf570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:35.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.516+0000 7fd9d0fc1700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd9cc15e910 0x7fd9cc0cf570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43084/0 (socket says 172.21.15.84:43084) 2023-09-13T08:24:35.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.516+0000 7fd9d0fc1700 1 -- 172.21.15.84:0/2662933324 learned_addr learned my addr 172.21.15.84:0/2662933324 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:24:35.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.516+0000 7fd9d0fc1700 1 -- 172.21.15.84:0/2662933324 >> v2:172.21.15.161:3300/0 conn(0x7fd9cc0cd590 msgr2=0x7fd9cc0cdbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:24:35.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.516+0000 7fd9d1fc3700 1 --2- 172.21.15.84:0/2662933324 >> v2:172.21.15.161:3300/0 conn(0x7fd9cc0cd590 0x7fd9cc0cdbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:35.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.516+0000 7fd9d0fc1700 1 --2- 172.21.15.84:0/2662933324 >> v2:172.21.15.161:3300/0 conn(0x7fd9cc0cd590 0x7fd9cc0cdbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:35.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.516+0000 7fd9d0fc1700 1 -- 172.21.15.84:0/2662933324 >> v1:172.21.15.161:6789/0 conn(0x7fd9cc0ca8e0 legacy=0x7fd9cc0cacc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:24:35.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.516+0000 7fd9d0fc1700 1 -- 172.21.15.84:0/2662933324 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9cc15e110 con 0x7fd9cc15e910 2023-09-13T08:24:35.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.516+0000 7fd9d0fc1700 1 --2- 172.21.15.84:0/2662933324 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9cc15e910 0x7fd9cc0cf570 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc15ecf0 tx=0x7fd9c0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2894cbc0df4755b7 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:35.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.516+0000 7fd9bffff700 1 -- 172.21.15.84:0/2662933324 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c0004230 con 0x7fd9cc15e910 2023-09-13T08:24:35.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.516+0000 7fd9bffff700 1 -- 172.21.15.84:0/2662933324 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9c0004390 con 0x7fd9cc15e910 2023-09-13T08:24:35.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.516+0000 7fd9bffff700 1 -- 172.21.15.84:0/2662933324 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c00036a0 con 0x7fd9cc15e910 2023-09-13T08:24:35.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.517+0000 7fd9d3a26700 1 -- 172.21.15.84:0/2662933324 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9cc15e910 msgr2=0x7fd9cc0cf570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:35.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.517+0000 7fd9d3a26700 1 --2- 172.21.15.84:0/2662933324 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9cc15e910 0x7fd9cc0cf570 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc15ecf0 tx=0x7fd9c0009bd0 comp rx=0 tx=0).stop 2023-09-13T08:24:35.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.517+0000 7fd9d3a26700 1 -- 172.21.15.84:0/2662933324 shutdown_connections 2023-09-13T08:24:35.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.517+0000 7fd9d3a26700 1 --2- 172.21.15.84:0/2662933324 >> v2:172.21.15.161:3300/0 conn(0x7fd9cc0cd590 0x7fd9cc0cdbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:35.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.517+0000 7fd9d3a26700 1 --2- 172.21.15.84:0/2662933324 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9cc15e910 0x7fd9cc0cf570 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:35.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.517+0000 7fd9d3a26700 1 -- 172.21.15.84:0/2662933324 >> 172.21.15.84:0/2662933324 conn(0x7fd9cc0cca70 msgr2=0x7fd9cc0cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:35.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.517+0000 7fd9d3a26700 1 -- 172.21.15.84:0/2662933324 shutdown_connections 2023-09-13T08:24:35.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.517+0000 7fd9d3a26700 1 -- 172.21.15.84:0/2662933324 wait complete. 2023-09-13T08:24:35.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.518+0000 7fd9d3a26700 1 Processor -- start 2023-09-13T08:24:35.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.518+0000 7fd9d3a26700 1 -- start start 2023-09-13T08:24:35.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.519+0000 7fd9d3a26700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9cc0ca8e0 0x7fd9cc155b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:35.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.519+0000 7fd9d3a26700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd9cc0cd590 0x7fd9cc0b30a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:35.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.519+0000 7fd9d3a26700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9cc15e910 0x7fd9cc1560e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:35.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.519+0000 7fd9d3a26700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9cc1f77b0 con 0x7fd9cc15e910 2023-09-13T08:24:35.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.519+0000 7fd9d3a26700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9cc0af010 con 0x7fd9cc0ca8e0 2023-09-13T08:24:35.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.519+0000 7fd9d3a26700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9cc0c4760 con 0x7fd9cc0cd590 2023-09-13T08:24:35.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.519+0000 7fd9d1fc3700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9cc15e910 0x7fd9cc1560e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:35.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.519+0000 7fd9d1fc3700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9cc15e910 0x7fd9cc1560e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43092/0 (socket says 172.21.15.84:43092) 2023-09-13T08:24:35.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.519+0000 7fd9d1fc3700 1 -- 172.21.15.84:0/1474110726 learned_addr learned my addr 172.21.15.84:0/1474110726 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:24:35.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.519+0000 7fd9d0fc1700 1 --2- 172.21.15.84:0/1474110726 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd9cc0cd590 0x7fd9cc0b30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:35.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.519+0000 7fd9d17c2700 1 --2- 172.21.15.84:0/1474110726 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9cc0ca8e0 0x7fd9cc155b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:35.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.519+0000 7fd9d1fc3700 1 -- 172.21.15.84:0/1474110726 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd9cc0cd590 msgr2=0x7fd9cc0b30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:35.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.519+0000 7fd9d1fc3700 1 --2- 172.21.15.84:0/1474110726 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd9cc0cd590 0x7fd9cc0b30a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:35.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.519+0000 7fd9d1fc3700 1 -- 172.21.15.84:0/1474110726 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9cc0ca8e0 msgr2=0x7fd9cc155b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:35.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.519+0000 7fd9d1fc3700 1 --2- 172.21.15.84:0/1474110726 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9cc0ca8e0 0x7fd9cc155b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:35.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.519+0000 7fd9d1fc3700 1 -- 172.21.15.84:0/1474110726 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9c0009550 con 0x7fd9cc15e910 2023-09-13T08:24:35.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.519+0000 7fd9d17c2700 1 --2- 172.21.15.84:0/1474110726 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9cc0ca8e0 0x7fd9cc155b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T08:24:35.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.519+0000 7fd9d1fc3700 1 --2- 172.21.15.84:0/1474110726 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9cc15e910 0x7fd9cc1560e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd9c400cd70 tx=0x7fd9c400a570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:35.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.519+0000 7fd9bdffb700 1 -- 172.21.15.84:0/1474110726 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c4003a20 con 0x7fd9cc15e910 2023-09-13T08:24:35.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.519+0000 7fd9bdffb700 1 -- 172.21.15.84:0/1474110726 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9c4003b80 con 0x7fd9cc15e910 2023-09-13T08:24:35.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.519+0000 7fd9d3a26700 1 -- 172.21.15.84:0/1474110726 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9cc0c6870 con 0x7fd9cc15e910 2023-09-13T08:24:35.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.519+0000 7fd9bdffb700 1 -- 172.21.15.84:0/1474110726 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c4004020 con 0x7fd9cc15e910 2023-09-13T08:24:35.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.519+0000 7fd9d3a26700 1 -- 172.21.15.84:0/1474110726 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9cc0b35e0 con 0x7fd9cc15e910 2023-09-13T08:24:35.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.520+0000 7fd9d3a26700 1 -- 172.21.15.84:0/1474110726 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9cc0c4530 con 0x7fd9cc15e910 2023-09-13T08:24:35.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.521+0000 7fd9bdffb700 1 -- 172.21.15.84:0/1474110726 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fd9c4004180 con 0x7fd9cc15e910 2023-09-13T08:24:35.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.521+0000 7fd9bdffb700 1 --2- 172.21.15.84:0/1474110726 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fd9b006a580 0x7fd9b006ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:35.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.521+0000 7fd9d17c2700 1 --2- 172.21.15.84:0/1474110726 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fd9b006a580 0x7fd9b006ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:35.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.521+0000 7fd9bdffb700 1 -- 172.21.15.84:0/1474110726 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd9c4012070 con 0x7fd9cc15e910 2023-09-13T08:24:35.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.521+0000 7fd9d17c2700 1 --2- 172.21.15.84:0/1474110726 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fd9b006a580 0x7fd9b006ca40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc06ffb0 tx=0x7fd9c8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:35.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.525+0000 7fd9bdffb700 1 -- 172.21.15.84:0/1474110726 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fd9cc0c4530 con 0x7fd9cc15e910 2023-09-13T08:24:35.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.715+0000 7fd9d3a26700 1 -- 172.21.15.84:0/1474110726 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd9cc0c4530 con 0x7fd9cc15e910 2023-09-13T08:24:35.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.715+0000 7fd9bdffb700 1 -- 172.21.15.84:0/1474110726 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd9cc0c4530 con 0x7fd9cc15e910 2023-09-13T08:24:35.716 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-09-13T08:24:35.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.717+0000 7fd9d3a26700 1 -- 172.21.15.84:0/1474110726 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fd9b006a580 msgr2=0x7fd9b006ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:35.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.717+0000 7fd9d3a26700 1 --2- 172.21.15.84:0/1474110726 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fd9b006a580 0x7fd9b006ca40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc06ffb0 tx=0x7fd9c8009040 comp rx=0 tx=0).stop 2023-09-13T08:24:35.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.717+0000 7fd9d3a26700 1 -- 172.21.15.84:0/1474110726 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9cc15e910 msgr2=0x7fd9cc1560e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:35.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.717+0000 7fd9d3a26700 1 --2- 172.21.15.84:0/1474110726 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9cc15e910 0x7fd9cc1560e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd9c400cd70 tx=0x7fd9c400a570 comp rx=0 tx=0).stop 2023-09-13T08:24:35.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.717+0000 7fd9d3a26700 1 -- 172.21.15.84:0/1474110726 shutdown_connections 2023-09-13T08:24:35.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.717+0000 7fd9d3a26700 1 --2- 172.21.15.84:0/1474110726 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9cc15e910 0x7fd9cc1560e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:35.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.717+0000 7fd9d3a26700 1 --2- 172.21.15.84:0/1474110726 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fd9b006a580 0x7fd9b006ca40 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:35.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.717+0000 7fd9d3a26700 1 --2- 172.21.15.84:0/1474110726 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9cc0ca8e0 0x7fd9cc155b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:35.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.717+0000 7fd9d3a26700 1 --2- 172.21.15.84:0/1474110726 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd9cc0cd590 0x7fd9cc0b30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:35.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.717+0000 7fd9d3a26700 1 -- 172.21.15.84:0/1474110726 >> 172.21.15.84:0/1474110726 conn(0x7fd9cc0cca70 msgr2=0x7fd9cc0afaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:35.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.717+0000 7fd9d3a26700 1 -- 172.21.15.84:0/1474110726 shutdown_connections 2023-09-13T08:24:35.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.717+0000 7fd9d3a26700 1 -- 172.21.15.84:0/1474110726 wait complete. 2023-09-13T08:24:35.729 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T08:24:35.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.849+0000 7f41f4bbc700 1 Processor -- start 2023-09-13T08:24:35.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.849+0000 7f41f4bbc700 1 -- start start 2023-09-13T08:24:35.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.850+0000 7f41f4bbc700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f41f00ca920 0x7f41f006d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:35.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.850+0000 7f41f4bbc700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f41f006a620 0x7f41f006aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:35.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.850+0000 7f41f4bbc700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41f006af90 con 0x7f41f015d530 2023-09-13T08:24:35.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.850+0000 7f41f4bbc700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41f00cff20 con 0x7f41f006a620 2023-09-13T08:24:35.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.850+0000 7f41f4bbc700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41f00cae50 con 0x7f41f00ca920 2023-09-13T08:24:35.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.850+0000 7f41ee59c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f41f015d530 0x7f41f0161bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:45742/0 (socket says 172.21.15.84:45742) 2023-09-13T08:24:35.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.850+0000 7f41ee59c700 1 -- 172.21.15.84:0/397971601 learned_addr learned my addr 172.21.15.84:0/397971601 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:24:35.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.850+0000 7f41edd9b700 1 --2- 172.21.15.84:0/397971601 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f41f00ca920 0x7f41f006d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:35.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.850+0000 7f41eed9d700 1 --2- 172.21.15.84:0/397971601 >> v2:172.21.15.161:3300/0 conn(0x7f41f006a620 0x7f41f006aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:35.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.850+0000 7f41ed59a700 1 -- 172.21.15.84:0/397971601 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3074632060 0 0) 0x7f41f006af90 con 0x7f41f015d530 2023-09-13T08:24:35.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.850+0000 7f41ed59a700 1 -- 172.21.15.84:0/397971601 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41d80035b0 con 0x7f41f015d530 2023-09-13T08:24:35.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.850+0000 7f41ed59a700 1 -- 172.21.15.84:0/397971601 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2650922280 0 0) 0x7f41d80035b0 con 0x7f41f015d530 2023-09-13T08:24:35.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.850+0000 7f41ed59a700 1 -- 172.21.15.84:0/397971601 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f41f00ca920 msgr2=0x7f41f006d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:24:35.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.850+0000 7f41ed59a700 1 --2- 172.21.15.84:0/397971601 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f41f00ca920 0x7f41f006d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:35.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.850+0000 7f41ed59a700 1 -- 172.21.15.84:0/397971601 >> v2:172.21.15.161:3300/0 conn(0x7f41f006a620 msgr2=0x7f41f006aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:24:35.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.850+0000 7f41ed59a700 1 --2- 172.21.15.84:0/397971601 >> v2:172.21.15.161:3300/0 conn(0x7f41f006a620 0x7f41f006aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:35.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.850+0000 7f41ed59a700 1 -- 172.21.15.84:0/397971601 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41f00cb130 con 0x7f41f015d530 2023-09-13T08:24:35.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.850+0000 7f41ed59a700 1 -- 172.21.15.84:0/397971601 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2302733408 0 0) 0x7f41e0001670 con 0x7f41f015d530 2023-09-13T08:24:35.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.850+0000 7f41ed59a700 1 -- 172.21.15.84:0/397971601 >> v1:172.21.15.84:6789/0 conn(0x7f41f015d530 legacy=0x7f41f0161bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:35.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.850+0000 7f41ed59a700 1 --2- 172.21.15.84:0/397971601 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41d8003a00 0x7f41d8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:35.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.850+0000 7f41ed59a700 1 --2- 172.21.15.84:0/397971601 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41d8004850 0x7f41d8004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:35.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.850+0000 7f41ed59a700 1 --2- 172.21.15.84:0/397971601 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f41f00ca920 0x7f41d8005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:35.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.850+0000 7f41ed59a700 1 -- 172.21.15.84:0/397971601 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41f00cae50 con 0x7f41d8004850 2023-09-13T08:24:35.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.850+0000 7f41ed59a700 1 -- 172.21.15.84:0/397971601 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41d800ba10 con 0x7f41d8003a00 2023-09-13T08:24:35.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.850+0000 7f41ed59a700 1 -- 172.21.15.84:0/397971601 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41d800bb50 con 0x7f41f00ca920 2023-09-13T08:24:35.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.850+0000 7f41edd9b700 1 --2- 172.21.15.84:0/397971601 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41d8004850 0x7f41d8004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:35.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.851+0000 7f41ee59c700 1 --2- 172.21.15.84:0/397971601 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41d8003a00 0x7f41d8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:35.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.851+0000 7f41eed9d700 1 --2- 172.21.15.84:0/397971601 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f41f00ca920 0x7f41d8005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:35.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.851+0000 7f41edd9b700 1 -- 172.21.15.84:0/397971601 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f41f00ca920 msgr2=0x7f41d8005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:24:35.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.851+0000 7f41edd9b700 1 --2- 172.21.15.84:0/397971601 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f41f00ca920 0x7f41d8005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:35.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.851+0000 7f41edd9b700 1 -- 172.21.15.84:0/397971601 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41d8003a00 msgr2=0x7f41d8003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:24:35.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.851+0000 7f41edd9b700 1 --2- 172.21.15.84:0/397971601 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41d8003a00 0x7f41d8003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:35.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.851+0000 7f41edd9b700 1 -- 172.21.15.84:0/397971601 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41d80035b0 con 0x7f41d8004850 2023-09-13T08:24:35.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.851+0000 7f41ee59c700 1 --2- 172.21.15.84:0/397971601 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41d8003a00 0x7f41d8003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T08:24:35.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.851+0000 7f41edd9b700 1 --2- 172.21.15.84:0/397971601 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41d8004850 0x7f41d8004cd0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f41e4009b30 tx=0x7f41d8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41dabeba78d5db8f server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:35.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.851+0000 7f41ed59a700 1 -- 172.21.15.84:0/397971601 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e400e6c0 con 0x7f41d8004850 2023-09-13T08:24:35.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.851+0000 7f41ed59a700 1 -- 172.21.15.84:0/397971601 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41e400e820 con 0x7f41d8004850 2023-09-13T08:24:35.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.851+0000 7f41ed59a700 1 -- 172.21.15.84:0/397971601 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e400eb90 con 0x7f41d8004850 2023-09-13T08:24:35.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.851+0000 7f41f4bbc700 1 -- 172.21.15.84:0/397971601 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41d8004850 msgr2=0x7f41d8004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:35.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.851+0000 7f41f4bbc700 1 --2- 172.21.15.84:0/397971601 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41d8004850 0x7f41d8004cd0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f41e4009b30 tx=0x7f41d8005880 comp rx=0 tx=0).stop 2023-09-13T08:24:35.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.851+0000 7f41eed9d700 1 -- 172.21.15.84:0/397971601 reap_dead start 2023-09-13T08:24:35.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.852+0000 7f41f4bbc700 1 -- 172.21.15.84:0/397971601 shutdown_connections 2023-09-13T08:24:35.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.852+0000 7f41f4bbc700 1 -- 172.21.15.84:0/397971601 >> 172.21.15.84:0/397971601 conn(0x7f41f00d00c0 msgr2=0x7f41f00d04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:35.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.852+0000 7f41f4bbc700 1 -- 172.21.15.84:0/397971601 shutdown_connections 2023-09-13T08:24:35.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.852+0000 7f41f4bbc700 1 -- 172.21.15.84:0/397971601 wait complete. 2023-09-13T08:24:35.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.853+0000 7f41f4bbc700 1 Processor -- start 2023-09-13T08:24:35.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.853+0000 7f41f4bbc700 1 -- start start 2023-09-13T08:24:35.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.854+0000 7f41f4bbc700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f41d8004850 0x7f41f014b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:35.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.854+0000 7f41f4bbc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41f0159170 0x7f41f00c9a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:35.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.854+0000 7f41f4bbc700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41f0155a00 0x7f41f015fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:35.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.854+0000 7f41f4bbc700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41f00c7b40 con 0x7f41f0159170 2023-09-13T08:24:35.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.854+0000 7f41f4bbc700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41f00c7d40 con 0x7f41f0155a00 2023-09-13T08:24:35.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.854+0000 7f41f4bbc700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41f014b920 con 0x7f41d8004850 2023-09-13T08:24:35.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.854+0000 7f41edd9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41f0159170 0x7f41f00c9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:35.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.854+0000 7f41edd9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41f0159170 0x7f41f00c9a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43110/0 (socket says 172.21.15.84:43110) 2023-09-13T08:24:35.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.854+0000 7f41edd9b700 1 -- 172.21.15.84:0/2619079005 learned_addr learned my addr 172.21.15.84:0/2619079005 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:24:35.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.854+0000 7f41eed9d700 1 --2- 172.21.15.84:0/2619079005 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41f0155a00 0x7f41f015fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:35.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.854+0000 7f41ee59c700 1 --2- 172.21.15.84:0/2619079005 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f41d8004850 0x7f41f014b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:35.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.854+0000 7f41edd9b700 1 -- 172.21.15.84:0/2619079005 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f41d8004850 msgr2=0x7f41f014b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:35.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.854+0000 7f41edd9b700 1 --2- 172.21.15.84:0/2619079005 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f41d8004850 0x7f41f014b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:35.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.854+0000 7f41edd9b700 1 -- 172.21.15.84:0/2619079005 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41f0155a00 msgr2=0x7f41f015fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:35.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.854+0000 7f41edd9b700 1 --2- 172.21.15.84:0/2619079005 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41f0155a00 0x7f41f015fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:35.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.854+0000 7f41edd9b700 1 -- 172.21.15.84:0/2619079005 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41f00c7fe0 con 0x7f41f0159170 2023-09-13T08:24:35.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.854+0000 7f41eed9d700 1 --2- 172.21.15.84:0/2619079005 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41f0155a00 0x7f41f015fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T08:24:35.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.854+0000 7f41edd9b700 1 --2- 172.21.15.84:0/2619079005 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41f0159170 0x7f41f00c9a60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f41d80046d0 tx=0x7f41e40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:35.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.854+0000 7f41deffd700 1 -- 172.21.15.84:0/2619079005 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e400e6c0 con 0x7f41f0159170 2023-09-13T08:24:35.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.854+0000 7f41deffd700 1 -- 172.21.15.84:0/2619079005 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41e4003ad0 con 0x7f41f0159170 2023-09-13T08:24:35.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.854+0000 7f41deffd700 1 -- 172.21.15.84:0/2619079005 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e4003e80 con 0x7f41f0159170 2023-09-13T08:24:35.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.854+0000 7f41f4bbc700 1 -- 172.21.15.84:0/2619079005 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41f00c82c0 con 0x7f41f0159170 2023-09-13T08:24:35.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.854+0000 7f41f4bbc700 1 -- 172.21.15.84:0/2619079005 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41f00c8880 con 0x7f41f0159170 2023-09-13T08:24:35.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.855+0000 7f41f4bbc700 1 -- 172.21.15.84:0/2619079005 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41f0156f60 con 0x7f41f0159170 2023-09-13T08:24:35.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.856+0000 7f41deffd700 1 -- 172.21.15.84:0/2619079005 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f41e4013470 con 0x7f41f0159170 2023-09-13T08:24:35.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.856+0000 7f41deffd700 1 --2- 172.21.15.84:0/2619079005 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f41d006a580 0x7f41d006ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:35.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.856+0000 7f41deffd700 1 -- 172.21.15.84:0/2619079005 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f41e4089fd0 con 0x7f41f0159170 2023-09-13T08:24:35.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.856+0000 7f41ee59c700 1 --2- 172.21.15.84:0/2619079005 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f41d006a580 0x7f41d006ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:35.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.857+0000 7f41ee59c700 1 --2- 172.21.15.84:0/2619079005 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f41d006a580 0x7f41d006ca40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f41e0000fb0 tx=0x7f41e0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:35.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:35.861+0000 7f41deffd700 1 -- 172.21.15.84:0/2619079005 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f41e4055a50 con 0x7f41f0159170 2023-09-13T08:24:36.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:36.095+0000 7f41f4bbc700 1 -- 172.21.15.84:0/2619079005 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f41f004e9b0 con 0x7f41f0159170 2023-09-13T08:24:36.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:36.095+0000 7f41deffd700 1 -- 172.21.15.84:0/2619079005 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1321 (secure 0 0 0) 0x7f41e4017540 con 0x7f41f0159170 2023-09-13T08:24:36.095 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:24:36.096 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4296,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/566416855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":566416855},{"type":"v1","addr":"172.21.15.84:6835","nonce":566416855}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-09-13T08:24:36.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:36.097+0000 7f41f4bbc700 1 -- 172.21.15.84:0/2619079005 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f41d006a580 msgr2=0x7f41d006ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:36.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:36.097+0000 7f41f4bbc700 1 --2- 172.21.15.84:0/2619079005 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f41d006a580 0x7f41d006ca40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f41e0000fb0 tx=0x7f41e0009040 comp rx=0 tx=0).stop 2023-09-13T08:24:36.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:36.097+0000 7f41f4bbc700 1 -- 172.21.15.84:0/2619079005 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41f0159170 msgr2=0x7f41f00c9a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:36.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:36.097+0000 7f41f4bbc700 1 --2- 172.21.15.84:0/2619079005 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41f0159170 0x7f41f00c9a60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f41d80046d0 tx=0x7f41e40047c0 comp rx=0 tx=0).stop 2023-09-13T08:24:36.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:36.097+0000 7f41f4bbc700 1 -- 172.21.15.84:0/2619079005 shutdown_connections 2023-09-13T08:24:36.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:36.097+0000 7f41f4bbc700 1 --2- 172.21.15.84:0/2619079005 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f41d006a580 0x7f41d006ca40 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:36.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:36.097+0000 7f41f4bbc700 1 --2- 172.21.15.84:0/2619079005 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41f0155a00 0x7f41f015fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:36.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:36.097+0000 7f41f4bbc700 1 --2- 172.21.15.84:0/2619079005 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f41d8004850 0x7f41f014b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:36.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:36.097+0000 7f41f4bbc700 1 --2- 172.21.15.84:0/2619079005 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41f0159170 0x7f41f00c9a60 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:36.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:36.097+0000 7f41f4bbc700 1 -- 172.21.15.84:0/2619079005 >> 172.21.15.84:0/2619079005 conn(0x7f41f00d00c0 msgr2=0x7f41f006d700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:36.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:36.097+0000 7f41f4bbc700 1 -- 172.21.15.84:0/2619079005 shutdown_connections 2023-09-13T08:24:36.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:36.097+0000 7f41f4bbc700 1 -- 172.21.15.84:0/2619079005 wait complete. 2023-09-13T08:24:36.100 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 2 2023-09-13T08:24:38.109 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T08:24:38.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.243+0000 7ff685644700 1 Processor -- start 2023-09-13T08:24:38.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.243+0000 7ff685644700 1 -- start start 2023-09-13T08:24:38.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.243+0000 7ff685644700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff68015d690 0x7ff6800ce3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:38.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.243+0000 7ff685644700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff680161250 0x7ff6801616d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:38.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.243+0000 7ff685644700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff6800d0e80 0x7ff6800d1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:38.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.243+0000 7ff685644700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6800cd9d0 con 0x7ff6800d0e80 2023-09-13T08:24:38.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.243+0000 7ff685644700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6800cdf50 con 0x7ff680161250 2023-09-13T08:24:38.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.243+0000 7ff685644700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff680161d10 con 0x7ff68015d690 2023-09-13T08:24:38.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.244+0000 7ff67f7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff6800d0e80 0x7ff6800d1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:38.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.244+0000 7ff67f7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff6800d0e80 0x7ff6800d1310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43122/0 (socket says 172.21.15.84:43122) 2023-09-13T08:24:38.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.244+0000 7ff67f7fe700 1 -- 172.21.15.84:0/3876777067 learned_addr learned my addr 172.21.15.84:0/3876777067 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:24:38.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.244+0000 7ff67e7fc700 1 --2- 172.21.15.84:0/3876777067 >> v2:172.21.15.161:3300/0 conn(0x7ff680161250 0x7ff6801616d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:38.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.244+0000 7ff67effd700 1 --2- 172.21.15.84:0/3876777067 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff68015d690 0x7ff6800ce3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:38.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.244+0000 7ff67f7fe700 1 -- 172.21.15.84:0/3876777067 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff68015d690 msgr2=0x7ff6800ce3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:24:38.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.244+0000 7ff67f7fe700 1 --2- 172.21.15.84:0/3876777067 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff68015d690 0x7ff6800ce3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:38.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.244+0000 7ff67f7fe700 1 -- 172.21.15.84:0/3876777067 >> v2:172.21.15.161:3300/0 conn(0x7ff680161250 msgr2=0x7ff6801616d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:24:38.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.244+0000 7ff67f7fe700 1 --2- 172.21.15.84:0/3876777067 >> v2:172.21.15.161:3300/0 conn(0x7ff680161250 0x7ff6801616d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:38.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.244+0000 7ff67f7fe700 1 -- 172.21.15.84:0/3876777067 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff680161ff0 con 0x7ff6800d0e80 2023-09-13T08:24:38.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.244+0000 7ff67e7fc700 1 --2- 172.21.15.84:0/3876777067 >> v2:172.21.15.161:3300/0 conn(0x7ff680161250 0x7ff6801616d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T08:24:38.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.244+0000 7ff67f7fe700 1 --2- 172.21.15.84:0/3876777067 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff6800d0e80 0x7ff6800d1310 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff6800cec10 tx=0x7ff67800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a447cc353a42dc05 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:38.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.244+0000 7ff67dffb700 1 -- 172.21.15.84:0/3876777067 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff67800e070 con 0x7ff6800d0e80 2023-09-13T08:24:38.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.244+0000 7ff67dffb700 1 -- 172.21.15.84:0/3876777067 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff67800b9c0 con 0x7ff6800d0e80 2023-09-13T08:24:38.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.244+0000 7ff67dffb700 1 -- 172.21.15.84:0/3876777067 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff67800bd70 con 0x7ff6800d0e80 2023-09-13T08:24:38.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.245+0000 7ff685644700 1 -- 172.21.15.84:0/3876777067 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff6800d0e80 msgr2=0x7ff6800d1310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:38.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.245+0000 7ff685644700 1 --2- 172.21.15.84:0/3876777067 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff6800d0e80 0x7ff6800d1310 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff6800cec10 tx=0x7ff67800b330 comp rx=0 tx=0).stop 2023-09-13T08:24:38.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.245+0000 7ff685644700 1 -- 172.21.15.84:0/3876777067 shutdown_connections 2023-09-13T08:24:38.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.245+0000 7ff685644700 1 --2- 172.21.15.84:0/3876777067 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff6800d0e80 0x7ff6800d1310 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:38.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.245+0000 7ff685644700 1 --2- 172.21.15.84:0/3876777067 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff68015d690 0x7ff6800ce3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:38.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.245+0000 7ff685644700 1 --2- 172.21.15.84:0/3876777067 >> v2:172.21.15.161:3300/0 conn(0x7ff680161250 0x7ff6801616d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:38.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.245+0000 7ff685644700 1 -- 172.21.15.84:0/3876777067 >> 172.21.15.84:0/3876777067 conn(0x7ff68008aff0 msgr2=0x7ff68009a480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:38.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.245+0000 7ff685644700 1 -- 172.21.15.84:0/3876777067 shutdown_connections 2023-09-13T08:24:38.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.245+0000 7ff685644700 1 -- 172.21.15.84:0/3876777067 wait complete. 2023-09-13T08:24:38.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.246+0000 7ff685644700 1 Processor -- start 2023-09-13T08:24:38.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.246+0000 7ff685644700 1 -- start start 2023-09-13T08:24:38.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.247+0000 7ff685644700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff6800d0e80 0x7ff6801f2a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:38.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.247+0000 7ff685644700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff68015d690 0x7ff6800c5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:38.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.247+0000 7ff685644700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff680161250 0x7ff680159340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:38.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.247+0000 7ff685644700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6800b5df0 con 0x7ff680161250 2023-09-13T08:24:38.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.247+0000 7ff685644700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6800c6750 con 0x7ff6800d0e80 2023-09-13T08:24:38.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.247+0000 7ff685644700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6800b5450 con 0x7ff68015d690 2023-09-13T08:24:38.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.247+0000 7ff67f7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff680161250 0x7ff680159340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:38.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.247+0000 7ff67f7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff680161250 0x7ff680159340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43128/0 (socket says 172.21.15.84:43128) 2023-09-13T08:24:38.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.247+0000 7ff67f7fe700 1 -- 172.21.15.84:0/976613467 learned_addr learned my addr 172.21.15.84:0/976613467 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:24:38.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.247+0000 7ff67effd700 1 --2- 172.21.15.84:0/976613467 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff6800d0e80 0x7ff6801f2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:38.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.247+0000 7ff67e7fc700 1 --2- 172.21.15.84:0/976613467 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff68015d690 0x7ff6800c5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:38.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.247+0000 7ff67f7fe700 1 -- 172.21.15.84:0/976613467 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff68015d690 msgr2=0x7ff6800c5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:38.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.247+0000 7ff67f7fe700 1 --2- 172.21.15.84:0/976613467 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff68015d690 0x7ff6800c5d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:38.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.247+0000 7ff67f7fe700 1 -- 172.21.15.84:0/976613467 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff6800d0e80 msgr2=0x7ff6801f2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:38.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.247+0000 7ff67f7fe700 1 --2- 172.21.15.84:0/976613467 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff6800d0e80 0x7ff6801f2a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:38.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.247+0000 7ff67f7fe700 1 -- 172.21.15.84:0/976613467 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff678009b30 con 0x7ff680161250 2023-09-13T08:24:38.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.247+0000 7ff67e7fc700 1 --2- 172.21.15.84:0/976613467 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff68015d690 0x7ff6800c5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T08:24:38.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.247+0000 7ff67f7fe700 1 --2- 172.21.15.84:0/976613467 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff680161250 0x7ff680159340 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff680072150 tx=0x7ff678004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:38.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.247+0000 7ff6677fe700 1 -- 172.21.15.84:0/976613467 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff678004250 con 0x7ff680161250 2023-09-13T08:24:38.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.247+0000 7ff6677fe700 1 -- 172.21.15.84:0/976613467 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6780043d0 con 0x7ff680161250 2023-09-13T08:24:38.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.248+0000 7ff685644700 1 -- 172.21.15.84:0/976613467 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6800b5730 con 0x7ff680161250 2023-09-13T08:24:38.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.248+0000 7ff6677fe700 1 -- 172.21.15.84:0/976613467 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff678004780 con 0x7ff680161250 2023-09-13T08:24:38.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.248+0000 7ff685644700 1 -- 172.21.15.84:0/976613467 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6800c4fd0 con 0x7ff680161250 2023-09-13T08:24:38.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.248+0000 7ff685644700 1 -- 172.21.15.84:0/976613467 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6800c5190 con 0x7ff680161250 2023-09-13T08:24:38.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.249+0000 7ff6677fe700 1 -- 172.21.15.84:0/976613467 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7ff67801c440 con 0x7ff680161250 2023-09-13T08:24:38.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.249+0000 7ff6677fe700 1 --2- 172.21.15.84:0/976613467 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7ff66c06a580 0x7ff66c06ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:38.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.249+0000 7ff6677fe700 1 -- 172.21.15.84:0/976613467 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff678089c80 con 0x7ff680161250 2023-09-13T08:24:38.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.249+0000 7ff67effd700 1 --2- 172.21.15.84:0/976613467 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7ff66c06a580 0x7ff66c06ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:38.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.250+0000 7ff67effd700 1 --2- 172.21.15.84:0/976613467 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7ff66c06a580 0x7ff66c06ca40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff67400c900 tx=0x7ff674008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:38.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.254+0000 7ff6677fe700 1 -- 172.21.15.84:0/976613467 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7ff678055540 con 0x7ff680161250 2023-09-13T08:24:38.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.485+0000 7ff685644700 1 -- 172.21.15.84:0/976613467 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff6800b5f30 con 0x7ff680161250 2023-09-13T08:24:38.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.485+0000 7ff6677fe700 1 -- 172.21.15.84:0/976613467 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3694 (secure 0 0 0) 0x7ff6800b5f30 con 0x7ff680161250 2023-09-13T08:24:38.486 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:24:38.486 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/3581118217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6833","nonce":3581118217},{"type":"v1","addr":"172.21.15.161:6835","nonce":3581118217}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4296,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/566416855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":566416855},{"type":"v1","addr":"172.21.15.84:6835","nonce":566416855}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4299,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/482729238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":482729238},{"type":"v1","addr":"172.21.15.84:6837","nonce":482729238}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4314,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6834/2524298549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":2524298549},{"type":"v1","addr":"172.21.15.161:6834","nonce":2524298549}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-09-13T08:24:38.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.487+0000 7ff685644700 1 -- 172.21.15.84:0/976613467 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7ff66c06a580 msgr2=0x7ff66c06ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:38.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.487+0000 7ff685644700 1 --2- 172.21.15.84:0/976613467 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7ff66c06a580 0x7ff66c06ca40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff67400c900 tx=0x7ff674008040 comp rx=0 tx=0).stop 2023-09-13T08:24:38.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.488+0000 7ff685644700 1 -- 172.21.15.84:0/976613467 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff680161250 msgr2=0x7ff680159340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:38.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.488+0000 7ff685644700 1 --2- 172.21.15.84:0/976613467 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff680161250 0x7ff680159340 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff680072150 tx=0x7ff678004ad0 comp rx=0 tx=0).stop 2023-09-13T08:24:38.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.488+0000 7ff685644700 1 -- 172.21.15.84:0/976613467 shutdown_connections 2023-09-13T08:24:38.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.488+0000 7ff685644700 1 --2- 172.21.15.84:0/976613467 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff680161250 0x7ff680159340 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:38.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.488+0000 7ff685644700 1 --2- 172.21.15.84:0/976613467 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7ff66c06a580 0x7ff66c06ca40 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:38.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.488+0000 7ff685644700 1 --2- 172.21.15.84:0/976613467 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff6800d0e80 0x7ff6801f2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:38.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.488+0000 7ff685644700 1 --2- 172.21.15.84:0/976613467 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff68015d690 0x7ff6800c5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:38.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.488+0000 7ff685644700 1 -- 172.21.15.84:0/976613467 >> 172.21.15.84:0/976613467 conn(0x7ff68008aff0 msgr2=0x7ff68006bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:38.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.488+0000 7ff685644700 1 -- 172.21.15.84:0/976613467 shutdown_connections 2023-09-13T08:24:38.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.488+0000 7ff685644700 1 -- 172.21.15.84:0/976613467 wait complete. 2023-09-13T08:24:38.491 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 3 2023-09-13T08:24:38.500 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T08:24:38.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.621+0000 7f4a178c9700 1 Processor -- start 2023-09-13T08:24:38.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.622+0000 7f4a178c9700 1 -- start start 2023-09-13T08:24:38.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.622+0000 7f4a178c9700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f4a10159a50 0x7f4a100b1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:38.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.622+0000 7f4a178c9700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4a100cb020 0x7f4a100cb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:38.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.622+0000 7f4a178c9700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a10159e30 con 0x7f4a100b1580 2023-09-13T08:24:38.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.622+0000 7f4a178c9700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a100cb9f0 con 0x7f4a100cb020 2023-09-13T08:24:38.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.622+0000 7f4a178c9700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a1015e090 con 0x7f4a10159a50 2023-09-13T08:24:38.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.622+0000 7f4a15e66700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4a100cb020 0x7f4a100cb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:38.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.622+0000 7f4a14e64700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f4a100b1580 0x7f4a1015d520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:45782/0 (socket says 172.21.15.84:45782) 2023-09-13T08:24:38.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.622+0000 7f4a14e64700 1 -- 172.21.15.84:0/2706235478 learned_addr learned my addr 172.21.15.84:0/2706235478 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:24:38.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.623+0000 7f4a15665700 1 --2- 172.21.15.84:0/2706235478 >> v2:172.21.15.161:3300/0 conn(0x7f4a10159a50 0x7f4a100b1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:38.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.623+0000 7f4a15e66700 1 -- 172.21.15.84:0/2706235478 >> v2:172.21.15.161:3300/0 conn(0x7f4a10159a50 msgr2=0x7f4a100b1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:24:38.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.623+0000 7f4a15e66700 1 --2- 172.21.15.84:0/2706235478 >> v2:172.21.15.161:3300/0 conn(0x7f4a10159a50 0x7f4a100b1040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:38.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.623+0000 7f4a15e66700 1 -- 172.21.15.84:0/2706235478 >> v1:172.21.15.84:6789/0 conn(0x7f4a100b1580 legacy=0x7f4a1015d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:38.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.623+0000 7f4a03fff700 1 -- 172.21.15.84:0/2706235478 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2638759279 0 0) 0x7f4a10159e30 con 0x7f4a100b1580 2023-09-13T08:24:38.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.623+0000 7f4a15e66700 1 -- 172.21.15.84:0/2706235478 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a100b0560 con 0x7f4a100cb020 2023-09-13T08:24:38.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.623+0000 7f4a15e66700 1 --2- 172.21.15.84:0/2706235478 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a100cb020 0x7f4a100cb4b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4a100cf780 tx=0x7f4a0800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1345fd2862f2d4e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:38.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.623+0000 7f4a03fff700 1 -- 172.21.15.84:0/2706235478 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a0800e070 con 0x7f4a100cb020 2023-09-13T08:24:38.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.623+0000 7f4a03fff700 1 -- 172.21.15.84:0/2706235478 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a0800bbd0 con 0x7f4a100cb020 2023-09-13T08:24:38.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.623+0000 7f4a03fff700 1 -- 172.21.15.84:0/2706235478 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a08012430 con 0x7f4a100cb020 2023-09-13T08:24:38.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.624+0000 7f4a178c9700 1 -- 172.21.15.84:0/2706235478 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a100cb020 msgr2=0x7f4a100cb4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:38.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.624+0000 7f4a178c9700 1 --2- 172.21.15.84:0/2706235478 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a100cb020 0x7f4a100cb4b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4a100cf780 tx=0x7f4a0800b330 comp rx=0 tx=0).stop 2023-09-13T08:24:38.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.624+0000 7f4a178c9700 1 -- 172.21.15.84:0/2706235478 shutdown_connections 2023-09-13T08:24:38.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.624+0000 7f4a178c9700 1 --2- 172.21.15.84:0/2706235478 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a100cb020 0x7f4a100cb4b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:38.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.624+0000 7f4a178c9700 1 --2- 172.21.15.84:0/2706235478 >> v2:172.21.15.161:3300/0 conn(0x7f4a10159a50 0x7f4a100b1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:38.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.624+0000 7f4a178c9700 1 -- 172.21.15.84:0/2706235478 >> 172.21.15.84:0/2706235478 conn(0x7f4a100cc230 msgr2=0x7f4a100cc640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:38.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.624+0000 7f4a178c9700 1 -- 172.21.15.84:0/2706235478 shutdown_connections 2023-09-13T08:24:38.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.624+0000 7f4a178c9700 1 -- 172.21.15.84:0/2706235478 wait complete. 2023-09-13T08:24:38.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.625+0000 7f4a178c9700 1 Processor -- start 2023-09-13T08:24:38.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.625+0000 7f4a178c9700 1 -- start start 2023-09-13T08:24:38.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.625+0000 7f4a178c9700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a100b1580 0x7f4a10142c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:38.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.625+0000 7f4a178c9700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4a100cb020 0x7f4a101f39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:38.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.625+0000 7f4a178c9700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4a10159a50 0x7f4a10145690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:38.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.625+0000 7f4a178c9700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a100c86e0 con 0x7f4a100b1580 2023-09-13T08:24:38.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.625+0000 7f4a178c9700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a101f3f00 con 0x7f4a10159a50 2023-09-13T08:24:38.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.625+0000 7f4a178c9700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a10145bd0 con 0x7f4a100cb020 2023-09-13T08:24:38.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.626+0000 7f4a15665700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a100b1580 0x7f4a10142c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:38.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.626+0000 7f4a15665700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a100b1580 0x7f4a10142c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43138/0 (socket says 172.21.15.84:43138) 2023-09-13T08:24:38.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.626+0000 7f4a15665700 1 -- 172.21.15.84:0/2867592436 learned_addr learned my addr 172.21.15.84:0/2867592436 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:24:38.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.626+0000 7f4a15e66700 1 --2- 172.21.15.84:0/2867592436 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4a10159a50 0x7f4a10145690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:38.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.626+0000 7f4a15665700 1 -- 172.21.15.84:0/2867592436 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4a100cb020 msgr2=0x7f4a101f39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:38.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.626+0000 7f4a15665700 1 --2- 172.21.15.84:0/2867592436 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4a100cb020 0x7f4a101f39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:38.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.626+0000 7f4a15665700 1 -- 172.21.15.84:0/2867592436 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4a10159a50 msgr2=0x7f4a10145690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:38.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.626+0000 7f4a15665700 1 --2- 172.21.15.84:0/2867592436 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4a10159a50 0x7f4a10145690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:38.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.626+0000 7f4a15665700 1 -- 172.21.15.84:0/2867592436 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a08009a70 con 0x7f4a100b1580 2023-09-13T08:24:38.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.626+0000 7f4a15665700 1 --2- 172.21.15.84:0/2867592436 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a100b1580 0x7f4a10142c30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4a0400d830 tx=0x7f4a0400dbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:38.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.626+0000 7f4a01ffb700 1 -- 172.21.15.84:0/2867592436 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a040125f0 con 0x7f4a100b1580 2023-09-13T08:24:38.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.626+0000 7f4a01ffb700 1 -- 172.21.15.84:0/2867592436 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a04012750 con 0x7f4a100b1580 2023-09-13T08:24:38.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.626+0000 7f4a178c9700 1 -- 172.21.15.84:0/2867592436 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a100b5130 con 0x7f4a100b1580 2023-09-13T08:24:38.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.626+0000 7f4a01ffb700 1 -- 172.21.15.84:0/2867592436 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a04012b00 con 0x7f4a100b1580 2023-09-13T08:24:38.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.626+0000 7f4a178c9700 1 -- 172.21.15.84:0/2867592436 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a100c8370 con 0x7f4a100b1580 2023-09-13T08:24:38.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.627+0000 7f4a178c9700 1 -- 172.21.15.84:0/2867592436 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a1004e9b0 con 0x7f4a100b1580 2023-09-13T08:24:38.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.628+0000 7f4a01ffb700 1 -- 172.21.15.84:0/2867592436 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f4a04012c60 con 0x7f4a100b1580 2023-09-13T08:24:38.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.628+0000 7f4a01ffb700 1 --2- 172.21.15.84:0/2867592436 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f49f406a580 0x7f49f406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:38.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.628+0000 7f4a01ffb700 1 -- 172.21.15.84:0/2867592436 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4a04088a40 con 0x7f4a100b1580 2023-09-13T08:24:38.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.628+0000 7f4a14e64700 1 --2- 172.21.15.84:0/2867592436 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f49f406a580 0x7f49f406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:38.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.629+0000 7f4a14e64700 1 --2- 172.21.15.84:0/2867592436 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f49f406a580 0x7f49f406ca40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c0011e0 tx=0x7f4a0c0079b0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:38.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.633+0000 7f4a01ffb700 1 -- 172.21.15.84:0/2867592436 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f4a0408ae60 con 0x7f4a100b1580 2023-09-13T08:24:38.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.824+0000 7f4a178c9700 1 -- 172.21.15.84:0/2867592436 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4a1006bb40 con 0x7f4a100b1580 2023-09-13T08:24:38.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.825+0000 7f4a01ffb700 1 -- 172.21.15.84:0/2867592436 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12826 (secure 0 0 0) 0x7f4a04054310 con 0x7f4a100b1580 2023-09-13T08:24:38.825 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:24:38.826 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":16,"fsid":"0107440b-b634-42c5-a643-5d31ea826116","created":"2023-09-13T08:24:16.931917+0000","modified":"2023-09-13T08:24:31.479515+0000","last_up_change":"2023-09-13T08:24:28.422631+0000","last_in_change":"2023-09-13T08:24:19.425578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T08:24:28.583720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4a53ec12-1469-4356-b4e1-2b8fc9b7c0f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6817","nonce":1599532366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6819","nonce":1599532366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6823","nonce":1599532366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6821","nonce":1599532366}]},"public_addr":"172.21.15.84:6817/1599532366","cluster_addr":"172.21.15.84:6819/1599532366","heartbeat_back_addr":"172.21.15.84:6823/1599532366","heartbeat_front_addr":"172.21.15.84:6821/1599532366","state":["exists","up"]},{"osd":1,"uuid":"11e964a0-b80c-4afc-bfbf-e2067969db29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6825","nonce":461860977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6827","nonce":461860977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6831","nonce":461860977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6829","nonce":461860977}]},"public_addr":"172.21.15.84:6825/461860977","cluster_addr":"172.21.15.84:6827/461860977","heartbeat_back_addr":"172.21.15.84:6831/461860977","heartbeat_front_addr":"172.21.15.84:6829/461860977","state":["exists","up"]},{"osd":2,"uuid":"3ce74529-4dd1-44c7-9576-968f5fdc0c25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6809","nonce":1168316165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6811","nonce":1168316165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6815","nonce":1168316165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6813","nonce":1168316165}]},"public_addr":"172.21.15.84:6809/1168316165","cluster_addr":"172.21.15.84:6811/1168316165","heartbeat_back_addr":"172.21.15.84:6815/1168316165","heartbeat_front_addr":"172.21.15.84:6813/1168316165","state":["exists","up"]},{"osd":3,"uuid":"460cb5c5-590a-4d06-a4d9-5bac2fdf33b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6801","nonce":1661609810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6803","nonce":1661609810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6807","nonce":1661609810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6805","nonce":1661609810}]},"public_addr":"172.21.15.84:6801/1661609810","cluster_addr":"172.21.15.84:6803/1661609810","heartbeat_back_addr":"172.21.15.84:6807/1661609810","heartbeat_front_addr":"172.21.15.84:6805/1661609810","state":["exists","up"]},{"osd":4,"uuid":"bf237dd0-3ebd-44b5-8078-24a63e00d792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6801","nonce":1303562374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6803","nonce":1303562374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6807","nonce":1303562374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6805","nonce":1303562374}]},"public_addr":"172.21.15.161:6801/1303562374","cluster_addr":"172.21.15.161:6803/1303562374","heartbeat_back_addr":"172.21.15.161:6807/1303562374","heartbeat_front_addr":"172.21.15.161:6805/1303562374","state":["exists","up"]},{"osd":5,"uuid":"e1e538e0-5844-456b-8c6e-434d3a914af1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6818","nonce":961120854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6822","nonce":961120854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6830","nonce":961120854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6826","nonce":961120854}]},"public_addr":"172.21.15.161:6818/961120854","cluster_addr":"172.21.15.161:6822/961120854","heartbeat_back_addr":"172.21.15.161:6830/961120854","heartbeat_front_addr":"172.21.15.161:6826/961120854","state":["exists","up"]},{"osd":6,"uuid":"5cb1785e-960f-4dd4-b295-9e21b2c3f875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6809","nonce":980533466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6811","nonce":980533466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6815","nonce":980533466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6813","nonce":980533466}]},"public_addr":"172.21.15.161:6809/980533466","cluster_addr":"172.21.15.161:6811/980533466","heartbeat_back_addr":"172.21.15.161:6815/980533466","heartbeat_front_addr":"172.21.15.161:6813/980533466","state":["exists","up"]},{"osd":7,"uuid":"5acb6619-e933-4b46-b1c2-60af30acb839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6817","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6819","nonce":2479691549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6821","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6823","nonce":2479691549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6829","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6831","nonce":2479691549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6825","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6827","nonce":2479691549}]},"public_addr":"172.21.15.161:6819/2479691549","cluster_addr":"172.21.15.161:6823/2479691549","heartbeat_back_addr":"172.21.15.161:6831/2479691549","heartbeat_front_addr":"172.21.15.161:6827/2479691549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.678857+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.685341+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.613603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.634940+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.564387+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.697347+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.637437+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.619397+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T08:24:38.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.827+0000 7f4a178c9700 1 -- 172.21.15.84:0/2867592436 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f49f406a580 msgr2=0x7f49f406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:38.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.827+0000 7f4a178c9700 1 --2- 172.21.15.84:0/2867592436 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f49f406a580 0x7f49f406ca40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c0011e0 tx=0x7f4a0c0079b0 comp rx=0 tx=0).stop 2023-09-13T08:24:38.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.827+0000 7f4a178c9700 1 -- 172.21.15.84:0/2867592436 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a100b1580 msgr2=0x7f4a10142c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:38.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.827+0000 7f4a178c9700 1 --2- 172.21.15.84:0/2867592436 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a100b1580 0x7f4a10142c30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4a0400d830 tx=0x7f4a0400dbf0 comp rx=0 tx=0).stop 2023-09-13T08:24:38.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.827+0000 7f4a178c9700 1 -- 172.21.15.84:0/2867592436 shutdown_connections 2023-09-13T08:24:38.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.827+0000 7f4a178c9700 1 --2- 172.21.15.84:0/2867592436 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f49f406a580 0x7f49f406ca40 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:38.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.827+0000 7f4a178c9700 1 --2- 172.21.15.84:0/2867592436 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4a10159a50 0x7f4a10145690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:38.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.827+0000 7f4a178c9700 1 --2- 172.21.15.84:0/2867592436 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a100b1580 0x7f4a10142c30 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:38.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.827+0000 7f4a178c9700 1 --2- 172.21.15.84:0/2867592436 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4a100cb020 0x7f4a101f39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:38.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.827+0000 7f4a178c9700 1 -- 172.21.15.84:0/2867592436 >> 172.21.15.84:0/2867592436 conn(0x7f4a100cc230 msgr2=0x7f4a1015d4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:38.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.827+0000 7f4a178c9700 1 -- 172.21.15.84:0/2867592436 shutdown_connections 2023-09-13T08:24:38.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.827+0000 7f4a178c9700 1 -- 172.21.15.84:0/2867592436 wait complete. 2023-09-13T08:24:38.839 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T08:24:28.583720+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-13T08:24:38.840 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T08:24:38.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.963+0000 7f7dedd50700 1 Processor -- start 2023-09-13T08:24:38.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.963+0000 7f7dedd50700 1 -- start start 2023-09-13T08:24:38.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.964+0000 7f7dedd50700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7de80ca8e0 0x7f7de80cf570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:38.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.964+0000 7f7dedd50700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7de815e910 0x7f7de80cacc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:38.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.964+0000 7f7dedd50700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f7de80cd590 0x7f7de8161150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:38.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.964+0000 7f7dedd50700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7de815e480 con 0x7f7de80ca8e0 2023-09-13T08:24:38.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.964+0000 7f7dedd50700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7de80cb200 con 0x7f7de80cd590 2023-09-13T08:24:38.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.964+0000 7f7dedd50700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7de80cfbe0 con 0x7f7de815e910 2023-09-13T08:24:38.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.964+0000 7f7de77fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7de80ca8e0 0x7f7de80cf570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:38.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.964+0000 7f7de77fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7de80ca8e0 0x7f7de80cf570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43146/0 (socket says 172.21.15.84:43146) 2023-09-13T08:24:38.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.964+0000 7f7de77fe700 1 -- 172.21.15.84:0/2003169911 learned_addr learned my addr 172.21.15.84:0/2003169911 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:24:38.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.964+0000 7f7de7fff700 1 --2- 172.21.15.84:0/2003169911 >> v2:172.21.15.161:3300/0 conn(0x7f7de80cd590 0x7f7de8161150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:38.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.964+0000 7f7de6ffd700 1 --2- 172.21.15.84:0/2003169911 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7de815e910 0x7f7de80cacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:38.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.964+0000 7f7de77fe700 1 -- 172.21.15.84:0/2003169911 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7de815e910 msgr2=0x7f7de80cacc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:24:38.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.964+0000 7f7de77fe700 1 --2- 172.21.15.84:0/2003169911 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7de815e910 0x7f7de80cacc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:38.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.964+0000 7f7de77fe700 1 -- 172.21.15.84:0/2003169911 >> v2:172.21.15.161:3300/0 conn(0x7f7de80cd590 msgr2=0x7f7de8161150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:24:38.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.964+0000 7f7de77fe700 1 --2- 172.21.15.84:0/2003169911 >> v2:172.21.15.161:3300/0 conn(0x7f7de80cd590 0x7f7de8161150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:38.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.964+0000 7f7de77fe700 1 -- 172.21.15.84:0/2003169911 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7de815de30 con 0x7f7de80ca8e0 2023-09-13T08:24:38.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.964+0000 7f7de6ffd700 1 --2- 172.21.15.84:0/2003169911 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7de815e910 0x7f7de80cacc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T08:24:38.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.964+0000 7f7de77fe700 1 --2- 172.21.15.84:0/2003169911 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7de80ca8e0 0x7f7de80cf570 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7de80712f0 tx=0x7f7ddc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbbd889741b1d00f server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:38.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.964+0000 7f7de67fc700 1 -- 172.21.15.84:0/2003169911 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ddc00b870 con 0x7f7de80ca8e0 2023-09-13T08:24:38.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.965+0000 7f7de67fc700 1 -- 172.21.15.84:0/2003169911 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ddc00b9d0 con 0x7f7de80ca8e0 2023-09-13T08:24:38.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.965+0000 7f7de67fc700 1 -- 172.21.15.84:0/2003169911 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ddc00bd60 con 0x7f7de80ca8e0 2023-09-13T08:24:38.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.965+0000 7f7dedd50700 1 -- 172.21.15.84:0/2003169911 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7de80ca8e0 msgr2=0x7f7de80cf570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:38.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.965+0000 7f7dedd50700 1 --2- 172.21.15.84:0/2003169911 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7de80ca8e0 0x7f7de80cf570 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7de80712f0 tx=0x7f7ddc009bd0 comp rx=0 tx=0).stop 2023-09-13T08:24:38.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.965+0000 7f7dedd50700 1 -- 172.21.15.84:0/2003169911 shutdown_connections 2023-09-13T08:24:38.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.965+0000 7f7dedd50700 1 --2- 172.21.15.84:0/2003169911 >> v2:172.21.15.161:3300/0 conn(0x7f7de80cd590 0x7f7de8161150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:38.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.965+0000 7f7dedd50700 1 --2- 172.21.15.84:0/2003169911 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7de80ca8e0 0x7f7de80cf570 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:38.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.965+0000 7f7dedd50700 1 --2- 172.21.15.84:0/2003169911 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7de815e910 0x7f7de80cacc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:38.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.965+0000 7f7dedd50700 1 -- 172.21.15.84:0/2003169911 >> 172.21.15.84:0/2003169911 conn(0x7f7de80cca70 msgr2=0x7f7de80cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:38.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.965+0000 7f7dedd50700 1 -- 172.21.15.84:0/2003169911 shutdown_connections 2023-09-13T08:24:38.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.965+0000 7f7dedd50700 1 -- 172.21.15.84:0/2003169911 wait complete. 2023-09-13T08:24:38.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.966+0000 7f7dedd50700 1 Processor -- start 2023-09-13T08:24:38.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.966+0000 7f7dedd50700 1 -- start start 2023-09-13T08:24:38.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.967+0000 7f7dedd50700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7de80ca8e0 0x7f7de8146c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:38.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.967+0000 7f7dedd50700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7de80cd590 0x7f7de8158080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:38.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.967+0000 7f7dedd50700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7de815e910 0x7f7de81e8f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:38.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.967+0000 7f7dedd50700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7de80c69b0 con 0x7f7de80cd590 2023-09-13T08:24:38.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.967+0000 7f7dedd50700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7de81471a0 con 0x7f7de80ca8e0 2023-09-13T08:24:38.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.967+0000 7f7dedd50700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7de80b4e10 con 0x7f7de815e910 2023-09-13T08:24:38.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.967+0000 7f7de6ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7de80cd590 0x7f7de8158080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:38.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.967+0000 7f7de6ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7de80cd590 0x7f7de8158080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43152/0 (socket says 172.21.15.84:43152) 2023-09-13T08:24:38.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.967+0000 7f7de6ffd700 1 -- 172.21.15.84:0/2699270372 learned_addr learned my addr 172.21.15.84:0/2699270372 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:24:38.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.968+0000 7f7de77fe700 1 --2- 172.21.15.84:0/2699270372 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7de80ca8e0 0x7f7de8146c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:38.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.968+0000 7f7de6ffd700 1 -- 172.21.15.84:0/2699270372 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7de815e910 msgr2=0x7f7de81e8f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:38.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.968+0000 7f7de6ffd700 1 --2- 172.21.15.84:0/2699270372 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7de815e910 0x7f7de81e8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:38.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.968+0000 7f7de6ffd700 1 -- 172.21.15.84:0/2699270372 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7de80ca8e0 msgr2=0x7f7de8146c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:38.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.968+0000 7f7de6ffd700 1 --2- 172.21.15.84:0/2699270372 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7de80ca8e0 0x7f7de8146c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:38.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.968+0000 7f7de6ffd700 1 -- 172.21.15.84:0/2699270372 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ddc009550 con 0x7f7de80cd590 2023-09-13T08:24:38.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.968+0000 7f7de6ffd700 1 --2- 172.21.15.84:0/2699270372 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7de80cd590 0x7f7de8158080 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7dd800c7f0 tx=0x7f7dd800cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:38.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.968+0000 7f7dcffff700 1 -- 172.21.15.84:0/2699270372 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd8004220 con 0x7f7de80cd590 2023-09-13T08:24:38.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.968+0000 7f7dcffff700 1 -- 172.21.15.84:0/2699270372 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dd8004380 con 0x7f7de80cd590 2023-09-13T08:24:38.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.968+0000 7f7dedd50700 1 -- 172.21.15.84:0/2699270372 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7de80b50f0 con 0x7f7de80cd590 2023-09-13T08:24:38.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.968+0000 7f7dcffff700 1 -- 172.21.15.84:0/2699270372 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd80036a0 con 0x7f7de80cd590 2023-09-13T08:24:38.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.968+0000 7f7dedd50700 1 -- 172.21.15.84:0/2699270372 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7de80b56b0 con 0x7f7de80cd590 2023-09-13T08:24:38.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.969+0000 7f7dedd50700 1 -- 172.21.15.84:0/2699270372 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7de804f200 con 0x7f7de80cd590 2023-09-13T08:24:38.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.969+0000 7f7dcffff700 1 -- 172.21.15.84:0/2699270372 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f7dd8003800 con 0x7f7de80cd590 2023-09-13T08:24:38.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.970+0000 7f7dcffff700 1 --2- 172.21.15.84:0/2699270372 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f7dd406a580 0x7f7dd406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:38.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.970+0000 7f7dcffff700 1 -- 172.21.15.84:0/2699270372 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7dd8088240 con 0x7f7de80cd590 2023-09-13T08:24:38.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.970+0000 7f7de77fe700 1 --2- 172.21.15.84:0/2699270372 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f7dd406a580 0x7f7dd406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:38.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.970+0000 7f7de77fe700 1 --2- 172.21.15.84:0/2699270372 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f7dd406a580 0x7f7dd406ca40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc009130 tx=0x7f7ddc008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:38.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:38.974+0000 7f7dcffff700 1 -- 172.21.15.84:0/2699270372 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f7dd8053ba0 con 0x7f7de80cd590 2023-09-13T08:24:39.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.164+0000 7f7dedd50700 1 -- 172.21.15.84:0/2699270372 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7de81585c0 con 0x7f7de80cd590 2023-09-13T08:24:39.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.165+0000 7f7dcffff700 1 -- 172.21.15.84:0/2699270372 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7dd80571c0 con 0x7f7de80cd590 2023-09-13T08:24:39.165 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-09-13T08:24:39.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.167+0000 7f7dedd50700 1 -- 172.21.15.84:0/2699270372 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f7dd406a580 msgr2=0x7f7dd406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:39.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.167+0000 7f7dedd50700 1 --2- 172.21.15.84:0/2699270372 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f7dd406a580 0x7f7dd406ca40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc009130 tx=0x7f7ddc008030 comp rx=0 tx=0).stop 2023-09-13T08:24:39.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.167+0000 7f7dedd50700 1 -- 172.21.15.84:0/2699270372 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7de80cd590 msgr2=0x7f7de8158080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:39.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.167+0000 7f7dedd50700 1 --2- 172.21.15.84:0/2699270372 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7de80cd590 0x7f7de8158080 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7dd800c7f0 tx=0x7f7dd800cbb0 comp rx=0 tx=0).stop 2023-09-13T08:24:39.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.167+0000 7f7dedd50700 1 -- 172.21.15.84:0/2699270372 shutdown_connections 2023-09-13T08:24:39.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.167+0000 7f7dedd50700 1 --2- 172.21.15.84:0/2699270372 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7de815e910 0x7f7de81e8f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:39.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.167+0000 7f7dedd50700 1 --2- 172.21.15.84:0/2699270372 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f7dd406a580 0x7f7dd406ca40 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:39.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.167+0000 7f7dedd50700 1 --2- 172.21.15.84:0/2699270372 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7de80ca8e0 0x7f7de8146c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:39.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.167+0000 7f7dedd50700 1 --2- 172.21.15.84:0/2699270372 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7de80cd590 0x7f7de8158080 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:39.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.167+0000 7f7dedd50700 1 -- 172.21.15.84:0/2699270372 >> 172.21.15.84:0/2699270372 conn(0x7f7de80cca70 msgr2=0x7f7de80afb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:39.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.167+0000 7f7dedd50700 1 -- 172.21.15.84:0/2699270372 shutdown_connections 2023-09-13T08:24:39.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.167+0000 7f7dedd50700 1 -- 172.21.15.84:0/2699270372 wait complete. 2023-09-13T08:24:39.179 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-09-13T08:24:39.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.298+0000 7fbb8248a700 1 Processor -- start 2023-09-13T08:24:39.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.298+0000 7fbb8248a700 1 -- start start 2023-09-13T08:24:39.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.299+0000 7fbb8248a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fbb7c0ca920 0x7fbb7c06d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:39.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.299+0000 7fbb8248a700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fbb7c06a620 0x7fbb7c06aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:39.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.299+0000 7fbb8248a700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb7c06af90 con 0x7fbb7c15d530 2023-09-13T08:24:39.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.299+0000 7fbb8248a700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb7c0cff20 con 0x7fbb7c0ca920 2023-09-13T08:24:39.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.299+0000 7fbb8248a700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb7c0cae50 con 0x7fbb7c06a620 2023-09-13T08:24:39.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.299+0000 7fbb7b7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fbb7c0ca920 0x7fbb7c06d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:39.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.299+0000 7fbb7b7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fbb7c0ca920 0x7fbb7c06d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43162/0 (socket says 172.21.15.84:43162) 2023-09-13T08:24:39.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.299+0000 7fbb7b7fe700 1 -- 172.21.15.84:0/1376814172 learned_addr learned my addr 172.21.15.84:0/1376814172 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:24:39.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.299+0000 7fbb80a27700 1 --2- 172.21.15.84:0/1376814172 >> v2:172.21.15.161:3300/0 conn(0x7fbb7c06a620 0x7fbb7c06aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:39.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.299+0000 7fbb7b7fe700 1 -- 172.21.15.84:0/1376814172 >> v2:172.21.15.161:3300/0 conn(0x7fbb7c06a620 msgr2=0x7fbb7c06aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:24:39.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.299+0000 7fbb7b7fe700 1 --2- 172.21.15.84:0/1376814172 >> v2:172.21.15.161:3300/0 conn(0x7fbb7c06a620 0x7fbb7c06aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:39.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.299+0000 7fbb7b7fe700 1 -- 172.21.15.84:0/1376814172 >> v1:172.21.15.161:6789/0 conn(0x7fbb7c15d530 legacy=0x7fbb7c161bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:24:39.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.299+0000 7fbb7b7fe700 1 -- 172.21.15.84:0/1376814172 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb7c0cb130 con 0x7fbb7c0ca920 2023-09-13T08:24:39.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.300+0000 7fbb7b7fe700 1 --2- 172.21.15.84:0/1376814172 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb7c0ca920 0x7fbb7c06d700 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbb7c06b210 tx=0x7fbb6c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=892a789ee2029334 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:39.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.300+0000 7fbb7affd700 1 -- 172.21.15.84:0/1376814172 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb6c004230 con 0x7fbb7c0ca920 2023-09-13T08:24:39.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.300+0000 7fbb7affd700 1 -- 172.21.15.84:0/1376814172 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb6c004390 con 0x7fbb7c0ca920 2023-09-13T08:24:39.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.300+0000 7fbb7affd700 1 -- 172.21.15.84:0/1376814172 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb6c0036a0 con 0x7fbb7c0ca920 2023-09-13T08:24:39.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.300+0000 7fbb8248a700 1 -- 172.21.15.84:0/1376814172 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb7c0ca920 msgr2=0x7fbb7c06d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:39.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.300+0000 7fbb8248a700 1 --2- 172.21.15.84:0/1376814172 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb7c0ca920 0x7fbb7c06d700 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbb7c06b210 tx=0x7fbb6c009bd0 comp rx=0 tx=0).stop 2023-09-13T08:24:39.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.300+0000 7fbb8248a700 1 -- 172.21.15.84:0/1376814172 shutdown_connections 2023-09-13T08:24:39.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.300+0000 7fbb8248a700 1 --2- 172.21.15.84:0/1376814172 >> v2:172.21.15.161:3300/0 conn(0x7fbb7c06a620 0x7fbb7c06aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:39.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.300+0000 7fbb8248a700 1 --2- 172.21.15.84:0/1376814172 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb7c0ca920 0x7fbb7c06d700 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:39.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.300+0000 7fbb8248a700 1 -- 172.21.15.84:0/1376814172 >> 172.21.15.84:0/1376814172 conn(0x7fbb7c0d00c0 msgr2=0x7fbb7c0d04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:39.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.300+0000 7fbb8248a700 1 -- 172.21.15.84:0/1376814172 shutdown_connections 2023-09-13T08:24:39.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.300+0000 7fbb8248a700 1 -- 172.21.15.84:0/1376814172 wait complete. 2023-09-13T08:24:39.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.302+0000 7fbb8248a700 1 Processor -- start 2023-09-13T08:24:39.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.302+0000 7fbb8248a700 1 -- start start 2023-09-13T08:24:39.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.303+0000 7fbb8248a700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbb7c06a620 0x7fbb7c0c98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:39.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.303+0000 7fbb8248a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbb7c0ca920 0x7fbb7c1519c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:39.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.303+0000 7fbb8248a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb7c15d530 0x7fbb7c0ced80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:39.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.303+0000 7fbb8248a700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb7c1595e0 con 0x7fbb7c15d530 2023-09-13T08:24:39.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.303+0000 7fbb8248a700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb7c151f00 con 0x7fbb7c0ca920 2023-09-13T08:24:39.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.303+0000 7fbb8248a700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb7c0c9fc0 con 0x7fbb7c06a620 2023-09-13T08:24:39.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.303+0000 7fbb80a27700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb7c15d530 0x7fbb7c0ced80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:39.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.303+0000 7fbb80a27700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb7c15d530 0x7fbb7c0ced80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43170/0 (socket says 172.21.15.84:43170) 2023-09-13T08:24:39.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.303+0000 7fbb80a27700 1 -- 172.21.15.84:0/1653416229 learned_addr learned my addr 172.21.15.84:0/1653416229 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:24:39.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.303+0000 7fbb7b7fe700 1 --2- 172.21.15.84:0/1653416229 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbb7c0ca920 0x7fbb7c1519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:39.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.303+0000 7fbb7bfff700 1 --2- 172.21.15.84:0/1653416229 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbb7c06a620 0x7fbb7c0c98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:39.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.303+0000 7fbb80a27700 1 -- 172.21.15.84:0/1653416229 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbb7c06a620 msgr2=0x7fbb7c0c98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:39.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.303+0000 7fbb80a27700 1 --2- 172.21.15.84:0/1653416229 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbb7c06a620 0x7fbb7c0c98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:39.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.303+0000 7fbb80a27700 1 -- 172.21.15.84:0/1653416229 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbb7c0ca920 msgr2=0x7fbb7c1519c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:39.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.303+0000 7fbb80a27700 1 --2- 172.21.15.84:0/1653416229 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbb7c0ca920 0x7fbb7c1519c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:39.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.303+0000 7fbb80a27700 1 -- 172.21.15.84:0/1653416229 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb6c009550 con 0x7fbb7c15d530 2023-09-13T08:24:39.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.303+0000 7fbb80a27700 1 --2- 172.21.15.84:0/1653416229 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb7c15d530 0x7fbb7c0ced80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbb7400cc80 tx=0x7fbb7400a4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:39.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.304+0000 7fbb78ff9700 1 -- 172.21.15.84:0/1653416229 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb7400ce20 con 0x7fbb7c15d530 2023-09-13T08:24:39.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.304+0000 7fbb78ff9700 1 -- 172.21.15.84:0/1653416229 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb7400ad30 con 0x7fbb7c15d530 2023-09-13T08:24:39.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.304+0000 7fbb78ff9700 1 -- 172.21.15.84:0/1653416229 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb7400aea0 con 0x7fbb7c15d530 2023-09-13T08:24:39.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.304+0000 7fbb8248a700 1 -- 172.21.15.84:0/1653416229 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb7c159830 con 0x7fbb7c15d530 2023-09-13T08:24:39.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.304+0000 7fbb8248a700 1 -- 172.21.15.84:0/1653416229 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb7c159df0 con 0x7fbb7c15d530 2023-09-13T08:24:39.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.305+0000 7fbb8248a700 1 -- 172.21.15.84:0/1653416229 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb7c04e9b0 con 0x7fbb7c15d530 2023-09-13T08:24:39.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.305+0000 7fbb78ff9700 1 -- 172.21.15.84:0/1653416229 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fbb7400f3f0 con 0x7fbb7c15d530 2023-09-13T08:24:39.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.305+0000 7fbb78ff9700 1 --2- 172.21.15.84:0/1653416229 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fbb6806a580 0x7fbb6806ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:39.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.305+0000 7fbb78ff9700 1 -- 172.21.15.84:0/1653416229 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fbb74088830 con 0x7fbb7c15d530 2023-09-13T08:24:39.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.305+0000 7fbb7bfff700 1 --2- 172.21.15.84:0/1653416229 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fbb6806a580 0x7fbb6806ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:39.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.306+0000 7fbb7bfff700 1 --2- 172.21.15.84:0/1653416229 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fbb6806a580 0x7fbb6806ca40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fbb70001730 tx=0x7fbb70009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:39.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.310+0000 7fbb78ff9700 1 -- 172.21.15.84:0/1653416229 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fbb74054100 con 0x7fbb7c15d530 2023-09-13T08:24:39.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.503+0000 7fbb8248a700 1 -- 172.21.15.84:0/1653416229 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fbb7c0b6040 con 0x7fbb7c15d530 2023-09-13T08:24:39.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.503+0000 7fbb78ff9700 1 -- 172.21.15.84:0/1653416229 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7fbb7401d070 con 0x7fbb7c15d530 2023-09-13T08:24:39.504 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:24:39.505 INFO:teuthology.orchestra.run.smithi084.stdout:[ 2023-09-13T08:24:39.505 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-09-13T08:24:39.505 INFO:teuthology.orchestra.run.smithi084.stdout: "poolnum": 1, 2023-09-13T08:24:39.505 INFO:teuthology.orchestra.run.smithi084.stdout: "poolname": ".mgr" 2023-09-13T08:24:39.505 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-09-13T08:24:39.506 INFO:teuthology.orchestra.run.smithi084.stdout:] 2023-09-13T08:24:39.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.505+0000 7fbb8248a700 1 -- 172.21.15.84:0/1653416229 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fbb6806a580 msgr2=0x7fbb6806ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:39.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.505+0000 7fbb8248a700 1 --2- 172.21.15.84:0/1653416229 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fbb6806a580 0x7fbb6806ca40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fbb70001730 tx=0x7fbb70009040 comp rx=0 tx=0).stop 2023-09-13T08:24:39.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.505+0000 7fbb8248a700 1 -- 172.21.15.84:0/1653416229 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb7c15d530 msgr2=0x7fbb7c0ced80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:39.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.505+0000 7fbb8248a700 1 --2- 172.21.15.84:0/1653416229 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb7c15d530 0x7fbb7c0ced80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbb7400cc80 tx=0x7fbb7400a4d0 comp rx=0 tx=0).stop 2023-09-13T08:24:39.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.505+0000 7fbb8248a700 1 -- 172.21.15.84:0/1653416229 shutdown_connections 2023-09-13T08:24:39.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.505+0000 7fbb8248a700 1 --2- 172.21.15.84:0/1653416229 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb7c15d530 0x7fbb7c0ced80 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:39.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.505+0000 7fbb8248a700 1 --2- 172.21.15.84:0/1653416229 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbb7c06a620 0x7fbb7c0c98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:39.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.505+0000 7fbb8248a700 1 --2- 172.21.15.84:0/1653416229 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fbb6806a580 0x7fbb6806ca40 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:39.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.505+0000 7fbb8248a700 1 --2- 172.21.15.84:0/1653416229 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbb7c0ca920 0x7fbb7c1519c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:39.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.505+0000 7fbb8248a700 1 -- 172.21.15.84:0/1653416229 >> 172.21.15.84:0/1653416229 conn(0x7fbb7c0d00c0 msgr2=0x7fbb7c1521e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:39.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.506+0000 7fbb8248a700 1 -- 172.21.15.84:0/1653416229 shutdown_connections 2023-09-13T08:24:39.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.506+0000 7fbb8248a700 1 -- 172.21.15.84:0/1653416229 wait complete. 2023-09-13T08:24:39.517 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-09-13T08:24:39.518 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-09-13T08:24:39.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.642+0000 7ff1b18d7700 1 Processor -- start 2023-09-13T08:24:39.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.642+0000 7ff1b18d7700 1 -- start start 2023-09-13T08:24:39.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.643+0000 7ff1b18d7700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff1ac15d5b0 0x7ff1ac0b8e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:39.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.643+0000 7ff1b18d7700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff1ac0d03b0 0x7ff1ac0d1e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:39.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.643+0000 7ff1b18d7700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1ac15d990 con 0x7ff1ac161030 2023-09-13T08:24:39.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.643+0000 7ff1b18d7700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1ac0b63f0 con 0x7ff1ac15d5b0 2023-09-13T08:24:39.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.643+0000 7ff1b18d7700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1ac161880 con 0x7ff1ac0d03b0 2023-09-13T08:24:39.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.643+0000 7ff1aaffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff1ac15d5b0 0x7ff1ac0b8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:39.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.643+0000 7ff1aa7fc700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7ff1ac161030 0x7ff1ac0cfca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:45822/0 (socket says 172.21.15.84:45822) 2023-09-13T08:24:39.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.643+0000 7ff1aa7fc700 1 -- 172.21.15.84:0/1810711041 learned_addr learned my addr 172.21.15.84:0/1810711041 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:24:39.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.643+0000 7ff1ab7fe700 1 --2- 172.21.15.84:0/1810711041 >> v2:172.21.15.161:3300/0 conn(0x7ff1ac0d03b0 0x7ff1ac0d1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:39.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.643+0000 7ff1a9ffb700 1 -- 172.21.15.84:0/1810711041 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2749379565 0 0) 0x7ff1a0001110 con 0x7ff1ac161030 2023-09-13T08:24:39.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.643+0000 7ff1a9ffb700 1 -- 172.21.15.84:0/1810711041 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1940035b0 con 0x7ff1ac161030 2023-09-13T08:24:39.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.643+0000 7ff1aaffd700 1 -- 172.21.15.84:0/1810711041 >> v2:172.21.15.161:3300/0 conn(0x7ff1ac0d03b0 msgr2=0x7ff1ac0d1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:24:39.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.643+0000 7ff1aaffd700 1 --2- 172.21.15.84:0/1810711041 >> v2:172.21.15.161:3300/0 conn(0x7ff1ac0d03b0 0x7ff1ac0d1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:39.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.643+0000 7ff1aaffd700 1 -- 172.21.15.84:0/1810711041 >> v1:172.21.15.84:6789/0 conn(0x7ff1ac161030 legacy=0x7ff1ac0cfca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:39.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.643+0000 7ff1aaffd700 1 -- 172.21.15.84:0/1810711041 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1ac161b60 con 0x7ff1ac15d5b0 2023-09-13T08:24:39.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.643+0000 7ff1ab7fe700 1 --2- 172.21.15.84:0/1810711041 >> v2:172.21.15.161:3300/0 conn(0x7ff1ac0d03b0 0x7ff1ac0d1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T08:24:39.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.643+0000 7ff1aaffd700 1 --2- 172.21.15.84:0/1810711041 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff1ac15d5b0 0x7ff1ac0b8e80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac072cf0 tx=0x7ff1a4009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a52b16b7cb172e27 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:39.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.643+0000 7ff1a9ffb700 1 -- 172.21.15.84:0/1810711041 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a4011830 con 0x7ff1ac15d5b0 2023-09-13T08:24:39.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.644+0000 7ff1a9ffb700 1 -- 172.21.15.84:0/1810711041 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1a4011990 con 0x7ff1ac15d5b0 2023-09-13T08:24:39.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.644+0000 7ff1a9ffb700 1 -- 172.21.15.84:0/1810711041 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a4011d20 con 0x7ff1ac15d5b0 2023-09-13T08:24:39.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.644+0000 7ff1b18d7700 1 -- 172.21.15.84:0/1810711041 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff1ac15d5b0 msgr2=0x7ff1ac0b8e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:39.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.644+0000 7ff1b18d7700 1 --2- 172.21.15.84:0/1810711041 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff1ac15d5b0 0x7ff1ac0b8e80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac072cf0 tx=0x7ff1a4009b20 comp rx=0 tx=0).stop 2023-09-13T08:24:39.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.644+0000 7ff1b18d7700 1 -- 172.21.15.84:0/1810711041 shutdown_connections 2023-09-13T08:24:39.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.644+0000 7ff1b18d7700 1 --2- 172.21.15.84:0/1810711041 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff1ac15d5b0 0x7ff1ac0b8e80 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:39.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.644+0000 7ff1b18d7700 1 --2- 172.21.15.84:0/1810711041 >> v2:172.21.15.161:3300/0 conn(0x7ff1ac0d03b0 0x7ff1ac0d1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:39.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.644+0000 7ff1b18d7700 1 -- 172.21.15.84:0/1810711041 >> 172.21.15.84:0/1810711041 conn(0x7ff1ac06b110 msgr2=0x7ff1ac06b4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:39.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.644+0000 7ff1b18d7700 1 -- 172.21.15.84:0/1810711041 shutdown_connections 2023-09-13T08:24:39.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.644+0000 7ff1b18d7700 1 -- 172.21.15.84:0/1810711041 wait complete. 2023-09-13T08:24:39.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.646+0000 7ff1b18d7700 1 Processor -- start 2023-09-13T08:24:39.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.646+0000 7ff1b18d7700 1 -- start start 2023-09-13T08:24:39.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.647+0000 7ff1b18d7700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff1ac0d03b0 0x7ff1ac150830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:39.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.647+0000 7ff1b18d7700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff1ac15d5b0 0x7ff1ac0cca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:39.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.647+0000 7ff1b18d7700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff1ac161030 0x7ff1ac0b73c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:39.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.647+0000 7ff1b18d7700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1ac1f2b30 con 0x7ff1ac0d03b0 2023-09-13T08:24:39.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.647+0000 7ff1b18d7700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1ac150d70 con 0x7ff1ac161030 2023-09-13T08:24:39.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.647+0000 7ff1b18d7700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1ac159cc0 con 0x7ff1ac15d5b0 2023-09-13T08:24:39.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.647+0000 7ff1aaffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff1ac0d03b0 0x7ff1ac150830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:39.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.647+0000 7ff1aaffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff1ac0d03b0 0x7ff1ac150830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43180/0 (socket says 172.21.15.84:43180) 2023-09-13T08:24:39.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.647+0000 7ff1aaffd700 1 -- 172.21.15.84:0/2058222446 learned_addr learned my addr 172.21.15.84:0/2058222446 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:24:39.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.647+0000 7ff1ab7fe700 1 --2- 172.21.15.84:0/2058222446 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff1ac161030 0x7ff1ac0b73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:39.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.647+0000 7ff1aaffd700 1 -- 172.21.15.84:0/2058222446 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff1ac15d5b0 msgr2=0x7ff1ac0cca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:39.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.647+0000 7ff1aa7fc700 1 --2- 172.21.15.84:0/2058222446 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff1ac15d5b0 0x7ff1ac0cca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:39.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.647+0000 7ff1aaffd700 1 --2- 172.21.15.84:0/2058222446 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff1ac15d5b0 0x7ff1ac0cca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:39.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.647+0000 7ff1aaffd700 1 -- 172.21.15.84:0/2058222446 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff1ac161030 msgr2=0x7ff1ac0b73c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:39.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.647+0000 7ff1aaffd700 1 --2- 172.21.15.84:0/2058222446 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff1ac161030 0x7ff1ac0b73c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:39.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.647+0000 7ff1aaffd700 1 -- 172.21.15.84:0/2058222446 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1a40094a0 con 0x7ff1ac0d03b0 2023-09-13T08:24:39.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.647+0000 7ff1aaffd700 1 --2- 172.21.15.84:0/2058222446 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff1ac0d03b0 0x7ff1ac150830 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff1a4009b60 tx=0x7ff1a4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:39.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.647+0000 7ff193fff700 1 -- 172.21.15.84:0/2058222446 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a40036a0 con 0x7ff1ac0d03b0 2023-09-13T08:24:39.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.647+0000 7ff193fff700 1 -- 172.21.15.84:0/2058222446 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1a401f070 con 0x7ff1ac0d03b0 2023-09-13T08:24:39.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.647+0000 7ff1b18d7700 1 -- 172.21.15.84:0/2058222446 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1ac0cb440 con 0x7ff1ac0d03b0 2023-09-13T08:24:39.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.647+0000 7ff193fff700 1 -- 172.21.15.84:0/2058222446 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a4003a40 con 0x7ff1ac0d03b0 2023-09-13T08:24:39.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.647+0000 7ff1b18d7700 1 -- 172.21.15.84:0/2058222446 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1ac0cba00 con 0x7ff1ac0d03b0 2023-09-13T08:24:39.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.648+0000 7ff1b18d7700 1 -- 172.21.15.84:0/2058222446 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1ac0d1580 con 0x7ff1ac0d03b0 2023-09-13T08:24:39.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.649+0000 7ff193fff700 1 -- 172.21.15.84:0/2058222446 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7ff1a4003ba0 con 0x7ff1ac0d03b0 2023-09-13T08:24:39.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.649+0000 7ff193fff700 1 --2- 172.21.15.84:0/2058222446 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7ff19806a580 0x7ff19806ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:39.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.649+0000 7ff193fff700 1 -- 172.21.15.84:0/2058222446 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff1a4021070 con 0x7ff1ac0d03b0 2023-09-13T08:24:39.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.649+0000 7ff1aa7fc700 1 --2- 172.21.15.84:0/2058222446 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7ff19806a580 0x7ff19806ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:39.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.650+0000 7ff1aa7fc700 1 --2- 172.21.15.84:0/2058222446 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7ff19806a580 0x7ff19806ca40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac0b7f10 tx=0x7ff1a0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:39.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.653+0000 7ff193fff700 1 -- 172.21.15.84:0/2058222446 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7ff1a40559b0 con 0x7ff1ac0d03b0 2023-09-13T08:24:39.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:39.844+0000 7ff1b18d7700 1 -- 172.21.15.84:0/2058222446 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7ff1ac04e9b0 con 0x7ff1ac0d03b0 2023-09-13T08:24:40.632 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:24:40.635 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:24:40.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:40.729+0000 7ff193fff700 1 -- 172.21.15.84:0/2058222446 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7ff1a402b0b0 con 0x7ff1ac0d03b0 2023-09-13T08:24:40.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:40.732+0000 7ff1b18d7700 1 -- 172.21.15.84:0/2058222446 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7ff19806a580 msgr2=0x7ff19806ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:40.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:40.732+0000 7ff1b18d7700 1 --2- 172.21.15.84:0/2058222446 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7ff19806a580 0x7ff19806ca40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac0b7f10 tx=0x7ff1a0009040 comp rx=0 tx=0).stop 2023-09-13T08:24:40.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:40.732+0000 7ff1b18d7700 1 -- 172.21.15.84:0/2058222446 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff1ac0d03b0 msgr2=0x7ff1ac150830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:40.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:40.732+0000 7ff1b18d7700 1 --2- 172.21.15.84:0/2058222446 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff1ac0d03b0 0x7ff1ac150830 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff1a4009b60 tx=0x7ff1a4004750 comp rx=0 tx=0).stop 2023-09-13T08:24:40.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:40.732+0000 7ff1b18d7700 1 -- 172.21.15.84:0/2058222446 shutdown_connections 2023-09-13T08:24:40.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:40.732+0000 7ff1b18d7700 1 --2- 172.21.15.84:0/2058222446 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7ff19806a580 0x7ff19806ca40 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:40.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:40.732+0000 7ff1b18d7700 1 --2- 172.21.15.84:0/2058222446 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff1ac161030 0x7ff1ac0b73c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:40.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:40.732+0000 7ff1b18d7700 1 --2- 172.21.15.84:0/2058222446 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff1ac0d03b0 0x7ff1ac150830 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:40.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:40.732+0000 7ff1b18d7700 1 --2- 172.21.15.84:0/2058222446 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff1ac15d5b0 0x7ff1ac0cca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:40.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:40.732+0000 7ff1b18d7700 1 -- 172.21.15.84:0/2058222446 >> 172.21.15.84:0/2058222446 conn(0x7ff1ac06b110 msgr2=0x7ff1ac0d2e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:40.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:40.732+0000 7ff1b18d7700 1 -- 172.21.15.84:0/2058222446 shutdown_connections 2023-09-13T08:24:40.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:40.732+0000 7ff1b18d7700 1 -- 172.21.15.84:0/2058222446 wait complete. 2023-09-13T08:24:40.736 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_metadata' created 2023-09-13T08:24:40.750 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-09-13T08:24:40.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:40.924+0000 7fa8d19cd700 1 Processor -- start 2023-09-13T08:24:40.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:40.924+0000 7fa8d19cd700 1 -- start start 2023-09-13T08:24:40.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:40.925+0000 7fa8d19cd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa8cc0d0340 0x7fa8cc0b8d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:40.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:40.925+0000 7fa8d19cd700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8cc15d950 con 0x7fa8cc160ff0 2023-09-13T08:24:40.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:40.925+0000 7fa8d19cd700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8cc161440 con 0x7fa8cc15d570 2023-09-13T08:24:40.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:40.925+0000 7fa8d19cd700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8cc1616f0 con 0x7fa8cc0d0340 2023-09-13T08:24:40.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:40.925+0000 7fa8ca7fc700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa8cc0d0340 0x7fa8cc0b8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:40.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:40.925+0000 7fa8cb7fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fa8cc160ff0 0x7fa8cc0d1c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:45838/0 (socket says 172.21.15.84:45838) 2023-09-13T08:24:40.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:40.925+0000 7fa8cb7fe700 1 -- 172.21.15.84:0/373080331 learned_addr learned my addr 172.21.15.84:0/373080331 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:24:40.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:40.925+0000 7fa8ca7fc700 1 -- 172.21.15.84:0/373080331 >> v1:172.21.15.161:6789/0 conn(0x7fa8cc15d570 legacy=0x7fa8cc0cfc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:40.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:40.925+0000 7fa8ca7fc700 1 -- 172.21.15.84:0/373080331 >> v1:172.21.15.84:6789/0 conn(0x7fa8cc160ff0 legacy=0x7fa8cc0d1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:40.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:40.925+0000 7fa8ca7fc700 1 -- 172.21.15.84:0/373080331 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8cc1619d0 con 0x7fa8cc0d0340 2023-09-13T08:24:40.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:40.926+0000 7fa8ca7fc700 1 --2- 172.21.15.84:0/373080331 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8cc0d0340 0x7fa8cc0b8d50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc009840 tx=0x7fa8bc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af11e6ad443a376c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:40.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:40.926+0000 7fa8c9ffb700 1 -- 172.21.15.84:0/373080331 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc011830 con 0x7fa8cc0d0340 2023-09-13T08:24:40.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:40.926+0000 7fa8c9ffb700 1 -- 172.21.15.84:0/373080331 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8bc011990 con 0x7fa8cc0d0340 2023-09-13T08:24:40.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:40.926+0000 7fa8c9ffb700 1 -- 172.21.15.84:0/373080331 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc011d20 con 0x7fa8cc0d0340 2023-09-13T08:24:40.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:40.926+0000 7fa8d19cd700 1 -- 172.21.15.84:0/373080331 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8cc0d0340 msgr2=0x7fa8cc0b8d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:40.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:40.926+0000 7fa8d19cd700 1 --2- 172.21.15.84:0/373080331 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8cc0d0340 0x7fa8cc0b8d50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc009840 tx=0x7fa8bc009b50 comp rx=0 tx=0).stop 2023-09-13T08:24:40.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:40.926+0000 7fa8d19cd700 1 -- 172.21.15.84:0/373080331 shutdown_connections 2023-09-13T08:24:40.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:40.926+0000 7fa8d19cd700 1 --2- 172.21.15.84:0/373080331 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8cc0d0340 0x7fa8cc0b8d50 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:40.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:40.926+0000 7fa8d19cd700 1 -- 172.21.15.84:0/373080331 >> 172.21.15.84:0/373080331 conn(0x7fa8cc06b0d0 msgr2=0x7fa8cc06b4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:40.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:40.926+0000 7fa8d19cd700 1 -- 172.21.15.84:0/373080331 shutdown_connections 2023-09-13T08:24:40.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:40.926+0000 7fa8d19cd700 1 -- 172.21.15.84:0/373080331 wait complete. 2023-09-13T08:24:40.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:40.927+0000 7fa8d19cd700 1 Processor -- start 2023-09-13T08:24:40.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:40.928+0000 7fa8d19cd700 1 -- start start 2023-09-13T08:24:40.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:40.928+0000 7fa8d19cd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8cc0d0340 0x7fa8cc15f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:40.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:40.928+0000 7fa8d19cd700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa8cc15d570 0x7fa8cc14ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:40.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:40.928+0000 7fa8d19cd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa8cc160ff0 0x7fa8cc0c87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:40.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:40.928+0000 7fa8d19cd700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8cc14f1d0 con 0x7fa8cc0d0340 2023-09-13T08:24:40.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:40.928+0000 7fa8d19cd700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8cc0c9b10 con 0x7fa8cc160ff0 2023-09-13T08:24:40.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:40.928+0000 7fa8d19cd700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8cc0c8d10 con 0x7fa8cc15d570 2023-09-13T08:24:40.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:40.928+0000 7fa8caffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8cc0d0340 0x7fa8cc15f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:40.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:40.928+0000 7fa8caffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8cc0d0340 0x7fa8cc15f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43194/0 (socket says 172.21.15.84:43194) 2023-09-13T08:24:40.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:40.928+0000 7fa8caffd700 1 -- 172.21.15.84:0/2477834111 learned_addr learned my addr 172.21.15.84:0/2477834111 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:24:40.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:40.929+0000 7fa8cb7fe700 1 --2- 172.21.15.84:0/2477834111 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa8cc160ff0 0x7fa8cc0c87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:40.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:40.929+0000 7fa8caffd700 1 -- 172.21.15.84:0/2477834111 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa8cc15d570 msgr2=0x7fa8cc14ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:40.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:40.929+0000 7fa8caffd700 1 --2- 172.21.15.84:0/2477834111 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa8cc15d570 0x7fa8cc14ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:40.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:40.929+0000 7fa8caffd700 1 -- 172.21.15.84:0/2477834111 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa8cc160ff0 msgr2=0x7fa8cc0c87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:40.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:40.929+0000 7fa8caffd700 1 --2- 172.21.15.84:0/2477834111 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa8cc160ff0 0x7fa8cc0c87d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:40.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:40.929+0000 7fa8caffd700 1 -- 172.21.15.84:0/2477834111 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8bc0094a0 con 0x7fa8cc0d0340 2023-09-13T08:24:40.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:40.929+0000 7fa8caffd700 1 --2- 172.21.15.84:0/2477834111 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8cc0d0340 0x7fa8cc15f3d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa8c000c730 tx=0x7fa8c000caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:40.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:40.929+0000 7fa8b3fff700 1 -- 172.21.15.84:0/2477834111 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c00052d0 con 0x7fa8cc0d0340 2023-09-13T08:24:40.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:40.929+0000 7fa8b3fff700 1 -- 172.21.15.84:0/2477834111 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8c0005430 con 0x7fa8cc0d0340 2023-09-13T08:24:40.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:40.929+0000 7fa8b3fff700 1 -- 172.21.15.84:0/2477834111 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c00038a0 con 0x7fa8cc0d0340 2023-09-13T08:24:40.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:40.929+0000 7fa8d19cd700 1 -- 172.21.15.84:0/2477834111 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8cc0c8f90 con 0x7fa8cc0d0340 2023-09-13T08:24:40.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:40.929+0000 7fa8d19cd700 1 -- 172.21.15.84:0/2477834111 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8cc0c9550 con 0x7fa8cc0d0340 2023-09-13T08:24:40.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:40.930+0000 7fa8d19cd700 1 -- 172.21.15.84:0/2477834111 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8cc04f200 con 0x7fa8cc0d0340 2023-09-13T08:24:40.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:40.930+0000 7fa8b3fff700 1 -- 172.21.15.84:0/2477834111 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fa8c0003a00 con 0x7fa8cc0d0340 2023-09-13T08:24:40.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:40.931+0000 7fa8b3fff700 1 --2- 172.21.15.84:0/2477834111 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fa8b806a580 0x7fa8b806ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:40.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:40.931+0000 7fa8ca7fc700 1 --2- 172.21.15.84:0/2477834111 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fa8b806a580 0x7fa8b806ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:40.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:40.931+0000 7fa8b3fff700 1 -- 172.21.15.84:0/2477834111 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fa8c0087c60 con 0x7fa8cc0d0340 2023-09-13T08:24:40.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:40.931+0000 7fa8ca7fc700 1 --2- 172.21.15.84:0/2477834111 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fa8b806a580 0x7fa8b806ca40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc0d0790 tx=0x7fa8bc010000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:40.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:40.935+0000 7fa8b3fff700 1 -- 172.21.15.84:0/2477834111 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fa8c0053450 con 0x7fa8cc0d0340 2023-09-13T08:24:41.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:41.127+0000 7fa8d19cd700 1 -- 172.21.15.84:0/2477834111 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7fa8cc153970 con 0x7fa8cc0d0340 2023-09-13T08:24:41.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:41.733+0000 7fa8b3fff700 1 -- 172.21.15.84:0/2477834111 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v18) v1 ==== 171+0+0 (secure 0 0 0) 0x7fa8c0003cb0 con 0x7fa8cc0d0340 2023-09-13T08:24:41.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:41.739+0000 7fa8d19cd700 1 -- 172.21.15.84:0/2477834111 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fa8b806a580 msgr2=0x7fa8b806ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:41.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:41.739+0000 7fa8d19cd700 1 --2- 172.21.15.84:0/2477834111 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fa8b806a580 0x7fa8b806ca40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc0d0790 tx=0x7fa8bc010000 comp rx=0 tx=0).stop 2023-09-13T08:24:41.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:41.739+0000 7fa8d19cd700 1 -- 172.21.15.84:0/2477834111 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8cc0d0340 msgr2=0x7fa8cc15f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:41.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:41.739+0000 7fa8d19cd700 1 --2- 172.21.15.84:0/2477834111 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8cc0d0340 0x7fa8cc15f3d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa8c000c730 tx=0x7fa8c000caf0 comp rx=0 tx=0).stop 2023-09-13T08:24:41.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:41.740+0000 7fa8d19cd700 1 -- 172.21.15.84:0/2477834111 shutdown_connections 2023-09-13T08:24:41.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:41.740+0000 7fa8d19cd700 1 --2- 172.21.15.84:0/2477834111 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fa8b806a580 0x7fa8b806ca40 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:41.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:41.740+0000 7fa8d19cd700 1 --2- 172.21.15.84:0/2477834111 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa8cc160ff0 0x7fa8cc0c87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:41.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:41.740+0000 7fa8d19cd700 1 --2- 172.21.15.84:0/2477834111 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8cc0d0340 0x7fa8cc15f3d0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:41.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:41.740+0000 7fa8d19cd700 1 --2- 172.21.15.84:0/2477834111 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa8cc15d570 0x7fa8cc14ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:41.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:41.740+0000 7fa8d19cd700 1 -- 172.21.15.84:0/2477834111 >> 172.21.15.84:0/2477834111 conn(0x7fa8cc06b0d0 msgr2=0x7fa8cc0d3650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:41.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:41.742+0000 7fa8d19cd700 1 -- 172.21.15.84:0/2477834111 shutdown_connections 2023-09-13T08:24:41.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:41.742+0000 7fa8d19cd700 1 -- 172.21.15.84:0/2477834111 wait complete. 2023-09-13T08:24:41.746 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_data' created 2023-09-13T08:24:41.763 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-09-13T08:24:41.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:41.888+0000 7fdf0b2c8700 1 Processor -- start 2023-09-13T08:24:41.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:41.888+0000 7fdf0b2c8700 1 -- start start 2023-09-13T08:24:41.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:41.889+0000 7fdf0b2c8700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fdf040ca8e0 0x7fdf040cf570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:41.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:41.889+0000 7fdf0b2c8700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fdf0415e910 0x7fdf040cacc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:41.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:41.889+0000 7fdf0b2c8700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf0415e480 con 0x7fdf040cd590 2023-09-13T08:24:41.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:41.889+0000 7fdf0b2c8700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf040cb200 con 0x7fdf0415e910 2023-09-13T08:24:41.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:41.889+0000 7fdf0b2c8700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf040cfbe0 con 0x7fdf040ca8e0 2023-09-13T08:24:41.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:41.889+0000 7fdf08863700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fdf0415e910 0x7fdf040cacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:41.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:41.889+0000 7fdf09865700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fdf040cd590 0x7fdf04161150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:45852/0 (socket says 172.21.15.84:45852) 2023-09-13T08:24:41.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:41.889+0000 7fdf09865700 1 -- 172.21.15.84:0/599769153 learned_addr learned my addr 172.21.15.84:0/599769153 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:24:41.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:41.889+0000 7fdf09064700 1 --2- 172.21.15.84:0/599769153 >> v2:172.21.15.161:3300/0 conn(0x7fdf040ca8e0 0x7fdf040cf570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:41.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:41.889+0000 7fdf08863700 1 -- 172.21.15.84:0/599769153 >> v2:172.21.15.161:3300/0 conn(0x7fdf040ca8e0 msgr2=0x7fdf040cf570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:24:41.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:41.889+0000 7fdf08863700 1 --2- 172.21.15.84:0/599769153 >> v2:172.21.15.161:3300/0 conn(0x7fdf040ca8e0 0x7fdf040cf570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:41.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:41.889+0000 7fdf08863700 1 -- 172.21.15.84:0/599769153 >> v1:172.21.15.84:6789/0 conn(0x7fdf040cd590 legacy=0x7fdf04161150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:41.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:41.889+0000 7fdefbfff700 1 -- 172.21.15.84:0/599769153 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4165835947 0 0) 0x7fdf0415e480 con 0x7fdf040cd590 2023-09-13T08:24:41.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:41.889+0000 7fdf08863700 1 -- 172.21.15.84:0/599769153 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf0415de30 con 0x7fdf0415e910 2023-09-13T08:24:41.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:41.889+0000 7fdf08863700 1 --2- 172.21.15.84:0/599769153 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf0415e910 0x7fdf040cacc0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fdf04069150 tx=0x7fdef4009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=889795b10d6d2fd1 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:41.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:41.889+0000 7fdefbfff700 1 -- 172.21.15.84:0/599769153 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef4011830 con 0x7fdf0415e910 2023-09-13T08:24:41.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:41.890+0000 7fdefbfff700 1 -- 172.21.15.84:0/599769153 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdef4011990 con 0x7fdf0415e910 2023-09-13T08:24:41.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:41.890+0000 7fdefbfff700 1 -- 172.21.15.84:0/599769153 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef4011d20 con 0x7fdf0415e910 2023-09-13T08:24:41.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:41.890+0000 7fdf0b2c8700 1 -- 172.21.15.84:0/599769153 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf0415e910 msgr2=0x7fdf040cacc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:41.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:41.890+0000 7fdf0b2c8700 1 --2- 172.21.15.84:0/599769153 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf0415e910 0x7fdf040cacc0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fdf04069150 tx=0x7fdef4009b20 comp rx=0 tx=0).stop 2023-09-13T08:24:41.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:41.890+0000 7fdf0b2c8700 1 -- 172.21.15.84:0/599769153 shutdown_connections 2023-09-13T08:24:41.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:41.890+0000 7fdf0b2c8700 1 --2- 172.21.15.84:0/599769153 >> v2:172.21.15.161:3300/0 conn(0x7fdf040ca8e0 0x7fdf040cf570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:41.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:41.890+0000 7fdf0b2c8700 1 --2- 172.21.15.84:0/599769153 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf0415e910 0x7fdf040cacc0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:41.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:41.890+0000 7fdf0b2c8700 1 -- 172.21.15.84:0/599769153 >> 172.21.15.84:0/599769153 conn(0x7fdf040cca70 msgr2=0x7fdf040cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:41.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:41.890+0000 7fdf0b2c8700 1 -- 172.21.15.84:0/599769153 shutdown_connections 2023-09-13T08:24:41.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:41.890+0000 7fdf0b2c8700 1 -- 172.21.15.84:0/599769153 wait complete. 2023-09-13T08:24:41.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:41.891+0000 7fdf0b2c8700 1 Processor -- start 2023-09-13T08:24:41.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:41.891+0000 7fdf0b2c8700 1 -- start start 2023-09-13T08:24:41.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:41.892+0000 7fdf0b2c8700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf040ca8e0 0x7fdf040b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:41.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:41.892+0000 7fdf0b2c8700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdf040cd590 0x7fdf04153e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:41.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:41.892+0000 7fdf0b2c8700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf0415e910 0x7fdf0415aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:41.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:41.892+0000 7fdf0b2c8700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf04157e20 con 0x7fdf040ca8e0 2023-09-13T08:24:41.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:41.892+0000 7fdf0b2c8700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0415b010 con 0x7fdf0415e910 2023-09-13T08:24:41.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:41.892+0000 7fdf0b2c8700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf040b32e0 con 0x7fdf040cd590 2023-09-13T08:24:41.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:41.892+0000 7fdf09064700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf040ca8e0 0x7fdf040b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:41.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:41.892+0000 7fdf09064700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf040ca8e0 0x7fdf040b2c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43208/0 (socket says 172.21.15.84:43208) 2023-09-13T08:24:41.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:41.892+0000 7fdf09064700 1 -- 172.21.15.84:0/2732325031 learned_addr learned my addr 172.21.15.84:0/2732325031 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:24:41.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:41.892+0000 7fdf09865700 1 --2- 172.21.15.84:0/2732325031 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf0415e910 0x7fdf0415aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:41.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:41.892+0000 7fdf09064700 1 -- 172.21.15.84:0/2732325031 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdf040cd590 msgr2=0x7fdf04153e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:41.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:41.892+0000 7fdf09064700 1 --2- 172.21.15.84:0/2732325031 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdf040cd590 0x7fdf04153e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:41.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:41.892+0000 7fdf09064700 1 -- 172.21.15.84:0/2732325031 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf0415e910 msgr2=0x7fdf0415aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:41.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:41.892+0000 7fdf09064700 1 --2- 172.21.15.84:0/2732325031 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf0415e910 0x7fdf0415aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:41.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:41.892+0000 7fdf09064700 1 -- 172.21.15.84:0/2732325031 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdef40094a0 con 0x7fdf040ca8e0 2023-09-13T08:24:41.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:41.893+0000 7fdf09064700 1 --2- 172.21.15.84:0/2732325031 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf040ca8e0 0x7fdf040b2c50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fdf0000e9d0 tx=0x7fdf0000ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:41.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:41.893+0000 7fdef9ffb700 1 -- 172.21.15.84:0/2732325031 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf00009730 con 0x7fdf040ca8e0 2023-09-13T08:24:41.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:41.893+0000 7fdef9ffb700 1 -- 172.21.15.84:0/2732325031 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf0000c7f0 con 0x7fdf040ca8e0 2023-09-13T08:24:41.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:41.893+0000 7fdf0b2c8700 1 -- 172.21.15.84:0/2732325031 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf040b35c0 con 0x7fdf040ca8e0 2023-09-13T08:24:41.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:41.893+0000 7fdef9ffb700 1 -- 172.21.15.84:0/2732325031 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf0000cb80 con 0x7fdf040ca8e0 2023-09-13T08:24:41.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:41.893+0000 7fdf0b2c8700 1 -- 172.21.15.84:0/2732325031 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf040b3b80 con 0x7fdf040ca8e0 2023-09-13T08:24:41.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:41.894+0000 7fdf0b2c8700 1 -- 172.21.15.84:0/2732325031 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf0404f200 con 0x7fdf040ca8e0 2023-09-13T08:24:41.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:41.895+0000 7fdef9ffb700 1 -- 172.21.15.84:0/2732325031 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fdf0000cce0 con 0x7fdf040ca8e0 2023-09-13T08:24:41.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:41.895+0000 7fdef9ffb700 1 --2- 172.21.15.84:0/2732325031 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fdee806a580 0x7fdee806ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:41.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:41.895+0000 7fdef9ffb700 1 -- 172.21.15.84:0/2732325031 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fdf000892c0 con 0x7fdf040ca8e0 2023-09-13T08:24:41.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:41.895+0000 7fdf08863700 1 --2- 172.21.15.84:0/2732325031 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fdee806a580 0x7fdee806ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:41.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:41.896+0000 7fdf08863700 1 --2- 172.21.15.84:0/2732325031 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fdee806a580 0x7fdee806ca40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fdf0406b640 tx=0x7fdef4010000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:41.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:41.899+0000 7fdef9ffb700 1 -- 172.21.15.84:0/2732325031 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fdf00054910 con 0x7fdf040ca8e0 2023-09-13T08:24:42.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:42.131+0000 7fdf0b2c8700 1 -- 172.21.15.84:0/2732325031 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fdf040cf610 con 0x7fdf040ca8e0 2023-09-13T08:24:42.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:42.749+0000 7fdef9ffb700 1 -- 172.21.15.84:0/2732325031 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fdf00057f30 con 0x7fdf040ca8e0 2023-09-13T08:24:42.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:42.754+0000 7fdf0b2c8700 1 -- 172.21.15.84:0/2732325031 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fdee806a580 msgr2=0x7fdee806ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:42.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:42.754+0000 7fdf0b2c8700 1 --2- 172.21.15.84:0/2732325031 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fdee806a580 0x7fdee806ca40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fdf0406b640 tx=0x7fdef4010000 comp rx=0 tx=0).stop 2023-09-13T08:24:42.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:42.754+0000 7fdf0b2c8700 1 -- 172.21.15.84:0/2732325031 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf040ca8e0 msgr2=0x7fdf040b2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:42.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:42.754+0000 7fdf0b2c8700 1 --2- 172.21.15.84:0/2732325031 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf040ca8e0 0x7fdf040b2c50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fdf0000e9d0 tx=0x7fdf0000ed90 comp rx=0 tx=0).stop 2023-09-13T08:24:42.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:42.755+0000 7fdf0b2c8700 1 -- 172.21.15.84:0/2732325031 shutdown_connections 2023-09-13T08:24:42.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:42.755+0000 7fdf0b2c8700 1 --2- 172.21.15.84:0/2732325031 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fdee806a580 0x7fdee806ca40 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:42.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:42.755+0000 7fdf0b2c8700 1 --2- 172.21.15.84:0/2732325031 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf0415e910 0x7fdf0415aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:42.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:42.755+0000 7fdf0b2c8700 1 --2- 172.21.15.84:0/2732325031 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf040ca8e0 0x7fdf040b2c50 secure :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fdf0000e9d0 tx=0x7fdf0000ed90 comp rx=0 tx=0).stop 2023-09-13T08:24:42.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:42.755+0000 7fdf0b2c8700 1 --2- 172.21.15.84:0/2732325031 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdf040cd590 0x7fdf04153e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:42.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:42.755+0000 7fdf0b2c8700 1 -- 172.21.15.84:0/2732325031 >> 172.21.15.84:0/2732325031 conn(0x7fdf040cca70 msgr2=0x7fdf040cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:42.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:42.762+0000 7fdf0b2c8700 1 -- 172.21.15.84:0/2732325031 shutdown_connections 2023-09-13T08:24:42.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:42.762+0000 7fdf0b2c8700 1 -- 172.21.15.84:0/2732325031 wait complete. 2023-09-13T08:24:42.765 INFO:teuthology.orchestra.run.smithi084.stderr:new fs with metadata pool 2 and data pool 3 2023-09-13T08:24:42.779 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-09-13T08:24:42.780 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-09-13T08:24:42.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:42.907+0000 7fe068d5c700 1 Processor -- start 2023-09-13T08:24:42.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:42.907+0000 7fe068d5c700 1 -- start start 2023-09-13T08:24:42.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:42.908+0000 7fe068d5c700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe06415d670 0x7fe0640cf420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:42.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:42.908+0000 7fe068d5c700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0640af510 con 0x7fe0640aefc0 2023-09-13T08:24:42.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:42.908+0000 7fe068d5c700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe06406b560 con 0x7fe0640cc240 2023-09-13T08:24:42.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:42.908+0000 7fe068d5c700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe06406afe0 con 0x7fe06415d670 2023-09-13T08:24:42.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:42.908+0000 7fe061d9b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fe0640aefc0 0x7fe064161230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:45862/0 (socket says 172.21.15.84:45862) 2023-09-13T08:24:42.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:42.908+0000 7fe061d9b700 1 -- 172.21.15.84:0/391982981 learned_addr learned my addr 172.21.15.84:0/391982981 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:24:42.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:42.908+0000 7fe06259c700 1 --2- 172.21.15.84:0/391982981 >> v2:172.21.15.161:3300/0 conn(0x7fe06415d670 0x7fe0640cf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:42.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:42.908+0000 7fe06159a700 1 -- 172.21.15.84:0/391982981 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1805331297 0 0) 0x7fe0640af510 con 0x7fe0640aefc0 2023-09-13T08:24:42.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:42.908+0000 7fe06159a700 1 -- 172.21.15.84:0/391982981 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe04c0035b0 con 0x7fe0640aefc0 2023-09-13T08:24:42.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:42.908+0000 7fe06159a700 1 -- 172.21.15.84:0/391982981 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3580274772 0 0) 0x7fe04c0035b0 con 0x7fe0640aefc0 2023-09-13T08:24:42.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:42.908+0000 7fe06159a700 1 -- 172.21.15.84:0/391982981 >> v2:172.21.15.161:3300/0 conn(0x7fe06415d670 msgr2=0x7fe0640cf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:24:42.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:42.908+0000 7fe06159a700 1 --2- 172.21.15.84:0/391982981 >> v2:172.21.15.161:3300/0 conn(0x7fe06415d670 0x7fe0640cf420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:42.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:42.908+0000 7fe06159a700 1 -- 172.21.15.84:0/391982981 >> v1:172.21.15.161:6789/0 conn(0x7fe0640cc240 legacy=0x7fe064161940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:42.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:42.908+0000 7fe06159a700 1 -- 172.21.15.84:0/391982981 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe064162050 con 0x7fe0640aefc0 2023-09-13T08:24:42.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:42.908+0000 7fe06159a700 1 -- 172.21.15.84:0/391982981 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2302733408 0 0) 0x7fe058001670 con 0x7fe0640aefc0 2023-09-13T08:24:42.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:42.908+0000 7fe06159a700 1 -- 172.21.15.84:0/391982981 >> v1:172.21.15.84:6789/0 conn(0x7fe0640aefc0 legacy=0x7fe064161230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:42.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:42.908+0000 7fe06159a700 1 --2- 172.21.15.84:0/391982981 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe04c003a00 0x7fe04c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:42.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:42.908+0000 7fe06159a700 1 --2- 172.21.15.84:0/391982981 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe04c004850 0x7fe04c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:42.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:42.908+0000 7fe06159a700 1 --2- 172.21.15.84:0/391982981 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe04c005210 0x7fe04c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:42.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:42.908+0000 7fe06159a700 1 -- 172.21.15.84:0/391982981 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe06406afe0 con 0x7fe04c004850 2023-09-13T08:24:42.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:42.908+0000 7fe06159a700 1 -- 172.21.15.84:0/391982981 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe04c00c0b0 con 0x7fe04c003a00 2023-09-13T08:24:42.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:42.908+0000 7fe06159a700 1 -- 172.21.15.84:0/391982981 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe04c00c270 con 0x7fe04c005210 2023-09-13T08:24:42.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:42.909+0000 7fe061d9b700 1 --2- 172.21.15.84:0/391982981 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe04c004850 0x7fe04c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:42.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:42.909+0000 7fe06259c700 1 --2- 172.21.15.84:0/391982981 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe04c003a00 0x7fe04c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:42.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:42.909+0000 7fe062d9d700 1 --2- 172.21.15.84:0/391982981 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe04c005210 0x7fe04c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:42.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:42.909+0000 7fe061d9b700 1 -- 172.21.15.84:0/391982981 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe04c005210 msgr2=0x7fe04c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:24:42.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:42.909+0000 7fe061d9b700 1 --2- 172.21.15.84:0/391982981 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe04c005210 0x7fe04c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:42.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:42.909+0000 7fe061d9b700 1 -- 172.21.15.84:0/391982981 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe04c003a00 msgr2=0x7fe04c003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:24:42.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:42.909+0000 7fe061d9b700 1 --2- 172.21.15.84:0/391982981 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe04c003a00 0x7fe04c003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:42.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:42.909+0000 7fe061d9b700 1 -- 172.21.15.84:0/391982981 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe04c0035b0 con 0x7fe04c004850 2023-09-13T08:24:42.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:42.909+0000 7fe062d9d700 1 -- 172.21.15.84:0/391982981 reap_dead start 2023-09-13T08:24:42.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:42.909+0000 7fe061d9b700 1 --2- 172.21.15.84:0/391982981 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe04c004850 0x7fe04c004cd0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe05800c210 tx=0x7fe04c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d00d82ea0de8fb8a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:42.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:42.909+0000 7fe06159a700 1 -- 172.21.15.84:0/391982981 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe058007c10 con 0x7fe04c004850 2023-09-13T08:24:42.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:42.909+0000 7fe06159a700 1 -- 172.21.15.84:0/391982981 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe05800cdd0 con 0x7fe04c004850 2023-09-13T08:24:42.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:42.909+0000 7fe06159a700 1 -- 172.21.15.84:0/391982981 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe058005ba0 con 0x7fe04c004850 2023-09-13T08:24:42.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:42.910+0000 7fe068d5c700 1 -- 172.21.15.84:0/391982981 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe04c004850 msgr2=0x7fe04c004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:42.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:42.910+0000 7fe068d5c700 1 --2- 172.21.15.84:0/391982981 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe04c004850 0x7fe04c004cd0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe05800c210 tx=0x7fe04c005880 comp rx=0 tx=0).stop 2023-09-13T08:24:42.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:42.910+0000 7fe068d5c700 1 -- 172.21.15.84:0/391982981 shutdown_connections 2023-09-13T08:24:42.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:42.910+0000 7fe068d5c700 1 --2- 172.21.15.84:0/391982981 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe04c004850 0x7fe04c004cd0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:42.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:42.910+0000 7fe068d5c700 1 -- 172.21.15.84:0/391982981 >> 172.21.15.84:0/391982981 conn(0x7fe0640d00d0 msgr2=0x7fe0640d04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:42.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:42.910+0000 7fe068d5c700 1 -- 172.21.15.84:0/391982981 shutdown_connections 2023-09-13T08:24:42.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:42.910+0000 7fe068d5c700 1 -- 172.21.15.84:0/391982981 wait complete. 2023-09-13T08:24:42.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:42.911+0000 7fe068d5c700 1 Processor -- start 2023-09-13T08:24:42.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:42.911+0000 7fe068d5c700 1 -- start start 2023-09-13T08:24:42.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:42.912+0000 7fe068d5c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe04c004850 0x7fe0640c7410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:42.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:42.912+0000 7fe068d5c700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe0640ca080 0x7fe0641f2f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:42.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:42.912+0000 7fe068d5c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0641f34c0 0x7fe0641f6770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:42.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:42.912+0000 7fe068d5c700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0640c90b0 con 0x7fe0641f34c0 2023-09-13T08:24:42.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:42.912+0000 7fe068d5c700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0640c9bf0 con 0x7fe04c004850 2023-09-13T08:24:42.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:42.912+0000 7fe068d5c700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0641f3cb0 con 0x7fe0640ca080 2023-09-13T08:24:42.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:42.912+0000 7fe062d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0641f34c0 0x7fe0641f6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:42.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:42.912+0000 7fe062d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0641f34c0 0x7fe0641f6770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43230/0 (socket says 172.21.15.84:43230) 2023-09-13T08:24:42.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:42.912+0000 7fe062d9d700 1 -- 172.21.15.84:0/2774925109 learned_addr learned my addr 172.21.15.84:0/2774925109 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:24:42.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:42.912+0000 7fe06259c700 1 --2- 172.21.15.84:0/2774925109 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe04c004850 0x7fe0640c7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:42.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:42.912+0000 7fe061d9b700 1 --2- 172.21.15.84:0/2774925109 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe0640ca080 0x7fe0641f2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:42.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:42.912+0000 7fe062d9d700 1 -- 172.21.15.84:0/2774925109 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe0640ca080 msgr2=0x7fe0641f2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:42.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:42.912+0000 7fe062d9d700 1 --2- 172.21.15.84:0/2774925109 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe0640ca080 0x7fe0641f2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:42.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:42.912+0000 7fe062d9d700 1 -- 172.21.15.84:0/2774925109 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe04c004850 msgr2=0x7fe0640c7410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:42.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:42.912+0000 7fe062d9d700 1 --2- 172.21.15.84:0/2774925109 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe04c004850 0x7fe0640c7410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:42.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:42.912+0000 7fe062d9d700 1 -- 172.21.15.84:0/2774925109 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0640c92c0 con 0x7fe0641f34c0 2023-09-13T08:24:42.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:42.912+0000 7fe062d9d700 1 --2- 172.21.15.84:0/2774925109 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0641f34c0 0x7fe0641f6770 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe0640cc000 tx=0x7fe05c00ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:42.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:42.912+0000 7fe052ffd700 1 -- 172.21.15.84:0/2774925109 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe05c00ee70 con 0x7fe0641f34c0 2023-09-13T08:24:42.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:42.912+0000 7fe052ffd700 1 -- 172.21.15.84:0/2774925109 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe05c003c10 con 0x7fe0641f34c0 2023-09-13T08:24:42.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:42.912+0000 7fe068d5c700 1 -- 172.21.15.84:0/2774925109 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0640c95a0 con 0x7fe0641f34c0 2023-09-13T08:24:42.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:42.912+0000 7fe052ffd700 1 -- 172.21.15.84:0/2774925109 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe05c0050d0 con 0x7fe0641f34c0 2023-09-13T08:24:42.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:42.913+0000 7fe068d5c700 1 -- 172.21.15.84:0/2774925109 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0641f3970 con 0x7fe0641f34c0 2023-09-13T08:24:42.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:42.913+0000 7fe068d5c700 1 -- 172.21.15.84:0/2774925109 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe06404e9b0 con 0x7fe0641f34c0 2023-09-13T08:24:42.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:42.914+0000 7fe052ffd700 1 -- 172.21.15.84:0/2774925109 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fe05c005230 con 0x7fe0641f34c0 2023-09-13T08:24:42.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:42.914+0000 7fe052ffd700 1 --2- 172.21.15.84:0/2774925109 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fe04406a580 0x7fe04406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:42.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:42.914+0000 7fe052ffd700 1 -- 172.21.15.84:0/2774925109 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe05c088810 con 0x7fe0641f34c0 2023-09-13T08:24:42.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:42.914+0000 7fe06259c700 1 --2- 172.21.15.84:0/2774925109 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fe04406a580 0x7fe04406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:42.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:42.915+0000 7fe06259c700 1 --2- 172.21.15.84:0/2774925109 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fe04406a580 0x7fe04406ca40 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe0640ca4d0 tx=0x7fe054009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:42.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:42.919+0000 7fe052ffd700 1 -- 172.21.15.84:0/2774925109 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fe05c053d90 con 0x7fe0641f34c0 2023-09-13T08:24:43.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:43.118+0000 7fe068d5c700 1 -- 172.21.15.84:0/2774925109 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7fe0640b6050 con 0x7fe0641f34c0 2023-09-13T08:24:43.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:43.740+0000 7fe052ffd700 1 -- 172.21.15.84:0/2774925109 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v20) v1 ==== 157+0+0 (secure 0 0 0) 0x7fe05c0573b0 con 0x7fe0641f34c0 2023-09-13T08:24:43.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:43.742+0000 7fe068d5c700 1 -- 172.21.15.84:0/2774925109 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fe04406a580 msgr2=0x7fe04406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:43.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:43.742+0000 7fe068d5c700 1 --2- 172.21.15.84:0/2774925109 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fe04406a580 0x7fe04406ca40 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe0640ca4d0 tx=0x7fe054009210 comp rx=0 tx=0).stop 2023-09-13T08:24:43.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:43.742+0000 7fe068d5c700 1 -- 172.21.15.84:0/2774925109 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0641f34c0 msgr2=0x7fe0641f6770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:43.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:43.742+0000 7fe068d5c700 1 --2- 172.21.15.84:0/2774925109 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0641f34c0 0x7fe0641f6770 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe0640cc000 tx=0x7fe05c00ed50 comp rx=0 tx=0).stop 2023-09-13T08:24:43.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:43.743+0000 7fe068d5c700 1 -- 172.21.15.84:0/2774925109 shutdown_connections 2023-09-13T08:24:43.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:43.743+0000 7fe068d5c700 1 --2- 172.21.15.84:0/2774925109 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0641f34c0 0x7fe0641f6770 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:43.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:43.743+0000 7fe068d5c700 1 --2- 172.21.15.84:0/2774925109 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fe04406a580 0x7fe04406ca40 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:43.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:43.743+0000 7fe068d5c700 1 --2- 172.21.15.84:0/2774925109 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe04c004850 0x7fe0640c7410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:43.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:43.743+0000 7fe068d5c700 1 --2- 172.21.15.84:0/2774925109 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe0640ca080 0x7fe0641f2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:43.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:43.743+0000 7fe068d5c700 1 -- 172.21.15.84:0/2774925109 >> 172.21.15.84:0/2774925109 conn(0x7fe0640d00d0 msgr2=0x7fe064158780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:43.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:43.743+0000 7fe068d5c700 1 -- 172.21.15.84:0/2774925109 shutdown_connections 2023-09-13T08:24:43.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:43.743+0000 7fe068d5c700 1 -- 172.21.15.84:0/2774925109 wait complete. 2023-09-13T08:24:43.758 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-09-13T08:24:43.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:43.894+0000 7f0c1f111700 1 Processor -- start 2023-09-13T08:24:43.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:43.894+0000 7f0c1f111700 1 -- start start 2023-09-13T08:24:43.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:43.895+0000 7f0c1f111700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0c180ce510 0x7f0c1815dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:43.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:43.895+0000 7f0c1f111700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c1815e250 0x7f0c180b1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:43.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:43.895+0000 7f0c1f111700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c1815ec90 con 0x7f0c180af130 2023-09-13T08:24:43.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:43.895+0000 7f0c1f111700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c1815e6d0 con 0x7f0c180ce510 2023-09-13T08:24:43.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:43.895+0000 7f0c1f111700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c1815e9b0 con 0x7f0c1815e250 2023-09-13T08:24:43.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:43.895+0000 7f0c17fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0c180ce510 0x7f0c1815dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:43.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:43.895+0000 7f0c1cead700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f0c180af130 0x7f0c1815b0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:45880/0 (socket says 172.21.15.84:45880) 2023-09-13T08:24:43.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:43.895+0000 7f0c1cead700 1 -- 172.21.15.84:0/3594702951 learned_addr learned my addr 172.21.15.84:0/3594702951 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:24:43.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:43.895+0000 7f0c1d6ae700 1 --2- 172.21.15.84:0/3594702951 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c1815e250 0x7f0c180b1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:43.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:43.895+0000 7f0c17fff700 1 -- 172.21.15.84:0/3594702951 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c1815e250 msgr2=0x7f0c180b1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:24:43.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:43.895+0000 7f0c17fff700 1 --2- 172.21.15.84:0/3594702951 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c1815e250 0x7f0c180b1ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:43.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:43.895+0000 7f0c17fff700 1 -- 172.21.15.84:0/3594702951 >> v1:172.21.15.84:6789/0 conn(0x7f0c180af130 legacy=0x7f0c1815b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:43.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:43.895+0000 7f0c177fe700 1 -- 172.21.15.84:0/3594702951 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 726073051 0 0) 0x7f0c1815ec90 con 0x7f0c180af130 2023-09-13T08:24:43.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:43.895+0000 7f0c17fff700 1 -- 172.21.15.84:0/3594702951 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c1815a8c0 con 0x7f0c180ce510 2023-09-13T08:24:43.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:43.895+0000 7f0c17fff700 1 --2- 172.21.15.84:0/3594702951 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0c180ce510 0x7f0c1815dd10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0c04009840 tx=0x7f0c04009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2da12b3aa9b62083 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:43.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:43.895+0000 7f0c177fe700 1 -- 172.21.15.84:0/3594702951 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c04011830 con 0x7f0c180ce510 2023-09-13T08:24:43.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:43.895+0000 7f0c177fe700 1 -- 172.21.15.84:0/3594702951 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c04011990 con 0x7f0c180ce510 2023-09-13T08:24:43.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:43.895+0000 7f0c177fe700 1 -- 172.21.15.84:0/3594702951 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c04011d20 con 0x7f0c180ce510 2023-09-13T08:24:43.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:43.896+0000 7f0c1f111700 1 -- 172.21.15.84:0/3594702951 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0c180ce510 msgr2=0x7f0c1815dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:43.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:43.896+0000 7f0c1f111700 1 --2- 172.21.15.84:0/3594702951 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0c180ce510 0x7f0c1815dd10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0c04009840 tx=0x7f0c04009b50 comp rx=0 tx=0).stop 2023-09-13T08:24:43.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:43.896+0000 7f0c1f111700 1 -- 172.21.15.84:0/3594702951 shutdown_connections 2023-09-13T08:24:43.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:43.896+0000 7f0c1f111700 1 --2- 172.21.15.84:0/3594702951 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c1815e250 0x7f0c180b1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:43.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:43.896+0000 7f0c1f111700 1 --2- 172.21.15.84:0/3594702951 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0c180ce510 0x7f0c1815dd10 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:43.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:43.896+0000 7f0c1f111700 1 -- 172.21.15.84:0/3594702951 >> 172.21.15.84:0/3594702951 conn(0x7f0c180ccab0 msgr2=0x7f0c180ccec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:43.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:43.896+0000 7f0c1f111700 1 -- 172.21.15.84:0/3594702951 shutdown_connections 2023-09-13T08:24:43.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:43.896+0000 7f0c1f111700 1 -- 172.21.15.84:0/3594702951 wait complete. 2023-09-13T08:24:43.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:43.897+0000 7f0c1f111700 1 Processor -- start 2023-09-13T08:24:43.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:43.897+0000 7f0c1f111700 1 -- start start 2023-09-13T08:24:43.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:43.898+0000 7f0c1f111700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c180af130 0x7f0c18151810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:43.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:43.899+0000 7f0c1f111700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0c1815e250 0x7f0c180ade60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:43.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:43.899+0000 7f0c1f111700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c180ae3a0 0x7f0c18155620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:43.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:43.899+0000 7f0c1f111700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c180ae850 con 0x7f0c1815e250 2023-09-13T08:24:43.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:43.899+0000 7f0c1f111700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c181587f0 con 0x7f0c180af130 2023-09-13T08:24:43.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:43.899+0000 7f0c1f111700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c18156390 con 0x7f0c180ae3a0 2023-09-13T08:24:43.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:43.899+0000 7f0c17fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0c1815e250 0x7f0c180ade60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:43.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:43.899+0000 7f0c17fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0c1815e250 0x7f0c180ade60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43242/0 (socket says 172.21.15.84:43242) 2023-09-13T08:24:43.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:43.899+0000 7f0c17fff700 1 -- 172.21.15.84:0/4095932562 learned_addr learned my addr 172.21.15.84:0/4095932562 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:24:43.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:43.899+0000 7f0c1cead700 1 --2- 172.21.15.84:0/4095932562 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c180af130 0x7f0c18151810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:43.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:43.899+0000 7f0c1d6ae700 1 --2- 172.21.15.84:0/4095932562 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c180ae3a0 0x7f0c18155620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:43.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:43.899+0000 7f0c17fff700 1 -- 172.21.15.84:0/4095932562 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c180ae3a0 msgr2=0x7f0c18155620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:43.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:43.899+0000 7f0c17fff700 1 --2- 172.21.15.84:0/4095932562 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c180ae3a0 0x7f0c18155620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:43.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:43.899+0000 7f0c17fff700 1 -- 172.21.15.84:0/4095932562 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c180af130 msgr2=0x7f0c18151810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:43.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:43.899+0000 7f0c17fff700 1 --2- 172.21.15.84:0/4095932562 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c180af130 0x7f0c18151810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:43.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:43.899+0000 7f0c17fff700 1 -- 172.21.15.84:0/4095932562 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c040094a0 con 0x7f0c1815e250 2023-09-13T08:24:43.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:43.899+0000 7f0c17fff700 1 --2- 172.21.15.84:0/4095932562 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0c1815e250 0x7f0c180ade60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0c04013000 tx=0x7f0c04004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:43.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:43.899+0000 7f0c157fa700 1 -- 172.21.15.84:0/4095932562 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c040038a0 con 0x7f0c1815e250 2023-09-13T08:24:43.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:43.899+0000 7f0c157fa700 1 -- 172.21.15.84:0/4095932562 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c04003a00 con 0x7f0c1815e250 2023-09-13T08:24:43.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:43.899+0000 7f0c1f111700 1 -- 172.21.15.84:0/4095932562 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c181581a0 con 0x7f0c1815e250 2023-09-13T08:24:43.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:43.899+0000 7f0c157fa700 1 -- 172.21.15.84:0/4095932562 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c04003d90 con 0x7f0c1815e250 2023-09-13T08:24:43.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:43.899+0000 7f0c1f111700 1 -- 172.21.15.84:0/4095932562 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c18151d50 con 0x7f0c1815e250 2023-09-13T08:24:43.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:43.900+0000 7f0c1f111700 1 -- 172.21.15.84:0/4095932562 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c18158000 con 0x7f0c1815e250 2023-09-13T08:24:43.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:43.900+0000 7f0c157fa700 1 -- 172.21.15.84:0/4095932562 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f0c0401b5c0 con 0x7f0c1815e250 2023-09-13T08:24:43.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:43.901+0000 7f0c157fa700 1 --2- 172.21.15.84:0/4095932562 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f0bfc06a580 0x7f0bfc06ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:43.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:43.901+0000 7f0c157fa700 1 -- 172.21.15.84:0/4095932562 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f0c0408bf00 con 0x7f0c1815e250 2023-09-13T08:24:43.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:43.901+0000 7f0c1cead700 1 --2- 172.21.15.84:0/4095932562 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f0bfc06a580 0x7f0bfc06ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:43.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:43.901+0000 7f0c1cead700 1 --2- 172.21.15.84:0/4095932562 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f0bfc06a580 0x7f0bfc06ca40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c000f60 tx=0x7f0c0c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:43.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:43.905+0000 7f0c157fa700 1 -- 172.21.15.84:0/4095932562 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f0c18158000 con 0x7f0c1815e250 2023-09-13T08:24:44.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:44.095+0000 7f0c1f111700 1 -- 172.21.15.84:0/4095932562 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f0c18157fe0 con 0x7f0c1815e250 2023-09-13T08:24:45.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:45.761+0000 7f0c157fa700 1 -- 172.21.15.84:0/4095932562 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v22) v1 ==== 228+0+0 (secure 0 0 0) 0x7f0c04057430 con 0x7f0c1815e250 2023-09-13T08:24:45.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:45.770+0000 7f0c1f111700 1 -- 172.21.15.84:0/4095932562 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f0bfc06a580 msgr2=0x7f0bfc06ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:45.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:45.770+0000 7f0c1f111700 1 --2- 172.21.15.84:0/4095932562 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f0bfc06a580 0x7f0bfc06ca40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c000f60 tx=0x7f0c0c009040 comp rx=0 tx=0).stop 2023-09-13T08:24:45.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:45.770+0000 7f0c1f111700 1 -- 172.21.15.84:0/4095932562 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0c1815e250 msgr2=0x7f0c180ade60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:45.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:45.770+0000 7f0c1f111700 1 --2- 172.21.15.84:0/4095932562 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0c1815e250 0x7f0c180ade60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0c04013000 tx=0x7f0c04004750 comp rx=0 tx=0).stop 2023-09-13T08:24:45.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:45.772+0000 7f0c1f111700 1 -- 172.21.15.84:0/4095932562 shutdown_connections 2023-09-13T08:24:45.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:45.772+0000 7f0c1f111700 1 --2- 172.21.15.84:0/4095932562 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c180ae3a0 0x7f0c18155620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:45.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:45.772+0000 7f0c1f111700 1 --2- 172.21.15.84:0/4095932562 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f0bfc06a580 0x7f0bfc06ca40 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:45.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:45.772+0000 7f0c1f111700 1 --2- 172.21.15.84:0/4095932562 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c180af130 0x7f0c18151810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:45.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:45.772+0000 7f0c1f111700 1 --2- 172.21.15.84:0/4095932562 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0c1815e250 0x7f0c180ade60 secure :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0c04013000 tx=0x7f0c04004750 comp rx=0 tx=0).stop 2023-09-13T08:24:45.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:45.772+0000 7f0c1f111700 1 -- 172.21.15.84:0/4095932562 >> 172.21.15.84:0/4095932562 conn(0x7f0c180ccab0 msgr2=0x7f0c18071b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:45.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:45.772+0000 7f0c1f111700 1 -- 172.21.15.84:0/4095932562 shutdown_connections 2023-09-13T08:24:45.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:45.772+0000 7f0c1f111700 1 -- 172.21.15.84:0/4095932562 wait complete. 2023-09-13T08:24:45.776 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_data_ec' created 2023-09-13T08:24:45.787 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-09-13T08:24:45.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:45.916+0000 7fc501890700 1 Processor -- start 2023-09-13T08:24:45.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:45.916+0000 7fc501890700 1 -- start start 2023-09-13T08:24:45.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:45.916+0000 7fc501890700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc4fc0d1c30 0x7fc4fc0cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:45.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:45.916+0000 7fc501890700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc4fc0d4030 0x7fc4fc15d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:45.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:45.916+0000 7fc501890700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc4fc0d2010 0x7fc4fc15d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:45.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:45.916+0000 7fc501890700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4fc15dce0 con 0x7fc4fc0d2010 2023-09-13T08:24:45.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:45.916+0000 7fc501890700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4fc0cf350 con 0x7fc4fc0d4030 2023-09-13T08:24:45.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:45.916+0000 7fc501890700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4fc0b6360 con 0x7fc4fc0d1c30 2023-09-13T08:24:45.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:45.917+0000 7fc4fb7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc4fc0d2010 0x7fc4fc15d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:45.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:45.917+0000 7fc4fb7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc4fc0d2010 0x7fc4fc15d7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43252/0 (socket says 172.21.15.84:43252) 2023-09-13T08:24:45.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:45.917+0000 7fc4fb7fe700 1 -- 172.21.15.84:0/882851198 learned_addr learned my addr 172.21.15.84:0/882851198 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:24:45.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:45.917+0000 7fc4fa7fc700 1 --2- 172.21.15.84:0/882851198 >> v2:172.21.15.161:3300/0 conn(0x7fc4fc0d4030 0x7fc4fc15d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:45.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:45.917+0000 7fc4faffd700 1 --2- 172.21.15.84:0/882851198 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc4fc0d1c30 0x7fc4fc0cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:45.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:45.917+0000 7fc4fb7fe700 1 -- 172.21.15.84:0/882851198 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc4fc0d1c30 msgr2=0x7fc4fc0cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:24:45.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:45.917+0000 7fc4fb7fe700 1 --2- 172.21.15.84:0/882851198 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc4fc0d1c30 0x7fc4fc0cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:45.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:45.917+0000 7fc4fb7fe700 1 -- 172.21.15.84:0/882851198 >> v2:172.21.15.161:3300/0 conn(0x7fc4fc0d4030 msgr2=0x7fc4fc15d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:24:45.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:45.917+0000 7fc4fb7fe700 1 --2- 172.21.15.84:0/882851198 >> v2:172.21.15.161:3300/0 conn(0x7fc4fc0d4030 0x7fc4fc15d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:45.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:45.917+0000 7fc4fb7fe700 1 -- 172.21.15.84:0/882851198 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4fc0b6640 con 0x7fc4fc0d2010 2023-09-13T08:24:45.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:45.917+0000 7fc4fb7fe700 1 --2- 172.21.15.84:0/882851198 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4fc0d2010 0x7fc4fc15d7a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc08cd20 tx=0x7fc4f400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3601d4be8c9527 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:45.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:45.917+0000 7fc4f9ffb700 1 -- 172.21.15.84:0/882851198 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f400e070 con 0x7fc4fc0d2010 2023-09-13T08:24:45.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:45.917+0000 7fc4f9ffb700 1 -- 172.21.15.84:0/882851198 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4f400b910 con 0x7fc4fc0d2010 2023-09-13T08:24:45.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:45.917+0000 7fc4f9ffb700 1 -- 172.21.15.84:0/882851198 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f400bcc0 con 0x7fc4fc0d2010 2023-09-13T08:24:45.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:45.918+0000 7fc501890700 1 -- 172.21.15.84:0/882851198 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4fc0d2010 msgr2=0x7fc4fc15d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:45.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:45.918+0000 7fc501890700 1 --2- 172.21.15.84:0/882851198 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4fc0d2010 0x7fc4fc15d7a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc08cd20 tx=0x7fc4f400b330 comp rx=0 tx=0).stop 2023-09-13T08:24:45.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:45.918+0000 7fc501890700 1 -- 172.21.15.84:0/882851198 shutdown_connections 2023-09-13T08:24:45.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:45.918+0000 7fc501890700 1 --2- 172.21.15.84:0/882851198 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4fc0d2010 0x7fc4fc15d7a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:45.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:45.918+0000 7fc501890700 1 --2- 172.21.15.84:0/882851198 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc4fc0d1c30 0x7fc4fc0cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:45.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:45.918+0000 7fc501890700 1 --2- 172.21.15.84:0/882851198 >> v2:172.21.15.161:3300/0 conn(0x7fc4fc0d4030 0x7fc4fc15d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:45.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:45.918+0000 7fc501890700 1 -- 172.21.15.84:0/882851198 >> 172.21.15.84:0/882851198 conn(0x7fc4fc09c6b0 msgr2=0x7fc4fc0d33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:45.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:45.918+0000 7fc501890700 1 -- 172.21.15.84:0/882851198 shutdown_connections 2023-09-13T08:24:45.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:45.918+0000 7fc501890700 1 -- 172.21.15.84:0/882851198 wait complete. 2023-09-13T08:24:45.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:45.919+0000 7fc501890700 1 Processor -- start 2023-09-13T08:24:45.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:45.919+0000 7fc501890700 1 -- start start 2023-09-13T08:24:45.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:45.920+0000 7fc501890700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4fc0d1c30 0x7fc4fc156a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:45.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:45.920+0000 7fc501890700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc4fc0d2010 0x7fc4fc1f2f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:45.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:45.920+0000 7fc501890700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc4fc0d4030 0x7fc4fc15e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:45.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:45.920+0000 7fc501890700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4fc156f80 con 0x7fc4fc0d1c30 2023-09-13T08:24:45.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:45.920+0000 7fc501890700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4fc1f3f00 con 0x7fc4fc0d2010 2023-09-13T08:24:45.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:45.920+0000 7fc501890700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4fc1f3940 con 0x7fc4fc0d4030 2023-09-13T08:24:45.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:45.920+0000 7fc4faffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4fc0d1c30 0x7fc4fc156a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:45.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:45.920+0000 7fc4faffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4fc0d1c30 0x7fc4fc156a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43254/0 (socket says 172.21.15.84:43254) 2023-09-13T08:24:45.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:45.920+0000 7fc4faffd700 1 -- 172.21.15.84:0/197980581 learned_addr learned my addr 172.21.15.84:0/197980581 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:24:45.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:45.920+0000 7fc4fa7fc700 1 --2- 172.21.15.84:0/197980581 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc4fc0d2010 0x7fc4fc1f2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:45.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:45.920+0000 7fc4fb7fe700 1 --2- 172.21.15.84:0/197980581 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc4fc0d4030 0x7fc4fc15e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:45.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:45.920+0000 7fc4faffd700 1 -- 172.21.15.84:0/197980581 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc4fc0d4030 msgr2=0x7fc4fc15e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:45.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:45.920+0000 7fc4faffd700 1 --2- 172.21.15.84:0/197980581 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc4fc0d4030 0x7fc4fc15e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:45.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:45.920+0000 7fc4faffd700 1 -- 172.21.15.84:0/197980581 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc4fc0d2010 msgr2=0x7fc4fc1f2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:45.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:45.920+0000 7fc4faffd700 1 --2- 172.21.15.84:0/197980581 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc4fc0d2010 0x7fc4fc1f2f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:45.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:45.920+0000 7fc4faffd700 1 -- 172.21.15.84:0/197980581 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4f4009b30 con 0x7fc4fc0d1c30 2023-09-13T08:24:45.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:45.920+0000 7fc4fa7fc700 1 --2- 172.21.15.84:0/197980581 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc4fc0d2010 0x7fc4fc1f2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T08:24:45.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:45.920+0000 7fc4faffd700 1 --2- 172.21.15.84:0/197980581 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4fc0d1c30 0x7fc4fc156a40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc4f000e870 tx=0x7fc4f000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:45.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:45.921+0000 7fc4e3fff700 1 -- 172.21.15.84:0/197980581 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f000c640 con 0x7fc4fc0d1c30 2023-09-13T08:24:45.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:45.921+0000 7fc4e3fff700 1 -- 172.21.15.84:0/197980581 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4f000c7a0 con 0x7fc4fc0d1c30 2023-09-13T08:24:45.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:45.921+0000 7fc501890700 1 -- 172.21.15.84:0/197980581 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4fc1f3c20 con 0x7fc4fc0d1c30 2023-09-13T08:24:45.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:45.921+0000 7fc4e3fff700 1 -- 172.21.15.84:0/197980581 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f000cb30 con 0x7fc4fc0d1c30 2023-09-13T08:24:45.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:45.921+0000 7fc501890700 1 -- 172.21.15.84:0/197980581 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4fc15e1b0 con 0x7fc4fc0d1c30 2023-09-13T08:24:45.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:45.922+0000 7fc501890700 1 -- 172.21.15.84:0/197980581 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4fc15e340 con 0x7fc4fc0d1c30 2023-09-13T08:24:45.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:45.922+0000 7fc4e3fff700 1 -- 172.21.15.84:0/197980581 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fc4f000cc90 con 0x7fc4fc0d1c30 2023-09-13T08:24:45.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:45.922+0000 7fc4e3fff700 1 --2- 172.21.15.84:0/197980581 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fc4e806a580 0x7fc4e806ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:45.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:45.922+0000 7fc4e3fff700 1 -- 172.21.15.84:0/197980581 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6428+0+0 (secure 0 0 0) 0x7fc4f0088c00 con 0x7fc4fc0d1c30 2023-09-13T08:24:45.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:45.922+0000 7fc4fa7fc700 1 --2- 172.21.15.84:0/197980581 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fc4e806a580 0x7fc4e806ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:45.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:45.923+0000 7fc4fa7fc700 1 --2- 172.21.15.84:0/197980581 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fc4e806a580 0x7fc4e806ca40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc15a7b0 tx=0x7fc4ec008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:45.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:45.927+0000 7fc4e3fff700 1 -- 172.21.15.84:0/197980581 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fc4f008f080 con 0x7fc4fc0d1c30 2023-09-13T08:24:46.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:46.114+0000 7fc501890700 1 -- 172.21.15.84:0/197980581 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7fc4fc04e9b0 con 0x7fc4fc0d1c30 2023-09-13T08:24:46.139 INFO:tasks.ceph.mds.b.smithi161.stderr:2023-09-13T08:24:46.139+0000 7f5181f76700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-09-13T08:24:46.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:46.772+0000 7fc4e3fff700 1 -- 172.21.15.84:0/197980581 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v23) v1 ==== 169+0+0 (secure 0 0 0) 0x7fc4f00210c0 con 0x7fc4fc0d1c30 2023-09-13T08:24:46.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:46.776+0000 7fc501890700 1 -- 172.21.15.84:0/197980581 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fc4e806a580 msgr2=0x7fc4e806ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:46.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:46.776+0000 7fc501890700 1 --2- 172.21.15.84:0/197980581 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fc4e806a580 0x7fc4e806ca40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc15a7b0 tx=0x7fc4ec008040 comp rx=0 tx=0).stop 2023-09-13T08:24:46.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:46.776+0000 7fc501890700 1 -- 172.21.15.84:0/197980581 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4fc0d1c30 msgr2=0x7fc4fc156a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:46.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:46.776+0000 7fc501890700 1 --2- 172.21.15.84:0/197980581 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4fc0d1c30 0x7fc4fc156a40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc4f000e870 tx=0x7fc4f000ec30 comp rx=0 tx=0).stop 2023-09-13T08:24:46.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:46.776+0000 7fc501890700 1 -- 172.21.15.84:0/197980581 shutdown_connections 2023-09-13T08:24:46.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:46.776+0000 7fc501890700 1 --2- 172.21.15.84:0/197980581 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc4fc0d4030 0x7fc4fc15e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:46.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:46.776+0000 7fc501890700 1 --2- 172.21.15.84:0/197980581 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4fc0d1c30 0x7fc4fc156a40 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:46.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:46.776+0000 7fc501890700 1 --2- 172.21.15.84:0/197980581 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fc4e806a580 0x7fc4e806ca40 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:46.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:46.776+0000 7fc501890700 1 --2- 172.21.15.84:0/197980581 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc4fc0d2010 0x7fc4fc1f2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:46.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:46.776+0000 7fc501890700 1 -- 172.21.15.84:0/197980581 >> 172.21.15.84:0/197980581 conn(0x7fc4fc09c6b0 msgr2=0x7fc4fc0d33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:46.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:46.778+0000 7fc501890700 1 -- 172.21.15.84:0/197980581 shutdown_connections 2023-09-13T08:24:46.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:46.778+0000 7fc501890700 1 -- 172.21.15.84:0/197980581 wait complete. 2023-09-13T08:24:46.791 INFO:teuthology.orchestra.run.smithi084.stderr:set pool 4 allow_ec_overwrites to true 2023-09-13T08:24:46.807 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-09-13T08:24:46.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:46.929+0000 7ff273cfc700 1 Processor -- start 2023-09-13T08:24:46.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:46.929+0000 7ff273cfc700 1 -- start start 2023-09-13T08:24:46.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:46.930+0000 7ff273cfc700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff26c0af130 0x7ff26c15b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:46.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:46.930+0000 7ff273cfc700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff26c15ec90 con 0x7ff26c0ce510 2023-09-13T08:24:46.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:46.930+0000 7ff273cfc700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff26c15e420 con 0x7ff26c0b1ab0 2023-09-13T08:24:46.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:46.930+0000 7ff273cfc700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff26c15e6d0 con 0x7ff26c0af130 2023-09-13T08:24:46.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:46.930+0000 7ff271297700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7ff26c0ce510 0x7ff26c15dd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:45910/0 (socket says 172.21.15.84:45910) 2023-09-13T08:24:46.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:46.930+0000 7ff271297700 1 -- 172.21.15.84:0/1516070353 learned_addr learned my addr 172.21.15.84:0/1516070353 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:24:46.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:46.930+0000 7ff271a98700 1 --2- 172.21.15.84:0/1516070353 >> v2:172.21.15.161:3300/0 conn(0x7ff26c0af130 0x7ff26c15b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:46.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:46.930+0000 7ff270a96700 1 -- 172.21.15.84:0/1516070353 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1578513362 0 0) 0x7ff26c15ec90 con 0x7ff26c0ce510 2023-09-13T08:24:46.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:46.930+0000 7ff270a96700 1 -- 172.21.15.84:0/1516070353 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2580035b0 con 0x7ff26c0ce510 2023-09-13T08:24:46.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:46.930+0000 7ff271a98700 1 -- 172.21.15.84:0/1516070353 >> v1:172.21.15.161:6789/0 conn(0x7ff26c0b1ab0 legacy=0x7ff26c0b1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:46.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:46.930+0000 7ff270a96700 1 -- 172.21.15.84:0/1516070353 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2719780707 0 0) 0x7ff2580035b0 con 0x7ff26c0ce510 2023-09-13T08:24:46.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:46.930+0000 7ff271a98700 1 -- 172.21.15.84:0/1516070353 >> v1:172.21.15.84:6789/0 conn(0x7ff26c0ce510 legacy=0x7ff26c15dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:46.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:46.930+0000 7ff271a98700 1 -- 172.21.15.84:0/1516070353 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff26c15e9b0 con 0x7ff26c0af130 2023-09-13T08:24:46.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:46.930+0000 7ff271a98700 1 --2- 172.21.15.84:0/1516070353 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff26c0af130 0x7ff26c15b0c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff2680097c0 tx=0x7ff268009ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=679e818c101dc900 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:46.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:46.931+0000 7ff270a96700 1 -- 172.21.15.84:0/1516070353 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff25c001670 con 0x7ff26c0af130 2023-09-13T08:24:46.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:46.931+0000 7ff270a96700 1 -- 172.21.15.84:0/1516070353 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff268004030 con 0x7ff26c0af130 2023-09-13T08:24:46.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:46.931+0000 7ff270a96700 1 -- 172.21.15.84:0/1516070353 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2680043a0 con 0x7ff26c0af130 2023-09-13T08:24:46.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:46.931+0000 7ff273cfc700 1 -- 172.21.15.84:0/1516070353 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff26c0af130 msgr2=0x7ff26c15b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:46.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:46.931+0000 7ff273cfc700 1 --2- 172.21.15.84:0/1516070353 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff26c0af130 0x7ff26c15b0c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff2680097c0 tx=0x7ff268009ad0 comp rx=0 tx=0).stop 2023-09-13T08:24:46.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:46.931+0000 7ff273cfc700 1 -- 172.21.15.84:0/1516070353 shutdown_connections 2023-09-13T08:24:46.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:46.931+0000 7ff273cfc700 1 --2- 172.21.15.84:0/1516070353 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff26c0af130 0x7ff26c15b0c0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:46.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:46.931+0000 7ff273cfc700 1 -- 172.21.15.84:0/1516070353 >> 172.21.15.84:0/1516070353 conn(0x7ff26c0ccab0 msgr2=0x7ff26c0ccec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:46.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:46.931+0000 7ff273cfc700 1 -- 172.21.15.84:0/1516070353 shutdown_connections 2023-09-13T08:24:46.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:46.931+0000 7ff273cfc700 1 -- 172.21.15.84:0/1516070353 wait complete. 2023-09-13T08:24:46.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:46.932+0000 7ff273cfc700 1 Processor -- start 2023-09-13T08:24:46.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:46.932+0000 7ff273cfc700 1 -- start start 2023-09-13T08:24:46.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:46.933+0000 7ff273cfc700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff26c0af130 0x7ff26c151660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:46.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:46.933+0000 7ff273cfc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff26c0b1ab0 0x7ff26c0b52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:46.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:46.933+0000 7ff273cfc700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff26c0b5800 0x7ff26c159440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:46.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:46.933+0000 7ff273cfc700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff26c1583a0 con 0x7ff26c0b1ab0 2023-09-13T08:24:46.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:46.933+0000 7ff273cfc700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff26c158680 con 0x7ff26c0af130 2023-09-13T08:24:46.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:46.933+0000 7ff273cfc700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff26c158960 con 0x7ff26c0b5800 2023-09-13T08:24:46.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:46.933+0000 7ff271297700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff26c0b1ab0 0x7ff26c0b52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:46.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:46.933+0000 7ff271297700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff26c0b1ab0 0x7ff26c0b52c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43270/0 (socket says 172.21.15.84:43270) 2023-09-13T08:24:46.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:46.933+0000 7ff271297700 1 -- 172.21.15.84:0/2228426851 learned_addr learned my addr 172.21.15.84:0/2228426851 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:24:46.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:46.933+0000 7ff271a98700 1 --2- 172.21.15.84:0/2228426851 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff26c0af130 0x7ff26c151660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:46.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:46.933+0000 7ff272299700 1 --2- 172.21.15.84:0/2228426851 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff26c0b5800 0x7ff26c159440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:46.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:46.933+0000 7ff271297700 1 -- 172.21.15.84:0/2228426851 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff26c0b5800 msgr2=0x7ff26c159440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:46.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:46.933+0000 7ff271297700 1 --2- 172.21.15.84:0/2228426851 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff26c0b5800 0x7ff26c159440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:46.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:46.933+0000 7ff271297700 1 -- 172.21.15.84:0/2228426851 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff26c0af130 msgr2=0x7ff26c151660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:46.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:46.933+0000 7ff271297700 1 --2- 172.21.15.84:0/2228426851 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff26c0af130 0x7ff26c151660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:46.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:46.933+0000 7ff271297700 1 -- 172.21.15.84:0/2228426851 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2680094a0 con 0x7ff26c0b1ab0 2023-09-13T08:24:46.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:46.933+0000 7ff271a98700 1 --2- 172.21.15.84:0/2228426851 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff26c0af130 0x7ff26c151660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T08:24:46.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:46.933+0000 7ff272299700 1 --2- 172.21.15.84:0/2228426851 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff26c0b5800 0x7ff26c159440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T08:24:46.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:46.934+0000 7ff271297700 1 --2- 172.21.15.84:0/2228426851 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff26c0b1ab0 0x7ff26c0b52c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff25c00c750 tx=0x7ff25c00cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:46.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:46.934+0000 7ff2627fc700 1 -- 172.21.15.84:0/2228426851 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff25c005d50 con 0x7ff26c0b1ab0 2023-09-13T08:24:46.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:46.934+0000 7ff2627fc700 1 -- 172.21.15.84:0/2228426851 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff25c0070d0 con 0x7ff26c0b1ab0 2023-09-13T08:24:46.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:46.934+0000 7ff273cfc700 1 -- 172.21.15.84:0/2228426851 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff26c158c40 con 0x7ff26c0b1ab0 2023-09-13T08:24:46.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:46.934+0000 7ff2627fc700 1 -- 172.21.15.84:0/2228426851 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff25c007460 con 0x7ff26c0b1ab0 2023-09-13T08:24:46.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:46.934+0000 7ff273cfc700 1 -- 172.21.15.84:0/2228426851 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff26c158000 con 0x7ff26c0b1ab0 2023-09-13T08:24:46.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:46.935+0000 7ff273cfc700 1 -- 172.21.15.84:0/2228426851 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff26c159160 con 0x7ff26c0b1ab0 2023-09-13T08:24:46.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:46.935+0000 7ff2627fc700 1 -- 172.21.15.84:0/2228426851 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7ff25c0075c0 con 0x7ff26c0b1ab0 2023-09-13T08:24:46.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:46.935+0000 7ff2627fc700 1 --2- 172.21.15.84:0/2228426851 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7ff25006a580 0x7ff25006ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:46.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:46.936+0000 7ff2627fc700 1 -- 172.21.15.84:0/2228426851 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6428+0+0 (secure 0 0 0) 0x7ff25c088140 con 0x7ff26c0b1ab0 2023-09-13T08:24:46.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:46.936+0000 7ff271a98700 1 --2- 172.21.15.84:0/2228426851 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7ff25006a580 0x7ff25006ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:46.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:46.936+0000 7ff271a98700 1 --2- 172.21.15.84:0/2228426851 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7ff25006a580 0x7ff25006ca40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff268000c00 tx=0x7ff268008000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:46.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:46.940+0000 7ff2627fc700 1 -- 172.21.15.84:0/2228426851 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7ff26c159160 con 0x7ff26c0b1ab0 2023-09-13T08:24:47.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:47.174+0000 7ff273cfc700 1 -- 172.21.15.84:0/2228426851 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7ff26c159160 con 0x7ff26c0b1ab0 2023-09-13T08:24:47.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:47.773+0000 7ff2627fc700 1 -- 172.21.15.84:0/2228426851 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7ff26c159160 con 0x7ff26c0b1ab0 2023-09-13T08:24:47.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:47.775+0000 7ff273cfc700 1 -- 172.21.15.84:0/2228426851 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7ff25006a580 msgr2=0x7ff25006ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:47.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:47.775+0000 7ff273cfc700 1 --2- 172.21.15.84:0/2228426851 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7ff25006a580 0x7ff25006ca40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff268000c00 tx=0x7ff268008000 comp rx=0 tx=0).stop 2023-09-13T08:24:47.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:47.775+0000 7ff273cfc700 1 -- 172.21.15.84:0/2228426851 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff26c0b1ab0 msgr2=0x7ff26c0b52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:47.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:47.775+0000 7ff273cfc700 1 --2- 172.21.15.84:0/2228426851 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff26c0b1ab0 0x7ff26c0b52c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff25c00c750 tx=0x7ff25c00cb10 comp rx=0 tx=0).stop 2023-09-13T08:24:47.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:47.776+0000 7ff273cfc700 1 -- 172.21.15.84:0/2228426851 shutdown_connections 2023-09-13T08:24:47.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:47.776+0000 7ff273cfc700 1 --2- 172.21.15.84:0/2228426851 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff26c0b5800 0x7ff26c159440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:47.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:47.776+0000 7ff273cfc700 1 --2- 172.21.15.84:0/2228426851 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7ff25006a580 0x7ff25006ca40 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:47.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:47.776+0000 7ff273cfc700 1 --2- 172.21.15.84:0/2228426851 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff26c0af130 0x7ff26c151660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:47.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:47.776+0000 7ff273cfc700 1 --2- 172.21.15.84:0/2228426851 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff26c0b1ab0 0x7ff26c0b52c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:47.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:47.776+0000 7ff273cfc700 1 -- 172.21.15.84:0/2228426851 >> 172.21.15.84:0/2228426851 conn(0x7ff26c0ccab0 msgr2=0x7ff26c0b1eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:47.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:47.776+0000 7ff273cfc700 1 -- 172.21.15.84:0/2228426851 shutdown_connections 2023-09-13T08:24:47.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:47.776+0000 7ff273cfc700 1 -- 172.21.15.84:0/2228426851 wait complete. 2023-09-13T08:24:47.779 INFO:teuthology.orchestra.run.smithi084.stderr:added data pool 4 to fsmap 2023-09-13T08:24:47.790 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T08:24:47.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:47.912+0000 7f03bd513700 1 Processor -- start 2023-09-13T08:24:47.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:47.912+0000 7f03bd513700 1 -- start start 2023-09-13T08:24:47.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:47.913+0000 7f03bd513700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f03b806cc50 0x7f03b806d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:47.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:47.913+0000 7f03bd513700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f03b806b510 0x7f03b80caf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:47.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:47.913+0000 7f03bd513700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03b80cb560 con 0x7f03b815d6b0 2023-09-13T08:24:47.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:47.913+0000 7f03bd513700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03b806d570 con 0x7f03b806cc50 2023-09-13T08:24:47.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:47.913+0000 7f03bd513700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03b806a750 con 0x7f03b806b510 2023-09-13T08:24:47.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:47.913+0000 7f03b77fe700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f03b806b510 0x7f03b80caf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:47.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:47.913+0000 7f03b6ffd700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f03b806cc50 0x7f03b806d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:47.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:47.914+0000 7f03b67fc700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f03b815d6b0 0x7f03b80ca830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.84:60324/0 (socket says 172.21.15.84:60324) 2023-09-13T08:24:47.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:47.914+0000 7f03b6ffd700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f03b806cc50 0x7f03b806d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.84:39048/0 (socket says 172.21.15.84:39048) 2023-09-13T08:24:47.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:47.914+0000 7f03b77fe700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f03b806b510 0x7f03b80caf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.84:53144/0 (socket says 172.21.15.84:53144) 2023-09-13T08:24:47.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:47.914+0000 7f03b67fc700 1 -- 172.21.15.84:0/2167600516 learned_addr learned my addr 172.21.15.84:0/2167600516 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:24:47.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:47.914+0000 7f03b77fe700 1 -- 172.21.15.84:0/2167600516 >> v2:172.21.15.161:3300/0 conn(0x7f03b806cc50 msgr2=0x7f03b806d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:24:47.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:47.914+0000 7f03b77fe700 1 --2- 172.21.15.84:0/2167600516 >> v2:172.21.15.161:3300/0 conn(0x7f03b806cc50 0x7f03b806d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:47.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:47.914+0000 7f03b77fe700 1 -- 172.21.15.84:0/2167600516 >> v1:172.21.15.161:6789/0 conn(0x7f03b815d6b0 legacy=0x7f03b80ca830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:47.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:47.914+0000 7f03b77fe700 1 -- 172.21.15.84:0/2167600516 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03b806aa30 con 0x7f03b806b510 2023-09-13T08:24:47.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:47.914+0000 7f03b6ffd700 1 --2- 172.21.15.84:0/2167600516 >> v2:172.21.15.161:3300/0 conn(0x7f03b806cc50 0x7f03b806d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T08:24:47.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:47.914+0000 7f03b77fe700 1 --2- 172.21.15.84:0/2167600516 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f03b806b510 0x7f03b80caf40 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f03b0009d90 tx=0x7f03b000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62ef49c10beac284 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:47.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:47.914+0000 7f03b5ffb700 1 -- 172.21.15.84:0/2167600516 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b000e070 con 0x7f03b806b510 2023-09-13T08:24:47.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:47.914+0000 7f03b5ffb700 1 -- 172.21.15.84:0/2167600516 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03b000bb20 con 0x7f03b806b510 2023-09-13T08:24:47.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:47.914+0000 7f03b5ffb700 1 -- 172.21.15.84:0/2167600516 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b0012430 con 0x7f03b806b510 2023-09-13T08:24:47.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:47.915+0000 7f03bd513700 1 -- 172.21.15.84:0/2167600516 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f03b806b510 msgr2=0x7f03b80caf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:47.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:47.915+0000 7f03bd513700 1 --2- 172.21.15.84:0/2167600516 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f03b806b510 0x7f03b80caf40 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f03b0009d90 tx=0x7f03b000b330 comp rx=0 tx=0).stop 2023-09-13T08:24:47.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:47.915+0000 7f03bd513700 1 -- 172.21.15.84:0/2167600516 shutdown_connections 2023-09-13T08:24:47.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:47.915+0000 7f03bd513700 1 --2- 172.21.15.84:0/2167600516 >> v2:172.21.15.161:3300/0 conn(0x7f03b806cc50 0x7f03b806d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:47.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:47.915+0000 7f03bd513700 1 --2- 172.21.15.84:0/2167600516 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f03b806b510 0x7f03b80caf40 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:47.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:47.915+0000 7f03bd513700 1 -- 172.21.15.84:0/2167600516 >> 172.21.15.84:0/2167600516 conn(0x7f03b80cc230 msgr2=0x7f03b80cc640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:47.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:47.915+0000 7f03bd513700 1 -- 172.21.15.84:0/2167600516 shutdown_connections 2023-09-13T08:24:47.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:47.915+0000 7f03bd513700 1 -- 172.21.15.84:0/2167600516 wait complete. 2023-09-13T08:24:47.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:47.916+0000 7f03bd513700 1 Processor -- start 2023-09-13T08:24:47.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:47.916+0000 7f03bd513700 1 -- start start 2023-09-13T08:24:47.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:47.917+0000 7f03bd513700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03b806b510 0x7f03b81e9050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:47.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:47.917+0000 7f03bd513700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f03b806cc50 0x7f03b8160020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:47.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:47.917+0000 7f03bd513700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03b815d6b0 0x7f03b814d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:47.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:47.917+0000 7f03bd513700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03b80c8ca0 con 0x7f03b815d6b0 2023-09-13T08:24:47.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:47.917+0000 7f03bd513700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03b80c8f80 con 0x7f03b806b510 2023-09-13T08:24:47.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:47.917+0000 7f03bd513700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03b80c9260 con 0x7f03b806cc50 2023-09-13T08:24:47.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:47.917+0000 7f03b77fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03b815d6b0 0x7f03b814d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:47.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:47.917+0000 7f03b77fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03b815d6b0 0x7f03b814d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43286/0 (socket says 172.21.15.84:43286) 2023-09-13T08:24:47.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:47.917+0000 7f03b77fe700 1 -- 172.21.15.84:0/3803386024 learned_addr learned my addr 172.21.15.84:0/3803386024 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:24:47.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:47.917+0000 7f03b67fc700 1 --2- 172.21.15.84:0/3803386024 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f03b806cc50 0x7f03b8160020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:47.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:47.917+0000 7f03b6ffd700 1 --2- 172.21.15.84:0/3803386024 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03b806b510 0x7f03b81e9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:47.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:47.917+0000 7f03b77fe700 1 -- 172.21.15.84:0/3803386024 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f03b806cc50 msgr2=0x7f03b8160020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:47.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:47.917+0000 7f03b77fe700 1 --2- 172.21.15.84:0/3803386024 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f03b806cc50 0x7f03b8160020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:47.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:47.917+0000 7f03b77fe700 1 -- 172.21.15.84:0/3803386024 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03b806b510 msgr2=0x7f03b81e9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:47.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:47.917+0000 7f03b77fe700 1 --2- 172.21.15.84:0/3803386024 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03b806b510 0x7f03b81e9050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:47.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:47.917+0000 7f03b77fe700 1 -- 172.21.15.84:0/3803386024 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03ac0094a0 con 0x7f03b815d6b0 2023-09-13T08:24:47.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:47.918+0000 7f03b77fe700 1 --2- 172.21.15.84:0/3803386024 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03b815d6b0 0x7f03b814d790 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f03b0014040 tx=0x7f03b0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:47.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:47.918+0000 7f039f7fe700 1 -- 172.21.15.84:0/3803386024 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b0012430 con 0x7f03b815d6b0 2023-09-13T08:24:47.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:47.918+0000 7f039f7fe700 1 -- 172.21.15.84:0/3803386024 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03b0020070 con 0x7f03b815d6b0 2023-09-13T08:24:47.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:47.918+0000 7f03bd513700 1 -- 172.21.15.84:0/3803386024 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03b0009a70 con 0x7f03b815d6b0 2023-09-13T08:24:47.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:47.918+0000 7f039f7fe700 1 -- 172.21.15.84:0/3803386024 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b0003ea0 con 0x7f03b815d6b0 2023-09-13T08:24:47.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:47.918+0000 7f03bd513700 1 -- 172.21.15.84:0/3803386024 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03b815af60 con 0x7f03b815d6b0 2023-09-13T08:24:47.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:47.919+0000 7f03bd513700 1 -- 172.21.15.84:0/3803386024 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03b80c9780 con 0x7f03b815d6b0 2023-09-13T08:24:47.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:47.919+0000 7f039f7fe700 1 -- 172.21.15.84:0/3803386024 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f03b0004280 con 0x7f03b815d6b0 2023-09-13T08:24:47.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:47.919+0000 7f039f7fe700 1 --2- 172.21.15.84:0/3803386024 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f03a406a580 0x7f03a406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:47.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:47.920+0000 7f039f7fe700 1 -- 172.21.15.84:0/3803386024 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f03b0022070 con 0x7f03b815d6b0 2023-09-13T08:24:47.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:47.920+0000 7f03b6ffd700 1 --2- 172.21.15.84:0/3803386024 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f03a406a580 0x7f03a406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:47.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:47.920+0000 7f03b6ffd700 1 --2- 172.21.15.84:0/3803386024 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f03a406a580 0x7f03a406ca40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f03ac009d00 tx=0x7f03ac008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:47.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:47.924+0000 7f039f7fe700 1 -- 172.21.15.84:0/3803386024 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f03b0055da0 con 0x7f03b815d6b0 2023-09-13T08:24:48.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.157+0000 7f03bd513700 1 -- 172.21.15.84:0/3803386024 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f03b804e9b0 con 0x7f03b815d6b0 2023-09-13T08:24:48.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.158+0000 7f039f7fe700 1 -- 172.21.15.84:0/3803386024 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4909 (secure 0 0 0) 0x7f03b002c020 con 0x7f03b815d6b0 2023-09-13T08:24:48.311 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:24:48.311 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/3581118217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6833","nonce":3581118217},{"type":"v1","addr":"172.21.15.161:6835","nonce":3581118217}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4296,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/566416855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":566416855},{"type":"v1","addr":"172.21.15.84:6835","nonce":566416855}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4299,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/482729238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":482729238},{"type":"v1","addr":"172.21.15.84:6837","nonce":482729238}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T08:24:42.132788+0000","modified":"2023-09-13T08:24:47.176463+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4314},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4314":{"gid":4314,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.161:6834/2524298549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":2524298549},{"type":"v1","addr":"172.21.15.161:6834","nonce":2524298549}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-09-13T08:24:48.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.160+0000 7f03bd513700 1 -- 172.21.15.84:0/3803386024 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f03a406a580 msgr2=0x7f03a406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:48.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.160+0000 7f03bd513700 1 --2- 172.21.15.84:0/3803386024 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f03a406a580 0x7f03a406ca40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f03ac009d00 tx=0x7f03ac008040 comp rx=0 tx=0).stop 2023-09-13T08:24:48.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.160+0000 7f03bd513700 1 -- 172.21.15.84:0/3803386024 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03b815d6b0 msgr2=0x7f03b814d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:48.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.160+0000 7f03bd513700 1 --2- 172.21.15.84:0/3803386024 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03b815d6b0 0x7f03b814d790 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f03b0014040 tx=0x7f03b0004ad0 comp rx=0 tx=0).stop 2023-09-13T08:24:48.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.160+0000 7f03bd513700 1 -- 172.21.15.84:0/3803386024 shutdown_connections 2023-09-13T08:24:48.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.160+0000 7f03bd513700 1 --2- 172.21.15.84:0/3803386024 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03b815d6b0 0x7f03b814d790 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:48.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.160+0000 7f03bd513700 1 --2- 172.21.15.84:0/3803386024 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f03a406a580 0x7f03a406ca40 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:48.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.160+0000 7f03bd513700 1 --2- 172.21.15.84:0/3803386024 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03b806b510 0x7f03b81e9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:48.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.160+0000 7f03bd513700 1 --2- 172.21.15.84:0/3803386024 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f03b806cc50 0x7f03b8160020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:48.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.160+0000 7f03bd513700 1 -- 172.21.15.84:0/3803386024 >> 172.21.15.84:0/3803386024 conn(0x7f03b80cc230 msgr2=0x7f03b815db80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:48.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.160+0000 7f03bd513700 1 -- 172.21.15.84:0/3803386024 shutdown_connections 2023-09-13T08:24:48.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.160+0000 7f03bd513700 1 -- 172.21.15.84:0/3803386024 wait complete. 2023-09-13T08:24:48.315 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 7 2023-09-13T08:24:48.316 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T08:24:48.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.436+0000 7f6a2c279700 1 Processor -- start 2023-09-13T08:24:48.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.436+0000 7f6a2c279700 1 -- start start 2023-09-13T08:24:48.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.437+0000 7f6a2c279700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6a2415b560 0x7f6a240ced90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:48.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.437+0000 7f6a2c279700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f6a240d1ce0 0x7f6a240cf2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:48.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.437+0000 7f6a2c279700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a2415b940 con 0x7f6a240b0630 2023-09-13T08:24:48.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.437+0000 7f6a2c279700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a240d2170 con 0x7f6a240d1ce0 2023-09-13T08:24:48.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.437+0000 7f6a2c279700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a240cc980 con 0x7f6a2415b560 2023-09-13T08:24:48.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.438+0000 7f6a2a816700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f6a240b0630 0x7f6a240cdb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:45940/0 (socket says 172.21.15.84:45940) 2023-09-13T08:24:48.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.438+0000 7f6a2a816700 1 -- 172.21.15.84:0/2311532196 learned_addr learned my addr 172.21.15.84:0/2311532196 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:24:48.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.438+0000 7f6a29814700 1 --2- 172.21.15.84:0/2311532196 >> v2:172.21.15.161:3300/0 conn(0x7f6a240d1ce0 0x7f6a240cf2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:48.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.438+0000 7f6a2a015700 1 --2- 172.21.15.84:0/2311532196 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6a2415b560 0x7f6a240ced90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:48.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.438+0000 7f6a29013700 1 -- 172.21.15.84:0/2311532196 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3581225086 0 0) 0x7f6a2415b940 con 0x7f6a240b0630 2023-09-13T08:24:48.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.438+0000 7f6a29013700 1 -- 172.21.15.84:0/2311532196 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a100035b0 con 0x7f6a240b0630 2023-09-13T08:24:48.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.438+0000 7f6a29814700 1 -- 172.21.15.84:0/2311532196 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6a2415b560 msgr2=0x7f6a240ced90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:24:48.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.438+0000 7f6a29814700 1 --2- 172.21.15.84:0/2311532196 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6a2415b560 0x7f6a240ced90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:48.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.438+0000 7f6a29814700 1 -- 172.21.15.84:0/2311532196 >> v1:172.21.15.84:6789/0 conn(0x7f6a240b0630 legacy=0x7f6a240cdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:48.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.438+0000 7f6a29013700 1 -- 172.21.15.84:0/2311532196 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2022771023 0 0) 0x7f6a100035b0 con 0x7f6a240b0630 2023-09-13T08:24:48.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.438+0000 7f6a29814700 1 -- 172.21.15.84:0/2311532196 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a240ccc20 con 0x7f6a240d1ce0 2023-09-13T08:24:48.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.438+0000 7f6a29814700 1 --2- 172.21.15.84:0/2311532196 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a240d1ce0 0x7f6a240cf2d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6a20009840 tx=0x7f6a20009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1029dc2697c1a8dc server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:48.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.438+0000 7f6a29013700 1 -- 172.21.15.84:0/2311532196 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a1c0019f0 con 0x7f6a240d1ce0 2023-09-13T08:24:48.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.438+0000 7f6a29013700 1 -- 172.21.15.84:0/2311532196 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a20004030 con 0x7f6a240d1ce0 2023-09-13T08:24:48.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.438+0000 7f6a29013700 1 -- 172.21.15.84:0/2311532196 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a200043c0 con 0x7f6a240d1ce0 2023-09-13T08:24:48.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.439+0000 7f6a2c279700 1 -- 172.21.15.84:0/2311532196 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a240d1ce0 msgr2=0x7f6a240cf2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:48.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.439+0000 7f6a2c279700 1 --2- 172.21.15.84:0/2311532196 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a240d1ce0 0x7f6a240cf2d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6a20009840 tx=0x7f6a20009b50 comp rx=0 tx=0).stop 2023-09-13T08:24:48.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.439+0000 7f6a2c279700 1 -- 172.21.15.84:0/2311532196 shutdown_connections 2023-09-13T08:24:48.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.439+0000 7f6a2c279700 1 --2- 172.21.15.84:0/2311532196 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6a2415b560 0x7f6a240ced90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:48.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.439+0000 7f6a2c279700 1 --2- 172.21.15.84:0/2311532196 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a240d1ce0 0x7f6a240cf2d0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:48.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.439+0000 7f6a2c279700 1 -- 172.21.15.84:0/2311532196 >> 172.21.15.84:0/2311532196 conn(0x7f6a240d11c0 msgr2=0x7f6a240d15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:48.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.439+0000 7f6a2c279700 1 -- 172.21.15.84:0/2311532196 shutdown_connections 2023-09-13T08:24:48.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.439+0000 7f6a2c279700 1 -- 172.21.15.84:0/2311532196 wait complete. 2023-09-13T08:24:48.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.440+0000 7f6a2c279700 1 Processor -- start 2023-09-13T08:24:48.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.440+0000 7f6a2c279700 1 -- start start 2023-09-13T08:24:48.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.441+0000 7f6a2c279700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a240b0630 0x7f6a240b6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:48.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.441+0000 7f6a2c279700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6a2415b560 0x7f6a2414f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:48.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.441+0000 7f6a2c279700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a2414b260 0x7f6a2414b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:48.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.441+0000 7f6a2c279700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2414bc50 con 0x7f6a2414b260 2023-09-13T08:24:48.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.441+0000 7f6a2c279700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a24148f10 con 0x7f6a240b0630 2023-09-13T08:24:48.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.441+0000 7f6a2c279700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a240b2e70 con 0x7f6a2415b560 2023-09-13T08:24:48.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.441+0000 7f6a2a816700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a2414b260 0x7f6a2414b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:48.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.441+0000 7f6a2a816700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a2414b260 0x7f6a2414b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43298/0 (socket says 172.21.15.84:43298) 2023-09-13T08:24:48.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.441+0000 7f6a2a816700 1 -- 172.21.15.84:0/3030344577 learned_addr learned my addr 172.21.15.84:0/3030344577 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:24:48.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.441+0000 7f6a29814700 1 --2- 172.21.15.84:0/3030344577 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6a2415b560 0x7f6a2414f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:48.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.441+0000 7f6a2a015700 1 --2- 172.21.15.84:0/3030344577 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a240b0630 0x7f6a240b6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:48.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.441+0000 7f6a2a816700 1 -- 172.21.15.84:0/3030344577 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6a2415b560 msgr2=0x7f6a2414f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:48.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.441+0000 7f6a2a816700 1 --2- 172.21.15.84:0/3030344577 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6a2415b560 0x7f6a2414f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:48.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.441+0000 7f6a2a816700 1 -- 172.21.15.84:0/3030344577 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a240b0630 msgr2=0x7f6a240b6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:48.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.441+0000 7f6a2a816700 1 --2- 172.21.15.84:0/3030344577 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a240b0630 0x7f6a240b6710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:48.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.441+0000 7f6a2a816700 1 -- 172.21.15.84:0/3030344577 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a200094a0 con 0x7f6a2414b260 2023-09-13T08:24:48.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.442+0000 7f6a2a816700 1 --2- 172.21.15.84:0/3030344577 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a2414b260 0x7f6a2414b710 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c001560 tx=0x7f6a1c00cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:48.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.442+0000 7f6a1affd700 1 -- 172.21.15.84:0/3030344577 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a1c00aa40 con 0x7f6a2414b260 2023-09-13T08:24:48.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.442+0000 7f6a1affd700 1 -- 172.21.15.84:0/3030344577 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a1c00abc0 con 0x7f6a2414b260 2023-09-13T08:24:48.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.442+0000 7f6a2c279700 1 -- 172.21.15.84:0/3030344577 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a240b3150 con 0x7f6a2414b260 2023-09-13T08:24:48.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.442+0000 7f6a1affd700 1 -- 172.21.15.84:0/3030344577 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a1c0070d0 con 0x7f6a2414b260 2023-09-13T08:24:48.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.442+0000 7f6a2c279700 1 -- 172.21.15.84:0/3030344577 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a240b3710 con 0x7f6a2414b260 2023-09-13T08:24:48.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.443+0000 7f6a2c279700 1 -- 172.21.15.84:0/3030344577 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a2404e9b0 con 0x7f6a2414b260 2023-09-13T08:24:48.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.443+0000 7f6a1affd700 1 -- 172.21.15.84:0/3030344577 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f6a1c007230 con 0x7f6a2414b260 2023-09-13T08:24:48.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.443+0000 7f6a1affd700 1 --2- 172.21.15.84:0/3030344577 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f6a0806a580 0x7f6a0806ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:48.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.443+0000 7f6a2a015700 1 --2- 172.21.15.84:0/3030344577 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f6a0806a580 0x7f6a0806ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:48.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.443+0000 7f6a1affd700 1 -- 172.21.15.84:0/3030344577 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6a1c088a40 con 0x7f6a2414b260 2023-09-13T08:24:48.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.444+0000 7f6a2a015700 1 --2- 172.21.15.84:0/3030344577 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f6a0806a580 0x7f6a0806ca40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6a14009be0 tx=0x7f6a14009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:48.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.448+0000 7f6a1affd700 1 -- 172.21.15.84:0/3030344577 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f6a1c08ae60 con 0x7f6a2414b260 2023-09-13T08:24:48.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.642+0000 7f6a2c279700 1 -- 172.21.15.84:0/3030344577 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6a2415e920 con 0x7f6a2414b260 2023-09-13T08:24:48.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.643+0000 7f6a1affd700 1 -- 172.21.15.84:0/3030344577 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18322 (secure 0 0 0) 0x7f6a1c018020 con 0x7f6a2414b260 2023-09-13T08:24:48.643 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:24:48.644 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":24,"fsid":"0107440b-b634-42c5-a643-5d31ea826116","created":"2023-09-13T08:24:16.931917+0000","modified":"2023-09-13T08:24:47.176259+0000","last_up_change":"2023-09-13T08:24:28.422631+0000","last_in_change":"2023-09-13T08:24:19.425578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T08:24:28.583720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-13T08:24:39.862832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-13T08:24:41.145511+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-13T08:24:44.775160+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4a53ec12-1469-4356-b4e1-2b8fc9b7c0f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6817","nonce":1599532366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6819","nonce":1599532366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6823","nonce":1599532366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6821","nonce":1599532366}]},"public_addr":"172.21.15.84:6817/1599532366","cluster_addr":"172.21.15.84:6819/1599532366","heartbeat_back_addr":"172.21.15.84:6823/1599532366","heartbeat_front_addr":"172.21.15.84:6821/1599532366","state":["exists","up"]},{"osd":1,"uuid":"11e964a0-b80c-4afc-bfbf-e2067969db29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6825","nonce":461860977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6827","nonce":461860977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6831","nonce":461860977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6829","nonce":461860977}]},"public_addr":"172.21.15.84:6825/461860977","cluster_addr":"172.21.15.84:6827/461860977","heartbeat_back_addr":"172.21.15.84:6831/461860977","heartbeat_front_addr":"172.21.15.84:6829/461860977","state":["exists","up"]},{"osd":2,"uuid":"3ce74529-4dd1-44c7-9576-968f5fdc0c25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6809","nonce":1168316165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6811","nonce":1168316165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6815","nonce":1168316165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6813","nonce":1168316165}]},"public_addr":"172.21.15.84:6809/1168316165","cluster_addr":"172.21.15.84:6811/1168316165","heartbeat_back_addr":"172.21.15.84:6815/1168316165","heartbeat_front_addr":"172.21.15.84:6813/1168316165","state":["exists","up"]},{"osd":3,"uuid":"460cb5c5-590a-4d06-a4d9-5bac2fdf33b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6801","nonce":1661609810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6803","nonce":1661609810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6807","nonce":1661609810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6805","nonce":1661609810}]},"public_addr":"172.21.15.84:6801/1661609810","cluster_addr":"172.21.15.84:6803/1661609810","heartbeat_back_addr":"172.21.15.84:6807/1661609810","heartbeat_front_addr":"172.21.15.84:6805/1661609810","state":["exists","up"]},{"osd":4,"uuid":"bf237dd0-3ebd-44b5-8078-24a63e00d792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6801","nonce":1303562374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6803","nonce":1303562374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6807","nonce":1303562374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6805","nonce":1303562374}]},"public_addr":"172.21.15.161:6801/1303562374","cluster_addr":"172.21.15.161:6803/1303562374","heartbeat_back_addr":"172.21.15.161:6807/1303562374","heartbeat_front_addr":"172.21.15.161:6805/1303562374","state":["exists","up"]},{"osd":5,"uuid":"e1e538e0-5844-456b-8c6e-434d3a914af1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6818","nonce":961120854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6822","nonce":961120854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6830","nonce":961120854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6826","nonce":961120854}]},"public_addr":"172.21.15.161:6818/961120854","cluster_addr":"172.21.15.161:6822/961120854","heartbeat_back_addr":"172.21.15.161:6830/961120854","heartbeat_front_addr":"172.21.15.161:6826/961120854","state":["exists","up"]},{"osd":6,"uuid":"5cb1785e-960f-4dd4-b295-9e21b2c3f875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6809","nonce":980533466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6811","nonce":980533466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6815","nonce":980533466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6813","nonce":980533466}]},"public_addr":"172.21.15.161:6809/980533466","cluster_addr":"172.21.15.161:6811/980533466","heartbeat_back_addr":"172.21.15.161:6815/980533466","heartbeat_front_addr":"172.21.15.161:6813/980533466","state":["exists","up"]},{"osd":7,"uuid":"5acb6619-e933-4b46-b1c2-60af30acb839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6817","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6819","nonce":2479691549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6821","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6823","nonce":2479691549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6829","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6831","nonce":2479691549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6825","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6827","nonce":2479691549}]},"public_addr":"172.21.15.161:6819/2479691549","cluster_addr":"172.21.15.161:6823/2479691549","heartbeat_back_addr":"172.21.15.161:6831/2479691549","heartbeat_front_addr":"172.21.15.161:6827/2479691549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.678857+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.685341+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.613603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.634940+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.564387+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.697347+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.637437+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.619397+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T08:24:48.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.645+0000 7f6a2c279700 1 -- 172.21.15.84:0/3030344577 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f6a0806a580 msgr2=0x7f6a0806ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:48.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.645+0000 7f6a2c279700 1 --2- 172.21.15.84:0/3030344577 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f6a0806a580 0x7f6a0806ca40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6a14009be0 tx=0x7f6a14009210 comp rx=0 tx=0).stop 2023-09-13T08:24:48.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.645+0000 7f6a2c279700 1 -- 172.21.15.84:0/3030344577 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a2414b260 msgr2=0x7f6a2414b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:48.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.645+0000 7f6a2c279700 1 --2- 172.21.15.84:0/3030344577 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a2414b260 0x7f6a2414b710 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c001560 tx=0x7f6a1c00cee0 comp rx=0 tx=0).stop 2023-09-13T08:24:48.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.645+0000 7f6a2c279700 1 -- 172.21.15.84:0/3030344577 shutdown_connections 2023-09-13T08:24:48.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.645+0000 7f6a2c279700 1 --2- 172.21.15.84:0/3030344577 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a2414b260 0x7f6a2414b710 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:48.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.645+0000 7f6a2c279700 1 --2- 172.21.15.84:0/3030344577 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f6a0806a580 0x7f6a0806ca40 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:48.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.645+0000 7f6a2c279700 1 --2- 172.21.15.84:0/3030344577 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a240b0630 0x7f6a240b6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:48.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.645+0000 7f6a2c279700 1 --2- 172.21.15.84:0/3030344577 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6a2415b560 0x7f6a2414f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:48.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.645+0000 7f6a2c279700 1 -- 172.21.15.84:0/3030344577 >> 172.21.15.84:0/3030344577 conn(0x7f6a240d11c0 msgr2=0x7f6a2415a670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:48.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.645+0000 7f6a2c279700 1 -- 172.21.15.84:0/3030344577 shutdown_connections 2023-09-13T08:24:48.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.645+0000 7f6a2c279700 1 -- 172.21.15.84:0/3030344577 wait complete. 2023-09-13T08:24:48.658 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T08:24:48.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.778+0000 7fcc3fadb700 1 Processor -- start 2023-09-13T08:24:48.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.778+0000 7fcc3fadb700 1 -- start start 2023-09-13T08:24:48.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.779+0000 7fcc3fadb700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcc380cda30 0x7fcc3806ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:48.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.779+0000 7fcc3fadb700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fcc3815e2c0 0x7fcc3806a620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:48.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.779+0000 7fcc3fadb700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc380c5fc0 con 0x7fcc381619b0 2023-09-13T08:24:48.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.779+0000 7fcc3fadb700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc3815b400 con 0x7fcc3815e2c0 2023-09-13T08:24:48.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.779+0000 7fcc3fadb700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc38161e30 con 0x7fcc380cda30 2023-09-13T08:24:48.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.779+0000 7fcc3d877700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcc380cda30 0x7fcc3806ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:48.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.779+0000 7fcc3e078700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fcc3815e2c0 0x7fcc3806a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:48.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.779+0000 7fcc3d076700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fcc381619b0 0x7fcc380cde10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.84:60352/0 (socket says 172.21.15.84:60352) 2023-09-13T08:24:48.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.779+0000 7fcc3d877700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcc380cda30 0x7fcc3806ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.84:53168/0 (socket says 172.21.15.84:53168) 2023-09-13T08:24:48.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.779+0000 7fcc3d076700 1 -- 172.21.15.84:0/4054495800 learned_addr learned my addr 172.21.15.84:0/4054495800 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:24:48.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.779+0000 7fcc3e078700 1 --2- 172.21.15.84:0/4054495800 >> v2:172.21.15.161:3300/0 conn(0x7fcc3815e2c0 0x7fcc3806a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.84:39080/0 (socket says 172.21.15.84:39080) 2023-09-13T08:24:48.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.779+0000 7fcc3e078700 1 -- 172.21.15.84:0/4054495800 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcc380cda30 msgr2=0x7fcc3806ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:24:48.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.779+0000 7fcc3e078700 1 --2- 172.21.15.84:0/4054495800 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcc380cda30 0x7fcc3806ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:48.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.779+0000 7fcc3e078700 1 -- 172.21.15.84:0/4054495800 >> v1:172.21.15.161:6789/0 conn(0x7fcc381619b0 legacy=0x7fcc380cde10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:48.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.779+0000 7fcc3e078700 1 -- 172.21.15.84:0/4054495800 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc380c6210 con 0x7fcc3815e2c0 2023-09-13T08:24:48.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.779+0000 7fcc3d877700 1 --2- 172.21.15.84:0/4054495800 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcc380cda30 0x7fcc3806ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T08:24:48.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.780+0000 7fcc3e078700 1 --2- 172.21.15.84:0/4054495800 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcc3815e2c0 0x7fcc3806a620 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fcc30009d90 tx=0x7fcc3000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5946bd7f01a827a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:48.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.780+0000 7fcc3c875700 1 -- 172.21.15.84:0/4054495800 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc3000e070 con 0x7fcc3815e2c0 2023-09-13T08:24:48.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.780+0000 7fcc3c875700 1 -- 172.21.15.84:0/4054495800 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc3000bb20 con 0x7fcc3815e2c0 2023-09-13T08:24:48.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.780+0000 7fcc3c875700 1 -- 172.21.15.84:0/4054495800 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc30012430 con 0x7fcc3815e2c0 2023-09-13T08:24:48.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.780+0000 7fcc3fadb700 1 -- 172.21.15.84:0/4054495800 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcc3815e2c0 msgr2=0x7fcc3806a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:48.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.780+0000 7fcc3fadb700 1 --2- 172.21.15.84:0/4054495800 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcc3815e2c0 0x7fcc3806a620 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fcc30009d90 tx=0x7fcc3000b330 comp rx=0 tx=0).stop 2023-09-13T08:24:48.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.780+0000 7fcc3fadb700 1 -- 172.21.15.84:0/4054495800 shutdown_connections 2023-09-13T08:24:48.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.780+0000 7fcc3fadb700 1 --2- 172.21.15.84:0/4054495800 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcc3815e2c0 0x7fcc3806a620 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:48.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.780+0000 7fcc3fadb700 1 --2- 172.21.15.84:0/4054495800 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcc380cda30 0x7fcc3806ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:48.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.780+0000 7fcc3fadb700 1 -- 172.21.15.84:0/4054495800 >> 172.21.15.84:0/4054495800 conn(0x7fcc380cc210 msgr2=0x7fcc380cc620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:48.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.781+0000 7fcc3fadb700 1 -- 172.21.15.84:0/4054495800 shutdown_connections 2023-09-13T08:24:48.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.781+0000 7fcc3fadb700 1 -- 172.21.15.84:0/4054495800 wait complete. 2023-09-13T08:24:48.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.782+0000 7fcc3fadb700 1 Processor -- start 2023-09-13T08:24:48.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.782+0000 7fcc3fadb700 1 -- start start 2023-09-13T08:24:48.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.783+0000 7fcc3fadb700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcc380cda30 0x7fcc380ad260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:48.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.783+0000 7fcc3fadb700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcc3815e2c0 0x7fcc38158320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:48.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.783+0000 7fcc3fadb700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc381619b0 0x7fcc380c6860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:48.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.783+0000 7fcc3fadb700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc380ac8d0 con 0x7fcc381619b0 2023-09-13T08:24:48.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.783+0000 7fcc3fadb700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc3806d4a0 con 0x7fcc3815e2c0 2023-09-13T08:24:48.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.783+0000 7fcc3fadb700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc3806da60 con 0x7fcc380cda30 2023-09-13T08:24:48.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.783+0000 7fcc3e078700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc381619b0 0x7fcc380c6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:48.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.783+0000 7fcc3e078700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc381619b0 0x7fcc380c6860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43314/0 (socket says 172.21.15.84:43314) 2023-09-13T08:24:48.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.783+0000 7fcc3e078700 1 -- 172.21.15.84:0/3835831776 learned_addr learned my addr 172.21.15.84:0/3835831776 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:24:48.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.783+0000 7fcc3d877700 1 --2- 172.21.15.84:0/3835831776 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcc380cda30 0x7fcc380ad260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:48.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.783+0000 7fcc3d076700 1 --2- 172.21.15.84:0/3835831776 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcc3815e2c0 0x7fcc38158320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:48.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.783+0000 7fcc3e078700 1 -- 172.21.15.84:0/3835831776 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcc380cda30 msgr2=0x7fcc380ad260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:48.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.783+0000 7fcc3e078700 1 --2- 172.21.15.84:0/3835831776 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcc380cda30 0x7fcc380ad260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:48.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.783+0000 7fcc3e078700 1 -- 172.21.15.84:0/3835831776 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcc3815e2c0 msgr2=0x7fcc38158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:48.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.783+0000 7fcc3e078700 1 --2- 172.21.15.84:0/3835831776 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcc3815e2c0 0x7fcc38158320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:48.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.783+0000 7fcc3e078700 1 -- 172.21.15.84:0/3835831776 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc340094a0 con 0x7fcc381619b0 2023-09-13T08:24:48.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.783+0000 7fcc3e078700 1 --2- 172.21.15.84:0/3835831776 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc381619b0 0x7fcc380c6860 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fcc38071f90 tx=0x7fcc30004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:48.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.784+0000 7fcc2e7fc700 1 -- 172.21.15.84:0/3835831776 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc30012430 con 0x7fcc381619b0 2023-09-13T08:24:48.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.785+0000 7fcc3fadb700 1 -- 172.21.15.84:0/3835831776 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc30009a70 con 0x7fcc381619b0 2023-09-13T08:24:48.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.785+0000 7fcc2e7fc700 1 -- 172.21.15.84:0/3835831776 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc30020070 con 0x7fcc381619b0 2023-09-13T08:24:48.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.785+0000 7fcc2e7fc700 1 -- 172.21.15.84:0/3835831776 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc300098f0 con 0x7fcc381619b0 2023-09-13T08:24:48.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.785+0000 7fcc3fadb700 1 -- 172.21.15.84:0/3835831776 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc380ad7a0 con 0x7fcc381619b0 2023-09-13T08:24:48.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.786+0000 7fcc3fadb700 1 -- 172.21.15.84:0/3835831776 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc3806dc10 con 0x7fcc381619b0 2023-09-13T08:24:48.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.786+0000 7fcc2e7fc700 1 -- 172.21.15.84:0/3835831776 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fcc30004040 con 0x7fcc381619b0 2023-09-13T08:24:48.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.786+0000 7fcc2e7fc700 1 --2- 172.21.15.84:0/3835831776 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fcc1c06a580 0x7fcc1c06ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:48.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.787+0000 7fcc3d877700 1 --2- 172.21.15.84:0/3835831776 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fcc1c06a580 0x7fcc1c06ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:48.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.787+0000 7fcc2e7fc700 1 -- 172.21.15.84:0/3835831776 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcc30022070 con 0x7fcc381619b0 2023-09-13T08:24:48.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.787+0000 7fcc3d877700 1 --2- 172.21.15.84:0/3835831776 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fcc1c06a580 0x7fcc1c06ca40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fcc34009cd0 tx=0x7fcc34009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:48.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.791+0000 7fcc2e7fc700 1 -- 172.21.15.84:0/3835831776 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fcc3806dc10 con 0x7fcc381619b0 2023-09-13T08:24:48.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.980+0000 7fcc3fadb700 1 -- 172.21.15.84:0/3835831776 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcc3806dbd0 con 0x7fcc381619b0 2023-09-13T08:24:48.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.981+0000 7fcc2e7fc700 1 -- 172.21.15.84:0/3835831776 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18322 (secure 0 0 0) 0x7fcc30059630 con 0x7fcc381619b0 2023-09-13T08:24:48.982 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:24:48.982 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":24,"fsid":"0107440b-b634-42c5-a643-5d31ea826116","created":"2023-09-13T08:24:16.931917+0000","modified":"2023-09-13T08:24:47.176259+0000","last_up_change":"2023-09-13T08:24:28.422631+0000","last_in_change":"2023-09-13T08:24:19.425578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T08:24:28.583720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-13T08:24:39.862832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-13T08:24:41.145511+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-13T08:24:44.775160+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4a53ec12-1469-4356-b4e1-2b8fc9b7c0f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6817","nonce":1599532366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6819","nonce":1599532366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6823","nonce":1599532366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6821","nonce":1599532366}]},"public_addr":"172.21.15.84:6817/1599532366","cluster_addr":"172.21.15.84:6819/1599532366","heartbeat_back_addr":"172.21.15.84:6823/1599532366","heartbeat_front_addr":"172.21.15.84:6821/1599532366","state":["exists","up"]},{"osd":1,"uuid":"11e964a0-b80c-4afc-bfbf-e2067969db29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6825","nonce":461860977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6827","nonce":461860977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6831","nonce":461860977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6829","nonce":461860977}]},"public_addr":"172.21.15.84:6825/461860977","cluster_addr":"172.21.15.84:6827/461860977","heartbeat_back_addr":"172.21.15.84:6831/461860977","heartbeat_front_addr":"172.21.15.84:6829/461860977","state":["exists","up"]},{"osd":2,"uuid":"3ce74529-4dd1-44c7-9576-968f5fdc0c25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6809","nonce":1168316165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6811","nonce":1168316165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6815","nonce":1168316165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6813","nonce":1168316165}]},"public_addr":"172.21.15.84:6809/1168316165","cluster_addr":"172.21.15.84:6811/1168316165","heartbeat_back_addr":"172.21.15.84:6815/1168316165","heartbeat_front_addr":"172.21.15.84:6813/1168316165","state":["exists","up"]},{"osd":3,"uuid":"460cb5c5-590a-4d06-a4d9-5bac2fdf33b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6801","nonce":1661609810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6803","nonce":1661609810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6807","nonce":1661609810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6805","nonce":1661609810}]},"public_addr":"172.21.15.84:6801/1661609810","cluster_addr":"172.21.15.84:6803/1661609810","heartbeat_back_addr":"172.21.15.84:6807/1661609810","heartbeat_front_addr":"172.21.15.84:6805/1661609810","state":["exists","up"]},{"osd":4,"uuid":"bf237dd0-3ebd-44b5-8078-24a63e00d792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6801","nonce":1303562374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6803","nonce":1303562374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6807","nonce":1303562374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6805","nonce":1303562374}]},"public_addr":"172.21.15.161:6801/1303562374","cluster_addr":"172.21.15.161:6803/1303562374","heartbeat_back_addr":"172.21.15.161:6807/1303562374","heartbeat_front_addr":"172.21.15.161:6805/1303562374","state":["exists","up"]},{"osd":5,"uuid":"e1e538e0-5844-456b-8c6e-434d3a914af1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6818","nonce":961120854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6822","nonce":961120854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6830","nonce":961120854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6826","nonce":961120854}]},"public_addr":"172.21.15.161:6818/961120854","cluster_addr":"172.21.15.161:6822/961120854","heartbeat_back_addr":"172.21.15.161:6830/961120854","heartbeat_front_addr":"172.21.15.161:6826/961120854","state":["exists","up"]},{"osd":6,"uuid":"5cb1785e-960f-4dd4-b295-9e21b2c3f875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6809","nonce":980533466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6811","nonce":980533466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6815","nonce":980533466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6813","nonce":980533466}]},"public_addr":"172.21.15.161:6809/980533466","cluster_addr":"172.21.15.161:6811/980533466","heartbeat_back_addr":"172.21.15.161:6815/980533466","heartbeat_front_addr":"172.21.15.161:6813/980533466","state":["exists","up"]},{"osd":7,"uuid":"5acb6619-e933-4b46-b1c2-60af30acb839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6817","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6819","nonce":2479691549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6821","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6823","nonce":2479691549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6829","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6831","nonce":2479691549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6825","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6827","nonce":2479691549}]},"public_addr":"172.21.15.161:6819/2479691549","cluster_addr":"172.21.15.161:6823/2479691549","heartbeat_back_addr":"172.21.15.161:6831/2479691549","heartbeat_front_addr":"172.21.15.161:6827/2479691549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.678857+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.685341+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.613603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.634940+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.564387+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.697347+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.637437+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.619397+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T08:24:48.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.983+0000 7fcc3fadb700 1 -- 172.21.15.84:0/3835831776 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fcc1c06a580 msgr2=0x7fcc1c06ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:48.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.983+0000 7fcc3fadb700 1 --2- 172.21.15.84:0/3835831776 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fcc1c06a580 0x7fcc1c06ca40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fcc34009cd0 tx=0x7fcc34009210 comp rx=0 tx=0).stop 2023-09-13T08:24:48.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.983+0000 7fcc3fadb700 1 -- 172.21.15.84:0/3835831776 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc381619b0 msgr2=0x7fcc380c6860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:48.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.983+0000 7fcc3fadb700 1 --2- 172.21.15.84:0/3835831776 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc381619b0 0x7fcc380c6860 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fcc38071f90 tx=0x7fcc30004ad0 comp rx=0 tx=0).stop 2023-09-13T08:24:48.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.983+0000 7fcc3fadb700 1 -- 172.21.15.84:0/3835831776 shutdown_connections 2023-09-13T08:24:48.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.983+0000 7fcc3fadb700 1 --2- 172.21.15.84:0/3835831776 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc381619b0 0x7fcc380c6860 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:48.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.983+0000 7fcc3fadb700 1 --2- 172.21.15.84:0/3835831776 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcc380cda30 0x7fcc380ad260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:48.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.983+0000 7fcc3fadb700 1 --2- 172.21.15.84:0/3835831776 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fcc1c06a580 0x7fcc1c06ca40 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:48.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.983+0000 7fcc3fadb700 1 --2- 172.21.15.84:0/3835831776 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcc3815e2c0 0x7fcc38158320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:48.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.983+0000 7fcc3fadb700 1 -- 172.21.15.84:0/3835831776 >> 172.21.15.84:0/3835831776 conn(0x7fcc380cc210 msgr2=0x7fcc380c4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:48.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.983+0000 7fcc3fadb700 1 -- 172.21.15.84:0/3835831776 shutdown_connections 2023-09-13T08:24:48.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:48.983+0000 7fcc3fadb700 1 -- 172.21.15.84:0/3835831776 wait complete. 2023-09-13T08:24:49.014 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T08:24:49.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.133+0000 7f82e3e4d700 1 Processor -- start 2023-09-13T08:24:49.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.133+0000 7f82e3e4d700 1 -- start start 2023-09-13T08:24:49.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.134+0000 7f82e3e4d700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f82dc15d530 0x7f82dc161bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:49.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.134+0000 7f82e3e4d700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82dc1620f0 con 0x7f82dc06a620 2023-09-13T08:24:49.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.134+0000 7f82e3e4d700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82dc0cae50 con 0x7f82dc0ca920 2023-09-13T08:24:49.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.134+0000 7f82e3e4d700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82dc0cff20 con 0x7f82dc15d530 2023-09-13T08:24:49.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.134+0000 7f82e23ea700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f82dc06a620 0x7f82dc0ce490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:45968/0 (socket says 172.21.15.84:45968) 2023-09-13T08:24:49.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.134+0000 7f82e23ea700 1 -- 172.21.15.84:0/1788548006 learned_addr learned my addr 172.21.15.84:0/1788548006 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:24:49.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.135+0000 7f82e1be9700 1 --2- 172.21.15.84:0/1788548006 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f82dc15d530 0x7f82dc161bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:49.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.135+0000 7f82e0be7700 1 -- 172.21.15.84:0/1788548006 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 457412829 0 0) 0x7f82dc1620f0 con 0x7f82dc06a620 2023-09-13T08:24:49.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.135+0000 7f82e0be7700 1 -- 172.21.15.84:0/1788548006 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82c80035b0 con 0x7f82dc06a620 2023-09-13T08:24:49.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.135+0000 7f82e0be7700 1 -- 172.21.15.84:0/1788548006 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3926165565 0 0) 0x7f82c80035b0 con 0x7f82dc06a620 2023-09-13T08:24:49.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.135+0000 7f82e0be7700 1 -- 172.21.15.84:0/1788548006 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f82dc15d530 msgr2=0x7f82dc161bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:24:49.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.135+0000 7f82e0be7700 1 --2- 172.21.15.84:0/1788548006 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f82dc15d530 0x7f82dc161bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:49.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.135+0000 7f82e0be7700 1 -- 172.21.15.84:0/1788548006 >> v1:172.21.15.161:6789/0 conn(0x7f82dc0ca920 legacy=0x7f82dc06d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:49.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.135+0000 7f82e0be7700 1 -- 172.21.15.84:0/1788548006 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82dc0cb130 con 0x7f82dc06a620 2023-09-13T08:24:49.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.135+0000 7f82e0be7700 1 -- 172.21.15.84:0/1788548006 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2302733408 0 0) 0x7f82d40019f0 con 0x7f82dc06a620 2023-09-13T08:24:49.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.135+0000 7f82e0be7700 1 -- 172.21.15.84:0/1788548006 >> v1:172.21.15.84:6789/0 conn(0x7f82dc06a620 legacy=0x7f82dc0ce490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:49.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.135+0000 7f82e0be7700 1 --2- 172.21.15.84:0/1788548006 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f82c8003a30 0x7f82c8003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:49.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.135+0000 7f82e0be7700 1 --2- 172.21.15.84:0/1788548006 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82c80043e0 0x7f82c80048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:49.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.135+0000 7f82e0be7700 1 --2- 172.21.15.84:0/1788548006 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f82dc15d530 0x7f82c8005110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:49.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.135+0000 7f82e0be7700 1 -- 172.21.15.84:0/1788548006 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82c800ba10 con 0x7f82c80043e0 2023-09-13T08:24:49.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.135+0000 7f82e0be7700 1 -- 172.21.15.84:0/1788548006 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82c800bb50 con 0x7f82c8003a30 2023-09-13T08:24:49.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.135+0000 7f82e0be7700 1 -- 172.21.15.84:0/1788548006 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82c800bd10 con 0x7f82dc15d530 2023-09-13T08:24:49.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.135+0000 7f82e13e8700 1 --2- 172.21.15.84:0/1788548006 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82c80043e0 0x7f82c80048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:49.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.135+0000 7f82e1be9700 1 --2- 172.21.15.84:0/1788548006 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f82c8003a30 0x7f82c8003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:49.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.135+0000 7f82e23ea700 1 --2- 172.21.15.84:0/1788548006 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f82dc15d530 0x7f82c8005110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:49.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.135+0000 7f82e13e8700 1 -- 172.21.15.84:0/1788548006 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f82dc15d530 msgr2=0x7f82c8005110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:24:49.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.135+0000 7f82e13e8700 1 --2- 172.21.15.84:0/1788548006 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f82dc15d530 0x7f82c8005110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:49.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.135+0000 7f82e13e8700 1 -- 172.21.15.84:0/1788548006 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f82c8003a30 msgr2=0x7f82c8003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:24:49.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.135+0000 7f82e13e8700 1 --2- 172.21.15.84:0/1788548006 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f82c8003a30 0x7f82c8003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:49.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.135+0000 7f82e13e8700 1 -- 172.21.15.84:0/1788548006 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82c80035b0 con 0x7f82c80043e0 2023-09-13T08:24:49.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.135+0000 7f82e23ea700 1 --2- 172.21.15.84:0/1788548006 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f82dc15d530 0x7f82c8005110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T08:24:49.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.136+0000 7f82e13e8700 1 --2- 172.21.15.84:0/1788548006 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82c80043e0 0x7f82c80048b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f82dc0cad80 tx=0x7f82c8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90f581650830766e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:49.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.136+0000 7f82e0be7700 1 -- 172.21.15.84:0/1788548006 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82cc00c660 con 0x7f82c80043e0 2023-09-13T08:24:49.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.136+0000 7f82e0be7700 1 -- 172.21.15.84:0/1788548006 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82cc00c7c0 con 0x7f82c80043e0 2023-09-13T08:24:49.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.136+0000 7f82e0be7700 1 -- 172.21.15.84:0/1788548006 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82cc00cb70 con 0x7f82c80043e0 2023-09-13T08:24:49.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.136+0000 7f82e3e4d700 1 -- 172.21.15.84:0/1788548006 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82c80043e0 msgr2=0x7f82c80048b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:49.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.136+0000 7f82e3e4d700 1 --2- 172.21.15.84:0/1788548006 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82c80043e0 0x7f82c80048b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f82dc0cad80 tx=0x7f82c8005880 comp rx=0 tx=0).stop 2023-09-13T08:24:49.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.136+0000 7f82e23ea700 1 -- 172.21.15.84:0/1788548006 reap_dead start 2023-09-13T08:24:49.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.136+0000 7f82e3e4d700 1 -- 172.21.15.84:0/1788548006 shutdown_connections 2023-09-13T08:24:49.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.136+0000 7f82e3e4d700 1 -- 172.21.15.84:0/1788548006 >> 172.21.15.84:0/1788548006 conn(0x7f82dc0d00c0 msgr2=0x7f82dc0d04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:49.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.136+0000 7f82e3e4d700 1 -- 172.21.15.84:0/1788548006 shutdown_connections 2023-09-13T08:24:49.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.136+0000 7f82e3e4d700 1 -- 172.21.15.84:0/1788548006 wait complete. 2023-09-13T08:24:49.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.137+0000 7f82e3e4d700 1 Processor -- start 2023-09-13T08:24:49.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.138+0000 7f82e3e4d700 1 -- start start 2023-09-13T08:24:49.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.138+0000 7f82e3e4d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82c80043e0 0x7f82dc1543c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:49.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.138+0000 7f82e3e4d700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f82dc152580 0x7f82dc158d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:49.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.138+0000 7f82e3e4d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f82dc1592b0 0x7f82dc1575b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:49.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.138+0000 7f82e3e4d700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82dc159730 con 0x7f82c80043e0 2023-09-13T08:24:49.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.138+0000 7f82e3e4d700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82dc158470 con 0x7f82dc1592b0 2023-09-13T08:24:49.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.138+0000 7f82e3e4d700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82dc0c9570 con 0x7f82dc152580 2023-09-13T08:24:49.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.138+0000 7f82e1be9700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82c80043e0 0x7f82dc1543c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:49.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.138+0000 7f82e1be9700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82c80043e0 0x7f82dc1543c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43330/0 (socket says 172.21.15.84:43330) 2023-09-13T08:24:49.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.138+0000 7f82e1be9700 1 -- 172.21.15.84:0/821027201 learned_addr learned my addr 172.21.15.84:0/821027201 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:24:49.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.138+0000 7f82e23ea700 1 --2- 172.21.15.84:0/821027201 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f82dc1592b0 0x7f82dc1575b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:49.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.138+0000 7f82e13e8700 1 --2- 172.21.15.84:0/821027201 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f82dc152580 0x7f82dc158d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:49.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.139+0000 7f82e1be9700 1 -- 172.21.15.84:0/821027201 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f82dc152580 msgr2=0x7f82dc158d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:49.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.139+0000 7f82e1be9700 1 --2- 172.21.15.84:0/821027201 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f82dc152580 0x7f82dc158d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:49.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.139+0000 7f82e1be9700 1 -- 172.21.15.84:0/821027201 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f82dc1592b0 msgr2=0x7f82dc1575b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:49.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.139+0000 7f82e1be9700 1 --2- 172.21.15.84:0/821027201 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f82dc1592b0 0x7f82dc1575b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:49.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.139+0000 7f82e1be9700 1 -- 172.21.15.84:0/821027201 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82dc0c74c0 con 0x7f82c80043e0 2023-09-13T08:24:49.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.139+0000 7f82e23ea700 1 --2- 172.21.15.84:0/821027201 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f82dc1592b0 0x7f82dc1575b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T08:24:49.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.139+0000 7f82e1be9700 1 --2- 172.21.15.84:0/821027201 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82c80043e0 0x7f82dc1543c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f82d8011ad0 tx=0x7f82d8011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:49.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.139+0000 7f82d27fc700 1 -- 172.21.15.84:0/821027201 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d800f9a0 con 0x7f82c80043e0 2023-09-13T08:24:49.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.139+0000 7f82d27fc700 1 -- 172.21.15.84:0/821027201 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82d800fb00 con 0x7f82c80043e0 2023-09-13T08:24:49.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.139+0000 7f82e3e4d700 1 -- 172.21.15.84:0/821027201 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82dc0c8c80 con 0x7f82c80043e0 2023-09-13T08:24:49.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.139+0000 7f82d27fc700 1 -- 172.21.15.84:0/821027201 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d800feb0 con 0x7f82c80043e0 2023-09-13T08:24:49.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.139+0000 7f82e3e4d700 1 -- 172.21.15.84:0/821027201 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82dc0c8f20 con 0x7f82c80043e0 2023-09-13T08:24:49.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.140+0000 7f82e3e4d700 1 -- 172.21.15.84:0/821027201 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82dc04e9b0 con 0x7f82c80043e0 2023-09-13T08:24:49.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.140+0000 7f82d27fc700 1 -- 172.21.15.84:0/821027201 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f82d8014440 con 0x7f82c80043e0 2023-09-13T08:24:49.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.141+0000 7f82d27fc700 1 --2- 172.21.15.84:0/821027201 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f82c006a580 0x7f82c006ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:49.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.141+0000 7f82d27fc700 1 -- 172.21.15.84:0/821027201 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f82d80893e0 con 0x7f82c80043e0 2023-09-13T08:24:49.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.141+0000 7f82e13e8700 1 --2- 172.21.15.84:0/821027201 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f82c006a580 0x7f82c006ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:49.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.141+0000 7f82e13e8700 1 --2- 172.21.15.84:0/821027201 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f82c006a580 0x7f82c006ca40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f82cc014040 tx=0x7f82cc005040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:49.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.145+0000 7f82d27fc700 1 -- 172.21.15.84:0/821027201 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f82d80547c0 con 0x7f82c80043e0 2023-09-13T08:24:49.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.377+0000 7f82e3e4d700 1 -- 172.21.15.84:0/821027201 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f82dc0b6040 con 0x7f82c80043e0 2023-09-13T08:24:49.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.377+0000 7f82d27fc700 1 -- 172.21.15.84:0/821027201 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4909 (secure 0 0 0) 0x7f82d8057de0 con 0x7f82c80043e0 2023-09-13T08:24:49.378 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:24:49.378 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/3581118217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6833","nonce":3581118217},{"type":"v1","addr":"172.21.15.161:6835","nonce":3581118217}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4296,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/566416855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":566416855},{"type":"v1","addr":"172.21.15.84:6835","nonce":566416855}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4299,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/482729238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":482729238},{"type":"v1","addr":"172.21.15.84:6837","nonce":482729238}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T08:24:42.132788+0000","modified":"2023-09-13T08:24:47.176463+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4314},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4314":{"gid":4314,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.161:6834/2524298549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":2524298549},{"type":"v1","addr":"172.21.15.161:6834","nonce":2524298549}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-09-13T08:24:49.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.379+0000 7f82e3e4d700 1 -- 172.21.15.84:0/821027201 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f82c006a580 msgr2=0x7f82c006ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:49.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.379+0000 7f82e3e4d700 1 --2- 172.21.15.84:0/821027201 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f82c006a580 0x7f82c006ca40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f82cc014040 tx=0x7f82cc005040 comp rx=0 tx=0).stop 2023-09-13T08:24:49.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.379+0000 7f82e3e4d700 1 -- 172.21.15.84:0/821027201 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82c80043e0 msgr2=0x7f82dc1543c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:49.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.379+0000 7f82e3e4d700 1 --2- 172.21.15.84:0/821027201 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82c80043e0 0x7f82dc1543c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f82d8011ad0 tx=0x7f82d8011e90 comp rx=0 tx=0).stop 2023-09-13T08:24:49.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.379+0000 7f82e3e4d700 1 -- 172.21.15.84:0/821027201 shutdown_connections 2023-09-13T08:24:49.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.379+0000 7f82e3e4d700 1 --2- 172.21.15.84:0/821027201 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f82c006a580 0x7f82c006ca40 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:49.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.379+0000 7f82e3e4d700 1 --2- 172.21.15.84:0/821027201 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f82dc1592b0 0x7f82dc1575b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:49.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.379+0000 7f82e3e4d700 1 --2- 172.21.15.84:0/821027201 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82c80043e0 0x7f82dc1543c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:49.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.379+0000 7f82e3e4d700 1 --2- 172.21.15.84:0/821027201 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f82dc152580 0x7f82dc158d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:49.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.379+0000 7f82e3e4d700 1 -- 172.21.15.84:0/821027201 >> 172.21.15.84:0/821027201 conn(0x7f82dc0d00c0 msgr2=0x7f82dc0718b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:49.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.380+0000 7f82e3e4d700 1 -- 172.21.15.84:0/821027201 shutdown_connections 2023-09-13T08:24:49.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.380+0000 7f82e3e4d700 1 -- 172.21.15.84:0/821027201 wait complete. 2023-09-13T08:24:49.382 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 7 2023-09-13T08:24:49.392 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T08:24:49.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.512+0000 7f5a730eb700 1 Processor -- start 2023-09-13T08:24:49.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.512+0000 7f5a730eb700 1 -- start start 2023-09-13T08:24:49.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.513+0000 7f5a730eb700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5a6c15d720 0x7f5a6c0af5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:49.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.513+0000 7f5a730eb700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5a6c0d0bf0 0x7f5a6c161990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:49.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.513+0000 7f5a730eb700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5a6c161ed0 0x7f5a6c06a620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:49.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.513+0000 7f5a730eb700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a6c06f180 con 0x7f5a6c161ed0 2023-09-13T08:24:49.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.513+0000 7f5a730eb700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a6c161500 con 0x7f5a6c0d0bf0 2023-09-13T08:24:49.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.513+0000 7f5a730eb700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a6c06ebc0 con 0x7f5a6c15d720 2023-09-13T08:24:49.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.513+0000 7f5a71688700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5a6c161ed0 0x7f5a6c06a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:49.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.513+0000 7f5a71688700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5a6c161ed0 0x7f5a6c06a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43342/0 (socket says 172.21.15.84:43342) 2023-09-13T08:24:49.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.513+0000 7f5a71688700 1 -- 172.21.15.84:0/3523704882 learned_addr learned my addr 172.21.15.84:0/3523704882 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:24:49.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.513+0000 7f5a6bfff700 1 --2- 172.21.15.84:0/3523704882 >> v2:172.21.15.161:3300/0 conn(0x7f5a6c0d0bf0 0x7f5a6c161990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:49.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.513+0000 7f5a70e87700 1 --2- 172.21.15.84:0/3523704882 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5a6c15d720 0x7f5a6c0af5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:49.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.513+0000 7f5a71688700 1 -- 172.21.15.84:0/3523704882 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5a6c15d720 msgr2=0x7f5a6c0af5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:24:49.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.513+0000 7f5a71688700 1 --2- 172.21.15.84:0/3523704882 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5a6c15d720 0x7f5a6c0af5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:49.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.513+0000 7f5a71688700 1 -- 172.21.15.84:0/3523704882 >> v2:172.21.15.161:3300/0 conn(0x7f5a6c0d0bf0 msgr2=0x7f5a6c161990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:24:49.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.514+0000 7f5a71688700 1 --2- 172.21.15.84:0/3523704882 >> v2:172.21.15.161:3300/0 conn(0x7f5a6c0d0bf0 0x7f5a6c161990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:49.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.514+0000 7f5a71688700 1 -- 172.21.15.84:0/3523704882 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a6c06eea0 con 0x7f5a6c161ed0 2023-09-13T08:24:49.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.514+0000 7f5a71688700 1 --2- 172.21.15.84:0/3523704882 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a6c161ed0 0x7f5a6c06a620 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c0b2c50 tx=0x7f5a6400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ca02621f9d1ff8 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:49.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.514+0000 7f5a6b7fe700 1 -- 172.21.15.84:0/3523704882 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a6400e070 con 0x7f5a6c161ed0 2023-09-13T08:24:49.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.514+0000 7f5a6b7fe700 1 -- 172.21.15.84:0/3523704882 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a6400b9c0 con 0x7f5a6c161ed0 2023-09-13T08:24:49.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.514+0000 7f5a6b7fe700 1 -- 172.21.15.84:0/3523704882 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a6400bd70 con 0x7f5a6c161ed0 2023-09-13T08:24:49.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.514+0000 7f5a730eb700 1 -- 172.21.15.84:0/3523704882 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a6c161ed0 msgr2=0x7f5a6c06a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:49.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.514+0000 7f5a730eb700 1 --2- 172.21.15.84:0/3523704882 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a6c161ed0 0x7f5a6c06a620 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c0b2c50 tx=0x7f5a6400b330 comp rx=0 tx=0).stop 2023-09-13T08:24:49.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.514+0000 7f5a730eb700 1 -- 172.21.15.84:0/3523704882 shutdown_connections 2023-09-13T08:24:49.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.514+0000 7f5a730eb700 1 --2- 172.21.15.84:0/3523704882 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a6c161ed0 0x7f5a6c06a620 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:49.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.514+0000 7f5a730eb700 1 --2- 172.21.15.84:0/3523704882 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5a6c15d720 0x7f5a6c0af5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:49.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.514+0000 7f5a730eb700 1 --2- 172.21.15.84:0/3523704882 >> v2:172.21.15.161:3300/0 conn(0x7f5a6c0d0bf0 0x7f5a6c161990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:49.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.514+0000 7f5a730eb700 1 -- 172.21.15.84:0/3523704882 >> 172.21.15.84:0/3523704882 conn(0x7f5a6c0d00d0 msgr2=0x7f5a6c0d04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:49.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.514+0000 7f5a730eb700 1 -- 172.21.15.84:0/3523704882 shutdown_connections 2023-09-13T08:24:49.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.514+0000 7f5a730eb700 1 -- 172.21.15.84:0/3523704882 wait complete. 2023-09-13T08:24:49.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.516+0000 7f5a730eb700 1 Processor -- start 2023-09-13T08:24:49.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.516+0000 7f5a730eb700 1 -- start start 2023-09-13T08:24:49.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.516+0000 7f5a730eb700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5a6c0d0bf0 0x7f5a6c151720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:49.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.516+0000 7f5a730eb700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5a6c15d720 0x7f5a6c0b1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:49.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.517+0000 7f5a730eb700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a6c161ed0 0x7f5a6c0b1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:49.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.517+0000 7f5a730eb700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a6c0c9fc0 con 0x7f5a6c161ed0 2023-09-13T08:24:49.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.517+0000 7f5a730eb700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a6c0af5a0 con 0x7f5a6c15d720 2023-09-13T08:24:49.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.517+0000 7f5a730eb700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a6c0c5c80 con 0x7f5a6c0d0bf0 2023-09-13T08:24:49.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.517+0000 7f5a71688700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a6c161ed0 0x7f5a6c0b1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:49.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.517+0000 7f5a71688700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a6c161ed0 0x7f5a6c0b1e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43348/0 (socket says 172.21.15.84:43348) 2023-09-13T08:24:49.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.517+0000 7f5a71688700 1 -- 172.21.15.84:0/3519680520 learned_addr learned my addr 172.21.15.84:0/3519680520 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:24:49.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.517+0000 7f5a70e87700 1 --2- 172.21.15.84:0/3519680520 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5a6c0d0bf0 0x7f5a6c151720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:49.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.517+0000 7f5a6bfff700 1 --2- 172.21.15.84:0/3519680520 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5a6c15d720 0x7f5a6c0b1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:49.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.517+0000 7f5a71688700 1 -- 172.21.15.84:0/3519680520 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5a6c0d0bf0 msgr2=0x7f5a6c151720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:49.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.517+0000 7f5a71688700 1 --2- 172.21.15.84:0/3519680520 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5a6c0d0bf0 0x7f5a6c151720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:49.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.517+0000 7f5a71688700 1 -- 172.21.15.84:0/3519680520 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5a6c15d720 msgr2=0x7f5a6c0b1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:49.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.517+0000 7f5a71688700 1 --2- 172.21.15.84:0/3519680520 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5a6c15d720 0x7f5a6c0b1910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:49.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.517+0000 7f5a71688700 1 -- 172.21.15.84:0/3519680520 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a64009b30 con 0x7f5a6c161ed0 2023-09-13T08:24:49.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.517+0000 7f5a6bfff700 1 --2- 172.21.15.84:0/3519680520 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5a6c15d720 0x7f5a6c0b1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T08:24:49.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.517+0000 7f5a70e87700 1 --2- 172.21.15.84:0/3519680520 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5a6c0d0bf0 0x7f5a6c151720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T08:24:49.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.517+0000 7f5a71688700 1 --2- 172.21.15.84:0/3519680520 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a6c161ed0 0x7f5a6c0b1e50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c070930 tx=0x7f5a64004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:49.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.517+0000 7f5a697fa700 1 -- 172.21.15.84:0/3519680520 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a64004250 con 0x7f5a6c161ed0 2023-09-13T08:24:49.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.517+0000 7f5a697fa700 1 -- 172.21.15.84:0/3519680520 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a640043d0 con 0x7f5a6c161ed0 2023-09-13T08:24:49.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.517+0000 7f5a730eb700 1 -- 172.21.15.84:0/3519680520 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a6c0c5f60 con 0x7f5a6c161ed0 2023-09-13T08:24:49.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.517+0000 7f5a697fa700 1 -- 172.21.15.84:0/3519680520 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a64004780 con 0x7f5a6c161ed0 2023-09-13T08:24:49.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.517+0000 7f5a730eb700 1 -- 172.21.15.84:0/3519680520 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a6c0af860 con 0x7f5a6c161ed0 2023-09-13T08:24:49.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.518+0000 7f5a730eb700 1 -- 172.21.15.84:0/3519680520 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a6c0ce870 con 0x7f5a6c161ed0 2023-09-13T08:24:49.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.519+0000 7f5a697fa700 1 -- 172.21.15.84:0/3519680520 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f5a6402e480 con 0x7f5a6c161ed0 2023-09-13T08:24:49.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.520+0000 7f5a697fa700 1 --2- 172.21.15.84:0/3519680520 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f5a5006a580 0x7f5a5006ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:49.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.520+0000 7f5a697fa700 1 -- 172.21.15.84:0/3519680520 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5a6408a360 con 0x7f5a6c161ed0 2023-09-13T08:24:49.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.520+0000 7f5a70e87700 1 --2- 172.21.15.84:0/3519680520 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f5a5006a580 0x7f5a5006ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:49.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.520+0000 7f5a70e87700 1 --2- 172.21.15.84:0/3519680520 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f5a5006a580 0x7f5a5006ca40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5a60009a00 tx=0x7f5a60008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:49.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.523+0000 7f5a697fa700 1 -- 172.21.15.84:0/3519680520 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f5a64055660 con 0x7f5a6c161ed0 2023-09-13T08:24:49.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.715+0000 7f5a730eb700 1 -- 172.21.15.84:0/3519680520 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5a6c04e9b0 con 0x7f5a6c161ed0 2023-09-13T08:24:49.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.716+0000 7f5a697fa700 1 -- 172.21.15.84:0/3519680520 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18322 (secure 0 0 0) 0x7f5a64058c80 con 0x7f5a6c161ed0 2023-09-13T08:24:49.717 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:24:49.717 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":24,"fsid":"0107440b-b634-42c5-a643-5d31ea826116","created":"2023-09-13T08:24:16.931917+0000","modified":"2023-09-13T08:24:47.176259+0000","last_up_change":"2023-09-13T08:24:28.422631+0000","last_in_change":"2023-09-13T08:24:19.425578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T08:24:28.583720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-13T08:24:39.862832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-13T08:24:41.145511+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-13T08:24:44.775160+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4a53ec12-1469-4356-b4e1-2b8fc9b7c0f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6817","nonce":1599532366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6819","nonce":1599532366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6823","nonce":1599532366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6821","nonce":1599532366}]},"public_addr":"172.21.15.84:6817/1599532366","cluster_addr":"172.21.15.84:6819/1599532366","heartbeat_back_addr":"172.21.15.84:6823/1599532366","heartbeat_front_addr":"172.21.15.84:6821/1599532366","state":["exists","up"]},{"osd":1,"uuid":"11e964a0-b80c-4afc-bfbf-e2067969db29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6825","nonce":461860977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6827","nonce":461860977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6831","nonce":461860977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6829","nonce":461860977}]},"public_addr":"172.21.15.84:6825/461860977","cluster_addr":"172.21.15.84:6827/461860977","heartbeat_back_addr":"172.21.15.84:6831/461860977","heartbeat_front_addr":"172.21.15.84:6829/461860977","state":["exists","up"]},{"osd":2,"uuid":"3ce74529-4dd1-44c7-9576-968f5fdc0c25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6809","nonce":1168316165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6811","nonce":1168316165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6815","nonce":1168316165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6813","nonce":1168316165}]},"public_addr":"172.21.15.84:6809/1168316165","cluster_addr":"172.21.15.84:6811/1168316165","heartbeat_back_addr":"172.21.15.84:6815/1168316165","heartbeat_front_addr":"172.21.15.84:6813/1168316165","state":["exists","up"]},{"osd":3,"uuid":"460cb5c5-590a-4d06-a4d9-5bac2fdf33b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6801","nonce":1661609810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6803","nonce":1661609810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6807","nonce":1661609810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6805","nonce":1661609810}]},"public_addr":"172.21.15.84:6801/1661609810","cluster_addr":"172.21.15.84:6803/1661609810","heartbeat_back_addr":"172.21.15.84:6807/1661609810","heartbeat_front_addr":"172.21.15.84:6805/1661609810","state":["exists","up"]},{"osd":4,"uuid":"bf237dd0-3ebd-44b5-8078-24a63e00d792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6801","nonce":1303562374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6803","nonce":1303562374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6807","nonce":1303562374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6805","nonce":1303562374}]},"public_addr":"172.21.15.161:6801/1303562374","cluster_addr":"172.21.15.161:6803/1303562374","heartbeat_back_addr":"172.21.15.161:6807/1303562374","heartbeat_front_addr":"172.21.15.161:6805/1303562374","state":["exists","up"]},{"osd":5,"uuid":"e1e538e0-5844-456b-8c6e-434d3a914af1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6818","nonce":961120854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6822","nonce":961120854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6830","nonce":961120854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6826","nonce":961120854}]},"public_addr":"172.21.15.161:6818/961120854","cluster_addr":"172.21.15.161:6822/961120854","heartbeat_back_addr":"172.21.15.161:6830/961120854","heartbeat_front_addr":"172.21.15.161:6826/961120854","state":["exists","up"]},{"osd":6,"uuid":"5cb1785e-960f-4dd4-b295-9e21b2c3f875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6809","nonce":980533466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6811","nonce":980533466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6815","nonce":980533466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6813","nonce":980533466}]},"public_addr":"172.21.15.161:6809/980533466","cluster_addr":"172.21.15.161:6811/980533466","heartbeat_back_addr":"172.21.15.161:6815/980533466","heartbeat_front_addr":"172.21.15.161:6813/980533466","state":["exists","up"]},{"osd":7,"uuid":"5acb6619-e933-4b46-b1c2-60af30acb839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6817","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6819","nonce":2479691549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6821","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6823","nonce":2479691549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6829","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6831","nonce":2479691549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6825","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6827","nonce":2479691549}]},"public_addr":"172.21.15.161:6819/2479691549","cluster_addr":"172.21.15.161:6823/2479691549","heartbeat_back_addr":"172.21.15.161:6831/2479691549","heartbeat_front_addr":"172.21.15.161:6827/2479691549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.678857+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.685341+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.613603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.634940+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.564387+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.697347+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.637437+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.619397+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T08:24:49.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.719+0000 7f5a730eb700 1 -- 172.21.15.84:0/3519680520 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f5a5006a580 msgr2=0x7f5a5006ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:49.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.719+0000 7f5a730eb700 1 --2- 172.21.15.84:0/3519680520 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f5a5006a580 0x7f5a5006ca40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5a60009a00 tx=0x7f5a60008040 comp rx=0 tx=0).stop 2023-09-13T08:24:49.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.719+0000 7f5a730eb700 1 -- 172.21.15.84:0/3519680520 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a6c161ed0 msgr2=0x7f5a6c0b1e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:49.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.719+0000 7f5a730eb700 1 --2- 172.21.15.84:0/3519680520 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a6c161ed0 0x7f5a6c0b1e50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c070930 tx=0x7f5a64004ad0 comp rx=0 tx=0).stop 2023-09-13T08:24:49.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.719+0000 7f5a730eb700 1 -- 172.21.15.84:0/3519680520 shutdown_connections 2023-09-13T08:24:49.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.719+0000 7f5a730eb700 1 --2- 172.21.15.84:0/3519680520 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a6c161ed0 0x7f5a6c0b1e50 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:49.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.719+0000 7f5a730eb700 1 --2- 172.21.15.84:0/3519680520 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5a6c0d0bf0 0x7f5a6c151720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:49.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.719+0000 7f5a730eb700 1 --2- 172.21.15.84:0/3519680520 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f5a5006a580 0x7f5a5006ca40 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:49.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.719+0000 7f5a730eb700 1 --2- 172.21.15.84:0/3519680520 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5a6c15d720 0x7f5a6c0b1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:49.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.719+0000 7f5a730eb700 1 -- 172.21.15.84:0/3519680520 >> 172.21.15.84:0/3519680520 conn(0x7f5a6c0d00d0 msgr2=0x7f5a6c0cc040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:49.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.719+0000 7f5a730eb700 1 -- 172.21.15.84:0/3519680520 shutdown_connections 2023-09-13T08:24:49.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:49.719+0000 7f5a730eb700 1 -- 172.21.15.84:0/3519680520 wait complete. 2023-09-13T08:24:50.134 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-09-13T08:24:42.132788+0000', 'modified': '2023-09-13T08:24:47.176463+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4314}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4314': {'gid': 4314, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.161:6834/2524298549', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.161:6832', 'nonce': 2524298549}, {'type': 'v1', 'addr': '172.21.15.161:6834', 'nonce': 2524298549}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-09-13T08:24:50.134 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-09-13T08:24:50.135 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-09-13T08:24:50.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.262+0000 7faf5fcd3700 1 Processor -- start 2023-09-13T08:24:50.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.262+0000 7faf5fcd3700 1 -- start start 2023-09-13T08:24:50.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.263+0000 7faf5fcd3700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faf5815d530 0x7faf58161bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:50.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.263+0000 7faf5fcd3700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7faf580ca920 0x7faf5806d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:50.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.263+0000 7faf5fcd3700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf581620f0 con 0x7faf5806a620 2023-09-13T08:24:50.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.263+0000 7faf5fcd3700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf580cff20 con 0x7faf580ca920 2023-09-13T08:24:50.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.263+0000 7faf5fcd3700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf580cae50 con 0x7faf5815d530 2023-09-13T08:24:50.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.263+0000 7faf5d26e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7faf580ca920 0x7faf5806d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:50.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.263+0000 7faf5d26e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7faf580ca920 0x7faf5806d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43354/0 (socket says 172.21.15.84:43354) 2023-09-13T08:24:50.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.263+0000 7faf5d26e700 1 -- 172.21.15.84:0/3537329814 learned_addr learned my addr 172.21.15.84:0/3537329814 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:24:50.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.263+0000 7faf5da6f700 1 --2- 172.21.15.84:0/3537329814 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faf5815d530 0x7faf58161bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:50.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.263+0000 7faf5d26e700 1 -- 172.21.15.84:0/3537329814 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faf5815d530 msgr2=0x7faf58161bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:24:50.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.263+0000 7faf5d26e700 1 --2- 172.21.15.84:0/3537329814 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faf5815d530 0x7faf58161bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:50.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.263+0000 7faf5d26e700 1 -- 172.21.15.84:0/3537329814 >> v1:172.21.15.161:6789/0 conn(0x7faf5806a620 legacy=0x7faf580ce490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:50.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.263+0000 7faf5d26e700 1 -- 172.21.15.84:0/3537329814 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf580cb130 con 0x7faf580ca920 2023-09-13T08:24:50.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.263+0000 7faf5d26e700 1 --2- 172.21.15.84:0/3537329814 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf580ca920 0x7faf5806d700 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7faf540098f0 tx=0x7faf54009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61948a30b7a86fdb server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:50.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.263+0000 7faf5ca6d700 1 -- 172.21.15.84:0/3537329814 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5400b8a0 con 0x7faf580ca920 2023-09-13T08:24:50.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.263+0000 7faf5ca6d700 1 -- 172.21.15.84:0/3537329814 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf5400ba00 con 0x7faf580ca920 2023-09-13T08:24:50.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.263+0000 7faf5ca6d700 1 -- 172.21.15.84:0/3537329814 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5400bd90 con 0x7faf580ca920 2023-09-13T08:24:50.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.264+0000 7faf5fcd3700 1 -- 172.21.15.84:0/3537329814 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf580ca920 msgr2=0x7faf5806d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:50.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.264+0000 7faf5fcd3700 1 --2- 172.21.15.84:0/3537329814 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf580ca920 0x7faf5806d700 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7faf540098f0 tx=0x7faf54009c00 comp rx=0 tx=0).stop 2023-09-13T08:24:50.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.264+0000 7faf5fcd3700 1 -- 172.21.15.84:0/3537329814 shutdown_connections 2023-09-13T08:24:50.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.264+0000 7faf5fcd3700 1 --2- 172.21.15.84:0/3537329814 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faf5815d530 0x7faf58161bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:50.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.264+0000 7faf5fcd3700 1 --2- 172.21.15.84:0/3537329814 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf580ca920 0x7faf5806d700 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:50.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.264+0000 7faf5fcd3700 1 -- 172.21.15.84:0/3537329814 >> 172.21.15.84:0/3537329814 conn(0x7faf580d00c0 msgr2=0x7faf580d04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:50.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.264+0000 7faf5fcd3700 1 -- 172.21.15.84:0/3537329814 shutdown_connections 2023-09-13T08:24:50.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.264+0000 7faf5fcd3700 1 -- 172.21.15.84:0/3537329814 wait complete. 2023-09-13T08:24:50.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.265+0000 7faf5fcd3700 1 Processor -- start 2023-09-13T08:24:50.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.265+0000 7faf5fcd3700 1 -- start start 2023-09-13T08:24:50.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.266+0000 7faf5fcd3700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faf5806a620 0x7faf581f36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:50.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.266+0000 7faf5fcd3700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faf580ca920 0x7faf5815f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:50.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.266+0000 7faf5fcd3700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf5815d530 0x7faf581f6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:50.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.266+0000 7faf5fcd3700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf581f32b0 con 0x7faf5815d530 2023-09-13T08:24:50.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.266+0000 7faf5fcd3700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf5815f870 con 0x7faf580ca920 2023-09-13T08:24:50.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.266+0000 7faf5fcd3700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf580b4790 con 0x7faf5806a620 2023-09-13T08:24:50.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.266+0000 7faf5e270700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf5815d530 0x7faf581f6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:50.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.266+0000 7faf5e270700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf5815d530 0x7faf581f6170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43362/0 (socket says 172.21.15.84:43362) 2023-09-13T08:24:50.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.266+0000 7faf5e270700 1 -- 172.21.15.84:0/1086430051 learned_addr learned my addr 172.21.15.84:0/1086430051 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:24:50.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.266+0000 7faf5da6f700 1 --2- 172.21.15.84:0/1086430051 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faf5806a620 0x7faf581f36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:50.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.266+0000 7faf5d26e700 1 --2- 172.21.15.84:0/1086430051 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faf580ca920 0x7faf5815f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:50.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.266+0000 7faf5e270700 1 -- 172.21.15.84:0/1086430051 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faf5806a620 msgr2=0x7faf581f36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:50.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.266+0000 7faf5e270700 1 --2- 172.21.15.84:0/1086430051 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faf5806a620 0x7faf581f36d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:50.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.266+0000 7faf5e270700 1 -- 172.21.15.84:0/1086430051 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faf580ca920 msgr2=0x7faf5815f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:50.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.266+0000 7faf5e270700 1 --2- 172.21.15.84:0/1086430051 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faf580ca920 0x7faf5815f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:50.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.266+0000 7faf5e270700 1 -- 172.21.15.84:0/1086430051 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf54009550 con 0x7faf5815d530 2023-09-13T08:24:50.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.266+0000 7faf5e270700 1 --2- 172.21.15.84:0/1086430051 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf5815d530 0x7faf581f6170 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7faf5000cb40 tx=0x7faf5000ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:50.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.266+0000 7faf4e7fc700 1 -- 172.21.15.84:0/1086430051 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf50003c00 con 0x7faf5815d530 2023-09-13T08:24:50.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.267+0000 7faf4e7fc700 1 -- 172.21.15.84:0/1086430051 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf50003d60 con 0x7faf5815d530 2023-09-13T08:24:50.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.267+0000 7faf5fcd3700 1 -- 172.21.15.84:0/1086430051 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf581f6ce0 con 0x7faf5815d530 2023-09-13T08:24:50.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.267+0000 7faf4e7fc700 1 -- 172.21.15.84:0/1086430051 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5000aa20 con 0x7faf5815d530 2023-09-13T08:24:50.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.267+0000 7faf5fcd3700 1 -- 172.21.15.84:0/1086430051 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf581f2ed0 con 0x7faf5815d530 2023-09-13T08:24:50.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.268+0000 7faf4e7fc700 1 -- 172.21.15.84:0/1086430051 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7faf5000ab80 con 0x7faf5815d530 2023-09-13T08:24:50.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.268+0000 7faf4e7fc700 1 --2- 172.21.15.84:0/1086430051 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7faf3c06a580 0x7faf3c06ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:50.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.268+0000 7faf4e7fc700 1 -- 172.21.15.84:0/1086430051 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7faf50088bb0 con 0x7faf5815d530 2023-09-13T08:24:50.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.268+0000 7faf5da6f700 1 --2- 172.21.15.84:0/1086430051 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7faf3c06a580 0x7faf3c06ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:50.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.269+0000 7faf5da6f700 1 --2- 172.21.15.84:0/1086430051 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7faf3c06a580 0x7faf3c06ca40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7faf48007a30 tx=0x7faf48008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:50.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.270+0000 7faf6beb8b80 1 Processor -- start 2023-09-13T08:24:50.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.270+0000 7faf6beb8b80 1 -- start start 2023-09-13T08:24:50.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.271+0000 7faf6beb8b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556e5879fcf0 0x556e587790d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:50.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.271+0000 7faf6beb8b80 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x556e587b5ab0 0x556e587a0490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:50.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.271+0000 7faf6beb8b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556e587a09d0 0x556e587a3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:50.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.271+0000 7faf6beb8b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e586d2730 con 0x556e5879fcf0 2023-09-13T08:24:50.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.271+0000 7faf6beb8b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e586d0050 con 0x556e587a09d0 2023-09-13T08:24:50.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.271+0000 7faf6beb8b80 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x556e586cb940 con 0x556e587b5ab0 2023-09-13T08:24:50.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.271+0000 7faf5da6f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556e5879fcf0 0x556e587790d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:50.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.271+0000 7faf5da6f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556e5879fcf0 0x556e587790d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43366/0 (socket says 172.21.15.84:43366) 2023-09-13T08:24:50.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.271+0000 7faf5da6f700 1 -- 172.21.15.84:0/3968330730 learned_addr learned my addr 172.21.15.84:0/3968330730 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:24:50.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.272+0000 7faf5da6f700 1 -- 172.21.15.84:0/3968330730 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x556e587b5ab0 msgr2=0x556e587a0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:24:50.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.272+0000 7faf5da6f700 1 --2- 172.21.15.84:0/3968330730 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x556e587b5ab0 0x556e587a0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:50.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.272+0000 7faf5da6f700 1 -- 172.21.15.84:0/3968330730 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556e587a09d0 msgr2=0x556e587a3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:24:50.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.272+0000 7faf5da6f700 1 --2- 172.21.15.84:0/3968330730 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556e587a09d0 0x556e587a3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:50.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.272+0000 7faf5da6f700 1 -- 172.21.15.84:0/3968330730 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556e5854b5e0 con 0x556e5879fcf0 2023-09-13T08:24:50.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.272+0000 7faf5da6f700 1 --2- 172.21.15.84:0/3968330730 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556e5879fcf0 0x556e587790d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7faf480109a0 tx=0x7faf48013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebc604fb7bcde72e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:50.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.272+0000 7faf3b7fe700 1 -- 172.21.15.84:0/3968330730 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf48025070 con 0x556e5879fcf0 2023-09-13T08:24:50.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.272+0000 7faf3b7fe700 1 -- 172.21.15.84:0/3968330730 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf4801a070 con 0x556e5879fcf0 2023-09-13T08:24:50.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.272+0000 7faf3b7fe700 1 -- 172.21.15.84:0/3968330730 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf48004020 con 0x556e5879fcf0 2023-09-13T08:24:50.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.272+0000 7faf6beb8b80 1 -- 172.21.15.84:0/3968330730 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556e5879fcf0 msgr2=0x556e587790d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:50.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.272+0000 7faf6beb8b80 1 --2- 172.21.15.84:0/3968330730 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556e5879fcf0 0x556e587790d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7faf480109a0 tx=0x7faf48013000 comp rx=0 tx=0).stop 2023-09-13T08:24:50.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.272+0000 7faf6beb8b80 1 -- 172.21.15.84:0/3968330730 shutdown_connections 2023-09-13T08:24:50.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.272+0000 7faf6beb8b80 1 --2- 172.21.15.84:0/3968330730 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556e587a09d0 0x556e587a3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:50.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.272+0000 7faf6beb8b80 1 --2- 172.21.15.84:0/3968330730 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556e5879fcf0 0x556e587790d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:50.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.272+0000 7faf6beb8b80 1 --2- 172.21.15.84:0/3968330730 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x556e587b5ab0 0x556e587a0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:50.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.272+0000 7faf6beb8b80 1 -- 172.21.15.84:0/3968330730 >> 172.21.15.84:0/3968330730 conn(0x556e586d7c30 msgr2=0x556e587beea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:50.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.273+0000 7faf6beb8b80 1 -- 172.21.15.84:0/3968330730 shutdown_connections 2023-09-13T08:24:50.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.273+0000 7faf6beb8b80 1 -- 172.21.15.84:0/3968330730 wait complete. 2023-09-13T08:24:50.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.273+0000 7faf6beb8b80 1 -- start start 2023-09-13T08:24:50.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.273+0000 7faf6beb8b80 1 Processor -- start 2023-09-13T08:24:50.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.274+0000 7faf6beb8b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556e5879fcf0 0x556e58794a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:50.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.274+0000 7faf6beb8b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556e587a09d0 0x556e587a5040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:50.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.274+0000 7faf6beb8b80 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x556e587b5ab0 0x556e587c0320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:50.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.274+0000 7faf6beb8b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e58669b60 con 0x556e5879fcf0 2023-09-13T08:24:50.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.274+0000 7faf6beb8b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e58669860 con 0x556e587a09d0 2023-09-13T08:24:50.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.274+0000 7faf6beb8b80 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x556e5854d8d0 con 0x556e587b5ab0 2023-09-13T08:24:50.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.274+0000 7faf6beb8b80 10 client.0 _ll_register_callbacks cb 0x556e58667630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T08:24:50.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.274+0000 7faf5da6f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556e5879fcf0 0x556e58794a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:50.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.274+0000 7faf5da6f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556e5879fcf0 0x556e58794a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43372/0 (socket says 172.21.15.84:43372) 2023-09-13T08:24:50.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.274+0000 7faf5da6f700 1 -- 172.21.15.84:0/1183876475 learned_addr learned my addr 172.21.15.84:0/1183876475 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:24:50.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.274+0000 7faf5d26e700 1 --2- 172.21.15.84:0/1183876475 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556e587a09d0 0x556e587a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:50.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.274+0000 7faf5e270700 1 --2- 172.21.15.84:0/1183876475 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x556e587b5ab0 0x556e587c0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:50.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.274+0000 7faf5da6f700 1 -- 172.21.15.84:0/1183876475 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x556e587b5ab0 msgr2=0x556e587c0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:24:50.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.274+0000 7faf5da6f700 1 --2- 172.21.15.84:0/1183876475 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x556e587b5ab0 0x556e587c0320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:50.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.274+0000 7faf5da6f700 1 -- 172.21.15.84:0/1183876475 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556e587a09d0 msgr2=0x556e587a5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:24:50.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.275+0000 7faf5da6f700 1 --2- 172.21.15.84:0/1183876475 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556e587a09d0 0x556e587a5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:50.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.275+0000 7faf5da6f700 1 -- 172.21.15.84:0/1183876475 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf4800e040 con 0x556e5879fcf0 2023-09-13T08:24:50.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.275+0000 7faf5da6f700 1 --2- 172.21.15.84:0/1183876475 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556e5879fcf0 0x556e58794a70 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7faf48016480 tx=0x7faf480047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d499ee01b94d3d25 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:50.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.275+0000 7faf38ff9700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-09-13T08:24:50.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.275+0000 7faf38ff9700 1 -- 172.21.15.84:0/1183876475 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf48025070 con 0x556e5879fcf0 2023-09-13T08:24:50.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.275+0000 7faf38ff9700 1 -- 172.21.15.84:0/1183876475 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7faf48016c50 con 0x556e5879fcf0 2023-09-13T08:24:50.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.275+0000 7faf6beb8b80 1 -- 172.21.15.84:0/1183876475 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556e5876c810 con 0x556e5879fcf0 2023-09-13T08:24:50.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.275+0000 7faf38ff9700 1 -- 172.21.15.84:0/1183876475 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7faf48010660 con 0x556e5879fcf0 2023-09-13T08:24:50.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.275+0000 7faf6beb8b80 10 client.4452 fetch_fsmap learned FSMap version 7 2023-09-13T08:24:50.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.275+0000 7faf6beb8b80 1 -- 172.21.15.84:0/1183876475 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x556e586e3750 con 0x556e5879fcf0 2023-09-13T08:24:50.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.275+0000 7faf38ff9700 1 -- 172.21.15.84:0/1183876475 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556e5876c810 con 0x556e5879fcf0 2023-09-13T08:24:50.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.275+0000 7faf38ff9700 1 -- 172.21.15.84:0/1183876475 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 7) v1 ==== 3302+0+0 (secure 0 0 0) 0x7faf480036a0 con 0x556e5879fcf0 2023-09-13T08:24:50.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.275+0000 7faf6beb8b80 10 client.4452 fetch_fsmap finished waiting for FSMap version 7 2023-09-13T08:24:50.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.275+0000 7faf6beb8b80 10 client.4452 resolve_mds: resolved name 'b' to daemon mds.b 2023-09-13T08:24:50.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.275+0000 7faf6beb8b80 20 client.4452 populate_metadata read hostname 'smithi084' 2023-09-13T08:24:50.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.275+0000 7faf6beb8b80 1 --2- 172.21.15.84:0/1183876475 >> [v2:172.21.15.161:6832/2524298549,v1:172.21.15.161:6834/2524298549] conn(0x556e58778fd0 0x556e587793b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:50.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.275+0000 7faf6beb8b80 4 client.4452 mds_command: new command op to 4314 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T08:24:50.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.275+0000 7faf6beb8b80 1 -- 172.21.15.84:0/1183876475 --> [v2:172.21.15.161:6832/2524298549,v1:172.21.15.161:6834/2524298549] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556e586c4920 con 0x556e58778fd0 2023-09-13T08:24:50.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.275+0000 7faf5d26e700 1 --2- 172.21.15.84:0/1183876475 >> [v2:172.21.15.161:6832/2524298549,v1:172.21.15.161:6834/2524298549] conn(0x556e58778fd0 0x556e587793b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:50.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.276+0000 7faf38ff9700 10 client.4452 ms_handle_connect on v2:172.21.15.161:6832/2524298549 2023-09-13T08:24:50.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.276+0000 7faf5d26e700 1 --2- 172.21.15.84:0/1183876475 >> [v2:172.21.15.161:6832/2524298549,v1:172.21.15.161:6834/2524298549] conn(0x556e58778fd0 0x556e587793b0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=61f1b93681a819f7 server_cookie=4ac5a7e1420bfd55 in_seq=0 out_seq=0 2023-09-13T08:24:50.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.277+0000 7faf38ff9700 1 -- 172.21.15.84:0/1183876475 <== mds.0 v2:172.21.15.161:6832/2524298549 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x556e586c4920 con 0x556e58778fd0 2023-09-13T08:24:50.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.277+0000 7faf38ff9700 10 client.4452 handle_command_reply: tid=0 2023-09-13T08:24:50.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.277+0000 7faf6beb8b80 1 client.4452 shutdown 2023-09-13T08:24:50.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.277+0000 7faf6beb8b80 1 -- 172.21.15.84:0/1183876475 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556e5879fcf0 msgr2=0x556e58794a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:50.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.277+0000 7faf6beb8b80 1 --2- 172.21.15.84:0/1183876475 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556e5879fcf0 0x556e58794a70 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7faf48016480 tx=0x7faf480047c0 comp rx=0 tx=0).stop 2023-09-13T08:24:50.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.277+0000 7faf6beb8b80 1 -- 172.21.15.84:0/1183876475 shutdown_connections 2023-09-13T08:24:50.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.277+0000 7faf6beb8b80 1 --2- 172.21.15.84:0/1183876475 >> [v2:172.21.15.161:6832/2524298549,v1:172.21.15.161:6834/2524298549] conn(0x556e58778fd0 0x556e587793b0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:50.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.277+0000 7faf6beb8b80 1 --2- 172.21.15.84:0/1183876475 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x556e587b5ab0 0x556e587c0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:50.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.277+0000 7faf38ff9700 0 client.4452 ms_handle_reset on v2:172.21.15.161:6832/2524298549 2023-09-13T08:24:50.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.277+0000 7faf6beb8b80 1 --2- 172.21.15.84:0/1183876475 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556e5879fcf0 0x556e58794a70 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:50.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.277+0000 7faf6beb8b80 1 --2- 172.21.15.84:0/1183876475 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556e587a09d0 0x556e587a5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:50.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.277+0000 7faf6beb8b80 1 -- 172.21.15.84:0/1183876475 >> 172.21.15.84:0/1183876475 conn(0x556e586d7c30 msgr2=0x556e5876e7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:50.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.277+0000 7faf6beb8b80 1 -- 172.21.15.84:0/1183876475 shutdown_connections 2023-09-13T08:24:50.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.277+0000 7faf6beb8b80 1 -- 172.21.15.84:0/1183876475 wait complete. 2023-09-13T08:24:50.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.277+0000 7faf6beb8b80 20 client.4452 trim_cache size 0 max 16384 2023-09-13T08:24:50.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.295+0000 7faf6beb8b80 1 Processor -- start 2023-09-13T08:24:50.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.295+0000 7faf6beb8b80 1 -- start start 2023-09-13T08:24:50.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.295+0000 7faf6beb8b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556e5879fcf0 0x556e5876e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:50.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.295+0000 7faf6beb8b80 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x556e587a09d0 0x556e5876eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:50.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.295+0000 7faf6beb8b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556e587b5ab0 0x556e587d09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:50.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.295+0000 7faf6beb8b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e587bf620 con 0x556e5879fcf0 2023-09-13T08:24:50.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.295+0000 7faf6beb8b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e587a16b0 con 0x556e587b5ab0 2023-09-13T08:24:50.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.295+0000 7faf6beb8b80 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x556e587a1940 con 0x556e587a09d0 2023-09-13T08:24:50.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.295+0000 7faf5da6f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556e5879fcf0 0x556e5876e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:50.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.295+0000 7faf5da6f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556e5879fcf0 0x556e5876e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43380/0 (socket says 172.21.15.84:43380) 2023-09-13T08:24:50.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.295+0000 7faf5da6f700 1 -- 172.21.15.84:0/3059531363 learned_addr learned my addr 172.21.15.84:0/3059531363 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:24:50.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.296+0000 7faf5d26e700 1 --2- 172.21.15.84:0/3059531363 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x556e587a09d0 0x556e5876eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:50.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.296+0000 7faf5e270700 1 --2- 172.21.15.84:0/3059531363 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556e587b5ab0 0x556e587d09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:50.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.296+0000 7faf5da6f700 1 -- 172.21.15.84:0/3059531363 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x556e587a09d0 msgr2=0x556e5876eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:24:50.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.296+0000 7faf5da6f700 1 --2- 172.21.15.84:0/3059531363 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x556e587a09d0 0x556e5876eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:50.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.296+0000 7faf5da6f700 1 -- 172.21.15.84:0/3059531363 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556e587b5ab0 msgr2=0x556e587d09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:24:50.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.296+0000 7faf5da6f700 1 --2- 172.21.15.84:0/3059531363 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556e587b5ab0 0x556e587d09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:50.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.296+0000 7faf5da6f700 1 -- 172.21.15.84:0/3059531363 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556e584f7d90 con 0x556e5879fcf0 2023-09-13T08:24:50.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.296+0000 7faf5da6f700 1 --2- 172.21.15.84:0/3059531363 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556e5879fcf0 0x556e5876e660 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7faf48004840 tx=0x7faf4802b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3aafa1ded6c6c28 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:50.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.296+0000 7faf3bfff700 1 -- 172.21.15.84:0/3059531363 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf48003e90 con 0x556e5879fcf0 2023-09-13T08:24:50.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.296+0000 7faf3bfff700 1 -- 172.21.15.84:0/3059531363 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf48026040 con 0x556e5879fcf0 2023-09-13T08:24:50.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.296+0000 7faf3bfff700 1 -- 172.21.15.84:0/3059531363 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf48007770 con 0x556e5879fcf0 2023-09-13T08:24:50.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.296+0000 7faf6beb8b80 1 -- 172.21.15.84:0/3059531363 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556e5879fcf0 msgr2=0x556e5876e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:50.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.296+0000 7faf6beb8b80 1 --2- 172.21.15.84:0/3059531363 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556e5879fcf0 0x556e5876e660 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7faf48004840 tx=0x7faf4802b000 comp rx=0 tx=0).stop 2023-09-13T08:24:50.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.296+0000 7faf6beb8b80 1 -- 172.21.15.84:0/3059531363 shutdown_connections 2023-09-13T08:24:50.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.296+0000 7faf6beb8b80 1 --2- 172.21.15.84:0/3059531363 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556e587b5ab0 0x556e587d09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:50.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.296+0000 7faf6beb8b80 1 --2- 172.21.15.84:0/3059531363 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556e5879fcf0 0x556e5876e660 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:50.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.296+0000 7faf6beb8b80 1 --2- 172.21.15.84:0/3059531363 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x556e587a09d0 0x556e5876eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:50.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.296+0000 7faf6beb8b80 1 -- 172.21.15.84:0/3059531363 >> 172.21.15.84:0/3059531363 conn(0x556e586d7c30 msgr2=0x556e587c1630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:50.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.297+0000 7faf6beb8b80 1 -- 172.21.15.84:0/3059531363 shutdown_connections 2023-09-13T08:24:50.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.297+0000 7faf6beb8b80 1 -- 172.21.15.84:0/3059531363 wait complete. 2023-09-13T08:24:50.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.297+0000 7faf6beb8b80 1 -- start start 2023-09-13T08:24:50.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.297+0000 7faf6beb8b80 1 Processor -- start 2023-09-13T08:24:50.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.298+0000 7faf6beb8b80 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x556e5879fcf0 0x556e587971c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:50.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.298+0000 7faf6beb8b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556e587a09d0 0x556e588255b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:50.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.298+0000 7faf6beb8b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556e587b5ab0 0x556e587cf9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:50.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.298+0000 7faf6beb8b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e587d02c0 con 0x556e587a09d0 2023-09-13T08:24:50.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.298+0000 7faf6beb8b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e587c19a0 con 0x556e587b5ab0 2023-09-13T08:24:50.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.298+0000 7faf6beb8b80 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x556e587c1bf0 con 0x556e5879fcf0 2023-09-13T08:24:50.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.298+0000 7faf6beb8b80 10 client.0 _ll_register_callbacks cb 0x556e58667630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T08:24:50.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.298+0000 7faf5d26e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556e587a09d0 0x556e588255b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:50.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.298+0000 7faf5d26e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556e587a09d0 0x556e588255b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43388/0 (socket says 172.21.15.84:43388) 2023-09-13T08:24:50.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.298+0000 7faf5d26e700 1 -- 172.21.15.84:0/2085946076 learned_addr learned my addr 172.21.15.84:0/2085946076 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:24:50.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.298+0000 7faf5e270700 1 --2- 172.21.15.84:0/2085946076 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556e587b5ab0 0x556e587cf9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:50.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.298+0000 7faf5da6f700 1 --2- 172.21.15.84:0/2085946076 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x556e5879fcf0 0x556e587971c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:50.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.298+0000 7faf5d26e700 1 -- 172.21.15.84:0/2085946076 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x556e5879fcf0 msgr2=0x556e587971c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:24:50.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.298+0000 7faf5d26e700 1 --2- 172.21.15.84:0/2085946076 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x556e5879fcf0 0x556e587971c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:50.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.298+0000 7faf5d26e700 1 -- 172.21.15.84:0/2085946076 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556e587b5ab0 msgr2=0x556e587cf9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:24:50.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.298+0000 7faf5d26e700 1 --2- 172.21.15.84:0/2085946076 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556e587b5ab0 0x556e587cf9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:50.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.298+0000 7faf5d26e700 1 -- 172.21.15.84:0/2085946076 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556e586e3750 con 0x556e587a09d0 2023-09-13T08:24:50.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.298+0000 7faf5da6f700 1 --2- 172.21.15.84:0/2085946076 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x556e5879fcf0 0x556e587971c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T08:24:50.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.299+0000 7faf5d26e700 1 --2- 172.21.15.84:0/2085946076 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556e587a09d0 0x556e588255b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7faf5806b380 tx=0x7faf540047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=455b5dc7cd677fe8 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:50.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.299+0000 7faf38ff9700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-09-13T08:24:50.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.299+0000 7faf38ff9700 1 -- 172.21.15.84:0/2085946076 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf54020070 con 0x556e587a09d0 2023-09-13T08:24:50.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.299+0000 7faf38ff9700 1 -- 172.21.15.84:0/2085946076 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7faf54029c60 con 0x556e587a09d0 2023-09-13T08:24:50.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.299+0000 7faf6beb8b80 1 -- 172.21.15.84:0/2085946076 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556e58776910 con 0x556e587a09d0 2023-09-13T08:24:50.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.299+0000 7faf38ff9700 1 -- 172.21.15.84:0/2085946076 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7faf54029e20 con 0x556e587a09d0 2023-09-13T08:24:50.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.299+0000 7faf6beb8b80 10 client.4458 fetch_fsmap learned FSMap version 7 2023-09-13T08:24:50.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.299+0000 7faf6beb8b80 1 -- 172.21.15.84:0/2085946076 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x556e584e0c10 con 0x556e587a09d0 2023-09-13T08:24:50.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.299+0000 7faf38ff9700 1 -- 172.21.15.84:0/2085946076 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556e58776910 con 0x556e587a09d0 2023-09-13T08:24:50.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.299+0000 7faf38ff9700 1 -- 172.21.15.84:0/2085946076 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 7) v1 ==== 3302+0+0 (secure 0 0 0) 0x7faf540290f0 con 0x556e587a09d0 2023-09-13T08:24:50.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.299+0000 7faf6beb8b80 10 client.4458 fetch_fsmap finished waiting for FSMap version 7 2023-09-13T08:24:50.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.299+0000 7faf6beb8b80 10 client.4458 resolve_mds: resolved name 'b' to daemon mds.b 2023-09-13T08:24:50.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.299+0000 7faf6beb8b80 20 client.4458 populate_metadata read hostname 'smithi084' 2023-09-13T08:24:50.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.299+0000 7faf6beb8b80 1 --2- 172.21.15.84:0/2085946076 >> [v2:172.21.15.161:6832/2524298549,v1:172.21.15.161:6834/2524298549] conn(0x556e5876e610 0x556e5876e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:50.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.299+0000 7faf6beb8b80 4 client.4458 mds_command: new command op to 4314 tid=0 multi_id=0 [{"prefix": "status"}] 2023-09-13T08:24:50.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.299+0000 7faf6beb8b80 1 -- 172.21.15.84:0/2085946076 --> [v2:172.21.15.161:6832/2524298549,v1:172.21.15.161:6834/2524298549] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7faf4801a070 con 0x556e5876e610 2023-09-13T08:24:50.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.299+0000 7faf5da6f700 1 --2- 172.21.15.84:0/2085946076 >> [v2:172.21.15.161:6832/2524298549,v1:172.21.15.161:6834/2524298549] conn(0x556e5876e610 0x556e5876e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:50.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.300+0000 7faf38ff9700 10 client.4458 ms_handle_connect on v2:172.21.15.161:6832/2524298549 2023-09-13T08:24:50.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.300+0000 7faf5da6f700 1 --2- 172.21.15.84:0/2085946076 >> [v2:172.21.15.161:6832/2524298549,v1:172.21.15.161:6834/2524298549] conn(0x556e5876e610 0x556e5876e9f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c20ceb76343cc9a5 server_cookie=19ab9252b77920fa in_seq=0 out_seq=0 2023-09-13T08:24:50.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.300+0000 7faf38ff9700 1 -- 172.21.15.84:0/2085946076 <== mds.0 v2:172.21.15.161:6832/2524298549 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x7faf4801a070 con 0x556e5876e610 2023-09-13T08:24:50.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.300+0000 7faf38ff9700 10 client.4458 handle_command_reply: tid=0 2023-09-13T08:24:50.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.300+0000 7faf6beb8b80 1 client.4458 shutdown 2023-09-13T08:24:50.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.300+0000 7faf6beb8b80 1 -- 172.21.15.84:0/2085946076 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556e587a09d0 msgr2=0x556e588255b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:50.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.300+0000 7faf6beb8b80 1 --2- 172.21.15.84:0/2085946076 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556e587a09d0 0x556e588255b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7faf5806b380 tx=0x7faf540047c0 comp rx=0 tx=0).stop 2023-09-13T08:24:50.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.300+0000 7faf6beb8b80 1 -- 172.21.15.84:0/2085946076 shutdown_connections 2023-09-13T08:24:50.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.300+0000 7faf6beb8b80 1 --2- 172.21.15.84:0/2085946076 >> [v2:172.21.15.161:6832/2524298549,v1:172.21.15.161:6834/2524298549] conn(0x556e5876e610 0x556e5876e9f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:50.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.300+0000 7faf6beb8b80 1 --2- 172.21.15.84:0/2085946076 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x556e587b5ab0 0x556e587cf9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:50.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.300+0000 7faf38ff9700 0 client.4458 ms_handle_reset on v2:172.21.15.161:6832/2524298549 2023-09-13T08:24:50.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.300+0000 7faf6beb8b80 1 --2- 172.21.15.84:0/2085946076 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x556e5879fcf0 0x556e587971c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:50.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.300+0000 7faf6beb8b80 1 --2- 172.21.15.84:0/2085946076 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556e587a09d0 0x556e588255b0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:50.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.300+0000 7faf6beb8b80 1 -- 172.21.15.84:0/2085946076 >> 172.21.15.84:0/2085946076 conn(0x556e586d7c30 msgr2=0x556e587a0e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:50.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.300+0000 7faf6beb8b80 1 -- 172.21.15.84:0/2085946076 shutdown_connections 2023-09-13T08:24:50.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.300+0000 7faf6beb8b80 1 -- 172.21.15.84:0/2085946076 wait complete. 2023-09-13T08:24:50.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.300+0000 7faf6beb8b80 20 client.4458 trim_cache size 0 max 16384 2023-09-13T08:24:50.328 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-09-13T08:24:50.329 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "0107440b-b634-42c5-a643-5d31ea826116", 2023-09-13T08:24:50.329 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 0, 2023-09-13T08:24:50.329 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 4314, 2023-09-13T08:24:50.329 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2023-09-13T08:24:50.330 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2023-09-13T08:24:50.330 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2023-09-13T08:24:50.330 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 7.5567179260000001, 2023-09-13T08:24:50.330 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 7, 2023-09-13T08:24:50.330 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 24, 2023-09-13T08:24:50.331 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 23, 2023-09-13T08:24:50.331 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 15.166545279999999 2023-09-13T08:24:50.331 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-09-13T08:24:50.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.301+0000 7faf5fcd3700 1 -- 172.21.15.84:0/1086430051 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7faf3c06a580 msgr2=0x7faf3c06ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:50.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.301+0000 7faf5fcd3700 1 --2- 172.21.15.84:0/1086430051 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7faf3c06a580 0x7faf3c06ca40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7faf48007a30 tx=0x7faf48008040 comp rx=0 tx=0).stop 2023-09-13T08:24:50.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.301+0000 7faf5fcd3700 1 -- 172.21.15.84:0/1086430051 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf5815d530 msgr2=0x7faf581f6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:50.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.301+0000 7faf5fcd3700 1 --2- 172.21.15.84:0/1086430051 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf5815d530 0x7faf581f6170 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7faf5000cb40 tx=0x7faf5000ce50 comp rx=0 tx=0).stop 2023-09-13T08:24:50.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.301+0000 7faf5fcd3700 1 -- 172.21.15.84:0/1086430051 shutdown_connections 2023-09-13T08:24:50.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.301+0000 7faf5fcd3700 1 --2- 172.21.15.84:0/1086430051 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf5815d530 0x7faf581f6170 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:50.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.301+0000 7faf5fcd3700 1 --2- 172.21.15.84:0/1086430051 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faf5806a620 0x7faf581f36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:50.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.301+0000 7faf5fcd3700 1 --2- 172.21.15.84:0/1086430051 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7faf3c06a580 0x7faf3c06ca40 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:50.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.301+0000 7faf5fcd3700 1 --2- 172.21.15.84:0/1086430051 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faf580ca920 0x7faf5815f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:50.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.301+0000 7faf5fcd3700 1 -- 172.21.15.84:0/1086430051 >> 172.21.15.84:0/1086430051 conn(0x7faf580d00c0 msgr2=0x7faf58161930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:50.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.301+0000 7faf5fcd3700 1 -- 172.21.15.84:0/1086430051 shutdown_connections 2023-09-13T08:24:50.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.301+0000 7faf5fcd3700 1 -- 172.21.15.84:0/1086430051 wait complete. 2023-09-13T08:24:50.336 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-09-13T08:24:50.337 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-09-13T08:24:50.337 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-13T08:24:50.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.456+0000 7fe26b57f700 1 Processor -- start 2023-09-13T08:24:50.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.457+0000 7fe26b57f700 1 -- start start 2023-09-13T08:24:50.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.457+0000 7fe26b57f700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe26415b560 0x7fe2640ced90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:50.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.457+0000 7fe26b57f700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe2640b0630 0x7fe2640ae160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:50.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.457+0000 7fe26b57f700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe26415b940 con 0x7fe2640d1ce0 2023-09-13T08:24:50.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.457+0000 7fe26b57f700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2640d2170 con 0x7fe26415b560 2023-09-13T08:24:50.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.457+0000 7fe26b57f700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2640cc980 con 0x7fe2640b0630 2023-09-13T08:24:50.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.458+0000 7fe26931b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe26415b560 0x7fe2640ced90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:50.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.458+0000 7fe26931b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe26415b560 0x7fe2640ced90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43394/0 (socket says 172.21.15.84:43394) 2023-09-13T08:24:50.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.458+0000 7fe26931b700 1 -- 172.21.15.84:0/3675948171 learned_addr learned my addr 172.21.15.84:0/3675948171 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:24:50.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.458+0000 7fe269b1c700 1 --2- 172.21.15.84:0/3675948171 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe2640b0630 0x7fe2640ae160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:50.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.458+0000 7fe26931b700 1 -- 172.21.15.84:0/3675948171 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe2640b0630 msgr2=0x7fe2640ae160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:24:50.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.458+0000 7fe26931b700 1 --2- 172.21.15.84:0/3675948171 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe2640b0630 0x7fe2640ae160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:50.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.458+0000 7fe26931b700 1 -- 172.21.15.84:0/3675948171 >> v1:172.21.15.161:6789/0 conn(0x7fe2640d1ce0 legacy=0x7fe2640cf2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:50.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.458+0000 7fe26931b700 1 -- 172.21.15.84:0/3675948171 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2640ccc20 con 0x7fe26415b560 2023-09-13T08:24:50.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.458+0000 7fe269b1c700 1 --2- 172.21.15.84:0/3675948171 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe2640b0630 0x7fe2640ae160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T08:24:50.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.458+0000 7fe26931b700 1 --2- 172.21.15.84:0/3675948171 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe26415b560 0x7fe2640ced90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe2540098f0 tx=0x7fe254009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3defe5f42a055902 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:50.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.458+0000 7fe25bfff700 1 -- 172.21.15.84:0/3675948171 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe25400b8a0 con 0x7fe26415b560 2023-09-13T08:24:50.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.458+0000 7fe25bfff700 1 -- 172.21.15.84:0/3675948171 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe25400ba00 con 0x7fe26415b560 2023-09-13T08:24:50.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.458+0000 7fe25bfff700 1 -- 172.21.15.84:0/3675948171 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe25400bd90 con 0x7fe26415b560 2023-09-13T08:24:50.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.459+0000 7fe26b57f700 1 -- 172.21.15.84:0/3675948171 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe26415b560 msgr2=0x7fe2640ced90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:50.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.459+0000 7fe26b57f700 1 --2- 172.21.15.84:0/3675948171 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe26415b560 0x7fe2640ced90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe2540098f0 tx=0x7fe254009c00 comp rx=0 tx=0).stop 2023-09-13T08:24:50.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.459+0000 7fe26b57f700 1 -- 172.21.15.84:0/3675948171 shutdown_connections 2023-09-13T08:24:50.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.459+0000 7fe26b57f700 1 --2- 172.21.15.84:0/3675948171 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe26415b560 0x7fe2640ced90 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:50.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.459+0000 7fe26b57f700 1 --2- 172.21.15.84:0/3675948171 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe2640b0630 0x7fe2640ae160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:50.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.459+0000 7fe26b57f700 1 -- 172.21.15.84:0/3675948171 >> 172.21.15.84:0/3675948171 conn(0x7fe2640d11c0 msgr2=0x7fe2640d15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:50.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.459+0000 7fe26b57f700 1 -- 172.21.15.84:0/3675948171 shutdown_connections 2023-09-13T08:24:50.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.459+0000 7fe26b57f700 1 -- 172.21.15.84:0/3675948171 wait complete. 2023-09-13T08:24:50.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.460+0000 7fe26b57f700 1 Processor -- start 2023-09-13T08:24:50.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.460+0000 7fe26b57f700 1 -- start start 2023-09-13T08:24:50.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.461+0000 7fe26b57f700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe2640b0630 0x7fe2640b3520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:50.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.461+0000 7fe26b57f700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe26415b560 0x7fe2640b4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:50.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.461+0000 7fe26b57f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe2640c7980 0x7fe2640b12e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:50.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.461+0000 7fe26b57f700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2640c59a0 con 0x7fe2640c7980 2023-09-13T08:24:50.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.461+0000 7fe26b57f700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2640c4d90 con 0x7fe26415b560 2023-09-13T08:24:50.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.461+0000 7fe26b57f700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2640c5070 con 0x7fe2640b0630 2023-09-13T08:24:50.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.461+0000 7fe269b1c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe2640c7980 0x7fe2640b12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:50.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.461+0000 7fe269b1c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe2640c7980 0x7fe2640b12e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43404/0 (socket says 172.21.15.84:43404) 2023-09-13T08:24:50.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.461+0000 7fe269b1c700 1 -- 172.21.15.84:0/1737399224 learned_addr learned my addr 172.21.15.84:0/1737399224 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:24:50.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.461+0000 7fe26931b700 1 --2- 172.21.15.84:0/1737399224 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe2640b0630 0x7fe2640b3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:50.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.461+0000 7fe268b1a700 1 --2- 172.21.15.84:0/1737399224 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe26415b560 0x7fe2640b4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:50.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.461+0000 7fe269b1c700 1 -- 172.21.15.84:0/1737399224 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe2640b0630 msgr2=0x7fe2640b3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:50.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.461+0000 7fe269b1c700 1 --2- 172.21.15.84:0/1737399224 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe2640b0630 0x7fe2640b3520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:50.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.461+0000 7fe269b1c700 1 -- 172.21.15.84:0/1737399224 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe26415b560 msgr2=0x7fe2640b4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:50.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.461+0000 7fe269b1c700 1 --2- 172.21.15.84:0/1737399224 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe26415b560 0x7fe2640b4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:50.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.461+0000 7fe269b1c700 1 -- 172.21.15.84:0/1737399224 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe254009550 con 0x7fe2640c7980 2023-09-13T08:24:50.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.461+0000 7fe268b1a700 1 --2- 172.21.15.84:0/1737399224 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe26415b560 0x7fe2640b4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T08:24:50.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.461+0000 7fe269b1c700 1 --2- 172.21.15.84:0/1737399224 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe2640c7980 0x7fe2640b12e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe25c007de0 tx=0x7fe25c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:50.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.461+0000 7fe259ffb700 1 -- 172.21.15.84:0/1737399224 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe25c00ddd0 con 0x7fe2640c7980 2023-09-13T08:24:50.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.461+0000 7fe259ffb700 1 -- 172.21.15.84:0/1737399224 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe25c00f040 con 0x7fe2640c7980 2023-09-13T08:24:50.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.461+0000 7fe26b57f700 1 -- 172.21.15.84:0/1737399224 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2640c5350 con 0x7fe2640c7980 2023-09-13T08:24:50.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.461+0000 7fe259ffb700 1 -- 172.21.15.84:0/1737399224 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe25c003c60 con 0x7fe2640c7980 2023-09-13T08:24:50.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.462+0000 7fe26b57f700 1 -- 172.21.15.84:0/1737399224 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2640b3a60 con 0x7fe2640c7980 2023-09-13T08:24:50.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.462+0000 7fe26b57f700 1 -- 172.21.15.84:0/1737399224 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2640c5b50 con 0x7fe2640c7980 2023-09-13T08:24:50.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.463+0000 7fe259ffb700 1 -- 172.21.15.84:0/1737399224 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fe25c004030 con 0x7fe2640c7980 2023-09-13T08:24:50.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.463+0000 7fe259ffb700 1 --2- 172.21.15.84:0/1737399224 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fe24806a580 0x7fe24806ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:50.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.463+0000 7fe259ffb700 1 -- 172.21.15.84:0/1737399224 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe25c088e90 con 0x7fe2640c7980 2023-09-13T08:24:50.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.463+0000 7fe26931b700 1 --2- 172.21.15.84:0/1737399224 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fe24806a580 0x7fe24806ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:50.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.464+0000 7fe26931b700 1 --2- 172.21.15.84:0/1737399224 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fe24806a580 0x7fe24806ca40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe254014040 tx=0x7fe254008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:50.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.468+0000 7fe259ffb700 1 -- 172.21.15.84:0/1737399224 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fe2640c5b50 con 0x7fe2640c7980 2023-09-13T08:24:50.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.699+0000 7fe26b57f700 1 -- 172.21.15.84:0/1737399224 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe26404e9b0 con 0x7fe2640c7980 2023-09-13T08:24:50.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.699+0000 7fe259ffb700 1 -- 172.21.15.84:0/1737399224 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7fe25c01a070 con 0x7fe2640c7980 2023-09-13T08:24:50.700 INFO:teuthology.orchestra.run.smithi084.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-09-13T08:24:50.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.701+0000 7fe26b57f700 1 -- 172.21.15.84:0/1737399224 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fe24806a580 msgr2=0x7fe24806ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:50.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.701+0000 7fe26b57f700 1 --2- 172.21.15.84:0/1737399224 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fe24806a580 0x7fe24806ca40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe254014040 tx=0x7fe254008030 comp rx=0 tx=0).stop 2023-09-13T08:24:50.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.701+0000 7fe26b57f700 1 -- 172.21.15.84:0/1737399224 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe2640c7980 msgr2=0x7fe2640b12e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:50.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.701+0000 7fe26b57f700 1 --2- 172.21.15.84:0/1737399224 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe2640c7980 0x7fe2640b12e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe25c007de0 tx=0x7fe25c00d3b0 comp rx=0 tx=0).stop 2023-09-13T08:24:50.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.701+0000 7fe26b57f700 1 -- 172.21.15.84:0/1737399224 shutdown_connections 2023-09-13T08:24:50.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.701+0000 7fe26b57f700 1 --2- 172.21.15.84:0/1737399224 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe2640c7980 0x7fe2640b12e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:50.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.701+0000 7fe26b57f700 1 --2- 172.21.15.84:0/1737399224 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe2640b0630 0x7fe2640b3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:50.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.701+0000 7fe26b57f700 1 --2- 172.21.15.84:0/1737399224 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fe24806a580 0x7fe24806ca40 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:50.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.701+0000 7fe26b57f700 1 --2- 172.21.15.84:0/1737399224 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe26415b560 0x7fe2640b4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:50.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.701+0000 7fe26b57f700 1 -- 172.21.15.84:0/1737399224 >> 172.21.15.84:0/1737399224 conn(0x7fe2640d11c0 msgr2=0x7fe26406b730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:50.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.701+0000 7fe26b57f700 1 -- 172.21.15.84:0/1737399224 shutdown_connections 2023-09-13T08:24:50.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:50.701+0000 7fe26b57f700 1 -- 172.21.15.84:0/1737399224 wait complete. 2023-09-13T08:24:50.713 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-09-13T08:24:50.713 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-13T08:24:50.714 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi084.front.sepia.ceph.com 2023-09-13T08:24:50.714 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-09-13T08:24:50.714 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-09-13T08:24:50.714 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-09-13T08:24:50.715 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-09-13T08:24:50.715 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-13T08:24:50.716 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-09-13T08:24:50.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:24:50.716 DEBUG:teuthology.orchestra.run.smithi084:> ip addr 2023-09-13T08:24:50.734 INFO:teuthology.orchestra.run.smithi084.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-13T08:24:50.735 INFO:teuthology.orchestra.run.smithi084.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-13T08:24:50.735 INFO:teuthology.orchestra.run.smithi084.stdout: inet 127.0.0.1/8 scope host lo 2023-09-13T08:24:50.736 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-09-13T08:24:50.736 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 ::1/128 scope host 2023-09-13T08:24:50.736 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-09-13T08:24:50.736 INFO:teuthology.orchestra.run.smithi084.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-13T08:24:50.737 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:68 brd ff:ff:ff:ff:ff:ff 2023-09-13T08:24:50.737 INFO:teuthology.orchestra.run.smithi084.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-13T08:24:50.737 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:69 brd ff:ff:ff:ff:ff:ff 2023-09-13T08:24:50.737 INFO:teuthology.orchestra.run.smithi084.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-13T08:24:50.737 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:50 brd ff:ff:ff:ff:ff:ff 2023-09-13T08:24:50.738 INFO:teuthology.orchestra.run.smithi084.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-13T08:24:50.738 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:51 brd ff:ff:ff:ff:ff:ff 2023-09-13T08:24:50.738 INFO:teuthology.orchestra.run.smithi084.stdout: inet 172.21.15.84/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-09-13T08:24:50.738 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft 42388sec preferred_lft 42388sec 2023-09-13T08:24:50.738 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::9f71:f307:edb2:844f/64 scope link noprefixroute 2023-09-13T08:24:50.739 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-09-13T08:24:50.740 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-09-13T08:24:50.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:24:50.740 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-09-13T08:24:50.741 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-09-13T08:24:50.741 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link add name ceph-brx type bridge 2023-09-13T08:24:50.742 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip addr flush dev ceph-brx 2023-09-13T08:24:50.742 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set ceph-brx up 2023-09-13T08:24:50.743 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-09-13T08:24:50.743 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-09-13T08:24:50.905 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:24:50.906 DEBUG:teuthology.orchestra.run.smithi084:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-13T08:24:50.934 INFO:teuthology.orchestra.run.smithi084.stdout:1 2023-09-13T08:24:50.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:24:50.936 DEBUG:teuthology.orchestra.run.smithi084:> route 2023-09-13T08:24:51.008 INFO:teuthology.orchestra.run.smithi084.stdout:Kernel IP routing table 2023-09-13T08:24:51.009 INFO:teuthology.orchestra.run.smithi084.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-13T08:24:51.009 INFO:teuthology.orchestra.run.smithi084.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-09-13T08:24:51.009 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-09-13T08:24:51.010 INFO:teuthology.orchestra.run.smithi084.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-13T08:24:51.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:24:51.011 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-09-13T08:24:51.011 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-09-13T08:24:51.011 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-09-13T08:24:51.012 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-09-13T08:24:51.012 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-09-13T08:24:51.013 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-09-13T08:24:51.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:24:51.273 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2023-09-13T08:24:51.290 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:24:51.290 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list-id 2023-09-13T08:24:51.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:24:51.347 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-09-13T08:24:51.347 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-09-13T08:24:51.348 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-09-13T08:24:51.348 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-09-13T08:24:51.348 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-09-13T08:24:51.440 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-09-13T08:24:51.441 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:24:51.441 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-09-13T08:24:51.442 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-09-13T08:24:51.442 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-09-13T08:24:51.442 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-09-13T08:24:51.443 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-09-13T08:24:51.443 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-09-13T08:24:51.443 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-09-13T08:24:51.444 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-09-13T08:24:51.646 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:24:51.647 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-09-13T08:24:51.647 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-09-13T08:24:51.647 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set brx.0 up 2023-09-13T08:24:51.648 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set dev brx.0 master ceph-brx 2023-09-13T08:24:51.648 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-09-13T08:24:51.747 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-09-13T08:24:51.748 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-13T08:24:51.748 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-09-13T08:24:51.768 INFO:teuthology.orchestra.run.smithi084.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-09-13T08:24:51.769 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-13T08:24:51.769 DEBUG:teuthology.orchestra.run.smithi084:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-09-13T08:24:51.825 DEBUG:teuthology.orchestra.run.smithi084:> sudo modprobe fuse 2023-09-13T08:24:51.893 DEBUG:teuthology.orchestra.run.smithi084:> cat /proc/self/mounts | awk '{print $2}' 2023-09-13T08:24:51.950 INFO:teuthology.orchestra.run.smithi084.stdout:/sys 2023-09-13T08:24:51.950 INFO:teuthology.orchestra.run.smithi084.stdout:/proc 2023-09-13T08:24:51.950 INFO:teuthology.orchestra.run.smithi084.stdout:/dev 2023-09-13T08:24:51.951 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/security 2023-09-13T08:24:51.951 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/shm 2023-09-13T08:24:51.951 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/pts 2023-09-13T08:24:51.951 INFO:teuthology.orchestra.run.smithi084.stdout:/run 2023-09-13T08:24:51.951 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/cgroup 2023-09-13T08:24:51.952 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/cgroup/systemd 2023-09-13T08:24:51.952 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/pstore 2023-09-13T08:24:51.952 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/bpf 2023-09-13T08:24:51.952 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-09-13T08:24:51.952 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/cgroup/blkio 2023-09-13T08:24:51.953 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/cgroup/memory 2023-09-13T08:24:51.953 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/cgroup/perf_event 2023-09-13T08:24:51.953 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/cgroup/hugetlb 2023-09-13T08:24:51.953 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/cgroup/freezer 2023-09-13T08:24:51.953 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/cgroup/rdma 2023-09-13T08:24:51.954 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/cgroup/pids 2023-09-13T08:24:51.954 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-09-13T08:24:51.954 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/cgroup/devices 2023-09-13T08:24:51.954 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/cgroup/cpuset 2023-09-13T08:24:51.954 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/tracing 2023-09-13T08:24:51.955 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/config 2023-09-13T08:24:51.955 INFO:teuthology.orchestra.run.smithi084.stdout:/ 2023-09-13T08:24:51.955 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/selinux 2023-09-13T08:24:51.955 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/debug 2023-09-13T08:24:51.955 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/mqueue 2023-09-13T08:24:51.956 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/hugepages 2023-09-13T08:24:51.956 INFO:teuthology.orchestra.run.smithi084.stdout:/proc/sys/fs/binfmt_misc 2023-09-13T08:24:51.956 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/fuse/connections 2023-09-13T08:24:51.956 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/nfs/rpc_pipefs 2023-09-13T08:24:51.957 INFO:teuthology.orchestra.run.smithi084.stdout:/run/user/1000 2023-09-13T08:24:51.957 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph 2023-09-13T08:24:51.957 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph/osd/ceph-0 2023-09-13T08:24:51.957 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph/osd/ceph-1 2023-09-13T08:24:51.957 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph/osd/ceph-2 2023-09-13T08:24:51.958 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph/osd/ceph-3 2023-09-13T08:24:51.958 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns 2023-09-13T08:24:51.958 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-09-13T08:24:51.958 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-09-13T08:24:51.959 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:24:51.959 DEBUG:teuthology.orchestra.run.smithi084:> ls /sys/fs/fuse/connections 2023-09-13T08:24:52.007 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-09-13T08:24:52.007 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-09-13T08:24:52.049 DEBUG:teuthology.orchestra.run.smithi084:> sudo modprobe fuse 2023-09-13T08:24:52.074 DEBUG:teuthology.orchestra.run.smithi084:> cat /proc/self/mounts | awk '{print $2}' 2023-09-13T08:24:52.132 INFO:teuthology.orchestra.run.smithi084.stdout:/sys 2023-09-13T08:24:52.132 INFO:teuthology.orchestra.run.smithi084.stdout:/proc 2023-09-13T08:24:52.132 INFO:teuthology.orchestra.run.smithi084.stdout:/dev 2023-09-13T08:24:52.132 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/security 2023-09-13T08:24:52.133 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/shm 2023-09-13T08:24:52.133 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/pts 2023-09-13T08:24:52.133 INFO:teuthology.orchestra.run.smithi084.stdout:/run 2023-09-13T08:24:52.133 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/cgroup 2023-09-13T08:24:52.133 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/cgroup/systemd 2023-09-13T08:24:52.134 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/pstore 2023-09-13T08:24:52.134 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/bpf 2023-09-13T08:24:52.134 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-09-13T08:24:52.134 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/cgroup/blkio 2023-09-13T08:24:52.135 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/cgroup/memory 2023-09-13T08:24:52.135 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/cgroup/perf_event 2023-09-13T08:24:52.135 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/cgroup/hugetlb 2023-09-13T08:24:52.135 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/cgroup/freezer 2023-09-13T08:24:52.135 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/cgroup/rdma 2023-09-13T08:24:52.136 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/cgroup/pids 2023-09-13T08:24:52.136 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-09-13T08:24:52.136 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/cgroup/devices 2023-09-13T08:24:52.136 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/cgroup/cpuset 2023-09-13T08:24:52.137 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/tracing 2023-09-13T08:24:52.137 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/config 2023-09-13T08:24:52.137 INFO:teuthology.orchestra.run.smithi084.stdout:/ 2023-09-13T08:24:52.137 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/selinux 2023-09-13T08:24:52.137 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/debug 2023-09-13T08:24:52.138 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/mqueue 2023-09-13T08:24:52.138 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/hugepages 2023-09-13T08:24:52.138 INFO:teuthology.orchestra.run.smithi084.stdout:/proc/sys/fs/binfmt_misc 2023-09-13T08:24:52.138 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/fuse/connections 2023-09-13T08:24:52.138 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/nfs/rpc_pipefs 2023-09-13T08:24:52.139 INFO:teuthology.orchestra.run.smithi084.stdout:/run/user/1000 2023-09-13T08:24:52.139 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph 2023-09-13T08:24:52.139 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph/osd/ceph-0 2023-09-13T08:24:52.139 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph/osd/ceph-1 2023-09-13T08:24:52.139 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph/osd/ceph-2 2023-09-13T08:24:52.140 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph/osd/ceph-3 2023-09-13T08:24:52.140 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns 2023-09-13T08:24:52.140 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-09-13T08:24:52.140 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-09-13T08:24:52.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:24:52.141 DEBUG:teuthology.orchestra.run.smithi084:> ls /sys/fs/fuse/connections 2023-09-13T08:24:52.159 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi084.stderr:2023-09-13T08:24:52.159+0000 7f6e804cc5c0 -1 init, newargv = 0x55a87040ae90 newargc=15 2023-09-13T08:24:52.160 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi084.stderr:ceph-fuse[110858]: starting ceph client 2023-09-13T08:24:52.166 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi084.stderr:ceph-fuse[110858]: starting fuse 2023-09-13T08:24:52.176 INFO:teuthology.orchestra.run.smithi084.stdout:46 2023-09-13T08:24:52.177 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-09-13T08:24:52.177 DEBUG:teuthology.orchestra.run.smithi084:> sudo stdin-killer -- python3 -c ' 2023-09-13T08:24:52.178 DEBUG:teuthology.orchestra.run.smithi084:> import glob 2023-09-13T08:24:52.178 DEBUG:teuthology.orchestra.run.smithi084:> import re 2023-09-13T08:24:52.179 DEBUG:teuthology.orchestra.run.smithi084:> import os 2023-09-13T08:24:52.179 DEBUG:teuthology.orchestra.run.smithi084:> import subprocess 2023-09-13T08:24:52.179 DEBUG:teuthology.orchestra.run.smithi084:> 2023-09-13T08:24:52.180 DEBUG:teuthology.orchestra.run.smithi084:> def _find_admin_socket(client_name): 2023-09-13T08:24:52.180 DEBUG:teuthology.orchestra.run.smithi084:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-09-13T08:24:52.180 DEBUG:teuthology.orchestra.run.smithi084:> files = glob.glob(asok_path) 2023-09-13T08:24:52.181 DEBUG:teuthology.orchestra.run.smithi084:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-09-13T08:24:52.181 DEBUG:teuthology.orchestra.run.smithi084:> 2023-09-13T08:24:52.181 DEBUG:teuthology.orchestra.run.smithi084:> # Given a non-glob path, it better be there 2023-09-13T08:24:52.182 DEBUG:teuthology.orchestra.run.smithi084:> if "*" not in asok_path: 2023-09-13T08:24:52.182 DEBUG:teuthology.orchestra.run.smithi084:> assert(len(files) == 1) 2023-09-13T08:24:52.182 DEBUG:teuthology.orchestra.run.smithi084:> return files[0] 2023-09-13T08:24:52.183 DEBUG:teuthology.orchestra.run.smithi084:> 2023-09-13T08:24:52.183 DEBUG:teuthology.orchestra.run.smithi084:> for f in files: 2023-09-13T08:24:52.183 DEBUG:teuthology.orchestra.run.smithi084:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-09-13T08:24:52.184 DEBUG:teuthology.orchestra.run.smithi084:> if os.path.exists("/proc/{0}".format(pid)): 2023-09-13T08:24:52.184 DEBUG:teuthology.orchestra.run.smithi084:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-09-13T08:24:52.185 DEBUG:teuthology.orchestra.run.smithi084:> contents = proc_f.read() 2023-09-13T08:24:52.185 DEBUG:teuthology.orchestra.run.smithi084:> if mountpoint in contents: 2023-09-13T08:24:52.185 DEBUG:teuthology.orchestra.run.smithi084:> return f 2023-09-13T08:24:52.186 DEBUG:teuthology.orchestra.run.smithi084:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-09-13T08:24:52.186 DEBUG:teuthology.orchestra.run.smithi084:> 2023-09-13T08:24:52.186 DEBUG:teuthology.orchestra.run.smithi084:> print(_find_admin_socket("client.admin")) 2023-09-13T08:24:52.187 DEBUG:teuthology.orchestra.run.smithi084:> ' 2023-09-13T08:24:52.298 INFO:teuthology.orchestra.run.smithi084.stdout:/var/run/ceph/ceph-client.admin.110858.asok 2023-09-13T08:24:52.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-09-13T08:24:52.308 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.110858.asok 2023-09-13T08:24:52.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:24:52.309 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.110858.asok status 2023-09-13T08:24:52.464 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-09-13T08:24:52.464 INFO:teuthology.orchestra.run.smithi084.stdout: "metadata": { 2023-09-13T08:24:52.465 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_sha1": "4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5", 2023-09-13T08:24:52.465 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_version": "ceph version 18.0.0-6083-g4a754ac9 (4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5) reef (dev)", 2023-09-13T08:24:52.465 INFO:teuthology.orchestra.run.smithi084.stdout: "entity_id": "admin", 2023-09-13T08:24:52.466 INFO:teuthology.orchestra.run.smithi084.stdout: "hostname": "smithi084", 2023-09-13T08:24:52.466 INFO:teuthology.orchestra.run.smithi084.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-09-13T08:24:52.467 INFO:teuthology.orchestra.run.smithi084.stdout: "pid": "110858", 2023-09-13T08:24:52.467 INFO:teuthology.orchestra.run.smithi084.stdout: "root": "/" 2023-09-13T08:24:52.467 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-09-13T08:24:52.468 INFO:teuthology.orchestra.run.smithi084.stdout: "dentry_count": 0, 2023-09-13T08:24:52.468 INFO:teuthology.orchestra.run.smithi084.stdout: "dentry_pinned_count": 0, 2023-09-13T08:24:52.469 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 4470, 2023-09-13T08:24:52.469 INFO:teuthology.orchestra.run.smithi084.stdout: "inst": { 2023-09-13T08:24:52.470 INFO:teuthology.orchestra.run.smithi084.stdout: "name": { 2023-09-13T08:24:52.470 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "client", 2023-09-13T08:24:52.470 INFO:teuthology.orchestra.run.smithi084.stdout: "num": 4470 2023-09-13T08:24:52.471 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-09-13T08:24:52.471 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": { 2023-09-13T08:24:52.471 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "v1", 2023-09-13T08:24:52.472 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": "192.168.0.1:0", 2023-09-13T08:24:52.472 INFO:teuthology.orchestra.run.smithi084.stdout: "nonce": 2804485844 2023-09-13T08:24:52.473 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-09-13T08:24:52.473 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-09-13T08:24:52.473 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": { 2023-09-13T08:24:52.474 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "v1", 2023-09-13T08:24:52.474 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": "192.168.0.1:0", 2023-09-13T08:24:52.475 INFO:teuthology.orchestra.run.smithi084.stdout: "nonce": 2804485844 2023-09-13T08:24:52.475 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-09-13T08:24:52.475 INFO:teuthology.orchestra.run.smithi084.stdout: "inst_str": "client.4470 192.168.0.1:0/2804485844", 2023-09-13T08:24:52.476 INFO:teuthology.orchestra.run.smithi084.stdout: "addr_str": "192.168.0.1:0/2804485844", 2023-09-13T08:24:52.476 INFO:teuthology.orchestra.run.smithi084.stdout: "inode_count": 1, 2023-09-13T08:24:52.476 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_epoch": 7, 2023-09-13T08:24:52.477 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_epoch": 24, 2023-09-13T08:24:52.477 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_epoch_barrier": 0, 2023-09-13T08:24:52.477 INFO:teuthology.orchestra.run.smithi084.stdout: "blocklisted": false, 2023-09-13T08:24:52.478 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs" 2023-09-13T08:24:52.478 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-09-13T08:24:52.481 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:24:52.481 DEBUG:teuthology.orchestra.run.smithi084:> stat --file-system '--printf=%T 2023-09-13T08:24:52.482 DEBUG:teuthology.orchestra.run.smithi084:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-09-13T08:24:52.500 INFO:teuthology.orchestra.run.smithi084.stdout:fuseblk 2023-09-13T08:24:52.501 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-09-13T08:24:52.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:24:52.502 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-09-13T08:24:52.568 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:24:52.569 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-09-13T08:24:52.676 INFO:teuthology.orchestra.run.smithi084.stdout:# file: . 2023-09-13T08:24:52.677 INFO:teuthology.orchestra.run.smithi084.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-09-13T08:24:52.677 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:24:52.677 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-09-13T08:24:52.678 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T08:24:52.695 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T08:24:52.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:52.857+0000 7f1a4e9c2700 1 Processor -- start 2023-09-13T08:24:52.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:52.857+0000 7f1a4e9c2700 1 -- start start 2023-09-13T08:24:52.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:52.857+0000 7f1a4e9c2700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1a4815d530 0x7f1a48161bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:52.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:52.857+0000 7f1a4e9c2700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f1a480ca920 0x7f1a4806d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:52.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:52.858+0000 7f1a4e9c2700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a481620f0 con 0x7f1a4806a620 2023-09-13T08:24:52.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:52.858+0000 7f1a4e9c2700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a480cff20 con 0x7f1a4815d530 2023-09-13T08:24:52.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:52.858+0000 7f1a4e9c2700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a480cae50 con 0x7f1a480ca920 2023-09-13T08:24:52.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:52.858+0000 7f1a47fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1a4815d530 0x7f1a48161bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:52.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:52.858+0000 7f1a4cf5f700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f1a4806a620 0x7f1a480ce490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:46080/0 (socket says 172.21.15.84:46080) 2023-09-13T08:24:52.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:52.858+0000 7f1a4cf5f700 1 -- 172.21.15.84:0/8734621 learned_addr learned my addr 172.21.15.84:0/8734621 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:24:52.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:52.858+0000 7f1a3ffff700 1 --2- 172.21.15.84:0/8734621 >> v2:172.21.15.161:3300/0 conn(0x7f1a480ca920 0x7f1a4806d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:52.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:52.858+0000 7f1a47fff700 1 -- 172.21.15.84:0/8734621 >> v2:172.21.15.161:3300/0 conn(0x7f1a480ca920 msgr2=0x7f1a4806d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:24:52.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:52.858+0000 7f1a47fff700 1 --2- 172.21.15.84:0/8734621 >> v2:172.21.15.161:3300/0 conn(0x7f1a480ca920 0x7f1a4806d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:52.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:52.858+0000 7f1a47fff700 1 -- 172.21.15.84:0/8734621 >> v1:172.21.15.84:6789/0 conn(0x7f1a4806a620 legacy=0x7f1a480ce490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:52.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:52.858+0000 7f1a47fff700 1 -- 172.21.15.84:0/8734621 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a480cb130 con 0x7f1a4815d530 2023-09-13T08:24:52.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:52.858+0000 7f1a477fe700 1 -- 172.21.15.84:0/8734621 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3556780569 0 0) 0x7f1a481620f0 con 0x7f1a4806a620 2023-09-13T08:24:52.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:52.858+0000 7f1a3ffff700 1 --2- 172.21.15.84:0/8734621 >> v2:172.21.15.161:3300/0 conn(0x7f1a480ca920 0x7f1a4806d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T08:24:52.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:52.858+0000 7f1a47fff700 1 --2- 172.21.15.84:0/8734621 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a4815d530 0x7f1a48161bb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1a480c7120 tx=0x7f1a38009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbb3a272ce10ee08 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:52.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:52.858+0000 7f1a477fe700 1 -- 172.21.15.84:0/8734621 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a38011830 con 0x7f1a4815d530 2023-09-13T08:24:52.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:52.858+0000 7f1a477fe700 1 -- 172.21.15.84:0/8734621 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a38011990 con 0x7f1a4815d530 2023-09-13T08:24:52.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:52.858+0000 7f1a477fe700 1 -- 172.21.15.84:0/8734621 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a38011d20 con 0x7f1a4815d530 2023-09-13T08:24:52.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:52.859+0000 7f1a4e9c2700 1 -- 172.21.15.84:0/8734621 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a4815d530 msgr2=0x7f1a48161bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:52.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:52.859+0000 7f1a4e9c2700 1 --2- 172.21.15.84:0/8734621 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a4815d530 0x7f1a48161bb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1a480c7120 tx=0x7f1a38009b20 comp rx=0 tx=0).stop 2023-09-13T08:24:52.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:52.859+0000 7f1a4e9c2700 1 -- 172.21.15.84:0/8734621 shutdown_connections 2023-09-13T08:24:52.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:52.859+0000 7f1a4e9c2700 1 --2- 172.21.15.84:0/8734621 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a4815d530 0x7f1a48161bb0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:52.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:52.859+0000 7f1a4e9c2700 1 --2- 172.21.15.84:0/8734621 >> v2:172.21.15.161:3300/0 conn(0x7f1a480ca920 0x7f1a4806d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:52.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:52.859+0000 7f1a4e9c2700 1 -- 172.21.15.84:0/8734621 >> 172.21.15.84:0/8734621 conn(0x7f1a480d00c0 msgr2=0x7f1a480d04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:52.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:52.859+0000 7f1a4e9c2700 1 -- 172.21.15.84:0/8734621 shutdown_connections 2023-09-13T08:24:52.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:52.859+0000 7f1a4e9c2700 1 -- 172.21.15.84:0/8734621 wait complete. 2023-09-13T08:24:52.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:52.861+0000 7f1a4e9c2700 1 Processor -- start 2023-09-13T08:24:52.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:52.861+0000 7f1a4e9c2700 1 -- start start 2023-09-13T08:24:52.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:52.861+0000 7f1a4e9c2700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1a4806a620 0x7f1a480c9c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:52.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:52.861+0000 7f1a4e9c2700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1a480ca920 0x7f1a480c7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:52.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:52.862+0000 7f1a4e9c2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a4815d530 0x7f1a480b4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:52.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:52.862+0000 7f1a4e9c2700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a480ca1a0 con 0x7f1a4815d530 2023-09-13T08:24:52.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:52.862+0000 7f1a4e9c2700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a4814dde0 con 0x7f1a480ca920 2023-09-13T08:24:52.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:52.862+0000 7f1a4e9c2700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a48155c10 con 0x7f1a4806a620 2023-09-13T08:24:52.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:52.862+0000 7f1a4cf5f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a4815d530 0x7f1a480b4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:52.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:52.862+0000 7f1a4cf5f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a4815d530 0x7f1a480b4b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43440/0 (socket says 172.21.15.84:43440) 2023-09-13T08:24:52.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:52.862+0000 7f1a4cf5f700 1 -- 172.21.15.84:0/3395868669 learned_addr learned my addr 172.21.15.84:0/3395868669 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:24:52.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:52.862+0000 7f1a3ffff700 1 --2- 172.21.15.84:0/3395868669 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1a480ca920 0x7f1a480c7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:52.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:52.862+0000 7f1a47fff700 1 --2- 172.21.15.84:0/3395868669 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1a4806a620 0x7f1a480c9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:52.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:52.862+0000 7f1a4cf5f700 1 -- 172.21.15.84:0/3395868669 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1a4806a620 msgr2=0x7f1a480c9c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:52.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:52.862+0000 7f1a4cf5f700 1 --2- 172.21.15.84:0/3395868669 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1a4806a620 0x7f1a480c9c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:52.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:52.862+0000 7f1a4cf5f700 1 -- 172.21.15.84:0/3395868669 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1a480ca920 msgr2=0x7f1a480c7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:52.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:52.862+0000 7f1a4cf5f700 1 --2- 172.21.15.84:0/3395868669 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1a480ca920 0x7f1a480c7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:52.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:52.862+0000 7f1a4cf5f700 1 -- 172.21.15.84:0/3395868669 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a380094a0 con 0x7f1a4815d530 2023-09-13T08:24:52.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:52.862+0000 7f1a4cf5f700 1 --2- 172.21.15.84:0/3395868669 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a4815d530 0x7f1a480b4b40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1a4000caf0 tx=0x7f1a4000ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:52.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:52.862+0000 7f1a457fa700 1 -- 172.21.15.84:0/3395868669 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a4000a9e0 con 0x7f1a4815d530 2023-09-13T08:24:52.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:52.862+0000 7f1a457fa700 1 -- 172.21.15.84:0/3395868669 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a4000ab60 con 0x7f1a4815d530 2023-09-13T08:24:52.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:52.862+0000 7f1a4e9c2700 1 -- 172.21.15.84:0/3395868669 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a48155ef0 con 0x7f1a4815d530 2023-09-13T08:24:52.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:52.862+0000 7f1a457fa700 1 -- 172.21.15.84:0/3395868669 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a400070d0 con 0x7f1a4815d530 2023-09-13T08:24:52.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:52.862+0000 7f1a4e9c2700 1 -- 172.21.15.84:0/3395868669 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a481564b0 con 0x7f1a4815d530 2023-09-13T08:24:52.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:52.863+0000 7f1a4e9c2700 1 -- 172.21.15.84:0/3395868669 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a4804e9b0 con 0x7f1a4815d530 2023-09-13T08:24:52.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:52.864+0000 7f1a457fa700 1 -- 172.21.15.84:0/3395868669 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f1a40007230 con 0x7f1a4815d530 2023-09-13T08:24:52.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:52.864+0000 7f1a457fa700 1 --2- 172.21.15.84:0/3395868669 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f1a2806a580 0x7f1a2806ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:52.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:52.864+0000 7f1a47fff700 1 --2- 172.21.15.84:0/3395868669 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f1a2806a580 0x7f1a2806ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:52.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:52.864+0000 7f1a457fa700 1 -- 172.21.15.84:0/3395868669 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1a400888a0 con 0x7f1a4815d530 2023-09-13T08:24:52.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:52.865+0000 7f1a47fff700 1 --2- 172.21.15.84:0/3395868669 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f1a2806a580 0x7f1a2806ca40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1a380090b0 tx=0x7f1a38008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:52.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:52.869+0000 7f1a457fa700 1 -- 172.21.15.84:0/3395868669 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f1a40053bc0 con 0x7f1a4815d530 2023-09-13T08:24:53.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.061+0000 7f1a4e9c2700 1 -- 172.21.15.84:0/3395868669 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1a480b6040 con 0x7f1a4815d530 2023-09-13T08:24:53.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.062+0000 7f1a457fa700 1 -- 172.21.15.84:0/3395868669 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18322 (secure 0 0 0) 0x7f1a40018090 con 0x7f1a4815d530 2023-09-13T08:24:53.062 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:24:53.062 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":24,"fsid":"0107440b-b634-42c5-a643-5d31ea826116","created":"2023-09-13T08:24:16.931917+0000","modified":"2023-09-13T08:24:47.176259+0000","last_up_change":"2023-09-13T08:24:28.422631+0000","last_in_change":"2023-09-13T08:24:19.425578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T08:24:28.583720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-13T08:24:39.862832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-13T08:24:41.145511+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-13T08:24:44.775160+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4a53ec12-1469-4356-b4e1-2b8fc9b7c0f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6817","nonce":1599532366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6819","nonce":1599532366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6823","nonce":1599532366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6821","nonce":1599532366}]},"public_addr":"172.21.15.84:6817/1599532366","cluster_addr":"172.21.15.84:6819/1599532366","heartbeat_back_addr":"172.21.15.84:6823/1599532366","heartbeat_front_addr":"172.21.15.84:6821/1599532366","state":["exists","up"]},{"osd":1,"uuid":"11e964a0-b80c-4afc-bfbf-e2067969db29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6825","nonce":461860977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6827","nonce":461860977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6831","nonce":461860977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6829","nonce":461860977}]},"public_addr":"172.21.15.84:6825/461860977","cluster_addr":"172.21.15.84:6827/461860977","heartbeat_back_addr":"172.21.15.84:6831/461860977","heartbeat_front_addr":"172.21.15.84:6829/461860977","state":["exists","up"]},{"osd":2,"uuid":"3ce74529-4dd1-44c7-9576-968f5fdc0c25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6809","nonce":1168316165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6811","nonce":1168316165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6815","nonce":1168316165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6813","nonce":1168316165}]},"public_addr":"172.21.15.84:6809/1168316165","cluster_addr":"172.21.15.84:6811/1168316165","heartbeat_back_addr":"172.21.15.84:6815/1168316165","heartbeat_front_addr":"172.21.15.84:6813/1168316165","state":["exists","up"]},{"osd":3,"uuid":"460cb5c5-590a-4d06-a4d9-5bac2fdf33b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6801","nonce":1661609810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6803","nonce":1661609810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6807","nonce":1661609810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6805","nonce":1661609810}]},"public_addr":"172.21.15.84:6801/1661609810","cluster_addr":"172.21.15.84:6803/1661609810","heartbeat_back_addr":"172.21.15.84:6807/1661609810","heartbeat_front_addr":"172.21.15.84:6805/1661609810","state":["exists","up"]},{"osd":4,"uuid":"bf237dd0-3ebd-44b5-8078-24a63e00d792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6801","nonce":1303562374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6803","nonce":1303562374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6807","nonce":1303562374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6805","nonce":1303562374}]},"public_addr":"172.21.15.161:6801/1303562374","cluster_addr":"172.21.15.161:6803/1303562374","heartbeat_back_addr":"172.21.15.161:6807/1303562374","heartbeat_front_addr":"172.21.15.161:6805/1303562374","state":["exists","up"]},{"osd":5,"uuid":"e1e538e0-5844-456b-8c6e-434d3a914af1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6818","nonce":961120854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6822","nonce":961120854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6830","nonce":961120854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6826","nonce":961120854}]},"public_addr":"172.21.15.161:6818/961120854","cluster_addr":"172.21.15.161:6822/961120854","heartbeat_back_addr":"172.21.15.161:6830/961120854","heartbeat_front_addr":"172.21.15.161:6826/961120854","state":["exists","up"]},{"osd":6,"uuid":"5cb1785e-960f-4dd4-b295-9e21b2c3f875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6809","nonce":980533466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6811","nonce":980533466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6815","nonce":980533466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6813","nonce":980533466}]},"public_addr":"172.21.15.161:6809/980533466","cluster_addr":"172.21.15.161:6811/980533466","heartbeat_back_addr":"172.21.15.161:6815/980533466","heartbeat_front_addr":"172.21.15.161:6813/980533466","state":["exists","up"]},{"osd":7,"uuid":"5acb6619-e933-4b46-b1c2-60af30acb839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6817","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6819","nonce":2479691549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6821","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6823","nonce":2479691549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6829","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6831","nonce":2479691549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6825","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6827","nonce":2479691549}]},"public_addr":"172.21.15.161:6819/2479691549","cluster_addr":"172.21.15.161:6823/2479691549","heartbeat_back_addr":"172.21.15.161:6831/2479691549","heartbeat_front_addr":"172.21.15.161:6827/2479691549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.678857+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.685341+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.613603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.634940+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.564387+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.697347+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.637437+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.619397+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T08:24:53.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.064+0000 7f1a4e9c2700 1 -- 172.21.15.84:0/3395868669 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f1a2806a580 msgr2=0x7f1a2806ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:53.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.064+0000 7f1a4e9c2700 1 --2- 172.21.15.84:0/3395868669 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f1a2806a580 0x7f1a2806ca40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1a380090b0 tx=0x7f1a38008030 comp rx=0 tx=0).stop 2023-09-13T08:24:53.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.064+0000 7f1a4e9c2700 1 -- 172.21.15.84:0/3395868669 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a4815d530 msgr2=0x7f1a480b4b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:53.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.064+0000 7f1a4e9c2700 1 --2- 172.21.15.84:0/3395868669 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a4815d530 0x7f1a480b4b40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1a4000caf0 tx=0x7f1a4000ce00 comp rx=0 tx=0).stop 2023-09-13T08:24:53.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.064+0000 7f1a4e9c2700 1 -- 172.21.15.84:0/3395868669 shutdown_connections 2023-09-13T08:24:53.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.064+0000 7f1a4e9c2700 1 --2- 172.21.15.84:0/3395868669 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a4815d530 0x7f1a480b4b40 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:53.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.064+0000 7f1a4e9c2700 1 --2- 172.21.15.84:0/3395868669 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1a4806a620 0x7f1a480c9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:53.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.064+0000 7f1a4e9c2700 1 --2- 172.21.15.84:0/3395868669 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f1a2806a580 0x7f1a2806ca40 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:53.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.064+0000 7f1a4e9c2700 1 --2- 172.21.15.84:0/3395868669 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1a480ca920 0x7f1a480c7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:53.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.064+0000 7f1a4e9c2700 1 -- 172.21.15.84:0/3395868669 >> 172.21.15.84:0/3395868669 conn(0x7f1a480d00c0 msgr2=0x7f1a4815c620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:53.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.064+0000 7f1a4e9c2700 1 -- 172.21.15.84:0/3395868669 shutdown_connections 2023-09-13T08:24:53.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.064+0000 7f1a4e9c2700 1 -- 172.21.15.84:0/3395868669 wait complete. 2023-09-13T08:24:53.076 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T08:24:28.583720+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-13T08:24:39.862832+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-13T08:24:41.145511+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-09-13T08:24:44.775160+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-13T08:24:53.077 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T08:24:53.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.200+0000 7f0ebe746700 1 Processor -- start 2023-09-13T08:24:53.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.200+0000 7f0ebe746700 1 -- start start 2023-09-13T08:24:53.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.201+0000 7f0ebe746700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f0eb815e910 0x7f0eb80cf570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:53.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.201+0000 7f0ebe746700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0eb80cd590 0x7f0eb80cdbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:53.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.201+0000 7f0ebe746700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0eb815e480 con 0x7f0eb80ca8e0 2023-09-13T08:24:53.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.201+0000 7f0ebe746700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0eb80cfbe0 con 0x7f0eb80cd590 2023-09-13T08:24:53.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.201+0000 7f0ebe746700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0eb815de30 con 0x7f0eb815e910 2023-09-13T08:24:53.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.201+0000 7f0ebcce3700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0eb80cd590 0x7f0eb80cdbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:53.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.201+0000 7f0ebcce3700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0eb80cd590 0x7f0eb80cdbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43448/0 (socket says 172.21.15.84:43448) 2023-09-13T08:24:53.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.201+0000 7f0ebcce3700 1 -- 172.21.15.84:0/1291207992 learned_addr learned my addr 172.21.15.84:0/1291207992 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:24:53.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.201+0000 7f0eb77fe700 1 --2- 172.21.15.84:0/1291207992 >> v2:172.21.15.161:3300/0 conn(0x7f0eb815e910 0x7f0eb80cf570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:53.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.201+0000 7f0ebcce3700 1 -- 172.21.15.84:0/1291207992 >> v2:172.21.15.161:3300/0 conn(0x7f0eb815e910 msgr2=0x7f0eb80cf570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:24:53.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.201+0000 7f0ebcce3700 1 --2- 172.21.15.84:0/1291207992 >> v2:172.21.15.161:3300/0 conn(0x7f0eb815e910 0x7f0eb80cf570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:53.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.201+0000 7f0ebcce3700 1 -- 172.21.15.84:0/1291207992 >> v1:172.21.15.161:6789/0 conn(0x7f0eb80ca8e0 legacy=0x7f0eb80cacc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:24:53.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.201+0000 7f0ebcce3700 1 -- 172.21.15.84:0/1291207992 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eb815e110 con 0x7f0eb80cd590 2023-09-13T08:24:53.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.201+0000 7f0ebcce3700 1 --2- 172.21.15.84:0/1291207992 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0eb80cd590 0x7f0eb80cdbc0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0eb80678a0 tx=0x7f0eb000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2d969bfd3f84416 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:53.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.201+0000 7f0eb6ffd700 1 -- 172.21.15.84:0/1291207992 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb000e070 con 0x7f0eb80cd590 2023-09-13T08:24:53.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.201+0000 7f0eb6ffd700 1 -- 172.21.15.84:0/1291207992 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eb0003a20 con 0x7f0eb80cd590 2023-09-13T08:24:53.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.201+0000 7f0eb6ffd700 1 -- 172.21.15.84:0/1291207992 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb0003dd0 con 0x7f0eb80cd590 2023-09-13T08:24:53.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.202+0000 7f0ebe746700 1 -- 172.21.15.84:0/1291207992 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0eb80cd590 msgr2=0x7f0eb80cdbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:53.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.202+0000 7f0ebe746700 1 --2- 172.21.15.84:0/1291207992 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0eb80cd590 0x7f0eb80cdbc0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0eb80678a0 tx=0x7f0eb000b330 comp rx=0 tx=0).stop 2023-09-13T08:24:53.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.202+0000 7f0ebe746700 1 -- 172.21.15.84:0/1291207992 shutdown_connections 2023-09-13T08:24:53.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.202+0000 7f0ebe746700 1 --2- 172.21.15.84:0/1291207992 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0eb80cd590 0x7f0eb80cdbc0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:53.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.202+0000 7f0ebe746700 1 --2- 172.21.15.84:0/1291207992 >> v2:172.21.15.161:3300/0 conn(0x7f0eb815e910 0x7f0eb80cf570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:53.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.202+0000 7f0ebe746700 1 -- 172.21.15.84:0/1291207992 >> 172.21.15.84:0/1291207992 conn(0x7f0eb80cca70 msgr2=0x7f0eb80cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:53.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.202+0000 7f0ebe746700 1 -- 172.21.15.84:0/1291207992 shutdown_connections 2023-09-13T08:24:53.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.202+0000 7f0ebe746700 1 -- 172.21.15.84:0/1291207992 wait complete. 2023-09-13T08:24:53.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.203+0000 7f0ebe746700 1 Processor -- start 2023-09-13T08:24:53.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.203+0000 7f0ebe746700 1 -- start start 2023-09-13T08:24:53.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.204+0000 7f0ebe746700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0eb80ca8e0 0x7f0eb81560a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:53.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.204+0000 7f0ebe746700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0eb80cd590 0x7f0eb80afad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:53.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.204+0000 7f0ebe746700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0eb815e910 0x7f0eb80b0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:53.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.204+0000 7f0ebe746700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb80b4fc0 con 0x7f0eb80ca8e0 2023-09-13T08:24:53.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.204+0000 7f0ebe746700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb80b4110 con 0x7f0eb815e910 2023-09-13T08:24:53.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.204+0000 7f0ebe746700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb80b43b0 con 0x7f0eb80cd590 2023-09-13T08:24:53.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.204+0000 7f0eb7fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0eb80ca8e0 0x7f0eb81560a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:53.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.204+0000 7f0eb7fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0eb80ca8e0 0x7f0eb81560a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43450/0 (socket says 172.21.15.84:43450) 2023-09-13T08:24:53.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.204+0000 7f0eb7fff700 1 -- 172.21.15.84:0/2657483908 learned_addr learned my addr 172.21.15.84:0/2657483908 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:24:53.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.204+0000 7f0ebcce3700 1 --2- 172.21.15.84:0/2657483908 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0eb815e910 0x7f0eb80b0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:53.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.204+0000 7f0eb77fe700 1 --2- 172.21.15.84:0/2657483908 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0eb80cd590 0x7f0eb80afad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:53.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.204+0000 7f0eb7fff700 1 -- 172.21.15.84:0/2657483908 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0eb80cd590 msgr2=0x7f0eb80afad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:53.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.204+0000 7f0eb7fff700 1 --2- 172.21.15.84:0/2657483908 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0eb80cd590 0x7f0eb80afad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:53.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.204+0000 7f0eb7fff700 1 -- 172.21.15.84:0/2657483908 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0eb815e910 msgr2=0x7f0eb80b0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:53.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.204+0000 7f0eb7fff700 1 --2- 172.21.15.84:0/2657483908 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0eb815e910 0x7f0eb80b0010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:53.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.204+0000 7f0eb7fff700 1 -- 172.21.15.84:0/2657483908 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eb0009b30 con 0x7f0eb80ca8e0 2023-09-13T08:24:53.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.204+0000 7f0eb77fe700 1 --2- 172.21.15.84:0/2657483908 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0eb80cd590 0x7f0eb80afad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T08:24:53.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.204+0000 7f0eb7fff700 1 --2- 172.21.15.84:0/2657483908 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0eb80ca8e0 0x7f0eb81560a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0ea800c4d0 tx=0x7f0ea800c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:53.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.205+0000 7f0eb4ff9700 1 -- 172.21.15.84:0/2657483908 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea8011790 con 0x7f0eb80ca8e0 2023-09-13T08:24:53.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.205+0000 7f0eb4ff9700 1 -- 172.21.15.84:0/2657483908 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ea80118f0 con 0x7f0eb80ca8e0 2023-09-13T08:24:53.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.205+0000 7f0eb4ff9700 1 -- 172.21.15.84:0/2657483908 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea8011ca0 con 0x7f0eb80ca8e0 2023-09-13T08:24:53.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.205+0000 7f0ebe746700 1 -- 172.21.15.84:0/2657483908 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0eb80b4690 con 0x7f0eb80ca8e0 2023-09-13T08:24:53.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.205+0000 7f0ebe746700 1 -- 172.21.15.84:0/2657483908 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0eb80b4c50 con 0x7f0eb80ca8e0 2023-09-13T08:24:53.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.206+0000 7f0ebe746700 1 -- 172.21.15.84:0/2657483908 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0eb804f200 con 0x7f0eb80ca8e0 2023-09-13T08:24:53.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.206+0000 7f0eb4ff9700 1 -- 172.21.15.84:0/2657483908 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f0ea801c460 con 0x7f0eb80ca8e0 2023-09-13T08:24:53.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.206+0000 7f0eb4ff9700 1 --2- 172.21.15.84:0/2657483908 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f0ea406a580 0x7f0ea406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:53.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.206+0000 7f0eb4ff9700 1 -- 172.21.15.84:0/2657483908 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0ea8088b20 con 0x7f0eb80ca8e0 2023-09-13T08:24:53.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.206+0000 7f0eb77fe700 1 --2- 172.21.15.84:0/2657483908 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f0ea406a580 0x7f0ea406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:53.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.207+0000 7f0eb77fe700 1 --2- 172.21.15.84:0/2657483908 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f0ea406a580 0x7f0ea406ca40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0eb806b640 tx=0x7f0eac008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:53.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.211+0000 7f0eb4ff9700 1 -- 172.21.15.84:0/2657483908 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f0ea8053db0 con 0x7f0eb80ca8e0 2023-09-13T08:24:53.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.398+0000 7f0ebe746700 1 -- 172.21.15.84:0/2657483908 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0eb80c3700 con 0x7f0eb80ca8e0 2023-09-13T08:24:53.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.398+0000 7f0eb4ff9700 1 -- 172.21.15.84:0/2657483908 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0ea80573d0 con 0x7f0eb80ca8e0 2023-09-13T08:24:53.399 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-09-13T08:24:53.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.401+0000 7f0ebe746700 1 -- 172.21.15.84:0/2657483908 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f0ea406a580 msgr2=0x7f0ea406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:53.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.401+0000 7f0ebe746700 1 --2- 172.21.15.84:0/2657483908 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f0ea406a580 0x7f0ea406ca40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0eb806b640 tx=0x7f0eac008040 comp rx=0 tx=0).stop 2023-09-13T08:24:53.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.401+0000 7f0ebe746700 1 -- 172.21.15.84:0/2657483908 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0eb80ca8e0 msgr2=0x7f0eb81560a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:53.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.401+0000 7f0ebe746700 1 --2- 172.21.15.84:0/2657483908 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0eb80ca8e0 0x7f0eb81560a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0ea800c4d0 tx=0x7f0ea800c7e0 comp rx=0 tx=0).stop 2023-09-13T08:24:53.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.401+0000 7f0ebe746700 1 -- 172.21.15.84:0/2657483908 shutdown_connections 2023-09-13T08:24:53.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.401+0000 7f0ebe746700 1 --2- 172.21.15.84:0/2657483908 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f0ea406a580 0x7f0ea406ca40 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:53.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.401+0000 7f0ebe746700 1 --2- 172.21.15.84:0/2657483908 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0eb815e910 0x7f0eb80b0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:53.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.401+0000 7f0ebe746700 1 --2- 172.21.15.84:0/2657483908 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0eb80ca8e0 0x7f0eb81560a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:53.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.401+0000 7f0ebe746700 1 --2- 172.21.15.84:0/2657483908 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0eb80cd590 0x7f0eb80afad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:53.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.401+0000 7f0ebe746700 1 -- 172.21.15.84:0/2657483908 >> 172.21.15.84:0/2657483908 conn(0x7f0eb80cca70 msgr2=0x7f0eb815fec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:53.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.401+0000 7f0ebe746700 1 -- 172.21.15.84:0/2657483908 shutdown_connections 2023-09-13T08:24:53.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.401+0000 7f0ebe746700 1 -- 172.21.15.84:0/2657483908 wait complete. 2023-09-13T08:24:53.413 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-13T08:24:53.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.547+0000 7f001f0c9700 1 Processor -- start 2023-09-13T08:24:53.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.547+0000 7f001f0c9700 1 -- start start 2023-09-13T08:24:53.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.548+0000 7f001f0c9700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f00180cd590 0x7f00180cf570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:53.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.548+0000 7f001f0c9700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f001815e480 con 0x7f001815e910 2023-09-13T08:24:53.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.548+0000 7f001f0c9700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00180cfbe0 con 0x7f00180ca8e0 2023-09-13T08:24:53.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.548+0000 7f001f0c9700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f001815de30 con 0x7f00180cd590 2023-09-13T08:24:53.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.548+0000 7f001d666700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f00180cd590 0x7f00180cf570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:53.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.548+0000 7f001d666700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f00180cd590 0x7f00180cf570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43462/0 (socket says 172.21.15.84:43462) 2023-09-13T08:24:53.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.548+0000 7f001d666700 1 -- 172.21.15.84:0/437314082 learned_addr learned my addr 172.21.15.84:0/437314082 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:24:53.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.548+0000 7f001d666700 1 -- 172.21.15.84:0/437314082 >> v1:172.21.15.161:6789/0 conn(0x7f00180ca8e0 legacy=0x7f00180cacc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:53.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.548+0000 7f001d666700 1 -- 172.21.15.84:0/437314082 >> v1:172.21.15.84:6789/0 conn(0x7f001815e910 legacy=0x7f00180cdbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:53.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.548+0000 7f001d666700 1 -- 172.21.15.84:0/437314082 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f001815e110 con 0x7f00180cd590 2023-09-13T08:24:53.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.548+0000 7f00177fe700 1 -- 172.21.15.84:0/437314082 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2522409460 0 0) 0x7f001815e480 con 0x7f001815e910 2023-09-13T08:24:53.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.548+0000 7f001d666700 1 --2- 172.21.15.84:0/437314082 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00180cd590 0x7f00180cf570 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0010009e50 tx=0x7f001000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25a361987c2be97d server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:53.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.548+0000 7f00177fe700 1 -- 172.21.15.84:0/437314082 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f001000e070 con 0x7f00180cd590 2023-09-13T08:24:53.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.549+0000 7f00177fe700 1 -- 172.21.15.84:0/437314082 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f001000b9c0 con 0x7f00180cd590 2023-09-13T08:24:53.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.549+0000 7f00177fe700 1 -- 172.21.15.84:0/437314082 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f001000bd70 con 0x7f00180cd590 2023-09-13T08:24:53.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.549+0000 7f001f0c9700 1 -- 172.21.15.84:0/437314082 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00180cd590 msgr2=0x7f00180cf570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:53.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.549+0000 7f001f0c9700 1 --2- 172.21.15.84:0/437314082 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00180cd590 0x7f00180cf570 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0010009e50 tx=0x7f001000b330 comp rx=0 tx=0).stop 2023-09-13T08:24:53.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.549+0000 7f001f0c9700 1 -- 172.21.15.84:0/437314082 shutdown_connections 2023-09-13T08:24:53.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.549+0000 7f001f0c9700 1 --2- 172.21.15.84:0/437314082 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00180cd590 0x7f00180cf570 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:53.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.549+0000 7f001f0c9700 1 -- 172.21.15.84:0/437314082 >> 172.21.15.84:0/437314082 conn(0x7f00180cca70 msgr2=0x7f00180cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:53.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.549+0000 7f001f0c9700 1 -- 172.21.15.84:0/437314082 shutdown_connections 2023-09-13T08:24:53.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.549+0000 7f001f0c9700 1 -- 172.21.15.84:0/437314082 wait complete. 2023-09-13T08:24:53.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.550+0000 7f001f0c9700 1 Processor -- start 2023-09-13T08:24:53.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.550+0000 7f001f0c9700 1 -- start start 2023-09-13T08:24:53.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.551+0000 7f001f0c9700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00180ca8e0 0x7f00180b5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:53.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.551+0000 7f001f0c9700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00180cd590 0x7f00180c5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:53.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.551+0000 7f001f0c9700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f001815e910 0x7f001814e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:53.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.551+0000 7f001f0c9700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00180b5fc0 con 0x7f00180ca8e0 2023-09-13T08:24:53.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.551+0000 7f001f0c9700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00180b4630 con 0x7f00180cd590 2023-09-13T08:24:53.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.551+0000 7f001f0c9700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00180b3d90 con 0x7f001815e910 2023-09-13T08:24:53.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.551+0000 7f001ce65700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00180ca8e0 0x7f00180b5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:53.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.551+0000 7f001ce65700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00180ca8e0 0x7f00180b5a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43464/0 (socket says 172.21.15.84:43464) 2023-09-13T08:24:53.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.551+0000 7f001ce65700 1 -- 172.21.15.84:0/2211021860 learned_addr learned my addr 172.21.15.84:0/2211021860 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:24:53.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.551+0000 7f0017fff700 1 --2- 172.21.15.84:0/2211021860 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00180cd590 0x7f00180c5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:53.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.551+0000 7f001d666700 1 --2- 172.21.15.84:0/2211021860 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f001815e910 0x7f001814e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:53.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.552+0000 7f001ce65700 1 -- 172.21.15.84:0/2211021860 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f001815e910 msgr2=0x7f001814e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:53.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.552+0000 7f001ce65700 1 --2- 172.21.15.84:0/2211021860 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f001815e910 0x7f001814e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:53.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.552+0000 7f001ce65700 1 -- 172.21.15.84:0/2211021860 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00180cd590 msgr2=0x7f00180c5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:53.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.552+0000 7f001ce65700 1 --2- 172.21.15.84:0/2211021860 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00180cd590 0x7f00180c5f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:53.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.552+0000 7f001ce65700 1 -- 172.21.15.84:0/2211021860 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0010009b30 con 0x7f00180ca8e0 2023-09-13T08:24:53.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.552+0000 7f001ce65700 1 --2- 172.21.15.84:0/2211021860 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00180ca8e0 0x7f00180b5a80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f000c00c4e0 tx=0x7f000c00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:53.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.552+0000 7f00157fa700 1 -- 172.21.15.84:0/2211021860 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f000c0052d0 con 0x7f00180ca8e0 2023-09-13T08:24:53.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.552+0000 7f00157fa700 1 -- 172.21.15.84:0/2211021860 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f000c005430 con 0x7f00180ca8e0 2023-09-13T08:24:53.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.552+0000 7f001f0c9700 1 -- 172.21.15.84:0/2211021860 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00180b4070 con 0x7f00180ca8e0 2023-09-13T08:24:53.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.552+0000 7f00157fa700 1 -- 172.21.15.84:0/2211021860 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f000c0038c0 con 0x7f00180ca8e0 2023-09-13T08:24:53.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.552+0000 7f001f0c9700 1 -- 172.21.15.84:0/2211021860 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00180c8760 con 0x7f00180ca8e0 2023-09-13T08:24:53.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.553+0000 7f001f0c9700 1 -- 172.21.15.84:0/2211021860 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f001804f200 con 0x7f00180ca8e0 2023-09-13T08:24:53.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.554+0000 7f00157fa700 1 -- 172.21.15.84:0/2211021860 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f000c003a20 con 0x7f00180ca8e0 2023-09-13T08:24:53.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.554+0000 7f00157fa700 1 --2- 172.21.15.84:0/2211021860 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7efffc06a580 0x7efffc06ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:53.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.554+0000 7f00157fa700 1 -- 172.21.15.84:0/2211021860 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f000c0880d0 con 0x7f00180ca8e0 2023-09-13T08:24:53.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.554+0000 7f0017fff700 1 --2- 172.21.15.84:0/2211021860 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7efffc06a580 0x7efffc06ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:53.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.554+0000 7f0017fff700 1 --2- 172.21.15.84:0/2211021860 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7efffc06a580 0x7efffc06ca40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f00181f6a50 tx=0x7f0004009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:53.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.559+0000 7f00157fa700 1 -- 172.21.15.84:0/2211021860 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f000c053360 con 0x7f00180ca8e0 2023-09-13T08:24:53.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.746+0000 7f001f0c9700 1 -- 172.21.15.84:0/2211021860 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f001806aeb0 con 0x7f00180ca8e0 2023-09-13T08:24:53.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.746+0000 7f00157fa700 1 -- 172.21.15.84:0/2211021860 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f000c056980 con 0x7f00180ca8e0 2023-09-13T08:24:53.747 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-09-13T08:24:53.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.748+0000 7f001f0c9700 1 -- 172.21.15.84:0/2211021860 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7efffc06a580 msgr2=0x7efffc06ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:53.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.748+0000 7f001f0c9700 1 --2- 172.21.15.84:0/2211021860 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7efffc06a580 0x7efffc06ca40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f00181f6a50 tx=0x7f0004009040 comp rx=0 tx=0).stop 2023-09-13T08:24:53.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.748+0000 7f001f0c9700 1 -- 172.21.15.84:0/2211021860 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00180ca8e0 msgr2=0x7f00180b5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:53.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.748+0000 7f001f0c9700 1 --2- 172.21.15.84:0/2211021860 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00180ca8e0 0x7f00180b5a80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f000c00c4e0 tx=0x7f000c00c7f0 comp rx=0 tx=0).stop 2023-09-13T08:24:53.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.748+0000 7f001f0c9700 1 -- 172.21.15.84:0/2211021860 shutdown_connections 2023-09-13T08:24:53.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.748+0000 7f001f0c9700 1 --2- 172.21.15.84:0/2211021860 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f001815e910 0x7f001814e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:53.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.748+0000 7f001f0c9700 1 --2- 172.21.15.84:0/2211021860 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00180ca8e0 0x7f00180b5a80 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:53.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.748+0000 7f001f0c9700 1 --2- 172.21.15.84:0/2211021860 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7efffc06a580 0x7efffc06ca40 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:53.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.748+0000 7f001f0c9700 1 --2- 172.21.15.84:0/2211021860 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00180cd590 0x7f00180c5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:53.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.748+0000 7f001f0c9700 1 -- 172.21.15.84:0/2211021860 >> 172.21.15.84:0/2211021860 conn(0x7f00180cca70 msgr2=0x7f001815ff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:53.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.748+0000 7f001f0c9700 1 -- 172.21.15.84:0/2211021860 shutdown_connections 2023-09-13T08:24:53.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.748+0000 7f001f0c9700 1 -- 172.21.15.84:0/2211021860 wait complete. 2023-09-13T08:24:53.763 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-13T08:24:53.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.890+0000 7f6cc0d77700 1 Processor -- start 2023-09-13T08:24:53.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.890+0000 7f6cc0d77700 1 -- start start 2023-09-13T08:24:53.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.891+0000 7f6cc0d77700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6cbc15a170 0x7f6cbc06e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:53.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.891+0000 7f6cc0d77700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6cbc0ca640 0x7f6cbc0caaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:53.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.891+0000 7f6cc0d77700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cbc0cfe40 con 0x7f6cbc0cf910 2023-09-13T08:24:53.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.891+0000 7f6cc0d77700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cbc15a550 con 0x7f6cbc15a170 2023-09-13T08:24:53.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.891+0000 7f6cc0d77700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cbc0cf4c0 con 0x7f6cbc0ca640 2023-09-13T08:24:53.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.891+0000 7f6cba59c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6cbc15a170 0x7f6cbc06e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:53.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.891+0000 7f6cba59c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6cbc15a170 0x7f6cbc06e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43472/0 (socket says 172.21.15.84:43472) 2023-09-13T08:24:53.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.891+0000 7f6cba59c700 1 -- 172.21.15.84:0/25426552 learned_addr learned my addr 172.21.15.84:0/25426552 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:24:53.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.891+0000 7f6cba59c700 1 -- 172.21.15.84:0/25426552 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6cbc0ca640 msgr2=0x7f6cbc0caaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:24:53.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.891+0000 7f6cba59c700 1 --2- 172.21.15.84:0/25426552 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6cbc0ca640 0x7f6cbc0caaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:53.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.891+0000 7f6cba59c700 1 -- 172.21.15.84:0/25426552 >> v1:172.21.15.161:6789/0 conn(0x7f6cbc0cf910 legacy=0x7f6cbc06ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:24:53.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.891+0000 7f6cba59c700 1 -- 172.21.15.84:0/25426552 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cbc0ce700 con 0x7f6cbc15a170 2023-09-13T08:24:53.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.892+0000 7f6cba59c700 1 --2- 172.21.15.84:0/25426552 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cbc15a170 0x7f6cbc06e740 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6cb00098f0 tx=0x7f6cb0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c133a893c8358bcd server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:53.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.892+0000 7f6cb959a700 1 -- 172.21.15.84:0/25426552 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb0004230 con 0x7f6cbc15a170 2023-09-13T08:24:53.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.892+0000 7f6cb959a700 1 -- 172.21.15.84:0/25426552 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cb0004390 con 0x7f6cbc15a170 2023-09-13T08:24:53.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.892+0000 7f6cb959a700 1 -- 172.21.15.84:0/25426552 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb00036a0 con 0x7f6cbc15a170 2023-09-13T08:24:53.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.892+0000 7f6cc0d77700 1 -- 172.21.15.84:0/25426552 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cbc15a170 msgr2=0x7f6cbc06e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:53.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.892+0000 7f6cc0d77700 1 --2- 172.21.15.84:0/25426552 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cbc15a170 0x7f6cbc06e740 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6cb00098f0 tx=0x7f6cb0009c00 comp rx=0 tx=0).stop 2023-09-13T08:24:53.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.892+0000 7f6cc0d77700 1 -- 172.21.15.84:0/25426552 shutdown_connections 2023-09-13T08:24:53.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.892+0000 7f6cc0d77700 1 --2- 172.21.15.84:0/25426552 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cbc15a170 0x7f6cbc06e740 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:53.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.892+0000 7f6cc0d77700 1 --2- 172.21.15.84:0/25426552 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6cbc0ca640 0x7f6cbc0caaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:53.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.892+0000 7f6cc0d77700 1 -- 172.21.15.84:0/25426552 >> 172.21.15.84:0/25426552 conn(0x7f6cbc0cca70 msgr2=0x7f6cbc0cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:53.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.892+0000 7f6cc0d77700 1 -- 172.21.15.84:0/25426552 shutdown_connections 2023-09-13T08:24:53.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.892+0000 7f6cc0d77700 1 -- 172.21.15.84:0/25426552 wait complete. 2023-09-13T08:24:53.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.894+0000 7f6cc0d77700 1 Processor -- start 2023-09-13T08:24:53.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.894+0000 7f6cc0d77700 1 -- start start 2023-09-13T08:24:53.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.894+0000 7f6cc0d77700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6cbc0ca640 0x7f6cbc0b4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:53.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.894+0000 7f6cc0d77700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cbc0cf910 0x7f6cbc0b0e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:53.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.894+0000 7f6cc0d77700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6cbc15a170 0x7f6cbc151980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:53.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.894+0000 7f6cc0d77700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cbc0b1390 con 0x7f6cbc0cf910 2023-09-13T08:24:53.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.894+0000 7f6cc0d77700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cbc0c3a60 con 0x7f6cbc0ca640 2023-09-13T08:24:53.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.894+0000 7f6cc0d77700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cbc151ec0 con 0x7f6cbc15a170 2023-09-13T08:24:53.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.895+0000 7f6cb9d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cbc0cf910 0x7f6cbc0b0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:53.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.895+0000 7f6cb9d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cbc0cf910 0x7f6cbc0b0e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43478/0 (socket says 172.21.15.84:43478) 2023-09-13T08:24:53.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.895+0000 7f6cb9d9b700 1 -- 172.21.15.84:0/1036454720 learned_addr learned my addr 172.21.15.84:0/1036454720 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:24:53.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.895+0000 7f6cba59c700 1 --2- 172.21.15.84:0/1036454720 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6cbc0ca640 0x7f6cbc0b4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:53.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.895+0000 7f6cbad9d700 1 --2- 172.21.15.84:0/1036454720 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6cbc15a170 0x7f6cbc151980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:53.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.895+0000 7f6cb9d9b700 1 -- 172.21.15.84:0/1036454720 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6cbc15a170 msgr2=0x7f6cbc151980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:53.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.895+0000 7f6cb9d9b700 1 --2- 172.21.15.84:0/1036454720 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6cbc15a170 0x7f6cbc151980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:53.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.895+0000 7f6cb9d9b700 1 -- 172.21.15.84:0/1036454720 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6cbc0ca640 msgr2=0x7f6cbc0b4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:53.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.895+0000 7f6cb9d9b700 1 --2- 172.21.15.84:0/1036454720 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6cbc0ca640 0x7f6cbc0b4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:53.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.895+0000 7f6cb9d9b700 1 -- 172.21.15.84:0/1036454720 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cb0009550 con 0x7f6cbc0cf910 2023-09-13T08:24:53.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.895+0000 7f6cb9d9b700 1 --2- 172.21.15.84:0/1036454720 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cbc0cf910 0x7f6cbc0b0e50 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6cac00b450 tx=0x7f6cac00b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:53.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.895+0000 7f6caaffd700 1 -- 172.21.15.84:0/1036454720 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cac011830 con 0x7f6cbc0cf910 2023-09-13T08:24:53.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.895+0000 7f6caaffd700 1 -- 172.21.15.84:0/1036454720 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cac011990 con 0x7f6cbc0cf910 2023-09-13T08:24:53.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.895+0000 7f6caaffd700 1 -- 172.21.15.84:0/1036454720 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cac011d40 con 0x7f6cbc0cf910 2023-09-13T08:24:53.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.895+0000 7f6cc0d77700 1 -- 172.21.15.84:0/1036454720 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cbc0c3cb0 con 0x7f6cbc0cf910 2023-09-13T08:24:53.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.895+0000 7f6cc0d77700 1 -- 172.21.15.84:0/1036454720 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cbc0c4270 con 0x7f6cbc0cf910 2023-09-13T08:24:53.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.896+0000 7f6cc0d77700 1 -- 172.21.15.84:0/1036454720 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cbc04f200 con 0x7f6cbc0cf910 2023-09-13T08:24:53.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.897+0000 7f6caaffd700 1 -- 172.21.15.84:0/1036454720 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f6cac01a400 con 0x7f6cbc0cf910 2023-09-13T08:24:53.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.897+0000 7f6caaffd700 1 --2- 172.21.15.84:0/1036454720 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f6c9c06a580 0x7f6c9c06ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:53.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.897+0000 7f6caaffd700 1 -- 172.21.15.84:0/1036454720 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6cac088a00 con 0x7f6cbc0cf910 2023-09-13T08:24:53.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.897+0000 7f6cba59c700 1 --2- 172.21.15.84:0/1036454720 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f6c9c06a580 0x7f6c9c06ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:53.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.897+0000 7f6cba59c700 1 --2- 172.21.15.84:0/1036454720 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f6c9c06a580 0x7f6c9c06ca40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6cb0009130 tx=0x7f6cb0008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:53.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:53.901+0000 7f6caaffd700 1 -- 172.21.15.84:0/1036454720 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f6cac053d20 con 0x7f6cbc0cf910 2023-09-13T08:24:54.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.093+0000 7f6cc0d77700 1 -- 172.21.15.84:0/1036454720 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6cbc0c7540 con 0x7f6cbc0cf910 2023-09-13T08:24:54.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.093+0000 7f6caaffd700 1 -- 172.21.15.84:0/1036454720 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6cac0150a0 con 0x7f6cbc0cf910 2023-09-13T08:24:54.094 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-09-13T08:24:54.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.096+0000 7f6cc0d77700 1 -- 172.21.15.84:0/1036454720 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f6c9c06a580 msgr2=0x7f6c9c06ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:54.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.096+0000 7f6cc0d77700 1 --2- 172.21.15.84:0/1036454720 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f6c9c06a580 0x7f6c9c06ca40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6cb0009130 tx=0x7f6cb0008030 comp rx=0 tx=0).stop 2023-09-13T08:24:54.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.096+0000 7f6cc0d77700 1 -- 172.21.15.84:0/1036454720 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cbc0cf910 msgr2=0x7f6cbc0b0e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:54.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.096+0000 7f6cc0d77700 1 --2- 172.21.15.84:0/1036454720 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cbc0cf910 0x7f6cbc0b0e50 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6cac00b450 tx=0x7f6cac00b810 comp rx=0 tx=0).stop 2023-09-13T08:24:54.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.096+0000 7f6cc0d77700 1 -- 172.21.15.84:0/1036454720 shutdown_connections 2023-09-13T08:24:54.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.096+0000 7f6cc0d77700 1 --2- 172.21.15.84:0/1036454720 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6cbc15a170 0x7f6cbc151980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:54.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.096+0000 7f6cc0d77700 1 --2- 172.21.15.84:0/1036454720 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f6c9c06a580 0x7f6c9c06ca40 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:54.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.096+0000 7f6cc0d77700 1 --2- 172.21.15.84:0/1036454720 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6cbc0ca640 0x7f6cbc0b4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:54.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.096+0000 7f6cc0d77700 1 --2- 172.21.15.84:0/1036454720 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cbc0cf910 0x7f6cbc0b0e50 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:54.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.096+0000 7f6cc0d77700 1 -- 172.21.15.84:0/1036454720 >> 172.21.15.84:0/1036454720 conn(0x7f6cbc0cca70 msgr2=0x7f6cbc06e5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:54.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.096+0000 7f6cc0d77700 1 -- 172.21.15.84:0/1036454720 shutdown_connections 2023-09-13T08:24:54.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.096+0000 7f6cc0d77700 1 -- 172.21.15.84:0/1036454720 wait complete. 2023-09-13T08:24:54.108 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-09-13T08:24:54.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.233+0000 7fbbb4e74700 1 Processor -- start 2023-09-13T08:24:54.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.233+0000 7fbbb4e74700 1 -- start start 2023-09-13T08:24:54.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.234+0000 7fbbb4e74700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbbb0140360 0x7fbbb006a620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:54.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.234+0000 7fbbb4e74700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fbbb00cf230 0x7fbbb0140740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:54.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.234+0000 7fbbb4e74700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbb00ccc50 con 0x7fbbb006ab60 2023-09-13T08:24:54.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.234+0000 7fbbb4e74700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbb00ce080 con 0x7fbbb00cf230 2023-09-13T08:24:54.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.234+0000 7fbbb4e74700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb00cc690 con 0x7fbbb0140360 2023-09-13T08:24:54.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.234+0000 7fbbaed9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fbbb00cf230 0x7fbbb0140740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:54.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.234+0000 7fbbaed9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fbbb00cf230 0x7fbbb0140740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43486/0 (socket says 172.21.15.84:43486) 2023-09-13T08:24:54.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.234+0000 7fbbaed9d700 1 -- 172.21.15.84:0/615619382 learned_addr learned my addr 172.21.15.84:0/615619382 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:24:54.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.235+0000 7fbbae59c700 1 --2- 172.21.15.84:0/615619382 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbbb0140360 0x7fbbb006a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:54.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.235+0000 7fbbaed9d700 1 -- 172.21.15.84:0/615619382 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbbb0140360 msgr2=0x7fbbb006a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:24:54.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.235+0000 7fbbaed9d700 1 --2- 172.21.15.84:0/615619382 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbbb0140360 0x7fbbb006a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:54.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.235+0000 7fbbaed9d700 1 -- 172.21.15.84:0/615619382 >> v1:172.21.15.161:6789/0 conn(0x7fbbb006ab60 legacy=0x7fbbb00ceb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:24:54.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.235+0000 7fbbaed9d700 1 -- 172.21.15.84:0/615619382 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbb00cc970 con 0x7fbbb00cf230 2023-09-13T08:24:54.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.235+0000 7fbbaed9d700 1 --2- 172.21.15.84:0/615619382 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbbb00cf230 0x7fbbb0140740 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fbba8009e50 tx=0x7fbba800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=768351bc74cad7cc server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:54.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.235+0000 7fbbad59a700 1 -- 172.21.15.84:0/615619382 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba800e070 con 0x7fbbb00cf230 2023-09-13T08:24:54.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.235+0000 7fbbad59a700 1 -- 172.21.15.84:0/615619382 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbba8003a20 con 0x7fbbb00cf230 2023-09-13T08:24:54.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.235+0000 7fbbad59a700 1 -- 172.21.15.84:0/615619382 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba8003dd0 con 0x7fbbb00cf230 2023-09-13T08:24:54.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.235+0000 7fbbb4e74700 1 -- 172.21.15.84:0/615619382 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbbb00cf230 msgr2=0x7fbbb0140740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:54.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.235+0000 7fbbb4e74700 1 --2- 172.21.15.84:0/615619382 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbbb00cf230 0x7fbbb0140740 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fbba8009e50 tx=0x7fbba800b330 comp rx=0 tx=0).stop 2023-09-13T08:24:54.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.235+0000 7fbbb4e74700 1 -- 172.21.15.84:0/615619382 shutdown_connections 2023-09-13T08:24:54.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.236+0000 7fbbb4e74700 1 --2- 172.21.15.84:0/615619382 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbbb00cf230 0x7fbbb0140740 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:54.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.236+0000 7fbbb4e74700 1 --2- 172.21.15.84:0/615619382 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbbb0140360 0x7fbbb006a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:54.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.236+0000 7fbbb4e74700 1 -- 172.21.15.84:0/615619382 >> 172.21.15.84:0/615619382 conn(0x7fbbb00cf8f0 msgr2=0x7fbbb00cfd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:54.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.236+0000 7fbbb4e74700 1 -- 172.21.15.84:0/615619382 shutdown_connections 2023-09-13T08:24:54.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.236+0000 7fbbb4e74700 1 -- 172.21.15.84:0/615619382 wait complete. 2023-09-13T08:24:54.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.237+0000 7fbbb4e74700 1 Processor -- start 2023-09-13T08:24:54.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.237+0000 7fbbb4e74700 1 -- start start 2023-09-13T08:24:54.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.238+0000 7fbbb4e74700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbbb006ab60 0x7fbbb013d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:54.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.238+0000 7fbbb4e74700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbbb00cf230 0x7fbbb0144310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:54.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.238+0000 7fbbb4e74700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbbb0140360 0x7fbbb013f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:54.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.238+0000 7fbbb4e74700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb01418a0 con 0x7fbbb006ab60 2023-09-13T08:24:54.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.238+0000 7fbbb4e74700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb0141af0 con 0x7fbbb0140360 2023-09-13T08:24:54.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.238+0000 7fbbb4e74700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb0141dd0 con 0x7fbbb00cf230 2023-09-13T08:24:54.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.238+0000 7fbbae59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbbb006ab60 0x7fbbb013d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:54.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.238+0000 7fbbae59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbbb006ab60 0x7fbbb013d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43490/0 (socket says 172.21.15.84:43490) 2023-09-13T08:24:54.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.238+0000 7fbbae59c700 1 -- 172.21.15.84:0/4095557829 learned_addr learned my addr 172.21.15.84:0/4095557829 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:24:54.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.238+0000 7fbbaed9d700 1 --2- 172.21.15.84:0/4095557829 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbbb0140360 0x7fbbb013f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:54.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.238+0000 7fbbadd9b700 1 --2- 172.21.15.84:0/4095557829 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbbb00cf230 0x7fbbb0144310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:54.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.238+0000 7fbbae59c700 1 -- 172.21.15.84:0/4095557829 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbbb00cf230 msgr2=0x7fbbb0144310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:54.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.238+0000 7fbbae59c700 1 --2- 172.21.15.84:0/4095557829 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbbb00cf230 0x7fbbb0144310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:54.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.238+0000 7fbbae59c700 1 -- 172.21.15.84:0/4095557829 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbbb0140360 msgr2=0x7fbbb013f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:54.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.238+0000 7fbbae59c700 1 --2- 172.21.15.84:0/4095557829 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbbb0140360 0x7fbbb013f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:54.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.238+0000 7fbbae59c700 1 -- 172.21.15.84:0/4095557829 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbba8009b30 con 0x7fbbb006ab60 2023-09-13T08:24:54.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.238+0000 7fbbae59c700 1 --2- 172.21.15.84:0/4095557829 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbbb006ab60 0x7fbbb013d950 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fbba400d800 tx=0x7fbba400db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:54.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.238+0000 7fbb9effd700 1 -- 172.21.15.84:0/4095557829 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba40125f0 con 0x7fbbb006ab60 2023-09-13T08:24:54.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.238+0000 7fbb9effd700 1 -- 172.21.15.84:0/4095557829 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbba4012750 con 0x7fbbb006ab60 2023-09-13T08:24:54.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.238+0000 7fbbb4e74700 1 -- 172.21.15.84:0/4095557829 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbb0129270 con 0x7fbbb006ab60 2023-09-13T08:24:54.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.239+0000 7fbb9effd700 1 -- 172.21.15.84:0/4095557829 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba4012b00 con 0x7fbbb006ab60 2023-09-13T08:24:54.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.239+0000 7fbbb4e74700 1 -- 172.21.15.84:0/4095557829 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbb012d570 con 0x7fbbb006ab60 2023-09-13T08:24:54.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.240+0000 7fbbb4e74700 1 -- 172.21.15.84:0/4095557829 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbb004f200 con 0x7fbbb006ab60 2023-09-13T08:24:54.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.240+0000 7fbb9effd700 1 -- 172.21.15.84:0/4095557829 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fbba4012c60 con 0x7fbbb006ab60 2023-09-13T08:24:54.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.240+0000 7fbb9effd700 1 --2- 172.21.15.84:0/4095557829 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fbb9006a580 0x7fbb9006ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:54.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.240+0000 7fbb9effd700 1 -- 172.21.15.84:0/4095557829 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbba4088d00 con 0x7fbbb006ab60 2023-09-13T08:24:54.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.240+0000 7fbbadd9b700 1 --2- 172.21.15.84:0/4095557829 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fbb9006a580 0x7fbb9006ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:54.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.241+0000 7fbbadd9b700 1 --2- 172.21.15.84:0/4095557829 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fbb9006a580 0x7fbb9006ca40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbbb013cf60 tx=0x7fbba0007ec0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:54.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.245+0000 7fbb9effd700 1 -- 172.21.15.84:0/4095557829 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fbba40540d0 con 0x7fbbb006ab60 2023-09-13T08:24:54.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.433+0000 7fbbb4e74700 1 -- 172.21.15.84:0/4095557829 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fbbb0141f90 con 0x7fbbb006ab60 2023-09-13T08:24:54.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.434+0000 7fbb9effd700 1 -- 172.21.15.84:0/4095557829 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7fbba40576f0 con 0x7fbbb006ab60 2023-09-13T08:24:54.434 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-09-13T08:24:54.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.436+0000 7fbbb4e74700 1 -- 172.21.15.84:0/4095557829 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fbb9006a580 msgr2=0x7fbb9006ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:54.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.436+0000 7fbbb4e74700 1 --2- 172.21.15.84:0/4095557829 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fbb9006a580 0x7fbb9006ca40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbbb013cf60 tx=0x7fbba0007ec0 comp rx=0 tx=0).stop 2023-09-13T08:24:54.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.436+0000 7fbbb4e74700 1 -- 172.21.15.84:0/4095557829 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbbb006ab60 msgr2=0x7fbbb013d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:54.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.436+0000 7fbbb4e74700 1 --2- 172.21.15.84:0/4095557829 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbbb006ab60 0x7fbbb013d950 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fbba400d800 tx=0x7fbba400db10 comp rx=0 tx=0).stop 2023-09-13T08:24:54.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.436+0000 7fbbb4e74700 1 -- 172.21.15.84:0/4095557829 shutdown_connections 2023-09-13T08:24:54.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.436+0000 7fbbb4e74700 1 --2- 172.21.15.84:0/4095557829 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fbb9006a580 0x7fbb9006ca40 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:54.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.436+0000 7fbbb4e74700 1 --2- 172.21.15.84:0/4095557829 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbbb0140360 0x7fbbb013f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:54.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.436+0000 7fbbb4e74700 1 --2- 172.21.15.84:0/4095557829 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbbb006ab60 0x7fbbb013d950 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:54.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.436+0000 7fbbb4e74700 1 --2- 172.21.15.84:0/4095557829 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbbb00cf230 0x7fbbb0144310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:54.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.436+0000 7fbbb4e74700 1 -- 172.21.15.84:0/4095557829 >> 172.21.15.84:0/4095557829 conn(0x7fbbb00cf8f0 msgr2=0x7fbbb013d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:54.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.436+0000 7fbbb4e74700 1 -- 172.21.15.84:0/4095557829 shutdown_connections 2023-09-13T08:24:54.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.436+0000 7fbbb4e74700 1 -- 172.21.15.84:0/4095557829 wait complete. 2023-09-13T08:24:54.452 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-09-13T08:24:54.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.574+0000 7fe46862c700 1 Processor -- start 2023-09-13T08:24:54.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.574+0000 7fe46862c700 1 -- start start 2023-09-13T08:24:54.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.575+0000 7fe46862c700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe46015d530 0x7fe460161bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:54.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.575+0000 7fe46862c700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe4600ca920 0x7fe46006d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:54.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.575+0000 7fe46862c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe46006a620 0x7fe46006aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:54.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.575+0000 7fe46862c700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4600cff20 con 0x7fe46006a620 2023-09-13T08:24:54.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.575+0000 7fe46862c700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe46006af90 con 0x7fe4600ca920 2023-09-13T08:24:54.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.575+0000 7fe46862c700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4601620f0 con 0x7fe46015d530 2023-09-13T08:24:54.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.575+0000 7fe466bc9700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe46006a620 0x7fe46006aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:54.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.575+0000 7fe466bc9700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe46006a620 0x7fe46006aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43500/0 (socket says 172.21.15.84:43500) 2023-09-13T08:24:54.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.575+0000 7fe466bc9700 1 -- 172.21.15.84:0/59846817 learned_addr learned my addr 172.21.15.84:0/59846817 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:24:54.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.576+0000 7fe465bc7700 1 --2- 172.21.15.84:0/59846817 >> v2:172.21.15.161:3300/0 conn(0x7fe4600ca920 0x7fe46006d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:54.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.576+0000 7fe4663c8700 1 --2- 172.21.15.84:0/59846817 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe46015d530 0x7fe460161bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:54.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.576+0000 7fe466bc9700 1 -- 172.21.15.84:0/59846817 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe46015d530 msgr2=0x7fe460161bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:24:54.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.576+0000 7fe466bc9700 1 --2- 172.21.15.84:0/59846817 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe46015d530 0x7fe460161bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:54.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.576+0000 7fe466bc9700 1 -- 172.21.15.84:0/59846817 >> v2:172.21.15.161:3300/0 conn(0x7fe4600ca920 msgr2=0x7fe46006d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:24:54.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.576+0000 7fe466bc9700 1 --2- 172.21.15.84:0/59846817 >> v2:172.21.15.161:3300/0 conn(0x7fe4600ca920 0x7fe46006d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:54.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.576+0000 7fe466bc9700 1 -- 172.21.15.84:0/59846817 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4600cae50 con 0x7fe46006a620 2023-09-13T08:24:54.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.576+0000 7fe465bc7700 1 --2- 172.21.15.84:0/59846817 >> v2:172.21.15.161:3300/0 conn(0x7fe4600ca920 0x7fe46006d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T08:24:54.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.576+0000 7fe466bc9700 1 --2- 172.21.15.84:0/59846817 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe46006a620 0x7fe46006aa50 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe4600677e0 tx=0x7fe45800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b66946289957c981 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:54.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.576+0000 7fe4653c6700 1 -- 172.21.15.84:0/59846817 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe45800e070 con 0x7fe46006a620 2023-09-13T08:24:54.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.576+0000 7fe4653c6700 1 -- 172.21.15.84:0/59846817 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe45800b9c0 con 0x7fe46006a620 2023-09-13T08:24:54.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.576+0000 7fe4653c6700 1 -- 172.21.15.84:0/59846817 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe45800bd70 con 0x7fe46006a620 2023-09-13T08:24:54.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.576+0000 7fe46862c700 1 -- 172.21.15.84:0/59846817 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe46006a620 msgr2=0x7fe46006aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:54.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.576+0000 7fe46862c700 1 --2- 172.21.15.84:0/59846817 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe46006a620 0x7fe46006aa50 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe4600677e0 tx=0x7fe45800b330 comp rx=0 tx=0).stop 2023-09-13T08:24:54.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.576+0000 7fe46862c700 1 -- 172.21.15.84:0/59846817 shutdown_connections 2023-09-13T08:24:54.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.576+0000 7fe46862c700 1 --2- 172.21.15.84:0/59846817 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe46006a620 0x7fe46006aa50 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:54.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.577+0000 7fe46862c700 1 --2- 172.21.15.84:0/59846817 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe46015d530 0x7fe460161bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:54.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.577+0000 7fe46862c700 1 --2- 172.21.15.84:0/59846817 >> v2:172.21.15.161:3300/0 conn(0x7fe4600ca920 0x7fe46006d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:54.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.577+0000 7fe46862c700 1 -- 172.21.15.84:0/59846817 >> 172.21.15.84:0/59846817 conn(0x7fe4600d00c0 msgr2=0x7fe4600d04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:54.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.577+0000 7fe46862c700 1 -- 172.21.15.84:0/59846817 shutdown_connections 2023-09-13T08:24:54.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.577+0000 7fe46862c700 1 -- 172.21.15.84:0/59846817 wait complete. 2023-09-13T08:24:54.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.578+0000 7fe46862c700 1 Processor -- start 2023-09-13T08:24:54.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.578+0000 7fe46862c700 1 -- start start 2023-09-13T08:24:54.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.578+0000 7fe46862c700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe46006a620 0x7fe46014d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:54.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.578+0000 7fe46862c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe4600ca920 0x7fe4600c8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:54.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.578+0000 7fe46862c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe46015d530 0x7fe4600b2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:54.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.578+0000 7fe46862c700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe46015e2b0 con 0x7fe46015d530 2023-09-13T08:24:54.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.578+0000 7fe46862c700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe46014d620 con 0x7fe4600ca920 2023-09-13T08:24:54.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.578+0000 7fe46862c700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4600c7a00 con 0x7fe46006a620 2023-09-13T08:24:54.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.578+0000 7fe466bc9700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe46015d530 0x7fe4600b2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:54.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.579+0000 7fe466bc9700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe46015d530 0x7fe4600b2ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43506/0 (socket says 172.21.15.84:43506) 2023-09-13T08:24:54.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.579+0000 7fe466bc9700 1 -- 172.21.15.84:0/1473231490 learned_addr learned my addr 172.21.15.84:0/1473231490 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:24:54.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.579+0000 7fe4663c8700 1 --2- 172.21.15.84:0/1473231490 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe46006a620 0x7fe46014d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:54.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.579+0000 7fe465bc7700 1 --2- 172.21.15.84:0/1473231490 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe4600ca920 0x7fe4600c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:54.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.579+0000 7fe466bc9700 1 -- 172.21.15.84:0/1473231490 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe46006a620 msgr2=0x7fe46014d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:54.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.579+0000 7fe466bc9700 1 --2- 172.21.15.84:0/1473231490 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe46006a620 0x7fe46014d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:54.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.579+0000 7fe466bc9700 1 -- 172.21.15.84:0/1473231490 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe4600ca920 msgr2=0x7fe4600c8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:54.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.579+0000 7fe466bc9700 1 --2- 172.21.15.84:0/1473231490 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe4600ca920 0x7fe4600c8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:54.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.579+0000 7fe466bc9700 1 -- 172.21.15.84:0/1473231490 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe458009b30 con 0x7fe46015d530 2023-09-13T08:24:54.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.579+0000 7fe466bc9700 1 --2- 172.21.15.84:0/1473231490 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe46015d530 0x7fe4600b2ee0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe45800b370 tx=0x7fe458004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:54.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.579+0000 7fe456ffd700 1 -- 172.21.15.84:0/1473231490 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe458004250 con 0x7fe46015d530 2023-09-13T08:24:54.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.579+0000 7fe456ffd700 1 -- 172.21.15.84:0/1473231490 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4580043f0 con 0x7fe46015d530 2023-09-13T08:24:54.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.579+0000 7fe46862c700 1 -- 172.21.15.84:0/1473231490 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4600c8b70 con 0x7fe46015d530 2023-09-13T08:24:54.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.579+0000 7fe456ffd700 1 -- 172.21.15.84:0/1473231490 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4580047a0 con 0x7fe46015d530 2023-09-13T08:24:54.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.579+0000 7fe46862c700 1 -- 172.21.15.84:0/1473231490 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe46015dbf0 con 0x7fe46015d530 2023-09-13T08:24:54.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.580+0000 7fe46862c700 1 -- 172.21.15.84:0/1473231490 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe46015e3f0 con 0x7fe46015d530 2023-09-13T08:24:54.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.580+0000 7fe456ffd700 1 -- 172.21.15.84:0/1473231490 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fe45801c440 con 0x7fe46015d530 2023-09-13T08:24:54.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.581+0000 7fe456ffd700 1 --2- 172.21.15.84:0/1473231490 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fe44406a580 0x7fe44406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:54.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.581+0000 7fe456ffd700 1 -- 172.21.15.84:0/1473231490 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe45808a100 con 0x7fe46015d530 2023-09-13T08:24:54.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.581+0000 7fe4663c8700 1 --2- 172.21.15.84:0/1473231490 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fe44406a580 0x7fe44406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:54.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.581+0000 7fe4663c8700 1 --2- 172.21.15.84:0/1473231490 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fe44406a580 0x7fe44406ca40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe450006fd0 tx=0x7fe450008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:54.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.585+0000 7fe456ffd700 1 -- 172.21.15.84:0/1473231490 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fe46015e3f0 con 0x7fe46015d530 2023-09-13T08:24:54.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.792+0000 7fe46862c700 1 -- 172.21.15.84:0/1473231490 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe46015e3f0 con 0x7fe46015d530 2023-09-13T08:24:54.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.792+0000 7fe456ffd700 1 -- 172.21.15.84:0/1473231490 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7fe46015e3f0 con 0x7fe46015d530 2023-09-13T08:24:54.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.795+0000 7fe46862c700 1 -- 172.21.15.84:0/1473231490 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fe44406a580 msgr2=0x7fe44406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:54.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.795+0000 7fe46862c700 1 --2- 172.21.15.84:0/1473231490 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fe44406a580 0x7fe44406ca40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe450006fd0 tx=0x7fe450008040 comp rx=0 tx=0).stop 2023-09-13T08:24:54.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.795+0000 7fe46862c700 1 -- 172.21.15.84:0/1473231490 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe46015d530 msgr2=0x7fe4600b2ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:54.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.795+0000 7fe46862c700 1 --2- 172.21.15.84:0/1473231490 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe46015d530 0x7fe4600b2ee0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe45800b370 tx=0x7fe458004ad0 comp rx=0 tx=0).stop 2023-09-13T08:24:54.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.795+0000 7fe46862c700 1 -- 172.21.15.84:0/1473231490 shutdown_connections 2023-09-13T08:24:54.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.795+0000 7fe46862c700 1 --2- 172.21.15.84:0/1473231490 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe46015d530 0x7fe4600b2ee0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:54.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.795+0000 7fe46862c700 1 --2- 172.21.15.84:0/1473231490 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe46006a620 0x7fe46014d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:54.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.795+0000 7fe46862c700 1 --2- 172.21.15.84:0/1473231490 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fe44406a580 0x7fe44406ca40 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:54.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.795+0000 7fe46862c700 1 --2- 172.21.15.84:0/1473231490 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe4600ca920 0x7fe4600c8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:54.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.795+0000 7fe46862c700 1 -- 172.21.15.84:0/1473231490 >> 172.21.15.84:0/1473231490 conn(0x7fe4600d00c0 msgr2=0x7fe4600712b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:54.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.795+0000 7fe46862c700 1 -- 172.21.15.84:0/1473231490 shutdown_connections 2023-09-13T08:24:54.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.795+0000 7fe46862c700 1 -- 172.21.15.84:0/1473231490 wait complete. 2023-09-13T08:24:54.798 INFO:teuthology.orchestra.run.smithi084.stderr:listed 0 entries 2023-09-13T08:24:54.809 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-09-13T08:24:54.810 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T08:24:54.829 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T08:24:54.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.989+0000 7fe5999c0700 1 Processor -- start 2023-09-13T08:24:54.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.990+0000 7fe5999c0700 1 -- start start 2023-09-13T08:24:54.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.990+0000 7fe5999c0700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe59415d530 0x7fe594161bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:54.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.990+0000 7fe5999c0700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe5940ca920 0x7fe59406d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:54.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.990+0000 7fe5999c0700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe59406a620 0x7fe59406aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:54.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.990+0000 7fe5999c0700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5940cff20 con 0x7fe59415d530 2023-09-13T08:24:54.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.990+0000 7fe5999c0700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe59406af90 con 0x7fe59406a620 2023-09-13T08:24:54.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.990+0000 7fe5999c0700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5941620f0 con 0x7fe5940ca920 2023-09-13T08:24:54.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.990+0000 7fe592ffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe59415d530 0x7fe594161bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:54.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.990+0000 7fe592ffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe59415d530 0x7fe594161bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43516/0 (socket says 172.21.15.84:43516) 2023-09-13T08:24:54.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.990+0000 7fe592ffd700 1 -- 172.21.15.84:0/1610343573 learned_addr learned my addr 172.21.15.84:0/1610343573 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:24:54.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.991+0000 7fe5937fe700 1 --2- 172.21.15.84:0/1610343573 >> v2:172.21.15.161:3300/0 conn(0x7fe59406a620 0x7fe59406aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:54.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.991+0000 7fe5927fc700 1 --2- 172.21.15.84:0/1610343573 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe5940ca920 0x7fe59406d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:54.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.991+0000 7fe592ffd700 1 -- 172.21.15.84:0/1610343573 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe5940ca920 msgr2=0x7fe59406d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:24:54.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.991+0000 7fe592ffd700 1 --2- 172.21.15.84:0/1610343573 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe5940ca920 0x7fe59406d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:54.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.991+0000 7fe592ffd700 1 -- 172.21.15.84:0/1610343573 >> v2:172.21.15.161:3300/0 conn(0x7fe59406a620 msgr2=0x7fe59406aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:24:54.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.991+0000 7fe592ffd700 1 --2- 172.21.15.84:0/1610343573 >> v2:172.21.15.161:3300/0 conn(0x7fe59406a620 0x7fe59406aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:54.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.991+0000 7fe592ffd700 1 -- 172.21.15.84:0/1610343573 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5940cae50 con 0x7fe59415d530 2023-09-13T08:24:54.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.991+0000 7fe592ffd700 1 --2- 172.21.15.84:0/1610343573 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe59415d530 0x7fe594161bb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe594072a70 tx=0x7fe57c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff0ba7b1b0326734 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:54.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.991+0000 7fe591ffb700 1 -- 172.21.15.84:0/1610343573 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe57c011830 con 0x7fe59415d530 2023-09-13T08:24:54.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.991+0000 7fe591ffb700 1 -- 172.21.15.84:0/1610343573 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe57c011990 con 0x7fe59415d530 2023-09-13T08:24:54.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.991+0000 7fe591ffb700 1 -- 172.21.15.84:0/1610343573 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe57c011d20 con 0x7fe59415d530 2023-09-13T08:24:54.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.992+0000 7fe5999c0700 1 -- 172.21.15.84:0/1610343573 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe59415d530 msgr2=0x7fe594161bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:54.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.992+0000 7fe5999c0700 1 --2- 172.21.15.84:0/1610343573 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe59415d530 0x7fe594161bb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe594072a70 tx=0x7fe57c009bd0 comp rx=0 tx=0).stop 2023-09-13T08:24:54.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.992+0000 7fe5999c0700 1 -- 172.21.15.84:0/1610343573 shutdown_connections 2023-09-13T08:24:54.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.992+0000 7fe5999c0700 1 --2- 172.21.15.84:0/1610343573 >> v2:172.21.15.161:3300/0 conn(0x7fe59406a620 0x7fe59406aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:54.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.992+0000 7fe5999c0700 1 --2- 172.21.15.84:0/1610343573 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe59415d530 0x7fe594161bb0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:54.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.992+0000 7fe5999c0700 1 --2- 172.21.15.84:0/1610343573 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe5940ca920 0x7fe59406d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:54.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.992+0000 7fe5999c0700 1 -- 172.21.15.84:0/1610343573 >> 172.21.15.84:0/1610343573 conn(0x7fe5940d00c0 msgr2=0x7fe5940d04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:54.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.992+0000 7fe5999c0700 1 -- 172.21.15.84:0/1610343573 shutdown_connections 2023-09-13T08:24:54.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.992+0000 7fe5999c0700 1 -- 172.21.15.84:0/1610343573 wait complete. 2023-09-13T08:24:54.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.993+0000 7fe5999c0700 1 Processor -- start 2023-09-13T08:24:54.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.993+0000 7fe5999c0700 1 -- start start 2023-09-13T08:24:55.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.994+0000 7fe5999c0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe59406a620 0x7fe5941576f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:55.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.994+0000 7fe5999c0700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe5940ca920 0x7fe5940c7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:55.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.994+0000 7fe5999c0700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe59415d530 0x7fe5940c9570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:55.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.994+0000 7fe5999c0700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5940b1920 con 0x7fe59406a620 2023-09-13T08:24:55.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.994+0000 7fe5999c0700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5940b4d10 con 0x7fe5940ca920 2023-09-13T08:24:55.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.994+0000 7fe5999c0700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5940c7cc0 con 0x7fe59415d530 2023-09-13T08:24:55.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.994+0000 7fe592ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe59406a620 0x7fe5941576f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:55.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.994+0000 7fe592ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe59406a620 0x7fe5941576f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43522/0 (socket says 172.21.15.84:43522) 2023-09-13T08:24:55.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.994+0000 7fe592ffd700 1 -- 172.21.15.84:0/2604705536 learned_addr learned my addr 172.21.15.84:0/2604705536 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:24:55.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.994+0000 7fe5927fc700 1 --2- 172.21.15.84:0/2604705536 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe5940ca920 0x7fe5940c7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:55.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.994+0000 7fe5937fe700 1 --2- 172.21.15.84:0/2604705536 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe59415d530 0x7fe5940c9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:55.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.994+0000 7fe592ffd700 1 -- 172.21.15.84:0/2604705536 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe59415d530 msgr2=0x7fe5940c9570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:55.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.994+0000 7fe592ffd700 1 --2- 172.21.15.84:0/2604705536 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe59415d530 0x7fe5940c9570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:55.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.994+0000 7fe592ffd700 1 -- 172.21.15.84:0/2604705536 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe5940ca920 msgr2=0x7fe5940c7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:55.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.994+0000 7fe592ffd700 1 --2- 172.21.15.84:0/2604705536 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe5940ca920 0x7fe5940c7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:55.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.994+0000 7fe592ffd700 1 -- 172.21.15.84:0/2604705536 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe57c009550 con 0x7fe59406a620 2023-09-13T08:24:55.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.994+0000 7fe5937fe700 1 --2- 172.21.15.84:0/2604705536 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe59415d530 0x7fe5940c9570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T08:24:55.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.994+0000 7fe592ffd700 1 --2- 172.21.15.84:0/2604705536 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe59406a620 0x7fe5941576f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe57c014040 tx=0x7fe57c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:55.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.994+0000 7fe58bfff700 1 -- 172.21.15.84:0/2604705536 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe57c004450 con 0x7fe59406a620 2023-09-13T08:24:55.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.994+0000 7fe58bfff700 1 -- 172.21.15.84:0/2604705536 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe57c01e070 con 0x7fe59406a620 2023-09-13T08:24:55.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.994+0000 7fe58bfff700 1 -- 172.21.15.84:0/2604705536 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe57c0038e0 con 0x7fe59406a620 2023-09-13T08:24:55.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.994+0000 7fe5999c0700 1 -- 172.21.15.84:0/2604705536 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5940c7f80 con 0x7fe59406a620 2023-09-13T08:24:55.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.994+0000 7fe5999c0700 1 -- 172.21.15.84:0/2604705536 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5940c77b0 con 0x7fe59406a620 2023-09-13T08:24:55.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.995+0000 7fe5999c0700 1 -- 172.21.15.84:0/2604705536 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe59404e9b0 con 0x7fe59406a620 2023-09-13T08:24:55.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.996+0000 7fe58bfff700 1 -- 172.21.15.84:0/2604705536 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fe57c003a40 con 0x7fe59406a620 2023-09-13T08:24:55.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.996+0000 7fe58bfff700 1 --2- 172.21.15.84:0/2604705536 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fe57406a580 0x7fe57406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:55.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.996+0000 7fe58bfff700 1 -- 172.21.15.84:0/2604705536 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe57c089a80 con 0x7fe59406a620 2023-09-13T08:24:55.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.996+0000 7fe5927fc700 1 --2- 172.21.15.84:0/2604705536 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fe57406a580 0x7fe57406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:55.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:54.997+0000 7fe5927fc700 1 --2- 172.21.15.84:0/2604705536 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fe57406a580 0x7fe57406ca40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe59415af20 tx=0x7fe584009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:55.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.000+0000 7fe58bfff700 1 -- 172.21.15.84:0/2604705536 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fe57c054da0 con 0x7fe59406a620 2023-09-13T08:24:55.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.193+0000 7fe5999c0700 1 -- 172.21.15.84:0/2604705536 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe5940cdc60 con 0x7fe59406a620 2023-09-13T08:24:55.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.194+0000 7fe58bfff700 1 -- 172.21.15.84:0/2604705536 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18322 (secure 0 0 0) 0x7fe57c015090 con 0x7fe59406a620 2023-09-13T08:24:55.194 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:24:55.195 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":24,"fsid":"0107440b-b634-42c5-a643-5d31ea826116","created":"2023-09-13T08:24:16.931917+0000","modified":"2023-09-13T08:24:47.176259+0000","last_up_change":"2023-09-13T08:24:28.422631+0000","last_in_change":"2023-09-13T08:24:19.425578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T08:24:28.583720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-13T08:24:39.862832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-13T08:24:41.145511+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-13T08:24:44.775160+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4a53ec12-1469-4356-b4e1-2b8fc9b7c0f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6817","nonce":1599532366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6819","nonce":1599532366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6823","nonce":1599532366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6821","nonce":1599532366}]},"public_addr":"172.21.15.84:6817/1599532366","cluster_addr":"172.21.15.84:6819/1599532366","heartbeat_back_addr":"172.21.15.84:6823/1599532366","heartbeat_front_addr":"172.21.15.84:6821/1599532366","state":["exists","up"]},{"osd":1,"uuid":"11e964a0-b80c-4afc-bfbf-e2067969db29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6825","nonce":461860977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6827","nonce":461860977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6831","nonce":461860977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6829","nonce":461860977}]},"public_addr":"172.21.15.84:6825/461860977","cluster_addr":"172.21.15.84:6827/461860977","heartbeat_back_addr":"172.21.15.84:6831/461860977","heartbeat_front_addr":"172.21.15.84:6829/461860977","state":["exists","up"]},{"osd":2,"uuid":"3ce74529-4dd1-44c7-9576-968f5fdc0c25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6809","nonce":1168316165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6811","nonce":1168316165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6815","nonce":1168316165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6813","nonce":1168316165}]},"public_addr":"172.21.15.84:6809/1168316165","cluster_addr":"172.21.15.84:6811/1168316165","heartbeat_back_addr":"172.21.15.84:6815/1168316165","heartbeat_front_addr":"172.21.15.84:6813/1168316165","state":["exists","up"]},{"osd":3,"uuid":"460cb5c5-590a-4d06-a4d9-5bac2fdf33b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6801","nonce":1661609810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6803","nonce":1661609810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6807","nonce":1661609810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6805","nonce":1661609810}]},"public_addr":"172.21.15.84:6801/1661609810","cluster_addr":"172.21.15.84:6803/1661609810","heartbeat_back_addr":"172.21.15.84:6807/1661609810","heartbeat_front_addr":"172.21.15.84:6805/1661609810","state":["exists","up"]},{"osd":4,"uuid":"bf237dd0-3ebd-44b5-8078-24a63e00d792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6801","nonce":1303562374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6803","nonce":1303562374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6807","nonce":1303562374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6805","nonce":1303562374}]},"public_addr":"172.21.15.161:6801/1303562374","cluster_addr":"172.21.15.161:6803/1303562374","heartbeat_back_addr":"172.21.15.161:6807/1303562374","heartbeat_front_addr":"172.21.15.161:6805/1303562374","state":["exists","up"]},{"osd":5,"uuid":"e1e538e0-5844-456b-8c6e-434d3a914af1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6818","nonce":961120854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6822","nonce":961120854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6830","nonce":961120854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6826","nonce":961120854}]},"public_addr":"172.21.15.161:6818/961120854","cluster_addr":"172.21.15.161:6822/961120854","heartbeat_back_addr":"172.21.15.161:6830/961120854","heartbeat_front_addr":"172.21.15.161:6826/961120854","state":["exists","up"]},{"osd":6,"uuid":"5cb1785e-960f-4dd4-b295-9e21b2c3f875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6809","nonce":980533466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6811","nonce":980533466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6815","nonce":980533466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6813","nonce":980533466}]},"public_addr":"172.21.15.161:6809/980533466","cluster_addr":"172.21.15.161:6811/980533466","heartbeat_back_addr":"172.21.15.161:6815/980533466","heartbeat_front_addr":"172.21.15.161:6813/980533466","state":["exists","up"]},{"osd":7,"uuid":"5acb6619-e933-4b46-b1c2-60af30acb839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6817","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6819","nonce":2479691549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6821","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6823","nonce":2479691549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6829","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6831","nonce":2479691549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6825","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6827","nonce":2479691549}]},"public_addr":"172.21.15.161:6819/2479691549","cluster_addr":"172.21.15.161:6823/2479691549","heartbeat_back_addr":"172.21.15.161:6831/2479691549","heartbeat_front_addr":"172.21.15.161:6827/2479691549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.678857+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.685341+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.613603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.634940+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.564387+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.697347+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.637437+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.619397+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T08:24:55.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.196+0000 7fe5999c0700 1 -- 172.21.15.84:0/2604705536 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fe57406a580 msgr2=0x7fe57406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:55.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.196+0000 7fe5999c0700 1 --2- 172.21.15.84:0/2604705536 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fe57406a580 0x7fe57406ca40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe59415af20 tx=0x7fe584009210 comp rx=0 tx=0).stop 2023-09-13T08:24:55.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.196+0000 7fe5999c0700 1 -- 172.21.15.84:0/2604705536 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe59406a620 msgr2=0x7fe5941576f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:55.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.196+0000 7fe5999c0700 1 --2- 172.21.15.84:0/2604705536 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe59406a620 0x7fe5941576f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe57c014040 tx=0x7fe57c004750 comp rx=0 tx=0).stop 2023-09-13T08:24:55.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.196+0000 7fe5999c0700 1 -- 172.21.15.84:0/2604705536 shutdown_connections 2023-09-13T08:24:55.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.196+0000 7fe5999c0700 1 --2- 172.21.15.84:0/2604705536 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe59415d530 0x7fe5940c9570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:55.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.196+0000 7fe5999c0700 1 --2- 172.21.15.84:0/2604705536 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe59406a620 0x7fe5941576f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:55.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.196+0000 7fe5999c0700 1 --2- 172.21.15.84:0/2604705536 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fe57406a580 0x7fe57406ca40 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:55.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.196+0000 7fe5999c0700 1 --2- 172.21.15.84:0/2604705536 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe5940ca920 0x7fe5940c7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:55.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.196+0000 7fe5999c0700 1 -- 172.21.15.84:0/2604705536 >> 172.21.15.84:0/2604705536 conn(0x7fe5940d00c0 msgr2=0x7fe5940b3130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:55.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.196+0000 7fe5999c0700 1 -- 172.21.15.84:0/2604705536 shutdown_connections 2023-09-13T08:24:55.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.196+0000 7fe5999c0700 1 -- 172.21.15.84:0/2604705536 wait complete. 2023-09-13T08:24:55.208 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T08:24:28.583720+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-13T08:24:39.862832+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-13T08:24:41.145511+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-09-13T08:24:44.775160+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-13T08:24:55.209 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T08:24:55.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.331+0000 7fd100632700 1 Processor -- start 2023-09-13T08:24:55.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.332+0000 7fd100632700 1 -- start start 2023-09-13T08:24:55.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.332+0000 7fd100632700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd0f8140360 0x7fd0f806a620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:55.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.332+0000 7fd100632700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd0f806ab60 0x7fd0f80ceb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:55.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.332+0000 7fd100632700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0f80ccc50 con 0x7fd0f80cf060 2023-09-13T08:24:55.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.332+0000 7fd100632700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0f80cf470 con 0x7fd0f8140360 2023-09-13T08:24:55.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.332+0000 7fd100632700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0f80ce080 con 0x7fd0f806ab60 2023-09-13T08:24:55.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.333+0000 7fd0fe3ce700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd0f8140360 0x7fd0f806a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:55.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.333+0000 7fd0fe3ce700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd0f8140360 0x7fd0f806a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43530/0 (socket says 172.21.15.84:43530) 2023-09-13T08:24:55.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.333+0000 7fd0fe3ce700 1 -- 172.21.15.84:0/4155004889 learned_addr learned my addr 172.21.15.84:0/4155004889 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:24:55.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.333+0000 7fd0fdbcd700 1 --2- 172.21.15.84:0/4155004889 >> v2:172.21.15.161:3300/0 conn(0x7fd0f806ab60 0x7fd0f80ceb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:55.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.333+0000 7fd0fe3ce700 1 -- 172.21.15.84:0/4155004889 >> v2:172.21.15.161:3300/0 conn(0x7fd0f806ab60 msgr2=0x7fd0f80ceb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:24:55.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.333+0000 7fd0fe3ce700 1 --2- 172.21.15.84:0/4155004889 >> v2:172.21.15.161:3300/0 conn(0x7fd0f806ab60 0x7fd0f80ceb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:55.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.333+0000 7fd0fe3ce700 1 -- 172.21.15.84:0/4155004889 >> v1:172.21.15.161:6789/0 conn(0x7fd0f80cf060 legacy=0x7fd0f8140740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:55.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.333+0000 7fd0fe3ce700 1 -- 172.21.15.84:0/4155004889 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0f80cc690 con 0x7fd0f8140360 2023-09-13T08:24:55.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.333+0000 7fd0fdbcd700 1 --2- 172.21.15.84:0/4155004889 >> v2:172.21.15.161:3300/0 conn(0x7fd0f806ab60 0x7fd0f80ceb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T08:24:55.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.333+0000 7fd0fe3ce700 1 --2- 172.21.15.84:0/4155004889 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0f8140360 0x7fd0f806a620 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd0f80cf670 tx=0x7fd0f4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f9a1073d8f575c8 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:55.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.333+0000 7fd0fd3cc700 1 -- 172.21.15.84:0/4155004889 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f400b870 con 0x7fd0f8140360 2023-09-13T08:24:55.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.333+0000 7fd0fd3cc700 1 -- 172.21.15.84:0/4155004889 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0f400b9d0 con 0x7fd0f8140360 2023-09-13T08:24:55.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.333+0000 7fd0fd3cc700 1 -- 172.21.15.84:0/4155004889 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f400bd60 con 0x7fd0f8140360 2023-09-13T08:24:55.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.334+0000 7fd100632700 1 -- 172.21.15.84:0/4155004889 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0f8140360 msgr2=0x7fd0f806a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:55.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.334+0000 7fd100632700 1 --2- 172.21.15.84:0/4155004889 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0f8140360 0x7fd0f806a620 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd0f80cf670 tx=0x7fd0f4009bd0 comp rx=0 tx=0).stop 2023-09-13T08:24:55.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.334+0000 7fd100632700 1 -- 172.21.15.84:0/4155004889 shutdown_connections 2023-09-13T08:24:55.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.334+0000 7fd100632700 1 --2- 172.21.15.84:0/4155004889 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0f8140360 0x7fd0f806a620 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:55.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.334+0000 7fd100632700 1 --2- 172.21.15.84:0/4155004889 >> v2:172.21.15.161:3300/0 conn(0x7fd0f806ab60 0x7fd0f80ceb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:55.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.334+0000 7fd100632700 1 -- 172.21.15.84:0/4155004889 >> 172.21.15.84:0/4155004889 conn(0x7fd0f80cf8f0 msgr2=0x7fd0f80cfd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:55.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.334+0000 7fd100632700 1 -- 172.21.15.84:0/4155004889 shutdown_connections 2023-09-13T08:24:55.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.334+0000 7fd100632700 1 -- 172.21.15.84:0/4155004889 wait complete. 2023-09-13T08:24:55.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.335+0000 7fd100632700 1 Processor -- start 2023-09-13T08:24:55.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.335+0000 7fd100632700 1 -- start start 2023-09-13T08:24:55.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.336+0000 7fd100632700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd0f806ab60 0x7fd0f81543d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:55.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.336+0000 7fd100632700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0f80cf060 0x7fd0f815ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:55.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.336+0000 7fd100632700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd0f8140360 0x7fd0f8138a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:55.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.336+0000 7fd100632700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f815f630 con 0x7fd0f80cf060 2023-09-13T08:24:55.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.336+0000 7fd100632700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f815ac90 con 0x7fd0f8140360 2023-09-13T08:24:55.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.336+0000 7fd100632700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f815a3a0 con 0x7fd0f806ab60 2023-09-13T08:24:55.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.336+0000 7fd0fdbcd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0f80cf060 0x7fd0f815ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:55.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.336+0000 7fd0fdbcd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0f80cf060 0x7fd0f815ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43536/0 (socket says 172.21.15.84:43536) 2023-09-13T08:24:55.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.336+0000 7fd0fdbcd700 1 -- 172.21.15.84:0/3308635444 learned_addr learned my addr 172.21.15.84:0/3308635444 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:24:55.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.336+0000 7fd0fe3ce700 1 --2- 172.21.15.84:0/3308635444 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd0f806ab60 0x7fd0f81543d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:55.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.336+0000 7fd0febcf700 1 --2- 172.21.15.84:0/3308635444 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd0f8140360 0x7fd0f8138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:55.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.336+0000 7fd0fdbcd700 1 -- 172.21.15.84:0/3308635444 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd0f806ab60 msgr2=0x7fd0f81543d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:55.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.336+0000 7fd0fdbcd700 1 --2- 172.21.15.84:0/3308635444 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd0f806ab60 0x7fd0f81543d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:55.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.336+0000 7fd0fdbcd700 1 -- 172.21.15.84:0/3308635444 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd0f8140360 msgr2=0x7fd0f8138a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:55.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.336+0000 7fd0fdbcd700 1 --2- 172.21.15.84:0/3308635444 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd0f8140360 0x7fd0f8138a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:55.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.336+0000 7fd0fdbcd700 1 -- 172.21.15.84:0/3308635444 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0f4009550 con 0x7fd0f80cf060 2023-09-13T08:24:55.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.336+0000 7fd0fdbcd700 1 --2- 172.21.15.84:0/3308635444 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0f80cf060 0x7fd0f815ece0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd0e800e840 tx=0x7fd0e800eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:55.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.336+0000 7fd0eeffd700 1 -- 172.21.15.84:0/3308635444 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e8004230 con 0x7fd0f80cf060 2023-09-13T08:24:55.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.336+0000 7fd0eeffd700 1 -- 172.21.15.84:0/3308635444 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0e8004390 con 0x7fd0f80cf060 2023-09-13T08:24:55.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.336+0000 7fd0eeffd700 1 -- 172.21.15.84:0/3308635444 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e80036a0 con 0x7fd0f80cf060 2023-09-13T08:24:55.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.336+0000 7fd100632700 1 -- 172.21.15.84:0/3308635444 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0f815a640 con 0x7fd0f80cf060 2023-09-13T08:24:55.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.337+0000 7fd100632700 1 -- 172.21.15.84:0/3308635444 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0f815b120 con 0x7fd0f80cf060 2023-09-13T08:24:55.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.337+0000 7fd100632700 1 -- 172.21.15.84:0/3308635444 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0f804f200 con 0x7fd0f80cf060 2023-09-13T08:24:55.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.338+0000 7fd0eeffd700 1 -- 172.21.15.84:0/3308635444 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fd0e8003800 con 0x7fd0f80cf060 2023-09-13T08:24:55.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.338+0000 7fd0eeffd700 1 --2- 172.21.15.84:0/3308635444 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fd0dc06a580 0x7fd0dc06ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:55.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.338+0000 7fd0eeffd700 1 -- 172.21.15.84:0/3308635444 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd0e80886f0 con 0x7fd0f80cf060 2023-09-13T08:24:55.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.338+0000 7fd0fe3ce700 1 --2- 172.21.15.84:0/3308635444 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fd0dc06a580 0x7fd0dc06ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:55.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.339+0000 7fd0fe3ce700 1 --2- 172.21.15.84:0/3308635444 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fd0dc06a580 0x7fd0dc06ca40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd0f4014040 tx=0x7fd0f4008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:55.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.342+0000 7fd0eeffd700 1 -- 172.21.15.84:0/3308635444 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fd0e8053980 con 0x7fd0f80cf060 2023-09-13T08:24:55.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.532+0000 7fd100632700 1 -- 172.21.15.84:0/3308635444 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd0f80cfee0 con 0x7fd0f80cf060 2023-09-13T08:24:55.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.532+0000 7fd0eeffd700 1 -- 172.21.15.84:0/3308635444 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd0e8056fa0 con 0x7fd0f80cf060 2023-09-13T08:24:55.533 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-09-13T08:24:55.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.534+0000 7fd100632700 1 -- 172.21.15.84:0/3308635444 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fd0dc06a580 msgr2=0x7fd0dc06ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:55.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.534+0000 7fd100632700 1 --2- 172.21.15.84:0/3308635444 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fd0dc06a580 0x7fd0dc06ca40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd0f4014040 tx=0x7fd0f4008030 comp rx=0 tx=0).stop 2023-09-13T08:24:55.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.534+0000 7fd100632700 1 -- 172.21.15.84:0/3308635444 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0f80cf060 msgr2=0x7fd0f815ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:55.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.534+0000 7fd100632700 1 --2- 172.21.15.84:0/3308635444 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0f80cf060 0x7fd0f815ece0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd0e800e840 tx=0x7fd0e800eb50 comp rx=0 tx=0).stop 2023-09-13T08:24:55.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.534+0000 7fd100632700 1 -- 172.21.15.84:0/3308635444 shutdown_connections 2023-09-13T08:24:55.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.534+0000 7fd100632700 1 --2- 172.21.15.84:0/3308635444 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fd0dc06a580 0x7fd0dc06ca40 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:55.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.534+0000 7fd100632700 1 --2- 172.21.15.84:0/3308635444 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd0f8140360 0x7fd0f8138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:55.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.534+0000 7fd100632700 1 --2- 172.21.15.84:0/3308635444 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd0f806ab60 0x7fd0f81543d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:55.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.534+0000 7fd100632700 1 --2- 172.21.15.84:0/3308635444 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0f80cf060 0x7fd0f815ece0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:55.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.535+0000 7fd100632700 1 -- 172.21.15.84:0/3308635444 >> 172.21.15.84:0/3308635444 conn(0x7fd0f80cf8f0 msgr2=0x7fd0f8140740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:55.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.535+0000 7fd100632700 1 -- 172.21.15.84:0/3308635444 shutdown_connections 2023-09-13T08:24:55.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.535+0000 7fd100632700 1 -- 172.21.15.84:0/3308635444 wait complete. 2023-09-13T08:24:55.547 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-13T08:24:55.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.669+0000 7fdc449dc700 1 Processor -- start 2023-09-13T08:24:55.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.669+0000 7fdc449dc700 1 -- start start 2023-09-13T08:24:55.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.670+0000 7fdc449dc700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fdc4006bc00 0x7fdc400b4850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:55.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.670+0000 7fdc449dc700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fdc400ac9d0 0x7fdc4015e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:55.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.670+0000 7fdc449dc700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc400b43c0 con 0x7fdc400ad2c0 2023-09-13T08:24:55.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.670+0000 7fdc449dc700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc4006bfe0 con 0x7fdc400ac9d0 2023-09-13T08:24:55.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.670+0000 7fdc449dc700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc4015e8b0 con 0x7fdc4006bc00 2023-09-13T08:24:55.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.670+0000 7fdc3dd9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fdc400ac9d0 0x7fdc4015e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:55.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.670+0000 7fdc3dd9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fdc400ac9d0 0x7fdc4015e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43544/0 (socket says 172.21.15.84:43544) 2023-09-13T08:24:55.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.670+0000 7fdc3dd9b700 1 -- 172.21.15.84:0/3330670214 learned_addr learned my addr 172.21.15.84:0/3330670214 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:24:55.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.671+0000 7fdc3e59c700 1 --2- 172.21.15.84:0/3330670214 >> v2:172.21.15.161:3300/0 conn(0x7fdc4006bc00 0x7fdc400b4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:55.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.671+0000 7fdc3dd9b700 1 -- 172.21.15.84:0/3330670214 >> v2:172.21.15.161:3300/0 conn(0x7fdc4006bc00 msgr2=0x7fdc400b4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:24:55.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.671+0000 7fdc3dd9b700 1 --2- 172.21.15.84:0/3330670214 >> v2:172.21.15.161:3300/0 conn(0x7fdc4006bc00 0x7fdc400b4850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:55.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.671+0000 7fdc3dd9b700 1 -- 172.21.15.84:0/3330670214 >> v1:172.21.15.161:6789/0 conn(0x7fdc400ad2c0 legacy=0x7fdc4006a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:24:55.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.671+0000 7fdc3dd9b700 1 -- 172.21.15.84:0/3330670214 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc400b37b0 con 0x7fdc400ac9d0 2023-09-13T08:24:55.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.671+0000 7fdc3dd9b700 1 --2- 172.21.15.84:0/3330670214 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc400ac9d0 0x7fdc4015e370 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fdc400b31f0 tx=0x7fdc30009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afa2143eb53896e9 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:55.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.671+0000 7fdc3d59a700 1 -- 172.21.15.84:0/3330670214 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc30004230 con 0x7fdc400ac9d0 2023-09-13T08:24:55.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.671+0000 7fdc3d59a700 1 -- 172.21.15.84:0/3330670214 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc30004390 con 0x7fdc400ac9d0 2023-09-13T08:24:55.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.671+0000 7fdc3d59a700 1 -- 172.21.15.84:0/3330670214 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc300036a0 con 0x7fdc400ac9d0 2023-09-13T08:24:55.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.672+0000 7fdc449dc700 1 -- 172.21.15.84:0/3330670214 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc400ac9d0 msgr2=0x7fdc4015e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:55.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.672+0000 7fdc449dc700 1 --2- 172.21.15.84:0/3330670214 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc400ac9d0 0x7fdc4015e370 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fdc400b31f0 tx=0x7fdc30009bd0 comp rx=0 tx=0).stop 2023-09-13T08:24:55.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.672+0000 7fdc449dc700 1 -- 172.21.15.84:0/3330670214 shutdown_connections 2023-09-13T08:24:55.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.672+0000 7fdc449dc700 1 --2- 172.21.15.84:0/3330670214 >> v2:172.21.15.161:3300/0 conn(0x7fdc4006bc00 0x7fdc400b4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:55.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.672+0000 7fdc449dc700 1 --2- 172.21.15.84:0/3330670214 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc400ac9d0 0x7fdc4015e370 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:55.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.672+0000 7fdc449dc700 1 -- 172.21.15.84:0/3330670214 >> 172.21.15.84:0/3330670214 conn(0x7fdc400cf8f0 msgr2=0x7fdc400cfd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:55.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.672+0000 7fdc449dc700 1 -- 172.21.15.84:0/3330670214 shutdown_connections 2023-09-13T08:24:55.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.672+0000 7fdc449dc700 1 -- 172.21.15.84:0/3330670214 wait complete. 2023-09-13T08:24:55.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.673+0000 7fdc449dc700 1 Processor -- start 2023-09-13T08:24:55.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.673+0000 7fdc449dc700 1 -- start start 2023-09-13T08:24:55.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.674+0000 7fdc449dc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc4006bc00 0x7fdc400b06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:55.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.674+0000 7fdc449dc700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdc400ac9d0 0x7fdc400cc2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:55.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.674+0000 7fdc449dc700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdc400ad2c0 0x7fdc401f2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:55.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.674+0000 7fdc449dc700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc401f3ee0 con 0x7fdc4006bc00 2023-09-13T08:24:55.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.674+0000 7fdc449dc700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc400cbe40 con 0x7fdc400ac9d0 2023-09-13T08:24:55.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.674+0000 7fdc449dc700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc401f3920 con 0x7fdc400ad2c0 2023-09-13T08:24:55.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.674+0000 7fdc3e59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc4006bc00 0x7fdc400b06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:55.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.674+0000 7fdc3e59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc4006bc00 0x7fdc400b06a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43548/0 (socket says 172.21.15.84:43548) 2023-09-13T08:24:55.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.674+0000 7fdc3e59c700 1 -- 172.21.15.84:0/182933639 learned_addr learned my addr 172.21.15.84:0/182933639 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:24:55.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.674+0000 7fdc3dd9b700 1 --2- 172.21.15.84:0/182933639 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdc400ac9d0 0x7fdc400cc2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:55.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.674+0000 7fdc3ed9d700 1 --2- 172.21.15.84:0/182933639 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdc400ad2c0 0x7fdc401f2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:55.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.674+0000 7fdc3e59c700 1 -- 172.21.15.84:0/182933639 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdc400ad2c0 msgr2=0x7fdc401f2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:55.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.674+0000 7fdc3e59c700 1 --2- 172.21.15.84:0/182933639 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdc400ad2c0 0x7fdc401f2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:55.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.674+0000 7fdc3e59c700 1 -- 172.21.15.84:0/182933639 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdc400ac9d0 msgr2=0x7fdc400cc2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:55.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.674+0000 7fdc3e59c700 1 --2- 172.21.15.84:0/182933639 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdc400ac9d0 0x7fdc400cc2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:55.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.674+0000 7fdc3e59c700 1 -- 172.21.15.84:0/182933639 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc30009550 con 0x7fdc4006bc00 2023-09-13T08:24:55.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.674+0000 7fdc3e59c700 1 --2- 172.21.15.84:0/182933639 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc4006bc00 0x7fdc400b06a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fdc3400e810 tx=0x7fdc3400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:55.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.674+0000 7fdc2effd700 1 -- 172.21.15.84:0/182933639 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc34013610 con 0x7fdc4006bc00 2023-09-13T08:24:55.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.674+0000 7fdc2effd700 1 -- 172.21.15.84:0/182933639 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc34013770 con 0x7fdc4006bc00 2023-09-13T08:24:55.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.674+0000 7fdc2effd700 1 -- 172.21.15.84:0/182933639 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc34013b20 con 0x7fdc4006bc00 2023-09-13T08:24:55.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.674+0000 7fdc449dc700 1 -- 172.21.15.84:0/182933639 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc401f3c00 con 0x7fdc4006bc00 2023-09-13T08:24:55.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.675+0000 7fdc449dc700 1 -- 172.21.15.84:0/182933639 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc400cd740 con 0x7fdc4006bc00 2023-09-13T08:24:55.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.675+0000 7fdc449dc700 1 -- 172.21.15.84:0/182933639 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc400cb930 con 0x7fdc4006bc00 2023-09-13T08:24:55.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.676+0000 7fdc2effd700 1 -- 172.21.15.84:0/182933639 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fdc34013c80 con 0x7fdc4006bc00 2023-09-13T08:24:55.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.676+0000 7fdc2effd700 1 --2- 172.21.15.84:0/182933639 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fdc2006a580 0x7fdc2006ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:55.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.676+0000 7fdc2effd700 1 -- 172.21.15.84:0/182933639 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fdc340889c0 con 0x7fdc4006bc00 2023-09-13T08:24:55.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.676+0000 7fdc3dd9b700 1 --2- 172.21.15.84:0/182933639 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fdc2006a580 0x7fdc2006ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:55.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.677+0000 7fdc3dd9b700 1 --2- 172.21.15.84:0/182933639 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fdc2006a580 0x7fdc2006ca40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fdc400b31f0 tx=0x7fdc30008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:55.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.680+0000 7fdc2effd700 1 -- 172.21.15.84:0/182933639 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fdc400cb930 con 0x7fdc4006bc00 2023-09-13T08:24:55.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.869+0000 7fdc449dc700 1 -- 172.21.15.84:0/182933639 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdc400cb930 con 0x7fdc4006bc00 2023-09-13T08:24:55.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.869+0000 7fdc2effd700 1 -- 172.21.15.84:0/182933639 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdc400cb930 con 0x7fdc4006bc00 2023-09-13T08:24:55.870 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-09-13T08:24:55.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.871+0000 7fdc449dc700 1 -- 172.21.15.84:0/182933639 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fdc2006a580 msgr2=0x7fdc2006ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:55.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.871+0000 7fdc449dc700 1 --2- 172.21.15.84:0/182933639 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fdc2006a580 0x7fdc2006ca40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fdc400b31f0 tx=0x7fdc30008030 comp rx=0 tx=0).stop 2023-09-13T08:24:55.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.871+0000 7fdc449dc700 1 -- 172.21.15.84:0/182933639 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc4006bc00 msgr2=0x7fdc400b06a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:55.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.871+0000 7fdc449dc700 1 --2- 172.21.15.84:0/182933639 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc4006bc00 0x7fdc400b06a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fdc3400e810 tx=0x7fdc3400eb20 comp rx=0 tx=0).stop 2023-09-13T08:24:55.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.871+0000 7fdc449dc700 1 -- 172.21.15.84:0/182933639 shutdown_connections 2023-09-13T08:24:55.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.871+0000 7fdc449dc700 1 --2- 172.21.15.84:0/182933639 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdc400ad2c0 0x7fdc401f2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:55.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.871+0000 7fdc449dc700 1 --2- 172.21.15.84:0/182933639 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc4006bc00 0x7fdc400b06a0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:55.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.871+0000 7fdc449dc700 1 --2- 172.21.15.84:0/182933639 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fdc2006a580 0x7fdc2006ca40 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:55.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.871+0000 7fdc449dc700 1 --2- 172.21.15.84:0/182933639 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdc400ac9d0 0x7fdc400cc2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:55.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.871+0000 7fdc449dc700 1 -- 172.21.15.84:0/182933639 >> 172.21.15.84:0/182933639 conn(0x7fdc400cf8f0 msgr2=0x7fdc40070ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:55.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.871+0000 7fdc449dc700 1 -- 172.21.15.84:0/182933639 shutdown_connections 2023-09-13T08:24:55.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:55.871+0000 7fdc449dc700 1 -- 172.21.15.84:0/182933639 wait complete. 2023-09-13T08:24:55.883 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-13T08:24:56.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.005+0000 7f672625f700 1 Processor -- start 2023-09-13T08:24:56.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.006+0000 7f672625f700 1 -- start start 2023-09-13T08:24:56.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.006+0000 7f672625f700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f67200b8d50 0x7f6720160ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:56.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.006+0000 7f672625f700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f672015d950 con 0x7f67200d0340 2023-09-13T08:24:56.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.006+0000 7f672625f700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67200b91a0 con 0x7f672015d570 2023-09-13T08:24:56.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.006+0000 7f672625f700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67201616f0 con 0x7f67200b8d50 2023-09-13T08:24:56.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.006+0000 7f671effd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f67200d0340 0x7f67200d1c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:46204/0 (socket says 172.21.15.84:46204) 2023-09-13T08:24:56.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.006+0000 7f671effd700 1 -- 172.21.15.84:0/515696373 learned_addr learned my addr 172.21.15.84:0/515696373 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:24:56.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.007+0000 7f671ffff700 1 --2- 172.21.15.84:0/515696373 >> v2:172.21.15.161:3300/0 conn(0x7f67200b8d50 0x7f6720160ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:56.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.007+0000 7f671e7fc700 1 -- 172.21.15.84:0/515696373 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 957208235 0 0) 0x7f6708001110 con 0x7f67200d0340 2023-09-13T08:24:56.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.007+0000 7f671e7fc700 1 -- 172.21.15.84:0/515696373 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f670c0035b0 con 0x7f67200d0340 2023-09-13T08:24:56.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.007+0000 7f671e7fc700 1 -- 172.21.15.84:0/515696373 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4203919138 0 0) 0x7f670c0035b0 con 0x7f67200d0340 2023-09-13T08:24:56.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.007+0000 7f671e7fc700 1 -- 172.21.15.84:0/515696373 >> v2:172.21.15.161:3300/0 conn(0x7f67200b8d50 msgr2=0x7f6720160ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:24:56.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.007+0000 7f671e7fc700 1 --2- 172.21.15.84:0/515696373 >> v2:172.21.15.161:3300/0 conn(0x7f67200b8d50 0x7f6720160ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:56.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.007+0000 7f671e7fc700 1 -- 172.21.15.84:0/515696373 >> v1:172.21.15.161:6789/0 conn(0x7f672015d570 legacy=0x7f67200cfc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:56.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.007+0000 7f671e7fc700 1 -- 172.21.15.84:0/515696373 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67201619d0 con 0x7f67200d0340 2023-09-13T08:24:56.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.007+0000 7f671e7fc700 1 -- 172.21.15.84:0/515696373 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2302733408 0 0) 0x7f6708001800 con 0x7f67200d0340 2023-09-13T08:24:56.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.007+0000 7f671e7fc700 1 -- 172.21.15.84:0/515696373 >> v1:172.21.15.84:6789/0 conn(0x7f67200d0340 legacy=0x7f67200d1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:56.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.007+0000 7f671e7fc700 1 --2- 172.21.15.84:0/515696373 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f670c003a00 0x7f670c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:56.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.007+0000 7f671e7fc700 1 --2- 172.21.15.84:0/515696373 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f670c004850 0x7f670c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:56.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.007+0000 7f671e7fc700 1 --2- 172.21.15.84:0/515696373 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f670c005210 0x7f670c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:56.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.007+0000 7f671e7fc700 1 -- 172.21.15.84:0/515696373 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67201616f0 con 0x7f670c003a00 2023-09-13T08:24:56.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.007+0000 7f671e7fc700 1 -- 172.21.15.84:0/515696373 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f670c00c0b0 con 0x7f670c005210 2023-09-13T08:24:56.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.007+0000 7f671e7fc700 1 -- 172.21.15.84:0/515696373 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f670c00c270 con 0x7f670c004850 2023-09-13T08:24:56.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.007+0000 7f671f7fe700 1 --2- 172.21.15.84:0/515696373 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f670c003a00 0x7f670c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:56.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.007+0000 7f671effd700 1 --2- 172.21.15.84:0/515696373 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f670c004850 0x7f670c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:56.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.007+0000 7f671ffff700 1 --2- 172.21.15.84:0/515696373 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f670c005210 0x7f670c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:56.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.007+0000 7f671f7fe700 1 -- 172.21.15.84:0/515696373 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f670c004850 msgr2=0x7f670c004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:24:56.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.007+0000 7f671f7fe700 1 --2- 172.21.15.84:0/515696373 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f670c004850 0x7f670c004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:56.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.007+0000 7f671f7fe700 1 -- 172.21.15.84:0/515696373 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f670c005210 msgr2=0x7f670c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:24:56.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.007+0000 7f671f7fe700 1 --2- 172.21.15.84:0/515696373 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f670c005210 0x7f670c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:56.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.007+0000 7f671f7fe700 1 -- 172.21.15.84:0/515696373 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f670c0035b0 con 0x7f670c003a00 2023-09-13T08:24:56.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.007+0000 7f671effd700 1 --2- 172.21.15.84:0/515696373 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f670c004850 0x7f670c004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T08:24:56.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.007+0000 7f671ffff700 1 --2- 172.21.15.84:0/515696373 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f670c005210 0x7f670c00ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T08:24:56.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.007+0000 7f671ffff700 1 -- 172.21.15.84:0/515696373 reap_dead start 2023-09-13T08:24:56.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.008+0000 7f671f7fe700 1 --2- 172.21.15.84:0/515696373 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f670c003a00 0x7f670c003e20 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6710001800 tx=0x7f670c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc5273e92129d2f4 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:56.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.008+0000 7f671e7fc700 1 -- 172.21.15.84:0/515696373 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67100012f0 con 0x7f670c003a00 2023-09-13T08:24:56.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.008+0000 7f671e7fc700 1 -- 172.21.15.84:0/515696373 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6710005310 con 0x7f670c003a00 2023-09-13T08:24:56.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.008+0000 7f671e7fc700 1 -- 172.21.15.84:0/515696373 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6710006860 con 0x7f670c003a00 2023-09-13T08:24:56.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.008+0000 7f672625f700 1 -- 172.21.15.84:0/515696373 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f670c003a00 msgr2=0x7f670c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:56.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.008+0000 7f672625f700 1 --2- 172.21.15.84:0/515696373 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f670c003a00 0x7f670c003e20 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6710001800 tx=0x7f670c005880 comp rx=0 tx=0).stop 2023-09-13T08:24:56.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.008+0000 7f672625f700 1 -- 172.21.15.84:0/515696373 shutdown_connections 2023-09-13T08:24:56.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.008+0000 7f672625f700 1 --2- 172.21.15.84:0/515696373 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f670c003a00 0x7f670c003e20 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:56.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.008+0000 7f672625f700 1 -- 172.21.15.84:0/515696373 >> 172.21.15.84:0/515696373 conn(0x7f672006b0d0 msgr2=0x7f672006b4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:56.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.008+0000 7f672625f700 1 -- 172.21.15.84:0/515696373 shutdown_connections 2023-09-13T08:24:56.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.008+0000 7f672625f700 1 -- 172.21.15.84:0/515696373 wait complete. 2023-09-13T08:24:56.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.009+0000 7f672625f700 1 Processor -- start 2023-09-13T08:24:56.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.010+0000 7f672625f700 1 -- start start 2023-09-13T08:24:56.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.010+0000 7f672625f700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f670c003a00 0x7f6720159090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:56.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.010+0000 7f672625f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6720142fd0 0x7f67201f6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:56.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.010+0000 7f672625f700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f67200b7ad0 0x7f67201f20d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:56.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.010+0000 7f672625f700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6720143fc0 con 0x7f6720142fd0 2023-09-13T08:24:56.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.010+0000 7f672625f700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67201f7110 con 0x7f670c003a00 2023-09-13T08:24:56.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.010+0000 7f672625f700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6720143450 con 0x7f67200b7ad0 2023-09-13T08:24:56.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.010+0000 7f671effd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6720142fd0 0x7f67201f6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:56.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.011+0000 7f671effd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6720142fd0 0x7f67201f6bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43570/0 (socket says 172.21.15.84:43570) 2023-09-13T08:24:56.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.011+0000 7f671effd700 1 -- 172.21.15.84:0/3359232203 learned_addr learned my addr 172.21.15.84:0/3359232203 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:24:56.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.011+0000 7f671f7fe700 1 --2- 172.21.15.84:0/3359232203 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f670c003a00 0x7f6720159090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:56.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.011+0000 7f671ffff700 1 --2- 172.21.15.84:0/3359232203 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f67200b7ad0 0x7f67201f20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:56.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.011+0000 7f671effd700 1 -- 172.21.15.84:0/3359232203 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f67200b7ad0 msgr2=0x7f67201f20d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:56.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.011+0000 7f671effd700 1 --2- 172.21.15.84:0/3359232203 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f67200b7ad0 0x7f67201f20d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:56.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.011+0000 7f671effd700 1 -- 172.21.15.84:0/3359232203 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f670c003a00 msgr2=0x7f6720159090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:56.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.011+0000 7f671effd700 1 --2- 172.21.15.84:0/3359232203 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f670c003a00 0x7f6720159090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:56.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.011+0000 7f671effd700 1 -- 172.21.15.84:0/3359232203 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6720143720 con 0x7f6720142fd0 2023-09-13T08:24:56.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.011+0000 7f671f7fe700 1 --2- 172.21.15.84:0/3359232203 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f670c003a00 0x7f6720159090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T08:24:56.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.011+0000 7f671ffff700 1 --2- 172.21.15.84:0/3359232203 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f67200b7ad0 0x7f67201f20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T08:24:56.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.011+0000 7f671effd700 1 --2- 172.21.15.84:0/3359232203 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6720142fd0 0x7f67201f6bd0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6708007fd0 tx=0x7f67080073e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:56.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.011+0000 7f6717fff700 1 -- 172.21.15.84:0/3359232203 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6708012590 con 0x7f6720142fd0 2023-09-13T08:24:56.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.011+0000 7f6717fff700 1 -- 172.21.15.84:0/3359232203 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67080126f0 con 0x7f6720142fd0 2023-09-13T08:24:56.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.011+0000 7f6717fff700 1 -- 172.21.15.84:0/3359232203 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6708012a60 con 0x7f6720142fd0 2023-09-13T08:24:56.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.011+0000 7f672625f700 1 -- 172.21.15.84:0/3359232203 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6720143a00 con 0x7f6720142fd0 2023-09-13T08:24:56.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.011+0000 7f672625f700 1 -- 172.21.15.84:0/3359232203 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67200c8950 con 0x7f6720142fd0 2023-09-13T08:24:56.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.012+0000 7f672625f700 1 -- 172.21.15.84:0/3359232203 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67200c87b0 con 0x7f6720142fd0 2023-09-13T08:24:56.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.013+0000 7f6717fff700 1 -- 172.21.15.84:0/3359232203 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f6708012bc0 con 0x7f6720142fd0 2023-09-13T08:24:56.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.013+0000 7f6717fff700 1 --2- 172.21.15.84:0/3359232203 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f670006a580 0x7f670006ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:56.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.013+0000 7f6717fff700 1 -- 172.21.15.84:0/3359232203 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f67080889f0 con 0x7f6720142fd0 2023-09-13T08:24:56.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.013+0000 7f671f7fe700 1 --2- 172.21.15.84:0/3359232203 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f670006a580 0x7f670006ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:56.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.013+0000 7f671f7fe700 1 --2- 172.21.15.84:0/3359232203 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f670006a580 0x7f670006ca40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6710001800 tx=0x7f6710009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:56.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.017+0000 7f6717fff700 1 -- 172.21.15.84:0/3359232203 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f67200c87b0 con 0x7f6720142fd0 2023-09-13T08:24:56.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.208+0000 7f672625f700 1 -- 172.21.15.84:0/3359232203 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f672015d950 con 0x7f6720142fd0 2023-09-13T08:24:56.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.208+0000 7f6717fff700 1 -- 172.21.15.84:0/3359232203 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f672015d950 con 0x7f6720142fd0 2023-09-13T08:24:56.209 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-09-13T08:24:56.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.210+0000 7f672625f700 1 -- 172.21.15.84:0/3359232203 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f670006a580 msgr2=0x7f670006ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:56.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.210+0000 7f672625f700 1 --2- 172.21.15.84:0/3359232203 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f670006a580 0x7f670006ca40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6710001800 tx=0x7f6710009030 comp rx=0 tx=0).stop 2023-09-13T08:24:56.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.210+0000 7f672625f700 1 -- 172.21.15.84:0/3359232203 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6720142fd0 msgr2=0x7f67201f6bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:56.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.210+0000 7f672625f700 1 --2- 172.21.15.84:0/3359232203 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6720142fd0 0x7f67201f6bd0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6708007fd0 tx=0x7f67080073e0 comp rx=0 tx=0).stop 2023-09-13T08:24:56.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.210+0000 7f672625f700 1 -- 172.21.15.84:0/3359232203 shutdown_connections 2023-09-13T08:24:56.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.210+0000 7f672625f700 1 --2- 172.21.15.84:0/3359232203 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f67200b7ad0 0x7f67201f20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:56.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.210+0000 7f672625f700 1 --2- 172.21.15.84:0/3359232203 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f670006a580 0x7f670006ca40 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:56.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.210+0000 7f672625f700 1 --2- 172.21.15.84:0/3359232203 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f670c003a00 0x7f6720159090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:56.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.210+0000 7f672625f700 1 --2- 172.21.15.84:0/3359232203 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6720142fd0 0x7f67201f6bd0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:56.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.210+0000 7f672625f700 1 -- 172.21.15.84:0/3359232203 >> 172.21.15.84:0/3359232203 conn(0x7f672006b0d0 msgr2=0x7f672015db80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:56.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.210+0000 7f672625f700 1 -- 172.21.15.84:0/3359232203 shutdown_connections 2023-09-13T08:24:56.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.210+0000 7f672625f700 1 -- 172.21.15.84:0/3359232203 wait complete. 2023-09-13T08:24:56.222 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-09-13T08:24:56.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.344+0000 7f2e3f5d2700 1 Processor -- start 2023-09-13T08:24:56.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.345+0000 7f2e3f5d2700 1 -- start start 2023-09-13T08:24:56.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.345+0000 7f2e3f5d2700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2e380cd590 0x7f2e380cf570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:56.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.345+0000 7f2e3f5d2700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e3815e480 con 0x7f2e380ca8e0 2023-09-13T08:24:56.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.345+0000 7f2e3f5d2700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e380cfbe0 con 0x7f2e3815e910 2023-09-13T08:24:56.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.345+0000 7f2e3f5d2700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e3815de30 con 0x7f2e380cd590 2023-09-13T08:24:56.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.345+0000 7f2e3db6f700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2e380cd590 0x7f2e380cf570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:56.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.345+0000 7f2e3db6f700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2e380cd590 0x7f2e380cf570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43580/0 (socket says 172.21.15.84:43580) 2023-09-13T08:24:56.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.345+0000 7f2e3db6f700 1 -- 172.21.15.84:0/57518198 learned_addr learned my addr 172.21.15.84:0/57518198 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:24:56.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.346+0000 7f2e3db6f700 1 -- 172.21.15.84:0/57518198 >> v1:172.21.15.161:6789/0 conn(0x7f2e3815e910 legacy=0x7f2e380cdbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:24:56.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.346+0000 7f2e3db6f700 1 -- 172.21.15.84:0/57518198 >> v1:172.21.15.84:6789/0 conn(0x7f2e380ca8e0 legacy=0x7f2e380cacc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:56.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.346+0000 7f2e2ffff700 1 -- 172.21.15.84:0/57518198 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2813591473 0 0) 0x7f2e3815e480 con 0x7f2e380ca8e0 2023-09-13T08:24:56.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.346+0000 7f2e3db6f700 1 -- 172.21.15.84:0/57518198 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e3815e110 con 0x7f2e380cd590 2023-09-13T08:24:56.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.346+0000 7f2e3db6f700 1 --2- 172.21.15.84:0/57518198 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e380cd590 0x7f2e380cf570 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2e30009e50 tx=0x7f2e3000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bc919cb10560c7c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:56.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.346+0000 7f2e2ffff700 1 -- 172.21.15.84:0/57518198 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e3000e070 con 0x7f2e380cd590 2023-09-13T08:24:56.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.346+0000 7f2e2ffff700 1 -- 172.21.15.84:0/57518198 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e30003a20 con 0x7f2e380cd590 2023-09-13T08:24:56.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.346+0000 7f2e2ffff700 1 -- 172.21.15.84:0/57518198 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e30003dd0 con 0x7f2e380cd590 2023-09-13T08:24:56.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.347+0000 7f2e3f5d2700 1 -- 172.21.15.84:0/57518198 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e380cd590 msgr2=0x7f2e380cf570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:56.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.347+0000 7f2e3f5d2700 1 --2- 172.21.15.84:0/57518198 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e380cd590 0x7f2e380cf570 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2e30009e50 tx=0x7f2e3000b330 comp rx=0 tx=0).stop 2023-09-13T08:24:56.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.347+0000 7f2e3f5d2700 1 -- 172.21.15.84:0/57518198 shutdown_connections 2023-09-13T08:24:56.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.347+0000 7f2e3f5d2700 1 --2- 172.21.15.84:0/57518198 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e380cd590 0x7f2e380cf570 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:56.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.347+0000 7f2e3f5d2700 1 -- 172.21.15.84:0/57518198 >> 172.21.15.84:0/57518198 conn(0x7f2e380cca70 msgr2=0x7f2e380cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:56.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.347+0000 7f2e3f5d2700 1 -- 172.21.15.84:0/57518198 shutdown_connections 2023-09-13T08:24:56.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.347+0000 7f2e3f5d2700 1 -- 172.21.15.84:0/57518198 wait complete. 2023-09-13T08:24:56.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.348+0000 7f2e3f5d2700 1 Processor -- start 2023-09-13T08:24:56.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.348+0000 7f2e3f5d2700 1 -- start start 2023-09-13T08:24:56.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.349+0000 7f2e3f5d2700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2e380ca8e0 0x7f2e380c66a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:56.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.349+0000 7f2e3f5d2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e380cd590 0x7f2e38152f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:56.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.349+0000 7f2e3f5d2700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2e3815e910 0x7f2e3814f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:56.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.349+0000 7f2e3f5d2700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e380c6210 con 0x7f2e380cd590 2023-09-13T08:24:56.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.349+0000 7f2e3f5d2700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e38153460 con 0x7f2e3815e910 2023-09-13T08:24:56.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.349+0000 7f2e3f5d2700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e3814fea0 con 0x7f2e380ca8e0 2023-09-13T08:24:56.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.349+0000 7f2e3cb6d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e380cd590 0x7f2e38152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:56.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.349+0000 7f2e3cb6d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e380cd590 0x7f2e38152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43584/0 (socket says 172.21.15.84:43584) 2023-09-13T08:24:56.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.349+0000 7f2e3cb6d700 1 -- 172.21.15.84:0/3718195752 learned_addr learned my addr 172.21.15.84:0/3718195752 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:24:56.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.349+0000 7f2e3db6f700 1 --2- 172.21.15.84:0/3718195752 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2e3815e910 0x7f2e3814f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:56.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.349+0000 7f2e3d36e700 1 --2- 172.21.15.84:0/3718195752 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2e380ca8e0 0x7f2e380c66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:56.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.349+0000 7f2e3cb6d700 1 -- 172.21.15.84:0/3718195752 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2e380ca8e0 msgr2=0x7f2e380c66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:56.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.349+0000 7f2e3cb6d700 1 --2- 172.21.15.84:0/3718195752 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2e380ca8e0 0x7f2e380c66a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:56.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.349+0000 7f2e3cb6d700 1 -- 172.21.15.84:0/3718195752 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2e3815e910 msgr2=0x7f2e3814f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:56.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.349+0000 7f2e3cb6d700 1 --2- 172.21.15.84:0/3718195752 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2e3815e910 0x7f2e3814f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:56.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.349+0000 7f2e3cb6d700 1 -- 172.21.15.84:0/3718195752 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e30009b30 con 0x7f2e380cd590 2023-09-13T08:24:56.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.349+0000 7f2e3db6f700 1 --2- 172.21.15.84:0/3718195752 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2e3815e910 0x7f2e3814f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T08:24:56.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.349+0000 7f2e3cb6d700 1 --2- 172.21.15.84:0/3718195752 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e380cd590 0x7f2e38152f20 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2e3400b410 tx=0x7f2e3400b7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:56.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.349+0000 7f2e2dffb700 1 -- 172.21.15.84:0/3718195752 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e34011830 con 0x7f2e380cd590 2023-09-13T08:24:56.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.349+0000 7f2e2dffb700 1 -- 172.21.15.84:0/3718195752 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e34011990 con 0x7f2e380cd590 2023-09-13T08:24:56.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.349+0000 7f2e2dffb700 1 -- 172.21.15.84:0/3718195752 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e34011d40 con 0x7f2e380cd590 2023-09-13T08:24:56.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.349+0000 7f2e3f5d2700 1 -- 172.21.15.84:0/3718195752 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e380c5600 con 0x7f2e380cd590 2023-09-13T08:24:56.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.350+0000 7f2e3f5d2700 1 -- 172.21.15.84:0/3718195752 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e380c5bc0 con 0x7f2e380cd590 2023-09-13T08:24:56.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.351+0000 7f2e3f5d2700 1 -- 172.21.15.84:0/3718195752 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e380c6380 con 0x7f2e380cd590 2023-09-13T08:24:56.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.351+0000 7f2e2dffb700 1 -- 172.21.15.84:0/3718195752 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f2e3401a400 con 0x7f2e380cd590 2023-09-13T08:24:56.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.351+0000 7f2e2dffb700 1 --2- 172.21.15.84:0/3718195752 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f2e1c06a580 0x7f2e1c06ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:56.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.351+0000 7f2e2dffb700 1 -- 172.21.15.84:0/3718195752 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2e34088bd0 con 0x7f2e380cd590 2023-09-13T08:24:56.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.351+0000 7f2e3d36e700 1 --2- 172.21.15.84:0/3718195752 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f2e1c06a580 0x7f2e1c06ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:56.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.352+0000 7f2e3d36e700 1 --2- 172.21.15.84:0/3718195752 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f2e1c06a580 0x7f2e1c06ca40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2e28000f60 tx=0x7f2e28009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:56.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.356+0000 7f2e2dffb700 1 -- 172.21.15.84:0/3718195752 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f2e34053ef0 con 0x7f2e380cd590 2023-09-13T08:24:56.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.544+0000 7f2e3f5d2700 1 -- 172.21.15.84:0/3718195752 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f2e3804f200 con 0x7f2e380cd590 2023-09-13T08:24:56.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.544+0000 7f2e2dffb700 1 -- 172.21.15.84:0/3718195752 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7f2e34057510 con 0x7f2e380cd590 2023-09-13T08:24:56.544 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-09-13T08:24:56.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.546+0000 7f2e3f5d2700 1 -- 172.21.15.84:0/3718195752 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f2e1c06a580 msgr2=0x7f2e1c06ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:56.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.546+0000 7f2e3f5d2700 1 --2- 172.21.15.84:0/3718195752 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f2e1c06a580 0x7f2e1c06ca40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2e28000f60 tx=0x7f2e28009040 comp rx=0 tx=0).stop 2023-09-13T08:24:56.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.546+0000 7f2e3f5d2700 1 -- 172.21.15.84:0/3718195752 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e380cd590 msgr2=0x7f2e38152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:56.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.546+0000 7f2e3f5d2700 1 --2- 172.21.15.84:0/3718195752 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e380cd590 0x7f2e38152f20 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2e3400b410 tx=0x7f2e3400b7d0 comp rx=0 tx=0).stop 2023-09-13T08:24:56.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.546+0000 7f2e3f5d2700 1 -- 172.21.15.84:0/3718195752 shutdown_connections 2023-09-13T08:24:56.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.546+0000 7f2e3f5d2700 1 --2- 172.21.15.84:0/3718195752 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f2e1c06a580 0x7f2e1c06ca40 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:56.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.546+0000 7f2e3f5d2700 1 --2- 172.21.15.84:0/3718195752 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2e3815e910 0x7f2e3814f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:56.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.546+0000 7f2e3f5d2700 1 --2- 172.21.15.84:0/3718195752 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2e380ca8e0 0x7f2e380c66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:56.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.546+0000 7f2e3f5d2700 1 --2- 172.21.15.84:0/3718195752 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e380cd590 0x7f2e38152f20 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:56.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.546+0000 7f2e3f5d2700 1 -- 172.21.15.84:0/3718195752 >> 172.21.15.84:0/3718195752 conn(0x7f2e380cca70 msgr2=0x7f2e3815ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:56.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.546+0000 7f2e3f5d2700 1 -- 172.21.15.84:0/3718195752 shutdown_connections 2023-09-13T08:24:56.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.546+0000 7f2e3f5d2700 1 -- 172.21.15.84:0/3718195752 wait complete. 2023-09-13T08:24:56.558 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-09-13T08:24:56.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.679+0000 7ffa948f5700 1 Processor -- start 2023-09-13T08:24:56.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.679+0000 7ffa948f5700 1 -- start start 2023-09-13T08:24:56.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.680+0000 7ffa948f5700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ffa900d0bf0 0x7ffa900af5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:56.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.680+0000 7ffa948f5700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa90161500 con 0x7ffa9006a620 2023-09-13T08:24:56.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.680+0000 7ffa948f5700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa9006ebc0 con 0x7ffa9015d720 2023-09-13T08:24:56.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.680+0000 7ffa948f5700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa9006f180 con 0x7ffa900d0bf0 2023-09-13T08:24:56.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.680+0000 7ffa8ed9d700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7ffa9006a620 0x7ffa9006d2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:46240/0 (socket says 172.21.15.84:46240) 2023-09-13T08:24:56.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.680+0000 7ffa8ed9d700 1 -- 172.21.15.84:0/1482676605 learned_addr learned my addr 172.21.15.84:0/1482676605 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:24:56.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.680+0000 7ffa8dd9b700 1 --2- 172.21.15.84:0/1482676605 >> v2:172.21.15.161:3300/0 conn(0x7ffa900d0bf0 0x7ffa900af5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:56.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.680+0000 7ffa8d59a700 1 -- 172.21.15.84:0/1482676605 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1077296748 0 0) 0x7ffa90161500 con 0x7ffa9006a620 2023-09-13T08:24:56.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.680+0000 7ffa8d59a700 1 -- 172.21.15.84:0/1482676605 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa780035b0 con 0x7ffa9006a620 2023-09-13T08:24:56.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.681+0000 7ffa8d59a700 1 -- 172.21.15.84:0/1482676605 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3011006577 0 0) 0x7ffa780035b0 con 0x7ffa9006a620 2023-09-13T08:24:56.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.681+0000 7ffa8d59a700 1 -- 172.21.15.84:0/1482676605 >> v2:172.21.15.161:3300/0 conn(0x7ffa900d0bf0 msgr2=0x7ffa900af5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:24:56.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.681+0000 7ffa8d59a700 1 --2- 172.21.15.84:0/1482676605 >> v2:172.21.15.161:3300/0 conn(0x7ffa900d0bf0 0x7ffa900af5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:56.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.681+0000 7ffa8d59a700 1 -- 172.21.15.84:0/1482676605 >> v1:172.21.15.161:6789/0 conn(0x7ffa9015d720 legacy=0x7ffa90161990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:56.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.681+0000 7ffa8d59a700 1 -- 172.21.15.84:0/1482676605 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa9006eea0 con 0x7ffa9006a620 2023-09-13T08:24:56.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.681+0000 7ffa8d59a700 1 -- 172.21.15.84:0/1482676605 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2302733408 0 0) 0x7ffa880019f0 con 0x7ffa9006a620 2023-09-13T08:24:56.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.681+0000 7ffa8d59a700 1 -- 172.21.15.84:0/1482676605 >> v1:172.21.15.84:6789/0 conn(0x7ffa9006a620 legacy=0x7ffa9006d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:56.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.681+0000 7ffa8d59a700 1 --2- 172.21.15.84:0/1482676605 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ffa78003a00 0x7ffa78003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:56.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.681+0000 7ffa8d59a700 1 --2- 172.21.15.84:0/1482676605 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa78004850 0x7ffa78004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:56.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.681+0000 7ffa8d59a700 1 --2- 172.21.15.84:0/1482676605 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffa78005210 0x7ffa7800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:56.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.681+0000 7ffa8d59a700 1 -- 172.21.15.84:0/1482676605 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9006f180 con 0x7ffa78004850 2023-09-13T08:24:56.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.681+0000 7ffa8d59a700 1 -- 172.21.15.84:0/1482676605 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7800c0b0 con 0x7ffa78005210 2023-09-13T08:24:56.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.681+0000 7ffa8d59a700 1 -- 172.21.15.84:0/1482676605 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7800c270 con 0x7ffa78003a00 2023-09-13T08:24:56.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.681+0000 7ffa8dd9b700 1 --2- 172.21.15.84:0/1482676605 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa78004850 0x7ffa78004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:56.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.681+0000 7ffa8e59c700 1 --2- 172.21.15.84:0/1482676605 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ffa78003a00 0x7ffa78003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:56.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.681+0000 7ffa8ed9d700 1 --2- 172.21.15.84:0/1482676605 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffa78005210 0x7ffa7800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:56.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.681+0000 7ffa8dd9b700 1 -- 172.21.15.84:0/1482676605 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ffa78003a00 msgr2=0x7ffa78003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:24:56.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.681+0000 7ffa8dd9b700 1 --2- 172.21.15.84:0/1482676605 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ffa78003a00 0x7ffa78003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:56.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.681+0000 7ffa8dd9b700 1 -- 172.21.15.84:0/1482676605 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffa78005210 msgr2=0x7ffa7800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:24:56.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.681+0000 7ffa8dd9b700 1 --2- 172.21.15.84:0/1482676605 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffa78005210 0x7ffa7800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:56.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.681+0000 7ffa8dd9b700 1 -- 172.21.15.84:0/1482676605 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa780035b0 con 0x7ffa78004850 2023-09-13T08:24:56.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.681+0000 7ffa8ed9d700 1 --2- 172.21.15.84:0/1482676605 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffa78005210 0x7ffa7800ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T08:24:56.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.681+0000 7ffa8ed9d700 1 -- 172.21.15.84:0/1482676605 reap_dead start 2023-09-13T08:24:56.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.681+0000 7ffa8dd9b700 1 --2- 172.21.15.84:0/1482676605 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa78004850 0x7ffa78004cd0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ffa80009b30 tx=0x7ffa78005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c04072f08d97bc0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:56.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.681+0000 7ffa8d59a700 1 -- 172.21.15.84:0/1482676605 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa8000e6c0 con 0x7ffa78004850 2023-09-13T08:24:56.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.681+0000 7ffa8d59a700 1 -- 172.21.15.84:0/1482676605 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa8000e820 con 0x7ffa78004850 2023-09-13T08:24:56.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.681+0000 7ffa8d59a700 1 -- 172.21.15.84:0/1482676605 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa8000eb90 con 0x7ffa78004850 2023-09-13T08:24:56.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.682+0000 7ffa948f5700 1 -- 172.21.15.84:0/1482676605 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa78004850 msgr2=0x7ffa78004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:56.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.682+0000 7ffa948f5700 1 --2- 172.21.15.84:0/1482676605 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa78004850 0x7ffa78004cd0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ffa80009b30 tx=0x7ffa78005880 comp rx=0 tx=0).stop 2023-09-13T08:24:56.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.682+0000 7ffa948f5700 1 -- 172.21.15.84:0/1482676605 shutdown_connections 2023-09-13T08:24:56.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.682+0000 7ffa948f5700 1 --2- 172.21.15.84:0/1482676605 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa78004850 0x7ffa78004cd0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:56.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.682+0000 7ffa948f5700 1 -- 172.21.15.84:0/1482676605 >> 172.21.15.84:0/1482676605 conn(0x7ffa900d00d0 msgr2=0x7ffa900d04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:56.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.682+0000 7ffa948f5700 1 -- 172.21.15.84:0/1482676605 shutdown_connections 2023-09-13T08:24:56.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.682+0000 7ffa948f5700 1 -- 172.21.15.84:0/1482676605 wait complete. 2023-09-13T08:24:56.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.683+0000 7ffa948f5700 1 Processor -- start 2023-09-13T08:24:56.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.683+0000 7ffa948f5700 1 -- start start 2023-09-13T08:24:56.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.684+0000 7ffa948f5700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa78004850 0x7ffa901607b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:56.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.684+0000 7ffa948f5700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ffa900b3900 0x7ffa90156e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:56.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.684+0000 7ffa948f5700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffa900b0b80 0x7ffa900b1000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:56.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.684+0000 7ffa948f5700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa900b1540 con 0x7ffa78004850 2023-09-13T08:24:56.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.684+0000 7ffa948f5700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa900c8b80 con 0x7ffa900b0b80 2023-09-13T08:24:56.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.684+0000 7ffa948f5700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa90157370 con 0x7ffa900b3900 2023-09-13T08:24:56.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.684+0000 7ffa8e59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa78004850 0x7ffa901607b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:56.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.684+0000 7ffa8e59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa78004850 0x7ffa901607b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43602/0 (socket says 172.21.15.84:43602) 2023-09-13T08:24:56.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.684+0000 7ffa8e59c700 1 -- 172.21.15.84:0/1623432294 learned_addr learned my addr 172.21.15.84:0/1623432294 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:24:56.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.684+0000 7ffa8dd9b700 1 --2- 172.21.15.84:0/1623432294 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ffa900b3900 0x7ffa90156e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:56.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.684+0000 7ffa8ed9d700 1 --2- 172.21.15.84:0/1623432294 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffa900b0b80 0x7ffa900b1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:56.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.684+0000 7ffa8e59c700 1 -- 172.21.15.84:0/1623432294 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ffa900b3900 msgr2=0x7ffa90156e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:56.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.684+0000 7ffa8e59c700 1 --2- 172.21.15.84:0/1623432294 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ffa900b3900 0x7ffa90156e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:56.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.685+0000 7ffa8e59c700 1 -- 172.21.15.84:0/1623432294 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffa900b0b80 msgr2=0x7ffa900b1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:56.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.685+0000 7ffa8e59c700 1 --2- 172.21.15.84:0/1623432294 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffa900b0b80 0x7ffa900b1000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:56.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.685+0000 7ffa8e59c700 1 -- 172.21.15.84:0/1623432294 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa900b3d80 con 0x7ffa78004850 2023-09-13T08:24:56.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.685+0000 7ffa8e59c700 1 --2- 172.21.15.84:0/1623432294 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa78004850 0x7ffa901607b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ffa8400f7a0 tx=0x7ffa8400fb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:56.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.685+0000 7ffa7effd700 1 -- 172.21.15.84:0/1623432294 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa840052e0 con 0x7ffa78004850 2023-09-13T08:24:56.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.685+0000 7ffa7effd700 1 -- 172.21.15.84:0/1623432294 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa84005440 con 0x7ffa78004850 2023-09-13T08:24:56.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.685+0000 7ffa948f5700 1 -- 172.21.15.84:0/1623432294 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa900b4010 con 0x7ffa78004850 2023-09-13T08:24:56.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.685+0000 7ffa7effd700 1 -- 172.21.15.84:0/1623432294 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa840038a0 con 0x7ffa78004850 2023-09-13T08:24:56.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.685+0000 7ffa948f5700 1 -- 172.21.15.84:0/1623432294 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa900c8530 con 0x7ffa78004850 2023-09-13T08:24:56.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.686+0000 7ffa948f5700 1 -- 172.21.15.84:0/1623432294 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa9004e9b0 con 0x7ffa78004850 2023-09-13T08:24:56.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.686+0000 7ffa7effd700 1 -- 172.21.15.84:0/1623432294 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7ffa84003a00 con 0x7ffa78004850 2023-09-13T08:24:56.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.687+0000 7ffa7effd700 1 --2- 172.21.15.84:0/1623432294 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7ffa7006a580 0x7ffa7006ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:24:56.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.687+0000 7ffa7effd700 1 -- 172.21.15.84:0/1623432294 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ffa84088a40 con 0x7ffa78004850 2023-09-13T08:24:56.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.687+0000 7ffa8dd9b700 1 --2- 172.21.15.84:0/1623432294 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7ffa7006a580 0x7ffa7006ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:24:56.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.687+0000 7ffa8dd9b700 1 --2- 172.21.15.84:0/1623432294 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7ffa7006a580 0x7ffa7006ca40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ffa800090b0 tx=0x7ffa80008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:24:56.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.691+0000 7ffa7effd700 1 -- 172.21.15.84:0/1623432294 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7ffa8408ae60 con 0x7ffa78004850 2023-09-13T08:24:56.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.896+0000 7ffa948f5700 1 -- 172.21.15.84:0/1623432294 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ffa900ce4c0 con 0x7ffa78004850 2023-09-13T08:24:56.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.896+0000 7ffa7effd700 1 -- 172.21.15.84:0/1623432294 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7ffa84053c40 con 0x7ffa78004850 2023-09-13T08:24:56.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.898+0000 7ffa948f5700 1 -- 172.21.15.84:0/1623432294 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7ffa7006a580 msgr2=0x7ffa7006ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:56.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.898+0000 7ffa948f5700 1 --2- 172.21.15.84:0/1623432294 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7ffa7006a580 0x7ffa7006ca40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ffa800090b0 tx=0x7ffa80008030 comp rx=0 tx=0).stop 2023-09-13T08:24:56.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.898+0000 7ffa948f5700 1 -- 172.21.15.84:0/1623432294 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa78004850 msgr2=0x7ffa901607b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:24:56.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.898+0000 7ffa948f5700 1 --2- 172.21.15.84:0/1623432294 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa78004850 0x7ffa901607b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ffa8400f7a0 tx=0x7ffa8400fb60 comp rx=0 tx=0).stop 2023-09-13T08:24:56.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.898+0000 7ffa948f5700 1 -- 172.21.15.84:0/1623432294 shutdown_connections 2023-09-13T08:24:56.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.898+0000 7ffa948f5700 1 --2- 172.21.15.84:0/1623432294 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7ffa7006a580 0x7ffa7006ca40 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:56.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.898+0000 7ffa948f5700 1 --2- 172.21.15.84:0/1623432294 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffa900b0b80 0x7ffa900b1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:56.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.898+0000 7ffa948f5700 1 --2- 172.21.15.84:0/1623432294 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa78004850 0x7ffa901607b0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:56.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.898+0000 7ffa948f5700 1 --2- 172.21.15.84:0/1623432294 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ffa900b3900 0x7ffa90156e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:24:56.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.898+0000 7ffa948f5700 1 -- 172.21.15.84:0/1623432294 >> 172.21.15.84:0/1623432294 conn(0x7ffa900d00d0 msgr2=0x7ffa9015c920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:24:56.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.898+0000 7ffa948f5700 1 -- 172.21.15.84:0/1623432294 shutdown_connections 2023-09-13T08:24:56.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:24:56.898+0000 7ffa948f5700 1 -- 172.21.15.84:0/1623432294 wait complete. 2023-09-13T08:24:56.901 INFO:teuthology.orchestra.run.smithi084.stderr:listed 0 entries 2023-09-13T08:24:56.910 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi084.front.sepia.ceph.com... 2023-09-13T08:24:56.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:24:56.911 DEBUG:teuthology.orchestra.run.smithi084:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-09-13T08:24:56.944 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi084.stderr:ceph-fuse[110858]: fuse finished with error 0 and tester_r 0 2023-09-13T08:24:56.945 INFO:teuthology.orchestra.run:waiting for 300 2023-09-13T08:25:03.047 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi084.front.sepia.ceph.com 2023-09-13T08:25:03.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:25:03.048 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-09-13T08:25:03.083 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T08:25:03.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.255+0000 7f91513c4700 1 Processor -- start 2023-09-13T08:25:03.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.255+0000 7f91513c4700 1 -- start start 2023-09-13T08:25:03.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.256+0000 7f91513c4700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f914c159a50 0x7f914c0b1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:03.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.256+0000 7f91513c4700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f914c0b1580 0x7f914c15d520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:03.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.256+0000 7f91513c4700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f914c15da60 0x7f914c0cb020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:03.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.256+0000 7f91513c4700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f914c159e30 con 0x7f914c0b1580 2023-09-13T08:25:03.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.256+0000 7f91513c4700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f914c15e090 con 0x7f914c15da60 2023-09-13T08:25:03.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.256+0000 7f91513c4700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f914c0b0560 con 0x7f914c159a50 2023-09-13T08:25:03.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.256+0000 7f914a7fc700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f914c0b1580 0x7f914c15d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:03.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.256+0000 7f914a7fc700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f914c0b1580 0x7f914c15d520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43612/0 (socket says 172.21.15.84:43612) 2023-09-13T08:25:03.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.256+0000 7f914a7fc700 1 -- 172.21.15.84:0/1114313958 learned_addr learned my addr 172.21.15.84:0/1114313958 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:03.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.257+0000 7f914b7fe700 1 --2- 172.21.15.84:0/1114313958 >> v2:172.21.15.161:3300/0 conn(0x7f914c15da60 0x7f914c0cb020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:03.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.257+0000 7f914affd700 1 --2- 172.21.15.84:0/1114313958 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f914c159a50 0x7f914c0b1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:03.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.257+0000 7f914a7fc700 1 -- 172.21.15.84:0/1114313958 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f914c159a50 msgr2=0x7f914c0b1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:03.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.257+0000 7f914a7fc700 1 --2- 172.21.15.84:0/1114313958 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f914c159a50 0x7f914c0b1040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:03.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.257+0000 7f914a7fc700 1 -- 172.21.15.84:0/1114313958 >> v2:172.21.15.161:3300/0 conn(0x7f914c15da60 msgr2=0x7f914c0cb020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:03.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.257+0000 7f914a7fc700 1 --2- 172.21.15.84:0/1114313958 >> v2:172.21.15.161:3300/0 conn(0x7f914c15da60 0x7f914c0cb020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:03.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.257+0000 7f914a7fc700 1 -- 172.21.15.84:0/1114313958 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f914c0b0840 con 0x7f914c0b1580 2023-09-13T08:25:03.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.257+0000 7f914b7fe700 1 --2- 172.21.15.84:0/1114313958 >> v2:172.21.15.161:3300/0 conn(0x7f914c15da60 0x7f914c0cb020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T08:25:03.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.257+0000 7f914affd700 1 --2- 172.21.15.84:0/1114313958 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f914c159a50 0x7f914c0b1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T08:25:03.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.257+0000 7f914a7fc700 1 --2- 172.21.15.84:0/1114313958 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f914c0b1580 0x7f914c15d520 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f914c0cf750 tx=0x7f913c00ad70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ea5d7c8d95cee40 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:03.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.257+0000 7f9149ffb700 1 -- 172.21.15.84:0/1114313958 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913c00cb70 con 0x7f914c0b1580 2023-09-13T08:25:03.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.257+0000 7f9149ffb700 1 -- 172.21.15.84:0/1114313958 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f913c00ccd0 con 0x7f914c0b1580 2023-09-13T08:25:03.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.257+0000 7f9149ffb700 1 -- 172.21.15.84:0/1114313958 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913c018620 con 0x7f914c0b1580 2023-09-13T08:25:03.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.257+0000 7f91513c4700 1 -- 172.21.15.84:0/1114313958 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f914c0b1580 msgr2=0x7f914c15d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:03.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.257+0000 7f91513c4700 1 --2- 172.21.15.84:0/1114313958 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f914c0b1580 0x7f914c15d520 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f914c0cf750 tx=0x7f913c00ad70 comp rx=0 tx=0).stop 2023-09-13T08:25:03.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.257+0000 7f91513c4700 1 -- 172.21.15.84:0/1114313958 shutdown_connections 2023-09-13T08:25:03.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.257+0000 7f91513c4700 1 --2- 172.21.15.84:0/1114313958 >> v2:172.21.15.161:3300/0 conn(0x7f914c15da60 0x7f914c0cb020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:03.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.257+0000 7f91513c4700 1 --2- 172.21.15.84:0/1114313958 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f914c159a50 0x7f914c0b1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:03.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.257+0000 7f91513c4700 1 --2- 172.21.15.84:0/1114313958 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f914c0b1580 0x7f914c15d520 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:03.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.258+0000 7f91513c4700 1 -- 172.21.15.84:0/1114313958 >> 172.21.15.84:0/1114313958 conn(0x7f914c0cc230 msgr2=0x7f914c0cc640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:03.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.258+0000 7f91513c4700 1 -- 172.21.15.84:0/1114313958 shutdown_connections 2023-09-13T08:25:03.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.258+0000 7f91513c4700 1 -- 172.21.15.84:0/1114313958 wait complete. 2023-09-13T08:25:03.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.259+0000 7f91513c4700 1 Processor -- start 2023-09-13T08:25:03.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.259+0000 7f91513c4700 1 -- start start 2023-09-13T08:25:03.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.260+0000 7f91513c4700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f914c0b1580 0x7f914c0b3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:03.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.260+0000 7f91513c4700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f914c159a50 0x7f914c0c6880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:03.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.260+0000 7f91513c4700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f914c15da60 0x7f914c0c6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:03.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.260+0000 7f91513c4700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f914c0b3010 con 0x7f914c159a50 2023-09-13T08:25:03.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.260+0000 7f91513c4700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f914c0b32f0 con 0x7f914c0b1580 2023-09-13T08:25:03.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.260+0000 7f91513c4700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f914c0b50d0 con 0x7f914c15da60 2023-09-13T08:25:03.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.260+0000 7f914a7fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f914c159a50 0x7f914c0c6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:03.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.260+0000 7f914a7fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f914c159a50 0x7f914c0c6880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43620/0 (socket says 172.21.15.84:43620) 2023-09-13T08:25:03.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.260+0000 7f914a7fc700 1 -- 172.21.15.84:0/4183181081 learned_addr learned my addr 172.21.15.84:0/4183181081 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:03.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.260+0000 7f914affd700 1 --2- 172.21.15.84:0/4183181081 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f914c0b1580 0x7f914c0b3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:03.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.260+0000 7f914b7fe700 1 --2- 172.21.15.84:0/4183181081 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f914c15da60 0x7f914c0c6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:03.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.260+0000 7f914a7fc700 1 -- 172.21.15.84:0/4183181081 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f914c15da60 msgr2=0x7f914c0c6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:03.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.260+0000 7f914a7fc700 1 --2- 172.21.15.84:0/4183181081 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f914c15da60 0x7f914c0c6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:03.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.260+0000 7f914a7fc700 1 -- 172.21.15.84:0/4183181081 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f914c0b1580 msgr2=0x7f914c0b3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:03.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.260+0000 7f914a7fc700 1 --2- 172.21.15.84:0/4183181081 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f914c0b1580 0x7f914c0b3780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:03.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.260+0000 7f914a7fc700 1 -- 172.21.15.84:0/4183181081 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f913c00a6f0 con 0x7f914c159a50 2023-09-13T08:25:03.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.260+0000 7f914b7fe700 1 --2- 172.21.15.84:0/4183181081 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f914c15da60 0x7f914c0c6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T08:25:03.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.260+0000 7f914a7fc700 1 --2- 172.21.15.84:0/4183181081 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f914c159a50 0x7f914c0c6880 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f913c00afd0 tx=0x7f913c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:03.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.260+0000 7f91337fe700 1 -- 172.21.15.84:0/4183181081 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913c01c040 con 0x7f914c159a50 2023-09-13T08:25:03.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.260+0000 7f91337fe700 1 -- 172.21.15.84:0/4183181081 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f913c003ab0 con 0x7f914c159a50 2023-09-13T08:25:03.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.260+0000 7f91337fe700 1 -- 172.21.15.84:0/4183181081 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913c003e60 con 0x7f914c159a50 2023-09-13T08:25:03.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.260+0000 7f91513c4700 1 -- 172.21.15.84:0/4183181081 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f914c0b5370 con 0x7f914c159a50 2023-09-13T08:25:03.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.260+0000 7f91513c4700 1 -- 172.21.15.84:0/4183181081 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f914c0c5920 con 0x7f914c159a50 2023-09-13T08:25:03.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.261+0000 7f91513c4700 1 -- 172.21.15.84:0/4183181081 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f914c04e9b0 con 0x7f914c159a50 2023-09-13T08:25:03.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.262+0000 7f91337fe700 1 -- 172.21.15.84:0/4183181081 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f913c018400 con 0x7f914c159a50 2023-09-13T08:25:03.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.262+0000 7f91337fe700 1 --2- 172.21.15.84:0/4183181081 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f913806a580 0x7f913806ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:03.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.262+0000 7f91337fe700 1 -- 172.21.15.84:0/4183181081 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f913c089ee0 con 0x7f914c159a50 2023-09-13T08:25:03.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.262+0000 7f914affd700 1 --2- 172.21.15.84:0/4183181081 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f913806a580 0x7f913806ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:03.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.263+0000 7f914affd700 1 --2- 172.21.15.84:0/4183181081 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f913806a580 0x7f913806ca40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9140006ba0 tx=0x7f9140008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:03.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.267+0000 7f91337fe700 1 -- 172.21.15.84:0/4183181081 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f913c055200 con 0x7f914c159a50 2023-09-13T08:25:03.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.458+0000 7f91513c4700 1 -- 172.21.15.84:0/4183181081 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f914c0cecd0 con 0x7f914c159a50 2023-09-13T08:25:03.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.459+0000 7f91337fe700 1 -- 172.21.15.84:0/4183181081 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18322 (secure 0 0 0) 0x7f913c026090 con 0x7f914c159a50 2023-09-13T08:25:03.460 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:25:03.460 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":24,"fsid":"0107440b-b634-42c5-a643-5d31ea826116","created":"2023-09-13T08:24:16.931917+0000","modified":"2023-09-13T08:24:47.176259+0000","last_up_change":"2023-09-13T08:24:28.422631+0000","last_in_change":"2023-09-13T08:24:19.425578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T08:24:28.583720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-13T08:24:39.862832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-13T08:24:41.145511+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-13T08:24:44.775160+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4a53ec12-1469-4356-b4e1-2b8fc9b7c0f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6817","nonce":1599532366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6819","nonce":1599532366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6823","nonce":1599532366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6821","nonce":1599532366}]},"public_addr":"172.21.15.84:6817/1599532366","cluster_addr":"172.21.15.84:6819/1599532366","heartbeat_back_addr":"172.21.15.84:6823/1599532366","heartbeat_front_addr":"172.21.15.84:6821/1599532366","state":["exists","up"]},{"osd":1,"uuid":"11e964a0-b80c-4afc-bfbf-e2067969db29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6825","nonce":461860977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6827","nonce":461860977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6831","nonce":461860977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6829","nonce":461860977}]},"public_addr":"172.21.15.84:6825/461860977","cluster_addr":"172.21.15.84:6827/461860977","heartbeat_back_addr":"172.21.15.84:6831/461860977","heartbeat_front_addr":"172.21.15.84:6829/461860977","state":["exists","up"]},{"osd":2,"uuid":"3ce74529-4dd1-44c7-9576-968f5fdc0c25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6809","nonce":1168316165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6811","nonce":1168316165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6815","nonce":1168316165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6813","nonce":1168316165}]},"public_addr":"172.21.15.84:6809/1168316165","cluster_addr":"172.21.15.84:6811/1168316165","heartbeat_back_addr":"172.21.15.84:6815/1168316165","heartbeat_front_addr":"172.21.15.84:6813/1168316165","state":["exists","up"]},{"osd":3,"uuid":"460cb5c5-590a-4d06-a4d9-5bac2fdf33b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6801","nonce":1661609810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6803","nonce":1661609810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6807","nonce":1661609810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6805","nonce":1661609810}]},"public_addr":"172.21.15.84:6801/1661609810","cluster_addr":"172.21.15.84:6803/1661609810","heartbeat_back_addr":"172.21.15.84:6807/1661609810","heartbeat_front_addr":"172.21.15.84:6805/1661609810","state":["exists","up"]},{"osd":4,"uuid":"bf237dd0-3ebd-44b5-8078-24a63e00d792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6801","nonce":1303562374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6803","nonce":1303562374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6807","nonce":1303562374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6805","nonce":1303562374}]},"public_addr":"172.21.15.161:6801/1303562374","cluster_addr":"172.21.15.161:6803/1303562374","heartbeat_back_addr":"172.21.15.161:6807/1303562374","heartbeat_front_addr":"172.21.15.161:6805/1303562374","state":["exists","up"]},{"osd":5,"uuid":"e1e538e0-5844-456b-8c6e-434d3a914af1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6818","nonce":961120854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6822","nonce":961120854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6830","nonce":961120854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6826","nonce":961120854}]},"public_addr":"172.21.15.161:6818/961120854","cluster_addr":"172.21.15.161:6822/961120854","heartbeat_back_addr":"172.21.15.161:6830/961120854","heartbeat_front_addr":"172.21.15.161:6826/961120854","state":["exists","up"]},{"osd":6,"uuid":"5cb1785e-960f-4dd4-b295-9e21b2c3f875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6809","nonce":980533466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6811","nonce":980533466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6815","nonce":980533466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6813","nonce":980533466}]},"public_addr":"172.21.15.161:6809/980533466","cluster_addr":"172.21.15.161:6811/980533466","heartbeat_back_addr":"172.21.15.161:6815/980533466","heartbeat_front_addr":"172.21.15.161:6813/980533466","state":["exists","up"]},{"osd":7,"uuid":"5acb6619-e933-4b46-b1c2-60af30acb839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6817","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6819","nonce":2479691549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6821","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6823","nonce":2479691549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6829","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6831","nonce":2479691549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6825","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6827","nonce":2479691549}]},"public_addr":"172.21.15.161:6819/2479691549","cluster_addr":"172.21.15.161:6823/2479691549","heartbeat_back_addr":"172.21.15.161:6831/2479691549","heartbeat_front_addr":"172.21.15.161:6827/2479691549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.678857+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.685341+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.613603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.634940+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.564387+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.697347+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.637437+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.619397+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T08:25:03.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.462+0000 7f91513c4700 1 -- 172.21.15.84:0/4183181081 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f913806a580 msgr2=0x7f913806ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:03.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.462+0000 7f91513c4700 1 --2- 172.21.15.84:0/4183181081 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f913806a580 0x7f913806ca40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9140006ba0 tx=0x7f9140008040 comp rx=0 tx=0).stop 2023-09-13T08:25:03.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.462+0000 7f91513c4700 1 -- 172.21.15.84:0/4183181081 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f914c159a50 msgr2=0x7f914c0c6880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:03.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.462+0000 7f91513c4700 1 --2- 172.21.15.84:0/4183181081 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f914c159a50 0x7f914c0c6880 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f913c00afd0 tx=0x7f913c004750 comp rx=0 tx=0).stop 2023-09-13T08:25:03.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.462+0000 7f91513c4700 1 -- 172.21.15.84:0/4183181081 shutdown_connections 2023-09-13T08:25:03.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.462+0000 7f91513c4700 1 --2- 172.21.15.84:0/4183181081 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f914c15da60 0x7f914c0c6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:03.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.462+0000 7f91513c4700 1 --2- 172.21.15.84:0/4183181081 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f913806a580 0x7f913806ca40 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:03.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.462+0000 7f91513c4700 1 --2- 172.21.15.84:0/4183181081 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f914c0b1580 0x7f914c0b3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:03.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.462+0000 7f91513c4700 1 --2- 172.21.15.84:0/4183181081 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f914c159a50 0x7f914c0c6880 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:03.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.462+0000 7f91513c4700 1 -- 172.21.15.84:0/4183181081 >> 172.21.15.84:0/4183181081 conn(0x7f914c0cc230 msgr2=0x7f914c15bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:03.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.462+0000 7f91513c4700 1 -- 172.21.15.84:0/4183181081 shutdown_connections 2023-09-13T08:25:03.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.462+0000 7f91513c4700 1 -- 172.21.15.84:0/4183181081 wait complete. 2023-09-13T08:25:03.474 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T08:25:03.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.595+0000 7f65381a0700 1 Processor -- start 2023-09-13T08:25:03.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.595+0000 7f65381a0700 1 -- start start 2023-09-13T08:25:03.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.596+0000 7f65381a0700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f65300ca920 0x7f653006d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:03.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.596+0000 7f65381a0700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f653006a620 0x7f653006aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:03.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.596+0000 7f65381a0700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f653006af90 con 0x7f653015d530 2023-09-13T08:25:03.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.596+0000 7f65381a0700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65300cff20 con 0x7f653006a620 2023-09-13T08:25:03.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.596+0000 7f65381a0700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65300cae50 con 0x7f65300ca920 2023-09-13T08:25:03.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.596+0000 7f653673d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f653006a620 0x7f653006aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:03.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.596+0000 7f6535f3c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f653015d530 0x7f6530161bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:46276/0 (socket says 172.21.15.84:46276) 2023-09-13T08:25:03.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.596+0000 7f6535f3c700 1 -- 172.21.15.84:0/389324714 learned_addr learned my addr 172.21.15.84:0/389324714 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:25:03.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.596+0000 7f653573b700 1 --2- 172.21.15.84:0/389324714 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f65300ca920 0x7f653006d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:03.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.596+0000 7f653673d700 1 -- 172.21.15.84:0/389324714 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f65300ca920 msgr2=0x7f653006d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:03.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.596+0000 7f653673d700 1 --2- 172.21.15.84:0/389324714 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f65300ca920 0x7f653006d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:03.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.596+0000 7f653673d700 1 -- 172.21.15.84:0/389324714 >> v1:172.21.15.84:6789/0 conn(0x7f653015d530 legacy=0x7f6530161bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:03.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.596+0000 7f653673d700 1 -- 172.21.15.84:0/389324714 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65300cb130 con 0x7f653006a620 2023-09-13T08:25:03.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.596+0000 7f6534f3a700 1 -- 172.21.15.84:0/389324714 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1303431418 0 0) 0x7f653006af90 con 0x7f653015d530 2023-09-13T08:25:03.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.597+0000 7f653673d700 1 --2- 172.21.15.84:0/389324714 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f653006a620 0x7f653006aa50 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6528009d90 tx=0x7f652800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58f16067ba1c77e5 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:03.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.597+0000 7f6534f3a700 1 -- 172.21.15.84:0/389324714 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f652800e070 con 0x7f653006a620 2023-09-13T08:25:03.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.597+0000 7f6534f3a700 1 -- 172.21.15.84:0/389324714 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f652800bb20 con 0x7f653006a620 2023-09-13T08:25:03.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.597+0000 7f6534f3a700 1 -- 172.21.15.84:0/389324714 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6528012430 con 0x7f653006a620 2023-09-13T08:25:03.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.597+0000 7f65381a0700 1 -- 172.21.15.84:0/389324714 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f653006a620 msgr2=0x7f653006aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:03.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.597+0000 7f65381a0700 1 --2- 172.21.15.84:0/389324714 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f653006a620 0x7f653006aa50 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6528009d90 tx=0x7f652800b330 comp rx=0 tx=0).stop 2023-09-13T08:25:03.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.597+0000 7f65381a0700 1 -- 172.21.15.84:0/389324714 shutdown_connections 2023-09-13T08:25:03.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.597+0000 7f65381a0700 1 --2- 172.21.15.84:0/389324714 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f653006a620 0x7f653006aa50 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:03.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.597+0000 7f65381a0700 1 --2- 172.21.15.84:0/389324714 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f65300ca920 0x7f653006d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:03.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.597+0000 7f65381a0700 1 -- 172.21.15.84:0/389324714 >> 172.21.15.84:0/389324714 conn(0x7f65300d00c0 msgr2=0x7f65300d04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:03.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.597+0000 7f65381a0700 1 -- 172.21.15.84:0/389324714 shutdown_connections 2023-09-13T08:25:03.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.597+0000 7f65381a0700 1 -- 172.21.15.84:0/389324714 wait complete. 2023-09-13T08:25:03.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.598+0000 7f65381a0700 1 Processor -- start 2023-09-13T08:25:03.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.599+0000 7f65381a0700 1 -- start start 2023-09-13T08:25:03.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.599+0000 7f65381a0700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f653006a620 0x7f65300c9b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:03.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.599+0000 7f65381a0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65300ca920 0x7f65301e6490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:03.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.599+0000 7f65381a0700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f653015d530 0x7f65300b5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:03.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.599+0000 7f65381a0700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65301e69d0 con 0x7f65300ca920 2023-09-13T08:25:03.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.599+0000 7f65381a0700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65301e7810 con 0x7f653006a620 2023-09-13T08:25:03.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.599+0000 7f65381a0700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65301e6c00 con 0x7f653015d530 2023-09-13T08:25:03.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.599+0000 7f653573b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65300ca920 0x7f65301e6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:03.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.599+0000 7f653573b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65300ca920 0x7f65301e6490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43632/0 (socket says 172.21.15.84:43632) 2023-09-13T08:25:03.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.599+0000 7f653573b700 1 -- 172.21.15.84:0/3015938804 learned_addr learned my addr 172.21.15.84:0/3015938804 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:03.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.600+0000 7f6535f3c700 1 --2- 172.21.15.84:0/3015938804 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f653006a620 0x7f65300c9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:03.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.600+0000 7f653673d700 1 --2- 172.21.15.84:0/3015938804 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f653015d530 0x7f65300b5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:03.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.600+0000 7f653573b700 1 -- 172.21.15.84:0/3015938804 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f653015d530 msgr2=0x7f65300b5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:03.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.600+0000 7f653573b700 1 --2- 172.21.15.84:0/3015938804 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f653015d530 0x7f65300b5440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:03.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.600+0000 7f653573b700 1 -- 172.21.15.84:0/3015938804 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f653006a620 msgr2=0x7f65300c9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:03.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.600+0000 7f653573b700 1 --2- 172.21.15.84:0/3015938804 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f653006a620 0x7f65300c9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:03.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.600+0000 7f653573b700 1 -- 172.21.15.84:0/3015938804 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6528009a70 con 0x7f65300ca920 2023-09-13T08:25:03.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.600+0000 7f653673d700 1 --2- 172.21.15.84:0/3015938804 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f653015d530 0x7f65300b5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T08:25:03.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.600+0000 7f653573b700 1 --2- 172.21.15.84:0/3015938804 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65300ca920 0x7f65301e6490 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f652c00e980 tx=0x7f652c00ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:03.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.600+0000 7f65267fc700 1 -- 172.21.15.84:0/3015938804 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f652c009710 con 0x7f65300ca920 2023-09-13T08:25:03.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.600+0000 7f65267fc700 1 -- 172.21.15.84:0/3015938804 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f652c00c850 con 0x7f65300ca920 2023-09-13T08:25:03.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.600+0000 7f65267fc700 1 -- 172.21.15.84:0/3015938804 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f652c00cc00 con 0x7f65300ca920 2023-09-13T08:25:03.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.600+0000 7f65381a0700 1 -- 172.21.15.84:0/3015938804 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65301e6ee0 con 0x7f65300ca920 2023-09-13T08:25:03.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.600+0000 7f65381a0700 1 -- 172.21.15.84:0/3015938804 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65301e74a0 con 0x7f65300ca920 2023-09-13T08:25:03.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.601+0000 7f65381a0700 1 -- 172.21.15.84:0/3015938804 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65301e79a0 con 0x7f65300ca920 2023-09-13T08:25:03.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.601+0000 7f65267fc700 1 -- 172.21.15.84:0/3015938804 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f652c013470 con 0x7f65300ca920 2023-09-13T08:25:03.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.602+0000 7f65267fc700 1 --2- 172.21.15.84:0/3015938804 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f651406a580 0x7f651406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:03.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.602+0000 7f65267fc700 1 -- 172.21.15.84:0/3015938804 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f652c088e10 con 0x7f65300ca920 2023-09-13T08:25:03.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.602+0000 7f6535f3c700 1 --2- 172.21.15.84:0/3015938804 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f651406a580 0x7f651406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:03.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.602+0000 7f6535f3c700 1 --2- 172.21.15.84:0/3015938804 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f651406a580 0x7f651406ca40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6520000f60 tx=0x7f6520007c90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:03.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.606+0000 7f65267fc700 1 -- 172.21.15.84:0/3015938804 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f652c0541f0 con 0x7f65300ca920 2023-09-13T08:25:03.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.798+0000 7f65381a0700 1 -- 172.21.15.84:0/3015938804 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f653004e9b0 con 0x7f65300ca920 2023-09-13T08:25:03.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.799+0000 7f65267fc700 1 -- 172.21.15.84:0/3015938804 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18322 (secure 0 0 0) 0x7f652c017090 con 0x7f65300ca920 2023-09-13T08:25:03.800 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:25:03.801 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":24,"fsid":"0107440b-b634-42c5-a643-5d31ea826116","created":"2023-09-13T08:24:16.931917+0000","modified":"2023-09-13T08:24:47.176259+0000","last_up_change":"2023-09-13T08:24:28.422631+0000","last_in_change":"2023-09-13T08:24:19.425578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T08:24:28.583720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-13T08:24:39.862832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-13T08:24:41.145511+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-13T08:24:44.775160+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4a53ec12-1469-4356-b4e1-2b8fc9b7c0f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6817","nonce":1599532366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6819","nonce":1599532366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6823","nonce":1599532366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6821","nonce":1599532366}]},"public_addr":"172.21.15.84:6817/1599532366","cluster_addr":"172.21.15.84:6819/1599532366","heartbeat_back_addr":"172.21.15.84:6823/1599532366","heartbeat_front_addr":"172.21.15.84:6821/1599532366","state":["exists","up"]},{"osd":1,"uuid":"11e964a0-b80c-4afc-bfbf-e2067969db29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6825","nonce":461860977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6827","nonce":461860977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6831","nonce":461860977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6829","nonce":461860977}]},"public_addr":"172.21.15.84:6825/461860977","cluster_addr":"172.21.15.84:6827/461860977","heartbeat_back_addr":"172.21.15.84:6831/461860977","heartbeat_front_addr":"172.21.15.84:6829/461860977","state":["exists","up"]},{"osd":2,"uuid":"3ce74529-4dd1-44c7-9576-968f5fdc0c25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6809","nonce":1168316165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6811","nonce":1168316165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6815","nonce":1168316165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6813","nonce":1168316165}]},"public_addr":"172.21.15.84:6809/1168316165","cluster_addr":"172.21.15.84:6811/1168316165","heartbeat_back_addr":"172.21.15.84:6815/1168316165","heartbeat_front_addr":"172.21.15.84:6813/1168316165","state":["exists","up"]},{"osd":3,"uuid":"460cb5c5-590a-4d06-a4d9-5bac2fdf33b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6801","nonce":1661609810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6803","nonce":1661609810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6807","nonce":1661609810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6805","nonce":1661609810}]},"public_addr":"172.21.15.84:6801/1661609810","cluster_addr":"172.21.15.84:6803/1661609810","heartbeat_back_addr":"172.21.15.84:6807/1661609810","heartbeat_front_addr":"172.21.15.84:6805/1661609810","state":["exists","up"]},{"osd":4,"uuid":"bf237dd0-3ebd-44b5-8078-24a63e00d792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6801","nonce":1303562374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6803","nonce":1303562374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6807","nonce":1303562374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6805","nonce":1303562374}]},"public_addr":"172.21.15.161:6801/1303562374","cluster_addr":"172.21.15.161:6803/1303562374","heartbeat_back_addr":"172.21.15.161:6807/1303562374","heartbeat_front_addr":"172.21.15.161:6805/1303562374","state":["exists","up"]},{"osd":5,"uuid":"e1e538e0-5844-456b-8c6e-434d3a914af1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6818","nonce":961120854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6822","nonce":961120854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6830","nonce":961120854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6826","nonce":961120854}]},"public_addr":"172.21.15.161:6818/961120854","cluster_addr":"172.21.15.161:6822/961120854","heartbeat_back_addr":"172.21.15.161:6830/961120854","heartbeat_front_addr":"172.21.15.161:6826/961120854","state":["exists","up"]},{"osd":6,"uuid":"5cb1785e-960f-4dd4-b295-9e21b2c3f875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6809","nonce":980533466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6811","nonce":980533466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6815","nonce":980533466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6813","nonce":980533466}]},"public_addr":"172.21.15.161:6809/980533466","cluster_addr":"172.21.15.161:6811/980533466","heartbeat_back_addr":"172.21.15.161:6815/980533466","heartbeat_front_addr":"172.21.15.161:6813/980533466","state":["exists","up"]},{"osd":7,"uuid":"5acb6619-e933-4b46-b1c2-60af30acb839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6817","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6819","nonce":2479691549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6821","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6823","nonce":2479691549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6829","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6831","nonce":2479691549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6825","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6827","nonce":2479691549}]},"public_addr":"172.21.15.161:6819/2479691549","cluster_addr":"172.21.15.161:6823/2479691549","heartbeat_back_addr":"172.21.15.161:6831/2479691549","heartbeat_front_addr":"172.21.15.161:6827/2479691549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.678857+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.685341+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.613603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.634940+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.564387+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.697347+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.637437+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.619397+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T08:25:03.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.801+0000 7f65381a0700 1 -- 172.21.15.84:0/3015938804 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f651406a580 msgr2=0x7f651406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:03.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.801+0000 7f65381a0700 1 --2- 172.21.15.84:0/3015938804 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f651406a580 0x7f651406ca40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6520000f60 tx=0x7f6520007c90 comp rx=0 tx=0).stop 2023-09-13T08:25:03.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.801+0000 7f65381a0700 1 -- 172.21.15.84:0/3015938804 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65300ca920 msgr2=0x7f65301e6490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:03.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.801+0000 7f65381a0700 1 --2- 172.21.15.84:0/3015938804 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65300ca920 0x7f65301e6490 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f652c00e980 tx=0x7f652c00ed40 comp rx=0 tx=0).stop 2023-09-13T08:25:03.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.801+0000 7f65381a0700 1 -- 172.21.15.84:0/3015938804 shutdown_connections 2023-09-13T08:25:03.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.801+0000 7f65381a0700 1 --2- 172.21.15.84:0/3015938804 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f653015d530 0x7f65300b5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:03.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.801+0000 7f65381a0700 1 --2- 172.21.15.84:0/3015938804 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f651406a580 0x7f651406ca40 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:03.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.801+0000 7f65381a0700 1 --2- 172.21.15.84:0/3015938804 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f653006a620 0x7f65300c9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:03.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.801+0000 7f65381a0700 1 --2- 172.21.15.84:0/3015938804 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65300ca920 0x7f65301e6490 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:03.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.801+0000 7f65381a0700 1 -- 172.21.15.84:0/3015938804 >> 172.21.15.84:0/3015938804 conn(0x7f65300d00c0 msgr2=0x7f65300b4520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:03.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.802+0000 7f65381a0700 1 -- 172.21.15.84:0/3015938804 shutdown_connections 2023-09-13T08:25:03.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.802+0000 7f65381a0700 1 -- 172.21.15.84:0/3015938804 wait complete. 2023-09-13T08:25:03.814 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-09-13T08:25:03.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.936+0000 7fd90d570700 1 Processor -- start 2023-09-13T08:25:03.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.936+0000 7fd90d570700 1 -- start start 2023-09-13T08:25:03.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.937+0000 7fd90d570700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd9080ced40 0x7fd9080cda40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:03.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.937+0000 7fd90d570700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9080cd170 con 0x7fd90815ea00 2023-09-13T08:25:03.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.937+0000 7fd90d570700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9080cc8d0 con 0x7fd9080cdf80 2023-09-13T08:25:03.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.937+0000 7fd90d570700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9080ce410 con 0x7fd9080ced40 2023-09-13T08:25:03.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.937+0000 7fd906ffd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fd90815ea00 0x7fd9080cbd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:46286/0 (socket says 172.21.15.84:46286) 2023-09-13T08:25:03.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.937+0000 7fd906ffd700 1 -- 172.21.15.84:0/2553917886 learned_addr learned my addr 172.21.15.84:0/2553917886 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:25:03.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.938+0000 7fd905ffb700 1 -- 172.21.15.84:0/2553917886 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2251048108 0 0) 0x7fd9080cd170 con 0x7fd90815ea00 2023-09-13T08:25:03.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.938+0000 7fd9067fc700 1 --2- 172.21.15.84:0/2553917886 >> v2:172.21.15.161:3300/0 conn(0x7fd9080ced40 0x7fd9080cda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:03.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.938+0000 7fd905ffb700 1 -- 172.21.15.84:0/2553917886 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8f00035b0 con 0x7fd90815ea00 2023-09-13T08:25:03.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.938+0000 7fd905ffb700 1 -- 172.21.15.84:0/2553917886 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 810092339 0 0) 0x7fd8f00035b0 con 0x7fd90815ea00 2023-09-13T08:25:03.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.938+0000 7fd905ffb700 1 -- 172.21.15.84:0/2553917886 >> v2:172.21.15.161:3300/0 conn(0x7fd9080ced40 msgr2=0x7fd9080cda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:03.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.938+0000 7fd905ffb700 1 --2- 172.21.15.84:0/2553917886 >> v2:172.21.15.161:3300/0 conn(0x7fd9080ced40 0x7fd9080cda40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:03.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.938+0000 7fd905ffb700 1 -- 172.21.15.84:0/2553917886 >> v1:172.21.15.161:6789/0 conn(0x7fd9080cdf80 legacy=0x7fd90815f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:03.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.938+0000 7fd905ffb700 1 -- 172.21.15.84:0/2553917886 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9080ccbb0 con 0x7fd90815ea00 2023-09-13T08:25:03.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.938+0000 7fd905ffb700 1 -- 172.21.15.84:0/2553917886 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2302733408 0 0) 0x7fd8fc0017f0 con 0x7fd90815ea00 2023-09-13T08:25:03.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.938+0000 7fd905ffb700 1 -- 172.21.15.84:0/2553917886 >> v1:172.21.15.84:6789/0 conn(0x7fd90815ea00 legacy=0x7fd9080cbd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:03.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.938+0000 7fd905ffb700 1 --2- 172.21.15.84:0/2553917886 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd8f0003a00 0x7fd8f0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:03.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.938+0000 7fd905ffb700 1 --2- 172.21.15.84:0/2553917886 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd8f0004850 0x7fd8f0004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:03.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.938+0000 7fd905ffb700 1 --2- 172.21.15.84:0/2553917886 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd8f0005210 0x7fd8f000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:03.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.938+0000 7fd905ffb700 1 -- 172.21.15.84:0/2553917886 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9080ce410 con 0x7fd8f0004850 2023-09-13T08:25:03.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.938+0000 7fd905ffb700 1 -- 172.21.15.84:0/2553917886 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f000c1b0 con 0x7fd8f0005210 2023-09-13T08:25:03.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.938+0000 7fd905ffb700 1 -- 172.21.15.84:0/2553917886 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f000c370 con 0x7fd8f0003a00 2023-09-13T08:25:03.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.938+0000 7fd9067fc700 1 --2- 172.21.15.84:0/2553917886 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd8f0004850 0x7fd8f0004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:03.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.938+0000 7fd906ffd700 1 --2- 172.21.15.84:0/2553917886 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd8f0003a00 0x7fd8f0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:03.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.938+0000 7fd9077fe700 1 --2- 172.21.15.84:0/2553917886 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd8f0005210 0x7fd8f000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:03.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.938+0000 7fd9067fc700 1 -- 172.21.15.84:0/2553917886 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd8f0003a00 msgr2=0x7fd8f0003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:03.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.938+0000 7fd9067fc700 1 --2- 172.21.15.84:0/2553917886 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd8f0003a00 0x7fd8f0003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:03.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.938+0000 7fd9067fc700 1 -- 172.21.15.84:0/2553917886 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd8f0005210 msgr2=0x7fd8f000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:03.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.938+0000 7fd9067fc700 1 --2- 172.21.15.84:0/2553917886 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd8f0005210 0x7fd8f000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:03.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.938+0000 7fd9067fc700 1 -- 172.21.15.84:0/2553917886 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8f00035b0 con 0x7fd8f0004850 2023-09-13T08:25:03.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.938+0000 7fd9077fe700 1 --2- 172.21.15.84:0/2553917886 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd8f0005210 0x7fd8f000ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T08:25:03.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.938+0000 7fd9077fe700 1 -- 172.21.15.84:0/2553917886 reap_dead start 2023-09-13T08:25:03.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.938+0000 7fd9067fc700 1 --2- 172.21.15.84:0/2553917886 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd8f0004850 0x7fd8f0004cd0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd8f8009b60 tx=0x7fd8f0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=560bc725e65161d8 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:03.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.939+0000 7fd905ffb700 1 -- 172.21.15.84:0/2553917886 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f800e6c0 con 0x7fd8f0004850 2023-09-13T08:25:03.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.939+0000 7fd905ffb700 1 -- 172.21.15.84:0/2553917886 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8f800e820 con 0x7fd8f0004850 2023-09-13T08:25:03.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.939+0000 7fd905ffb700 1 -- 172.21.15.84:0/2553917886 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f800eb90 con 0x7fd8f0004850 2023-09-13T08:25:03.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.939+0000 7fd90d570700 1 -- 172.21.15.84:0/2553917886 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd8f0004850 msgr2=0x7fd8f0004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:03.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.939+0000 7fd90d570700 1 --2- 172.21.15.84:0/2553917886 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd8f0004850 0x7fd8f0004cd0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd8f8009b60 tx=0x7fd8f0005880 comp rx=0 tx=0).stop 2023-09-13T08:25:03.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.939+0000 7fd90d570700 1 -- 172.21.15.84:0/2553917886 shutdown_connections 2023-09-13T08:25:03.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.939+0000 7fd90d570700 1 --2- 172.21.15.84:0/2553917886 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd8f0004850 0x7fd8f0004cd0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:03.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.939+0000 7fd90d570700 1 -- 172.21.15.84:0/2553917886 >> 172.21.15.84:0/2553917886 conn(0x7fd90809a470 msgr2=0x7fd9080d1170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:03.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.939+0000 7fd90d570700 1 -- 172.21.15.84:0/2553917886 shutdown_connections 2023-09-13T08:25:03.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.939+0000 7fd90d570700 1 -- 172.21.15.84:0/2553917886 wait complete. 2023-09-13T08:25:03.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.941+0000 7fd90d570700 1 Processor -- start 2023-09-13T08:25:03.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.941+0000 7fd90d570700 1 -- start start 2023-09-13T08:25:03.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.941+0000 7fd90d570700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd8f0004850 0x7fd9080c50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:03.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.941+0000 7fd90d570700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9080b64b0 0x7fd9080b6930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:03.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.941+0000 7fd90d570700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9080b2d70 0x7fd9080b3200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:03.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.941+0000 7fd90d570700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9080b6e70 con 0x7fd9080b2d70 2023-09-13T08:25:03.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.941+0000 7fd90d570700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9080b4630 con 0x7fd9080b64b0 2023-09-13T08:25:03.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.941+0000 7fd90d570700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9081f3e80 con 0x7fd8f0004850 2023-09-13T08:25:03.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.941+0000 7fd9077fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9080b2d70 0x7fd9080b3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:03.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.942+0000 7fd9077fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9080b2d70 0x7fd9080b3200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43656/0 (socket says 172.21.15.84:43656) 2023-09-13T08:25:03.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.942+0000 7fd9077fe700 1 -- 172.21.15.84:0/1191069430 learned_addr learned my addr 172.21.15.84:0/1191069430 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:03.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.942+0000 7fd9067fc700 1 --2- 172.21.15.84:0/1191069430 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9080b64b0 0x7fd9080b6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:03.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.942+0000 7fd906ffd700 1 --2- 172.21.15.84:0/1191069430 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd8f0004850 0x7fd9080c50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:03.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.942+0000 7fd9077fe700 1 -- 172.21.15.84:0/1191069430 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd8f0004850 msgr2=0x7fd9080c50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:03.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.942+0000 7fd9077fe700 1 --2- 172.21.15.84:0/1191069430 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd8f0004850 0x7fd9080c50b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:03.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.942+0000 7fd9077fe700 1 -- 172.21.15.84:0/1191069430 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9080b64b0 msgr2=0x7fd9080b6930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:03.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.942+0000 7fd9077fe700 1 --2- 172.21.15.84:0/1191069430 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9080b64b0 0x7fd9080b6930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:03.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.942+0000 7fd9077fe700 1 -- 172.21.15.84:0/1191069430 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9081f4a00 con 0x7fd9080b2d70 2023-09-13T08:25:03.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.942+0000 7fd9077fe700 1 --2- 172.21.15.84:0/1191069430 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9080b2d70 0x7fd9080b3200 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd90000ea70 tx=0x7fd90000ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:03.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.942+0000 7fd8ef7fe700 1 -- 172.21.15.84:0/1191069430 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90000eeb0 con 0x7fd9080b2d70 2023-09-13T08:25:03.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.942+0000 7fd8ef7fe700 1 -- 172.21.15.84:0/1191069430 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd900003c10 con 0x7fd9080b2d70 2023-09-13T08:25:03.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.942+0000 7fd90d570700 1 -- 172.21.15.84:0/1191069430 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9081f40d0 con 0x7fd9080b2d70 2023-09-13T08:25:03.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.942+0000 7fd8ef7fe700 1 -- 172.21.15.84:0/1191069430 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9000050d0 con 0x7fd9080b2d70 2023-09-13T08:25:03.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.942+0000 7fd90d570700 1 -- 172.21.15.84:0/1191069430 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9081f4690 con 0x7fd9080b2d70 2023-09-13T08:25:03.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.943+0000 7fd90d570700 1 -- 172.21.15.84:0/1191069430 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd90804f200 con 0x7fd9080b2d70 2023-09-13T08:25:03.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.943+0000 7fd8ef7fe700 1 -- 172.21.15.84:0/1191069430 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fd900005230 con 0x7fd9080b2d70 2023-09-13T08:25:03.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.944+0000 7fd8ef7fe700 1 --2- 172.21.15.84:0/1191069430 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fd8f406a580 0x7fd8f406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:03.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.944+0000 7fd8ef7fe700 1 -- 172.21.15.84:0/1191069430 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd900088ae0 con 0x7fd9080b2d70 2023-09-13T08:25:03.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.944+0000 7fd906ffd700 1 --2- 172.21.15.84:0/1191069430 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fd8f406a580 0x7fd8f406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:03.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.944+0000 7fd906ffd700 1 --2- 172.21.15.84:0/1191069430 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fd8f406a580 0x7fd8f406ca40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc000ef0 tx=0x7fd8fc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:03.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:03.948+0000 7fd8ef7fe700 1 -- 172.21.15.84:0/1191069430 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fd900053eb0 con 0x7fd9080b2d70 2023-09-13T08:25:04.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:04.182+0000 7fd90d570700 1 -- 172.21.15.84:0/1191069430 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fd9080d2080 con 0x7fd9080b2d70 2023-09-13T08:25:04.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:04.822+0000 7fd8ef7fe700 1 -- 172.21.15.84:0/1191069430 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7fd9000574d0 con 0x7fd9080b2d70 2023-09-13T08:25:04.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:04.824+0000 7fd90d570700 1 -- 172.21.15.84:0/1191069430 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fd8f406a580 msgr2=0x7fd8f406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:04.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:04.824+0000 7fd90d570700 1 --2- 172.21.15.84:0/1191069430 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fd8f406a580 0x7fd8f406ca40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc000ef0 tx=0x7fd8fc009040 comp rx=0 tx=0).stop 2023-09-13T08:25:04.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:04.824+0000 7fd90d570700 1 -- 172.21.15.84:0/1191069430 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9080b2d70 msgr2=0x7fd9080b3200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:04.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:04.824+0000 7fd90d570700 1 --2- 172.21.15.84:0/1191069430 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9080b2d70 0x7fd9080b3200 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd90000ea70 tx=0x7fd90000ed80 comp rx=0 tx=0).stop 2023-09-13T08:25:04.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:04.824+0000 7fd90d570700 1 -- 172.21.15.84:0/1191069430 shutdown_connections 2023-09-13T08:25:04.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:04.824+0000 7fd90d570700 1 --2- 172.21.15.84:0/1191069430 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9080b2d70 0x7fd9080b3200 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:04.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:04.824+0000 7fd90d570700 1 --2- 172.21.15.84:0/1191069430 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd8f0004850 0x7fd9080c50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:04.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:04.824+0000 7fd90d570700 1 --2- 172.21.15.84:0/1191069430 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fd8f406a580 0x7fd8f406ca40 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:04.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:04.824+0000 7fd90d570700 1 --2- 172.21.15.84:0/1191069430 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9080b64b0 0x7fd9080b6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:04.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:04.824+0000 7fd90d570700 1 -- 172.21.15.84:0/1191069430 >> 172.21.15.84:0/1191069430 conn(0x7fd90809a470 msgr2=0x7fd9080cf7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:04.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:04.824+0000 7fd90d570700 1 -- 172.21.15.84:0/1191069430 shutdown_connections 2023-09-13T08:25:04.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:04.824+0000 7fd90d570700 1 -- 172.21.15.84:0/1191069430 wait complete. 2023-09-13T08:25:04.838 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2023-09-13T08:25:04.839 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-09-13T08:25:04.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:04.967+0000 7fe5e54a5700 1 Processor -- start 2023-09-13T08:25:04.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:04.967+0000 7fe5e54a5700 1 -- start start 2023-09-13T08:25:04.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:04.968+0000 7fe5e54a5700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe5e00b8d50 0x7fe5e0160ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:04.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:04.968+0000 7fe5e54a5700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5e015d950 con 0x7fe5e015d570 2023-09-13T08:25:04.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:04.968+0000 7fe5e54a5700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5e00b91a0 con 0x7fe5e00d0340 2023-09-13T08:25:04.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:04.968+0000 7fe5e54a5700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5e01616f0 con 0x7fe5e00b8d50 2023-09-13T08:25:04.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:04.968+0000 7fe5deffd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fe5e015d570 0x7fe5e00cfc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:46306/0 (socket says 172.21.15.84:46306) 2023-09-13T08:25:04.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:04.968+0000 7fe5deffd700 1 -- 172.21.15.84:0/3032071949 learned_addr learned my addr 172.21.15.84:0/3032071949 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:25:04.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:04.968+0000 7fe5df7fe700 1 --2- 172.21.15.84:0/3032071949 >> v2:172.21.15.161:3300/0 conn(0x7fe5e00b8d50 0x7fe5e0160ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:04.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:04.968+0000 7fe5ddffb700 1 -- 172.21.15.84:0/3032071949 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2387104980 0 0) 0x7fe5d4001110 con 0x7fe5e015d570 2023-09-13T08:25:04.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:04.968+0000 7fe5ddffb700 1 -- 172.21.15.84:0/3032071949 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5c80035b0 con 0x7fe5e015d570 2023-09-13T08:25:04.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:04.968+0000 7fe5ddffb700 1 -- 172.21.15.84:0/3032071949 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2357092890 0 0) 0x7fe5c80035b0 con 0x7fe5e015d570 2023-09-13T08:25:04.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:04.968+0000 7fe5ddffb700 1 -- 172.21.15.84:0/3032071949 >> v2:172.21.15.161:3300/0 conn(0x7fe5e00b8d50 msgr2=0x7fe5e0160ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:04.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:04.968+0000 7fe5ddffb700 1 --2- 172.21.15.84:0/3032071949 >> v2:172.21.15.161:3300/0 conn(0x7fe5e00b8d50 0x7fe5e0160ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:04.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:04.968+0000 7fe5ddffb700 1 -- 172.21.15.84:0/3032071949 >> v1:172.21.15.161:6789/0 conn(0x7fe5e00d0340 legacy=0x7fe5e00d1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:04.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:04.968+0000 7fe5ddffb700 1 -- 172.21.15.84:0/3032071949 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5e01619d0 con 0x7fe5e015d570 2023-09-13T08:25:04.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:04.968+0000 7fe5ddffb700 1 -- 172.21.15.84:0/3032071949 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2302733408 0 0) 0x7fe5d4001800 con 0x7fe5e015d570 2023-09-13T08:25:04.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:04.968+0000 7fe5df7fe700 1 --2- 172.21.15.84:0/3032071949 >> v2:172.21.15.161:3300/0 conn(0x7fe5e00b8d50 0x7fe5e0160ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T08:25:04.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:04.968+0000 7fe5ddffb700 1 -- 172.21.15.84:0/3032071949 >> v1:172.21.15.84:6789/0 conn(0x7fe5e015d570 legacy=0x7fe5e00cfc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:04.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:04.969+0000 7fe5ddffb700 1 --2- 172.21.15.84:0/3032071949 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5c8003a00 0x7fe5c8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:04.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:04.969+0000 7fe5ddffb700 1 --2- 172.21.15.84:0/3032071949 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe5c8004850 0x7fe5c8004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:04.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:04.969+0000 7fe5ddffb700 1 --2- 172.21.15.84:0/3032071949 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe5c8005210 0x7fe5c800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:04.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:04.969+0000 7fe5ddffb700 1 -- 172.21.15.84:0/3032071949 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e01616f0 con 0x7fe5c8003a00 2023-09-13T08:25:04.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:04.969+0000 7fe5ddffb700 1 -- 172.21.15.84:0/3032071949 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c800c0b0 con 0x7fe5c8005210 2023-09-13T08:25:04.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:04.969+0000 7fe5ddffb700 1 -- 172.21.15.84:0/3032071949 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c800c270 con 0x7fe5c8004850 2023-09-13T08:25:04.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:04.969+0000 7fe5deffd700 1 --2- 172.21.15.84:0/3032071949 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5c8003a00 0x7fe5c8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:04.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:04.969+0000 7fe5df7fe700 1 --2- 172.21.15.84:0/3032071949 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe5c8005210 0x7fe5c800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:04.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:04.969+0000 7fe5de7fc700 1 --2- 172.21.15.84:0/3032071949 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe5c8004850 0x7fe5c8004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:04.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:04.969+0000 7fe5deffd700 1 -- 172.21.15.84:0/3032071949 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe5c8004850 msgr2=0x7fe5c8004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:04.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:04.969+0000 7fe5deffd700 1 --2- 172.21.15.84:0/3032071949 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe5c8004850 0x7fe5c8004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:04.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:04.969+0000 7fe5deffd700 1 -- 172.21.15.84:0/3032071949 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe5c8005210 msgr2=0x7fe5c800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:04.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:04.969+0000 7fe5deffd700 1 --2- 172.21.15.84:0/3032071949 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe5c8005210 0x7fe5c800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:04.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:04.969+0000 7fe5deffd700 1 -- 172.21.15.84:0/3032071949 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5c80035b0 con 0x7fe5c8003a00 2023-09-13T08:25:04.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:04.969+0000 7fe5df7fe700 1 --2- 172.21.15.84:0/3032071949 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe5c8005210 0x7fe5c800ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T08:25:04.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:04.969+0000 7fe5df7fe700 1 -- 172.21.15.84:0/3032071949 reap_dead start 2023-09-13T08:25:04.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:04.969+0000 7fe5deffd700 1 --2- 172.21.15.84:0/3032071949 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5c8003a00 0x7fe5c8003e20 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe5d400c210 tx=0x7fe5c8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be974cdb041318fe server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:04.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:04.969+0000 7fe5ddffb700 1 -- 172.21.15.84:0/3032071949 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5d4007d90 con 0x7fe5c8003a00 2023-09-13T08:25:04.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:04.969+0000 7fe5ddffb700 1 -- 172.21.15.84:0/3032071949 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5d400cdd0 con 0x7fe5c8003a00 2023-09-13T08:25:04.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:04.969+0000 7fe5ddffb700 1 -- 172.21.15.84:0/3032071949 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5d4005ba0 con 0x7fe5c8003a00 2023-09-13T08:25:04.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:04.970+0000 7fe5e54a5700 1 -- 172.21.15.84:0/3032071949 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5c8003a00 msgr2=0x7fe5c8003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:04.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:04.970+0000 7fe5e54a5700 1 --2- 172.21.15.84:0/3032071949 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5c8003a00 0x7fe5c8003e20 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe5d400c210 tx=0x7fe5c8005880 comp rx=0 tx=0).stop 2023-09-13T08:25:04.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:04.970+0000 7fe5e54a5700 1 -- 172.21.15.84:0/3032071949 shutdown_connections 2023-09-13T08:25:04.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:04.970+0000 7fe5e54a5700 1 --2- 172.21.15.84:0/3032071949 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5c8003a00 0x7fe5c8003e20 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:04.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:04.970+0000 7fe5e54a5700 1 -- 172.21.15.84:0/3032071949 >> 172.21.15.84:0/3032071949 conn(0x7fe5e006b0d0 msgr2=0x7fe5e006b4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:04.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:04.970+0000 7fe5e54a5700 1 -- 172.21.15.84:0/3032071949 shutdown_connections 2023-09-13T08:25:04.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:04.970+0000 7fe5e54a5700 1 -- 172.21.15.84:0/3032071949 wait complete. 2023-09-13T08:25:04.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:04.971+0000 7fe5e54a5700 1 Processor -- start 2023-09-13T08:25:04.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:04.971+0000 7fe5e54a5700 1 -- start start 2023-09-13T08:25:04.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:04.972+0000 7fe5e54a5700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe5c8003a00 0x7fe5e0155460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:04.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:04.972+0000 7fe5e54a5700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe5e0154060 0x7fe5e00d2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:04.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:04.972+0000 7fe5e54a5700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5e01544e0 0x7fe5e00d33e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:04.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:04.972+0000 7fe5e54a5700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e01559a0 con 0x7fe5e01544e0 2023-09-13T08:25:04.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:04.972+0000 7fe5e54a5700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e00c7200 con 0x7fe5c8003a00 2023-09-13T08:25:04.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:04.972+0000 7fe5e54a5700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e00c74e0 con 0x7fe5e0154060 2023-09-13T08:25:04.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:04.972+0000 7fe5df7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5e01544e0 0x7fe5e00d33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:04.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:04.972+0000 7fe5df7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5e01544e0 0x7fe5e00d33e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43674/0 (socket says 172.21.15.84:43674) 2023-09-13T08:25:04.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:04.972+0000 7fe5df7fe700 1 -- 172.21.15.84:0/1976213394 learned_addr learned my addr 172.21.15.84:0/1976213394 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:04.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:04.972+0000 7fe5deffd700 1 --2- 172.21.15.84:0/1976213394 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe5c8003a00 0x7fe5e0155460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:04.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:04.972+0000 7fe5de7fc700 1 --2- 172.21.15.84:0/1976213394 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe5e0154060 0x7fe5e00d2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:04.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:04.972+0000 7fe5df7fe700 1 -- 172.21.15.84:0/1976213394 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe5e0154060 msgr2=0x7fe5e00d2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:04.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:04.972+0000 7fe5df7fe700 1 --2- 172.21.15.84:0/1976213394 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe5e0154060 0x7fe5e00d2ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:04.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:04.972+0000 7fe5df7fe700 1 -- 172.21.15.84:0/1976213394 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe5c8003a00 msgr2=0x7fe5e0155460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:04.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:04.972+0000 7fe5df7fe700 1 --2- 172.21.15.84:0/1976213394 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe5c8003a00 0x7fe5e0155460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:04.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:04.972+0000 7fe5df7fe700 1 -- 172.21.15.84:0/1976213394 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5e00c77c0 con 0x7fe5e01544e0 2023-09-13T08:25:04.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:04.972+0000 7fe5de7fc700 1 --2- 172.21.15.84:0/1976213394 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe5e0154060 0x7fe5e00d2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T08:25:04.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:04.972+0000 7fe5df7fe700 1 --2- 172.21.15.84:0/1976213394 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5e01544e0 0x7fe5e00d33e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe5e006c480 tx=0x7fe5d80114b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:04.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:04.972+0000 7fe5c77fe700 1 -- 172.21.15.84:0/1976213394 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5d800e030 con 0x7fe5e01544e0 2023-09-13T08:25:04.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:04.972+0000 7fe5c77fe700 1 -- 172.21.15.84:0/1976213394 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5d8011c20 con 0x7fe5e01544e0 2023-09-13T08:25:04.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:04.972+0000 7fe5e54a5700 1 -- 172.21.15.84:0/1976213394 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5e00c7aa0 con 0x7fe5e01544e0 2023-09-13T08:25:04.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:04.972+0000 7fe5c77fe700 1 -- 172.21.15.84:0/1976213394 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5d8016470 con 0x7fe5e01544e0 2023-09-13T08:25:04.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:04.972+0000 7fe5e54a5700 1 -- 172.21.15.84:0/1976213394 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5e00c6f90 con 0x7fe5e01544e0 2023-09-13T08:25:04.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:04.973+0000 7fe5e54a5700 1 -- 172.21.15.84:0/1976213394 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5e004f200 con 0x7fe5e01544e0 2023-09-13T08:25:04.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:04.974+0000 7fe5c77fe700 1 -- 172.21.15.84:0/1976213394 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fe5d80165d0 con 0x7fe5e01544e0 2023-09-13T08:25:04.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:04.974+0000 7fe5c77fe700 1 --2- 172.21.15.84:0/1976213394 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fe5cc06a580 0x7fe5cc06ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:04.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:04.974+0000 7fe5deffd700 1 --2- 172.21.15.84:0/1976213394 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fe5cc06a580 0x7fe5cc06ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:04.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:04.974+0000 7fe5c77fe700 1 -- 172.21.15.84:0/1976213394 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe5d800f070 con 0x7fe5e01544e0 2023-09-13T08:25:04.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:04.975+0000 7fe5deffd700 1 --2- 172.21.15.84:0/1976213394 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fe5cc06a580 0x7fe5cc06ca40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe5d4000c00 tx=0x7fe5d4007000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:04.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:04.979+0000 7fe5c77fe700 1 -- 172.21.15.84:0/1976213394 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fe5d8054950 con 0x7fe5e01544e0 2023-09-13T08:25:05.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:05.210+0000 7fe5e54a5700 1 -- 172.21.15.84:0/1976213394 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fe5e0160fc0 con 0x7fe5e01544e0 2023-09-13T08:25:05.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:05.826+0000 7fe5c77fe700 1 -- 172.21.15.84:0/1976213394 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe5d8057f70 con 0x7fe5e01544e0 2023-09-13T08:25:05.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:05.829+0000 7fe5e54a5700 1 -- 172.21.15.84:0/1976213394 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fe5cc06a580 msgr2=0x7fe5cc06ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:05.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:05.829+0000 7fe5e54a5700 1 --2- 172.21.15.84:0/1976213394 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fe5cc06a580 0x7fe5cc06ca40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe5d4000c00 tx=0x7fe5d4007000 comp rx=0 tx=0).stop 2023-09-13T08:25:05.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:05.829+0000 7fe5e54a5700 1 -- 172.21.15.84:0/1976213394 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5e01544e0 msgr2=0x7fe5e00d33e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:05.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:05.829+0000 7fe5e54a5700 1 --2- 172.21.15.84:0/1976213394 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5e01544e0 0x7fe5e00d33e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe5e006c480 tx=0x7fe5d80114b0 comp rx=0 tx=0).stop 2023-09-13T08:25:05.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:05.829+0000 7fe5e54a5700 1 -- 172.21.15.84:0/1976213394 shutdown_connections 2023-09-13T08:25:05.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:05.829+0000 7fe5e54a5700 1 --2- 172.21.15.84:0/1976213394 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5e01544e0 0x7fe5e00d33e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:05.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:05.829+0000 7fe5e54a5700 1 --2- 172.21.15.84:0/1976213394 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fe5cc06a580 0x7fe5cc06ca40 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:05.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:05.829+0000 7fe5e54a5700 1 --2- 172.21.15.84:0/1976213394 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe5c8003a00 0x7fe5e0155460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:05.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:05.829+0000 7fe5e54a5700 1 --2- 172.21.15.84:0/1976213394 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe5e0154060 0x7fe5e00d2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:05.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:05.829+0000 7fe5e54a5700 1 -- 172.21.15.84:0/1976213394 >> 172.21.15.84:0/1976213394 conn(0x7fe5e006b0d0 msgr2=0x7fe5e015daf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:05.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:05.830+0000 7fe5e54a5700 1 -- 172.21.15.84:0/1976213394 shutdown_connections 2023-09-13T08:25:05.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:05.830+0000 7fe5e54a5700 1 -- 172.21.15.84:0/1976213394 wait complete. 2023-09-13T08:25:05.844 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-09-13T08:25:05.845 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T08:25:05.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:05.970+0000 7fc768ce3700 1 Processor -- start 2023-09-13T08:25:05.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:05.970+0000 7fc768ce3700 1 -- start start 2023-09-13T08:25:05.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:05.971+0000 7fc768ce3700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc76415d530 0x7fc764161bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:05.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:05.971+0000 7fc768ce3700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc7640ca920 0x7fc76406d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:05.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:05.971+0000 7fc768ce3700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7641620f0 con 0x7fc76406a620 2023-09-13T08:25:05.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:05.971+0000 7fc768ce3700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7640cff20 con 0x7fc7640ca920 2023-09-13T08:25:05.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:05.971+0000 7fc768ce3700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7640cae50 con 0x7fc76415d530 2023-09-13T08:25:05.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:05.971+0000 7fc761d9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc7640ca920 0x7fc76406d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:05.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:05.971+0000 7fc762d9d700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fc76406a620 0x7fc7640ce490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:46330/0 (socket says 172.21.15.84:46330) 2023-09-13T08:25:05.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:05.971+0000 7fc761d9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc7640ca920 0x7fc76406d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43680/0 (socket says 172.21.15.84:43680) 2023-09-13T08:25:05.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:05.971+0000 7fc762d9d700 1 -- 172.21.15.84:0/347547006 learned_addr learned my addr 172.21.15.84:0/347547006 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:25:05.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:05.971+0000 7fc76259c700 1 --2- 172.21.15.84:0/347547006 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc76415d530 0x7fc764161bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:05.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:05.971+0000 7fc761d9b700 1 -- 172.21.15.84:0/347547006 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc76415d530 msgr2=0x7fc764161bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:05.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:05.971+0000 7fc761d9b700 1 --2- 172.21.15.84:0/347547006 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc76415d530 0x7fc764161bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:05.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:05.971+0000 7fc761d9b700 1 -- 172.21.15.84:0/347547006 >> v1:172.21.15.84:6789/0 conn(0x7fc76406a620 legacy=0x7fc7640ce490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:05.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:05.971+0000 7fc761d9b700 1 -- 172.21.15.84:0/347547006 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7640cb130 con 0x7fc7640ca920 2023-09-13T08:25:05.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:05.971+0000 7fc76159a700 1 -- 172.21.15.84:0/347547006 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3904361542 0 0) 0x7fc7641620f0 con 0x7fc76406a620 2023-09-13T08:25:05.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:05.971+0000 7fc761d9b700 1 --2- 172.21.15.84:0/347547006 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7640ca920 0x7fc76406d700 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc754009840 tx=0x7fc754009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc03ea18d9f04ade server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:05.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:05.972+0000 7fc76159a700 1 -- 172.21.15.84:0/347547006 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc754011830 con 0x7fc7640ca920 2023-09-13T08:25:05.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:05.972+0000 7fc76159a700 1 -- 172.21.15.84:0/347547006 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc754011990 con 0x7fc7640ca920 2023-09-13T08:25:05.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:05.972+0000 7fc76159a700 1 -- 172.21.15.84:0/347547006 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc754011d20 con 0x7fc7640ca920 2023-09-13T08:25:05.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:05.972+0000 7fc768ce3700 1 -- 172.21.15.84:0/347547006 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7640ca920 msgr2=0x7fc76406d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:05.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:05.972+0000 7fc768ce3700 1 --2- 172.21.15.84:0/347547006 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7640ca920 0x7fc76406d700 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc754009840 tx=0x7fc754009b50 comp rx=0 tx=0).stop 2023-09-13T08:25:05.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:05.972+0000 7fc768ce3700 1 -- 172.21.15.84:0/347547006 shutdown_connections 2023-09-13T08:25:05.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:05.972+0000 7fc768ce3700 1 --2- 172.21.15.84:0/347547006 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc76415d530 0x7fc764161bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:05.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:05.972+0000 7fc768ce3700 1 --2- 172.21.15.84:0/347547006 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7640ca920 0x7fc76406d700 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:05.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:05.972+0000 7fc768ce3700 1 -- 172.21.15.84:0/347547006 >> 172.21.15.84:0/347547006 conn(0x7fc7640d00c0 msgr2=0x7fc7640d04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:05.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:05.972+0000 7fc768ce3700 1 -- 172.21.15.84:0/347547006 shutdown_connections 2023-09-13T08:25:05.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:05.972+0000 7fc768ce3700 1 -- 172.21.15.84:0/347547006 wait complete. 2023-09-13T08:25:05.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:05.974+0000 7fc768ce3700 1 Processor -- start 2023-09-13T08:25:05.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:05.974+0000 7fc768ce3700 1 -- start start 2023-09-13T08:25:05.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:05.974+0000 7fc768ce3700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc76406a620 0x7fc764154bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:05.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:05.974+0000 7fc768ce3700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc7640ca920 0x7fc7640c9650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:05.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:05.974+0000 7fc768ce3700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc76415d530 0x7fc7640c9b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:05.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:05.974+0000 7fc768ce3700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7640c8bb0 con 0x7fc76406a620 2023-09-13T08:25:05.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:05.974+0000 7fc768ce3700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc764155130 con 0x7fc76415d530 2023-09-13T08:25:05.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:05.974+0000 7fc768ce3700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7640c7fa0 con 0x7fc7640ca920 2023-09-13T08:25:05.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:05.974+0000 7fc76259c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc76406a620 0x7fc764154bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:05.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:05.974+0000 7fc76259c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc76406a620 0x7fc764154bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43686/0 (socket says 172.21.15.84:43686) 2023-09-13T08:25:05.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:05.974+0000 7fc76259c700 1 -- 172.21.15.84:0/2644617557 learned_addr learned my addr 172.21.15.84:0/2644617557 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:05.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:05.975+0000 7fc761d9b700 1 --2- 172.21.15.84:0/2644617557 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc7640ca920 0x7fc7640c9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:05.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:05.975+0000 7fc762d9d700 1 --2- 172.21.15.84:0/2644617557 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc76415d530 0x7fc7640c9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:05.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:05.975+0000 7fc76259c700 1 -- 172.21.15.84:0/2644617557 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc7640ca920 msgr2=0x7fc7640c9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:05.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:05.975+0000 7fc76259c700 1 --2- 172.21.15.84:0/2644617557 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc7640ca920 0x7fc7640c9650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:05.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:05.975+0000 7fc76259c700 1 -- 172.21.15.84:0/2644617557 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc76415d530 msgr2=0x7fc7640c9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:05.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:05.975+0000 7fc76259c700 1 --2- 172.21.15.84:0/2644617557 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc76415d530 0x7fc7640c9b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:05.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:05.975+0000 7fc76259c700 1 -- 172.21.15.84:0/2644617557 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7540094a0 con 0x7fc76406a620 2023-09-13T08:25:05.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:05.975+0000 7fc761d9b700 1 --2- 172.21.15.84:0/2644617557 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc7640ca920 0x7fc7640c9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T08:25:05.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:05.975+0000 7fc762d9d700 1 --2- 172.21.15.84:0/2644617557 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc76415d530 0x7fc7640c9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T08:25:05.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:05.975+0000 7fc76259c700 1 --2- 172.21.15.84:0/2644617557 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc76406a620 0x7fc764154bf0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc75800d830 tx=0x7fc75800dbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:05.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:05.975+0000 7fc752ffd700 1 -- 172.21.15.84:0/2644617557 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7580125f0 con 0x7fc76406a620 2023-09-13T08:25:05.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:05.975+0000 7fc752ffd700 1 -- 172.21.15.84:0/2644617557 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc758012750 con 0x7fc76406a620 2023-09-13T08:25:05.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:05.975+0000 7fc768ce3700 1 -- 172.21.15.84:0/2644617557 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7640c8280 con 0x7fc76406a620 2023-09-13T08:25:05.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:05.975+0000 7fc752ffd700 1 -- 172.21.15.84:0/2644617557 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc758012b00 con 0x7fc76406a620 2023-09-13T08:25:05.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:05.975+0000 7fc768ce3700 1 -- 172.21.15.84:0/2644617557 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7640c8840 con 0x7fc76406a620 2023-09-13T08:25:05.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:05.976+0000 7fc768ce3700 1 -- 172.21.15.84:0/2644617557 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc764155ff0 con 0x7fc76406a620 2023-09-13T08:25:05.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:05.976+0000 7fc752ffd700 1 -- 172.21.15.84:0/2644617557 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fc758012c60 con 0x7fc76406a620 2023-09-13T08:25:05.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:05.977+0000 7fc752ffd700 1 --2- 172.21.15.84:0/2644617557 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fc74406a580 0x7fc74406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:05.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:05.977+0000 7fc752ffd700 1 -- 172.21.15.84:0/2644617557 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc7580890c0 con 0x7fc76406a620 2023-09-13T08:25:05.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:05.977+0000 7fc761d9b700 1 --2- 172.21.15.84:0/2644617557 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fc74406a580 0x7fc74406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:05.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:05.977+0000 7fc761d9b700 1 --2- 172.21.15.84:0/2644617557 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fc74406a580 0x7fc74406ca40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc7640cad80 tx=0x7fc754008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:05.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:05.981+0000 7fc752ffd700 1 -- 172.21.15.84:0/2644617557 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fc758054350 con 0x7fc76406a620 2023-09-13T08:25:06.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.212+0000 7fc768ce3700 1 -- 172.21.15.84:0/2644617557 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc76404e9b0 con 0x7fc76406a620 2023-09-13T08:25:06.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.213+0000 7fc752ffd700 1 -- 172.21.15.84:0/2644617557 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4909 (secure 0 0 0) 0x7fc758057970 con 0x7fc76406a620 2023-09-13T08:25:06.213 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:25:06.213 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/3581118217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6833","nonce":3581118217},{"type":"v1","addr":"172.21.15.161:6835","nonce":3581118217}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4296,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/566416855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":566416855},{"type":"v1","addr":"172.21.15.84:6835","nonce":566416855}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4299,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/482729238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":482729238},{"type":"v1","addr":"172.21.15.84:6837","nonce":482729238}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T08:24:42.132788+0000","modified":"2023-09-13T08:25:05.211766+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4314},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4314":{"gid":4314,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.161:6834/2524298549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":2524298549},{"type":"v1","addr":"172.21.15.161:6834","nonce":2524298549}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-13T08:25:06.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.215+0000 7fc768ce3700 1 -- 172.21.15.84:0/2644617557 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fc74406a580 msgr2=0x7fc74406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:06.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.215+0000 7fc768ce3700 1 --2- 172.21.15.84:0/2644617557 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fc74406a580 0x7fc74406ca40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc7640cad80 tx=0x7fc754008030 comp rx=0 tx=0).stop 2023-09-13T08:25:06.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.215+0000 7fc768ce3700 1 -- 172.21.15.84:0/2644617557 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc76406a620 msgr2=0x7fc764154bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:06.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.215+0000 7fc768ce3700 1 --2- 172.21.15.84:0/2644617557 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc76406a620 0x7fc764154bf0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc75800d830 tx=0x7fc75800dbf0 comp rx=0 tx=0).stop 2023-09-13T08:25:06.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.215+0000 7fc768ce3700 1 -- 172.21.15.84:0/2644617557 shutdown_connections 2023-09-13T08:25:06.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.215+0000 7fc768ce3700 1 --2- 172.21.15.84:0/2644617557 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fc74406a580 0x7fc74406ca40 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:06.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.215+0000 7fc768ce3700 1 --2- 172.21.15.84:0/2644617557 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc76415d530 0x7fc7640c9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:06.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.215+0000 7fc768ce3700 1 --2- 172.21.15.84:0/2644617557 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc76406a620 0x7fc764154bf0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:06.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.215+0000 7fc768ce3700 1 --2- 172.21.15.84:0/2644617557 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc7640ca920 0x7fc7640c9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:06.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.215+0000 7fc768ce3700 1 -- 172.21.15.84:0/2644617557 >> 172.21.15.84:0/2644617557 conn(0x7fc7640d00c0 msgr2=0x7fc7640b3a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:06.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.215+0000 7fc768ce3700 1 -- 172.21.15.84:0/2644617557 shutdown_connections 2023-09-13T08:25:06.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.215+0000 7fc768ce3700 1 -- 172.21.15.84:0/2644617557 wait complete. 2023-09-13T08:25:06.218 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 9 2023-09-13T08:25:06.227 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T08:25:06.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.347+0000 7faac71af700 1 Processor -- start 2023-09-13T08:25:06.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.347+0000 7faac71af700 1 -- start start 2023-09-13T08:25:06.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.348+0000 7faac71af700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7faac0159a50 0x7faac00b1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:06.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.348+0000 7faac71af700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faac00cb020 0x7faac00cb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:06.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.348+0000 7faac71af700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faac0159e30 con 0x7faac00b1580 2023-09-13T08:25:06.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.348+0000 7faac71af700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faac00cb9f0 con 0x7faac0159a50 2023-09-13T08:25:06.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.348+0000 7faac71af700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faac015e090 con 0x7faac00cb020 2023-09-13T08:25:06.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.348+0000 7faac4f4b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7faac0159a50 0x7faac00b1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:06.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.348+0000 7faac4f4b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7faac0159a50 0x7faac00b1040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43694/0 (socket says 172.21.15.84:43694) 2023-09-13T08:25:06.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.348+0000 7faac4f4b700 1 -- 172.21.15.84:0/1029549442 learned_addr learned my addr 172.21.15.84:0/1029549442 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:06.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.348+0000 7faac574c700 1 --2- 172.21.15.84:0/1029549442 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faac00cb020 0x7faac00cb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:06.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.348+0000 7faac4f4b700 1 -- 172.21.15.84:0/1029549442 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faac00cb020 msgr2=0x7faac00cb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:06.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.348+0000 7faac4f4b700 1 --2- 172.21.15.84:0/1029549442 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faac00cb020 0x7faac00cb4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:06.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.348+0000 7faac4f4b700 1 -- 172.21.15.84:0/1029549442 >> v1:172.21.15.161:6789/0 conn(0x7faac00b1580 legacy=0x7faac015d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:06.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.348+0000 7faac4f4b700 1 -- 172.21.15.84:0/1029549442 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faac00b0560 con 0x7faac0159a50 2023-09-13T08:25:06.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.349+0000 7faac4f4b700 1 --2- 172.21.15.84:0/1029549442 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faac0159a50 0x7faac00b1040 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7faab40098f0 tx=0x7faab4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee8913a298af9b49 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:06.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.349+0000 7faabf7fe700 1 -- 172.21.15.84:0/1029549442 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab4004230 con 0x7faac0159a50 2023-09-13T08:25:06.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.349+0000 7faabf7fe700 1 -- 172.21.15.84:0/1029549442 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faab4004390 con 0x7faac0159a50 2023-09-13T08:25:06.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.349+0000 7faabf7fe700 1 -- 172.21.15.84:0/1029549442 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab40036a0 con 0x7faac0159a50 2023-09-13T08:25:06.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.349+0000 7faac71af700 1 -- 172.21.15.84:0/1029549442 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faac0159a50 msgr2=0x7faac00b1040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:06.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.349+0000 7faac71af700 1 --2- 172.21.15.84:0/1029549442 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faac0159a50 0x7faac00b1040 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7faab40098f0 tx=0x7faab4009c00 comp rx=0 tx=0).stop 2023-09-13T08:25:06.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.349+0000 7faac71af700 1 -- 172.21.15.84:0/1029549442 shutdown_connections 2023-09-13T08:25:06.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.349+0000 7faac71af700 1 --2- 172.21.15.84:0/1029549442 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faac0159a50 0x7faac00b1040 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:06.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.349+0000 7faac71af700 1 --2- 172.21.15.84:0/1029549442 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faac00cb020 0x7faac00cb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:06.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.349+0000 7faac71af700 1 -- 172.21.15.84:0/1029549442 >> 172.21.15.84:0/1029549442 conn(0x7faac00cc230 msgr2=0x7faac00cc640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:06.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.349+0000 7faac71af700 1 -- 172.21.15.84:0/1029549442 shutdown_connections 2023-09-13T08:25:06.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.349+0000 7faac71af700 1 -- 172.21.15.84:0/1029549442 wait complete. 2023-09-13T08:25:06.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.350+0000 7faac71af700 1 Processor -- start 2023-09-13T08:25:06.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.351+0000 7faac71af700 1 -- start start 2023-09-13T08:25:06.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.351+0000 7faac71af700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faac00b1580 0x7faac014d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:06.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.351+0000 7faac71af700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faac00cb020 0x7faac00c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:06.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.351+0000 7faac71af700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faac0159a50 0x7faac00c4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:06.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.351+0000 7faac71af700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faac00c6140 con 0x7faac0159a50 2023-09-13T08:25:06.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.351+0000 7faac71af700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faac00adf90 con 0x7faac00cb020 2023-09-13T08:25:06.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.351+0000 7faac71af700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faac00c32e0 con 0x7faac00b1580 2023-09-13T08:25:06.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.352+0000 7faac574c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faac0159a50 0x7faac00c4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:06.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.352+0000 7faac574c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faac0159a50 0x7faac00c4060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43704/0 (socket says 172.21.15.84:43704) 2023-09-13T08:25:06.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.352+0000 7faac574c700 1 -- 172.21.15.84:0/129063908 learned_addr learned my addr 172.21.15.84:0/129063908 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:06.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.352+0000 7faac4f4b700 1 --2- 172.21.15.84:0/129063908 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faac00b1580 0x7faac014d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:06.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.352+0000 7faabffff700 1 --2- 172.21.15.84:0/129063908 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faac00cb020 0x7faac00c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:06.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.352+0000 7faac574c700 1 -- 172.21.15.84:0/129063908 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faac00b1580 msgr2=0x7faac014d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:06.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.352+0000 7faac574c700 1 --2- 172.21.15.84:0/129063908 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faac00b1580 0x7faac014d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:06.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.352+0000 7faac574c700 1 -- 172.21.15.84:0/129063908 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faac00cb020 msgr2=0x7faac00c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:06.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.352+0000 7faac574c700 1 --2- 172.21.15.84:0/129063908 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faac00cb020 0x7faac00c5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:06.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.352+0000 7faac574c700 1 -- 172.21.15.84:0/129063908 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faab4009550 con 0x7faac0159a50 2023-09-13T08:25:06.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.352+0000 7faac574c700 1 --2- 172.21.15.84:0/129063908 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faac0159a50 0x7faac00c4060 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7faab800cd70 tx=0x7faab800a570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:06.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.352+0000 7faabd7fa700 1 -- 172.21.15.84:0/129063908 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab8003a20 con 0x7faac0159a50 2023-09-13T08:25:06.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.352+0000 7faabd7fa700 1 -- 172.21.15.84:0/129063908 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faab8003b80 con 0x7faac0159a50 2023-09-13T08:25:06.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.352+0000 7faac71af700 1 -- 172.21.15.84:0/129063908 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faac01f7140 con 0x7faac0159a50 2023-09-13T08:25:06.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.352+0000 7faabd7fa700 1 -- 172.21.15.84:0/129063908 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab8004020 con 0x7faac0159a50 2023-09-13T08:25:06.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.352+0000 7faac71af700 1 -- 172.21.15.84:0/129063908 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faac00c3860 con 0x7faac0159a50 2023-09-13T08:25:06.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.353+0000 7faac71af700 1 -- 172.21.15.84:0/129063908 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faac004e9b0 con 0x7faac0159a50 2023-09-13T08:25:06.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.353+0000 7faabd7fa700 1 -- 172.21.15.84:0/129063908 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7faab8004180 con 0x7faac0159a50 2023-09-13T08:25:06.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.354+0000 7faabd7fa700 1 --2- 172.21.15.84:0/129063908 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7faaa406a580 0x7faaa406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:06.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.354+0000 7faabd7fa700 1 -- 172.21.15.84:0/129063908 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7faab8012070 con 0x7faac0159a50 2023-09-13T08:25:06.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.354+0000 7faac4f4b700 1 --2- 172.21.15.84:0/129063908 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7faaa406a580 0x7faaa406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:06.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.354+0000 7faac4f4b700 1 --2- 172.21.15.84:0/129063908 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7faaa406a580 0x7faaa406ca40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7faab4009840 tx=0x7faab4008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:06.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.358+0000 7faabd7fa700 1 -- 172.21.15.84:0/129063908 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7faab80546b0 con 0x7faac0159a50 2023-09-13T08:25:06.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.548+0000 7faac71af700 1 -- 172.21.15.84:0/129063908 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faac015f360 con 0x7faac0159a50 2023-09-13T08:25:06.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.549+0000 7faabd7fa700 1 -- 172.21.15.84:0/129063908 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18322 (secure 0 0 0) 0x7faab8057cd0 con 0x7faac0159a50 2023-09-13T08:25:06.549 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:25:06.549 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":24,"fsid":"0107440b-b634-42c5-a643-5d31ea826116","created":"2023-09-13T08:24:16.931917+0000","modified":"2023-09-13T08:24:47.176259+0000","last_up_change":"2023-09-13T08:24:28.422631+0000","last_in_change":"2023-09-13T08:24:19.425578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T08:24:28.583720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-13T08:24:39.862832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-13T08:24:41.145511+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-13T08:24:44.775160+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4a53ec12-1469-4356-b4e1-2b8fc9b7c0f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6817","nonce":1599532366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6819","nonce":1599532366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6823","nonce":1599532366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6821","nonce":1599532366}]},"public_addr":"172.21.15.84:6817/1599532366","cluster_addr":"172.21.15.84:6819/1599532366","heartbeat_back_addr":"172.21.15.84:6823/1599532366","heartbeat_front_addr":"172.21.15.84:6821/1599532366","state":["exists","up"]},{"osd":1,"uuid":"11e964a0-b80c-4afc-bfbf-e2067969db29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6825","nonce":461860977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6827","nonce":461860977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6831","nonce":461860977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6829","nonce":461860977}]},"public_addr":"172.21.15.84:6825/461860977","cluster_addr":"172.21.15.84:6827/461860977","heartbeat_back_addr":"172.21.15.84:6831/461860977","heartbeat_front_addr":"172.21.15.84:6829/461860977","state":["exists","up"]},{"osd":2,"uuid":"3ce74529-4dd1-44c7-9576-968f5fdc0c25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6809","nonce":1168316165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6811","nonce":1168316165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6815","nonce":1168316165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6813","nonce":1168316165}]},"public_addr":"172.21.15.84:6809/1168316165","cluster_addr":"172.21.15.84:6811/1168316165","heartbeat_back_addr":"172.21.15.84:6815/1168316165","heartbeat_front_addr":"172.21.15.84:6813/1168316165","state":["exists","up"]},{"osd":3,"uuid":"460cb5c5-590a-4d06-a4d9-5bac2fdf33b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6801","nonce":1661609810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6803","nonce":1661609810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6807","nonce":1661609810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6805","nonce":1661609810}]},"public_addr":"172.21.15.84:6801/1661609810","cluster_addr":"172.21.15.84:6803/1661609810","heartbeat_back_addr":"172.21.15.84:6807/1661609810","heartbeat_front_addr":"172.21.15.84:6805/1661609810","state":["exists","up"]},{"osd":4,"uuid":"bf237dd0-3ebd-44b5-8078-24a63e00d792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6801","nonce":1303562374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6803","nonce":1303562374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6807","nonce":1303562374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6805","nonce":1303562374}]},"public_addr":"172.21.15.161:6801/1303562374","cluster_addr":"172.21.15.161:6803/1303562374","heartbeat_back_addr":"172.21.15.161:6807/1303562374","heartbeat_front_addr":"172.21.15.161:6805/1303562374","state":["exists","up"]},{"osd":5,"uuid":"e1e538e0-5844-456b-8c6e-434d3a914af1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6818","nonce":961120854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6822","nonce":961120854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6830","nonce":961120854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6826","nonce":961120854}]},"public_addr":"172.21.15.161:6818/961120854","cluster_addr":"172.21.15.161:6822/961120854","heartbeat_back_addr":"172.21.15.161:6830/961120854","heartbeat_front_addr":"172.21.15.161:6826/961120854","state":["exists","up"]},{"osd":6,"uuid":"5cb1785e-960f-4dd4-b295-9e21b2c3f875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6809","nonce":980533466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6811","nonce":980533466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6815","nonce":980533466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6813","nonce":980533466}]},"public_addr":"172.21.15.161:6809/980533466","cluster_addr":"172.21.15.161:6811/980533466","heartbeat_back_addr":"172.21.15.161:6815/980533466","heartbeat_front_addr":"172.21.15.161:6813/980533466","state":["exists","up"]},{"osd":7,"uuid":"5acb6619-e933-4b46-b1c2-60af30acb839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6817","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6819","nonce":2479691549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6821","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6823","nonce":2479691549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6829","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6831","nonce":2479691549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6825","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6827","nonce":2479691549}]},"public_addr":"172.21.15.161:6819/2479691549","cluster_addr":"172.21.15.161:6823/2479691549","heartbeat_back_addr":"172.21.15.161:6831/2479691549","heartbeat_front_addr":"172.21.15.161:6827/2479691549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.678857+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.685341+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.613603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.634940+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.564387+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.697347+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.637437+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.619397+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T08:25:06.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.551+0000 7faac71af700 1 -- 172.21.15.84:0/129063908 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7faaa406a580 msgr2=0x7faaa406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:06.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.551+0000 7faac71af700 1 --2- 172.21.15.84:0/129063908 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7faaa406a580 0x7faaa406ca40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7faab4009840 tx=0x7faab4008030 comp rx=0 tx=0).stop 2023-09-13T08:25:06.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.551+0000 7faac71af700 1 -- 172.21.15.84:0/129063908 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faac0159a50 msgr2=0x7faac00c4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:06.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.551+0000 7faac71af700 1 --2- 172.21.15.84:0/129063908 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faac0159a50 0x7faac00c4060 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7faab800cd70 tx=0x7faab800a570 comp rx=0 tx=0).stop 2023-09-13T08:25:06.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.551+0000 7faac71af700 1 -- 172.21.15.84:0/129063908 shutdown_connections 2023-09-13T08:25:06.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.551+0000 7faac71af700 1 --2- 172.21.15.84:0/129063908 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faac0159a50 0x7faac00c4060 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:06.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.551+0000 7faac71af700 1 --2- 172.21.15.84:0/129063908 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faac00b1580 0x7faac014d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:06.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.551+0000 7faac71af700 1 --2- 172.21.15.84:0/129063908 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7faaa406a580 0x7faaa406ca40 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:06.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.551+0000 7faac71af700 1 --2- 172.21.15.84:0/129063908 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faac00cb020 0x7faac00c5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:06.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.551+0000 7faac71af700 1 -- 172.21.15.84:0/129063908 >> 172.21.15.84:0/129063908 conn(0x7faac00cc230 msgr2=0x7faac00cc610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:06.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.551+0000 7faac71af700 1 -- 172.21.15.84:0/129063908 shutdown_connections 2023-09-13T08:25:06.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.551+0000 7faac71af700 1 -- 172.21.15.84:0/129063908 wait complete. 2023-09-13T08:25:06.563 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-09-13T08:25:06.564 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-13T08:25:06.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.684+0000 7f55d2beb700 1 Processor -- start 2023-09-13T08:25:06.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.684+0000 7f55d2beb700 1 -- start start 2023-09-13T08:25:06.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.685+0000 7f55d2beb700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f55cc15d530 0x7f55cc161bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:06.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.685+0000 7f55d2beb700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55cc1620f0 con 0x7f55cc06a620 2023-09-13T08:25:06.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.685+0000 7f55d2beb700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55cc0cae50 con 0x7f55cc0ca920 2023-09-13T08:25:06.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.685+0000 7f55d2beb700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55cc0cff20 con 0x7f55cc15d530 2023-09-13T08:25:06.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.685+0000 7f55d0987700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f55cc15d530 0x7f55cc161bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:06.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.685+0000 7f55d1188700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f55cc06a620 0x7f55cc0ce490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:46358/0 (socket says 172.21.15.84:46358) 2023-09-13T08:25:06.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.685+0000 7f55d1188700 1 -- 172.21.15.84:0/2697422538 learned_addr learned my addr 172.21.15.84:0/2697422538 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:25:06.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.685+0000 7f55d0987700 1 -- 172.21.15.84:0/2697422538 >> v1:172.21.15.161:6789/0 conn(0x7f55cc0ca920 legacy=0x7f55cc06d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:06.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.685+0000 7f55d0987700 1 -- 172.21.15.84:0/2697422538 >> v1:172.21.15.84:6789/0 conn(0x7f55cc06a620 legacy=0x7f55cc0ce490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:06.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.685+0000 7f55cb7fe700 1 -- 172.21.15.84:0/2697422538 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4157806396 0 0) 0x7f55cc1620f0 con 0x7f55cc06a620 2023-09-13T08:25:06.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.686+0000 7f55d0987700 1 -- 172.21.15.84:0/2697422538 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55cc0cb130 con 0x7f55cc15d530 2023-09-13T08:25:06.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.686+0000 7f55d0987700 1 --2- 172.21.15.84:0/2697422538 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55cc15d530 0x7f55cc161bb0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f55c0009840 tx=0x7f55c0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=432a33a682a26d1f server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:06.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.686+0000 7f55cb7fe700 1 -- 172.21.15.84:0/2697422538 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c0011830 con 0x7f55cc15d530 2023-09-13T08:25:06.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.686+0000 7f55cb7fe700 1 -- 172.21.15.84:0/2697422538 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55c0011990 con 0x7f55cc15d530 2023-09-13T08:25:06.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.686+0000 7f55cb7fe700 1 -- 172.21.15.84:0/2697422538 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c0011d20 con 0x7f55cc15d530 2023-09-13T08:25:06.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.686+0000 7f55d2beb700 1 -- 172.21.15.84:0/2697422538 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55cc15d530 msgr2=0x7f55cc161bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:06.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.686+0000 7f55d2beb700 1 --2- 172.21.15.84:0/2697422538 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55cc15d530 0x7f55cc161bb0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f55c0009840 tx=0x7f55c0009b50 comp rx=0 tx=0).stop 2023-09-13T08:25:06.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.686+0000 7f55d2beb700 1 -- 172.21.15.84:0/2697422538 shutdown_connections 2023-09-13T08:25:06.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.686+0000 7f55d2beb700 1 --2- 172.21.15.84:0/2697422538 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55cc15d530 0x7f55cc161bb0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:06.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.686+0000 7f55d2beb700 1 -- 172.21.15.84:0/2697422538 >> 172.21.15.84:0/2697422538 conn(0x7f55cc0d00c0 msgr2=0x7f55cc0d04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:06.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.686+0000 7f55d2beb700 1 -- 172.21.15.84:0/2697422538 shutdown_connections 2023-09-13T08:25:06.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.686+0000 7f55d2beb700 1 -- 172.21.15.84:0/2697422538 wait complete. 2023-09-13T08:25:06.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.687+0000 7f55d2beb700 1 Processor -- start 2023-09-13T08:25:06.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.687+0000 7f55d2beb700 1 -- start start 2023-09-13T08:25:06.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.688+0000 7f55d2beb700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55cc06a620 0x7f55cc1515e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:06.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.688+0000 7f55d2beb700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f55cc0ca920 0x7f55cc0c8920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:06.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.688+0000 7f55d2beb700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55cc15d530 0x7f55cc0b4b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:06.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.688+0000 7f55d2beb700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55cc152bd0 con 0x7f55cc15d530 2023-09-13T08:25:06.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.688+0000 7f55d2beb700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55cc151fc0 con 0x7f55cc06a620 2023-09-13T08:25:06.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.688+0000 7f55d2beb700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55cc1522a0 con 0x7f55cc0ca920 2023-09-13T08:25:06.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.688+0000 7f55d1188700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55cc15d530 0x7f55cc0b4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:06.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.689+0000 7f55d1188700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55cc15d530 0x7f55cc0b4b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43718/0 (socket says 172.21.15.84:43718) 2023-09-13T08:25:06.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.689+0000 7f55d1188700 1 -- 172.21.15.84:0/1406211581 learned_addr learned my addr 172.21.15.84:0/1406211581 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:06.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.689+0000 7f55d0987700 1 --2- 172.21.15.84:0/1406211581 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55cc06a620 0x7f55cc1515e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:06.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.689+0000 7f55cbfff700 1 --2- 172.21.15.84:0/1406211581 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f55cc0ca920 0x7f55cc0c8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:06.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.689+0000 7f55d1188700 1 -- 172.21.15.84:0/1406211581 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f55cc0ca920 msgr2=0x7f55cc0c8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:06.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.689+0000 7f55d1188700 1 --2- 172.21.15.84:0/1406211581 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f55cc0ca920 0x7f55cc0c8920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:06.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.689+0000 7f55d1188700 1 -- 172.21.15.84:0/1406211581 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55cc06a620 msgr2=0x7f55cc1515e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:06.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.689+0000 7f55d1188700 1 --2- 172.21.15.84:0/1406211581 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55cc06a620 0x7f55cc1515e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:06.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.689+0000 7f55d1188700 1 -- 172.21.15.84:0/1406211581 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55c00094a0 con 0x7f55cc15d530 2023-09-13T08:25:06.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.689+0000 7f55cbfff700 1 --2- 172.21.15.84:0/1406211581 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f55cc0ca920 0x7f55cc0c8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T08:25:06.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.689+0000 7f55d1188700 1 --2- 172.21.15.84:0/1406211581 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55cc15d530 0x7f55cc0b4b20 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f55c400cb90 tx=0x7f55c400cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:06.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.689+0000 7f55c97fa700 1 -- 172.21.15.84:0/1406211581 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c400aac0 con 0x7f55cc15d530 2023-09-13T08:25:06.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.689+0000 7f55c97fa700 1 -- 172.21.15.84:0/1406211581 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55c400ac40 con 0x7f55cc15d530 2023-09-13T08:25:06.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.689+0000 7f55d2beb700 1 -- 172.21.15.84:0/1406211581 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55cc152580 con 0x7f55cc15d530 2023-09-13T08:25:06.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.689+0000 7f55c97fa700 1 -- 172.21.15.84:0/1406211581 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c40070d0 con 0x7f55cc15d530 2023-09-13T08:25:06.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.689+0000 7f55d2beb700 1 -- 172.21.15.84:0/1406211581 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55cc0c8e60 con 0x7f55cc15d530 2023-09-13T08:25:06.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.690+0000 7f55d2beb700 1 -- 172.21.15.84:0/1406211581 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55cc152d40 con 0x7f55cc15d530 2023-09-13T08:25:06.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.691+0000 7f55c97fa700 1 -- 172.21.15.84:0/1406211581 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f55c4007250 con 0x7f55cc15d530 2023-09-13T08:25:06.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.691+0000 7f55c97fa700 1 --2- 172.21.15.84:0/1406211581 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f55b006a580 0x7f55b006ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:06.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.691+0000 7f55d0987700 1 --2- 172.21.15.84:0/1406211581 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f55b006a580 0x7f55b006ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:06.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.691+0000 7f55c97fa700 1 -- 172.21.15.84:0/1406211581 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f55c4088b20 con 0x7f55cc15d530 2023-09-13T08:25:06.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.692+0000 7f55d0987700 1 --2- 172.21.15.84:0/1406211581 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f55b006a580 0x7f55b006ca40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f55c00090b0 tx=0x7f55c001c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:06.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.696+0000 7f55c97fa700 1 -- 172.21.15.84:0/1406211581 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f55c4053db0 con 0x7f55cc15d530 2023-09-13T08:25:06.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.888+0000 7f55d2beb700 1 -- 172.21.15.84:0/1406211581 --> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f55cc0cdc90 con 0x7f55b006a580 2023-09-13T08:25:06.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.898+0000 7f55c97fa700 1 -- 172.21.15.84:0/1406211581 <== mgr.4104 v2:172.21.15.84:6832/3568908055 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345313 (secure 0 0 0) 0x7f55c0011c00 con 0x7f55b006a580 2023-09-13T08:25:06.902 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:25:06.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.901+0000 7f55d2beb700 1 -- 172.21.15.84:0/1406211581 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f55b006a580 msgr2=0x7f55b006ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:06.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.901+0000 7f55d2beb700 1 --2- 172.21.15.84:0/1406211581 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f55b006a580 0x7f55b006ca40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f55c00090b0 tx=0x7f55c001c040 comp rx=0 tx=0).stop 2023-09-13T08:25:06.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.901+0000 7f55d2beb700 1 -- 172.21.15.84:0/1406211581 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55cc15d530 msgr2=0x7f55cc0b4b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:06.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.901+0000 7f55d2beb700 1 --2- 172.21.15.84:0/1406211581 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55cc15d530 0x7f55cc0b4b20 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f55c400cb90 tx=0x7f55c400cea0 comp rx=0 tx=0).stop 2023-09-13T08:25:06.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.901+0000 7f55d2beb700 1 -- 172.21.15.84:0/1406211581 shutdown_connections 2023-09-13T08:25:06.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.901+0000 7f55d2beb700 1 --2- 172.21.15.84:0/1406211581 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55cc15d530 0x7f55cc0b4b20 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:06.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.901+0000 7f55d2beb700 1 --2- 172.21.15.84:0/1406211581 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f55b006a580 0x7f55b006ca40 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:06.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.901+0000 7f55d2beb700 1 --2- 172.21.15.84:0/1406211581 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55cc06a620 0x7f55cc1515e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:06.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.901+0000 7f55d2beb700 1 --2- 172.21.15.84:0/1406211581 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f55cc0ca920 0x7f55cc0c8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:06.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.901+0000 7f55d2beb700 1 -- 172.21.15.84:0/1406211581 >> 172.21.15.84:0/1406211581 conn(0x7f55cc0d00c0 msgr2=0x7f55cc15c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:06.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.901+0000 7f55d2beb700 1 -- 172.21.15.84:0/1406211581 shutdown_connections 2023-09-13T08:25:06.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:06.901+0000 7f55d2beb700 1 -- 172.21.15.84:0/1406211581 wait complete. 2023-09-13T08:25:06.908 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-09-13T08:25:06.914 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2023-09-13T08:25:06.546377+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219368,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755352,"statfs":{"total":773094113280,"available":772869480448,"internally_reserved":0,"allocated":3284992,"data_stored":1988256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003043"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.774842+0000","last_change":"2023-09-13T08:24:42.765440+0000","last_active":"2023-09-13T08:24:46.774842+0000","last_peered":"2023-09-13T08:24:46.774842+0000","last_clean":"2023-09-13T08:24:46.774842+0000","last_became_active":"2023-09-13T08:24:42.764929+0000","last_became_peered":"2023-09-13T08:24:42.764929+0000","last_unstale":"2023-09-13T08:24:46.774842+0000","last_undegraded":"2023-09-13T08:24:46.774842+0000","last_fullsized":"2023-09-13T08:24:46.774842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:14:26.147276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.778909+0000","last_change":"2023-09-13T08:24:42.755837+0000","last_active":"2023-09-13T08:24:46.778909+0000","last_peered":"2023-09-13T08:24:46.778909+0000","last_clean":"2023-09-13T08:24:46.778909+0000","last_became_active":"2023-09-13T08:24:42.755520+0000","last_became_peered":"2023-09-13T08:24:42.755520+0000","last_unstale":"2023-09-13T08:24:46.778909+0000","last_undegraded":"2023-09-13T08:24:46.778909+0000","last_fullsized":"2023-09-13T08:24:46.778909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:01:14.370463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.778319+0000","last_change":"2023-09-13T08:24:42.751148+0000","last_active":"2023-09-13T08:24:46.778319+0000","last_peered":"2023-09-13T08:24:46.778319+0000","last_clean":"2023-09-13T08:24:46.778319+0000","last_became_active":"2023-09-13T08:24:42.750784+0000","last_became_peered":"2023-09-13T08:24:42.750784+0000","last_unstale":"2023-09-13T08:24:46.778319+0000","last_undegraded":"2023-09-13T08:24:46.778319+0000","last_fullsized":"2023-09-13T08:24:46.778319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:01:15.582567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.775884+0000","last_change":"2023-09-13T08:24:42.766616+0000","last_active":"2023-09-13T08:24:46.775884+0000","last_peered":"2023-09-13T08:24:46.775884+0000","last_clean":"2023-09-13T08:24:46.775884+0000","last_became_active":"2023-09-13T08:24:42.766318+0000","last_became_peered":"2023-09-13T08:24:42.766318+0000","last_unstale":"2023-09-13T08:24:46.775884+0000","last_undegraded":"2023-09-13T08:24:46.775884+0000","last_fullsized":"2023-09-13T08:24:46.775884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:29:11.602118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.773834+0000","last_change":"2023-09-13T08:24:42.760772+0000","last_active":"2023-09-13T08:24:46.773834+0000","last_peered":"2023-09-13T08:24:46.773834+0000","last_clean":"2023-09-13T08:24:46.773834+0000","last_became_active":"2023-09-13T08:24:42.760319+0000","last_became_peered":"2023-09-13T08:24:42.760319+0000","last_unstale":"2023-09-13T08:24:46.773834+0000","last_undegraded":"2023-09-13T08:24:46.773834+0000","last_fullsized":"2023-09-13T08:24:46.773834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:17:32.912375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.774449+0000","last_change":"2023-09-13T08:24:42.765841+0000","last_active":"2023-09-13T08:24:46.774449+0000","last_peered":"2023-09-13T08:24:46.774449+0000","last_clean":"2023-09-13T08:24:46.774449+0000","last_became_active":"2023-09-13T08:24:42.764312+0000","last_became_peered":"2023-09-13T08:24:42.764312+0000","last_unstale":"2023-09-13T08:24:46.774449+0000","last_undegraded":"2023-09-13T08:24:46.774449+0000","last_fullsized":"2023-09-13T08:24:46.774449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:31:23.082234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.773749+0000","last_change":"2023-09-13T08:24:42.753624+0000","last_active":"2023-09-13T08:24:46.773749+0000","last_peered":"2023-09-13T08:24:46.773749+0000","last_clean":"2023-09-13T08:24:46.773749+0000","last_became_active":"2023-09-13T08:24:42.753354+0000","last_became_peered":"2023-09-13T08:24:42.753354+0000","last_unstale":"2023-09-13T08:24:46.773749+0000","last_undegraded":"2023-09-13T08:24:46.773749+0000","last_fullsized":"2023-09-13T08:24:46.773749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:31:23.082234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.772638+0000","last_change":"2023-09-13T08:24:42.770839+0000","last_active":"2023-09-13T08:24:46.772638+0000","last_peered":"2023-09-13T08:24:46.772638+0000","last_clean":"2023-09-13T08:24:46.772638+0000","last_became_active":"2023-09-13T08:24:42.770596+0000","last_became_peered":"2023-09-13T08:24:42.770596+0000","last_unstale":"2023-09-13T08:24:46.772638+0000","last_undegraded":"2023-09-13T08:24:46.772638+0000","last_fullsized":"2023-09-13T08:24:46.772638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:38:04.836936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.774754+0000","last_change":"2023-09-13T08:24:42.768552+0000","last_active":"2023-09-13T08:24:46.774754+0000","last_peered":"2023-09-13T08:24:46.774754+0000","last_clean":"2023-09-13T08:24:46.774754+0000","last_became_active":"2023-09-13T08:24:42.768084+0000","last_became_peered":"2023-09-13T08:24:42.768084+0000","last_unstale":"2023-09-13T08:24:46.774754+0000","last_undegraded":"2023-09-13T08:24:46.774754+0000","last_fullsized":"2023-09-13T08:24:46.774754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T19:01:29.959464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.786411+0000","last_change":"2023-09-13T08:24:42.765506+0000","last_active":"2023-09-13T08:24:46.786411+0000","last_peered":"2023-09-13T08:24:46.786411+0000","last_clean":"2023-09-13T08:24:46.786411+0000","last_became_active":"2023-09-13T08:24:42.765119+0000","last_became_peered":"2023-09-13T08:24:42.765119+0000","last_unstale":"2023-09-13T08:24:46.786411+0000","last_undegraded":"2023-09-13T08:24:46.786411+0000","last_fullsized":"2023-09-13T08:24:46.786411+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:17:32.912375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.786113+0000","last_change":"2023-09-13T08:24:42.768066+0000","last_active":"2023-09-13T08:24:46.786113+0000","last_peered":"2023-09-13T08:24:46.786113+0000","last_clean":"2023-09-13T08:24:46.786113+0000","last_became_active":"2023-09-13T08:24:42.767857+0000","last_became_peered":"2023-09-13T08:24:42.767857+0000","last_unstale":"2023-09-13T08:24:46.786113+0000","last_undegraded":"2023-09-13T08:24:46.786113+0000","last_fullsized":"2023-09-13T08:24:46.786113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:01:14.370463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.781776+0000","last_change":"2023-09-13T08:24:42.750028+0000","last_active":"2023-09-13T08:24:46.781776+0000","last_peered":"2023-09-13T08:24:46.781776+0000","last_clean":"2023-09-13T08:24:46.781776+0000","last_became_active":"2023-09-13T08:24:42.749472+0000","last_became_peered":"2023-09-13T08:24:42.749472+0000","last_unstale":"2023-09-13T08:24:46.781776+0000","last_undegraded":"2023-09-13T08:24:46.781776+0000","last_fullsized":"2023-09-13T08:24:46.781776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:16:34.157802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.772598+0000","last_change":"2023-09-13T08:24:42.756966+0000","last_active":"2023-09-13T08:24:46.772598+0000","last_peered":"2023-09-13T08:24:46.772598+0000","last_clean":"2023-09-13T08:24:46.772598+0000","last_became_active":"2023-09-13T08:24:42.756694+0000","last_became_peered":"2023-09-13T08:24:42.756694+0000","last_unstale":"2023-09-13T08:24:46.772598+0000","last_undegraded":"2023-09-13T08:24:46.772598+0000","last_fullsized":"2023-09-13T08:24:46.772598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:22:05.554377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.779252+0000","last_change":"2023-09-13T08:24:42.761359+0000","last_active":"2023-09-13T08:24:46.779252+0000","last_peered":"2023-09-13T08:24:46.779252+0000","last_clean":"2023-09-13T08:24:46.779252+0000","last_became_active":"2023-09-13T08:24:42.761113+0000","last_became_peered":"2023-09-13T08:24:42.761113+0000","last_unstale":"2023-09-13T08:24:46.779252+0000","last_undegraded":"2023-09-13T08:24:46.779252+0000","last_fullsized":"2023-09-13T08:24:46.779252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:38:04.836936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.778710+0000","last_change":"2023-09-13T08:24:42.756240+0000","last_active":"2023-09-13T08:24:46.778710+0000","last_peered":"2023-09-13T08:24:46.778710+0000","last_clean":"2023-09-13T08:24:46.778710+0000","last_became_active":"2023-09-13T08:24:42.755563+0000","last_became_peered":"2023-09-13T08:24:42.755563+0000","last_unstale":"2023-09-13T08:24:46.778710+0000","last_undegraded":"2023-09-13T08:24:46.778710+0000","last_fullsized":"2023-09-13T08:24:46.778710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:07:53.062826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.774724+0000","last_change":"2023-09-13T08:24:42.762083+0000","last_active":"2023-09-13T08:24:46.774724+0000","last_peered":"2023-09-13T08:24:46.774724+0000","last_clean":"2023-09-13T08:24:46.774724+0000","last_became_active":"2023-09-13T08:24:42.761624+0000","last_became_peered":"2023-09-13T08:24:42.761624+0000","last_unstale":"2023-09-13T08:24:46.774724+0000","last_undegraded":"2023-09-13T08:24:46.774724+0000","last_fullsized":"2023-09-13T08:24:46.774724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:01:14.370463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.774482+0000","last_change":"2023-09-13T08:24:42.771083+0000","last_active":"2023-09-13T08:24:46.774482+0000","last_peered":"2023-09-13T08:24:46.774482+0000","last_clean":"2023-09-13T08:24:46.774482+0000","last_became_active":"2023-09-13T08:24:42.770750+0000","last_became_peered":"2023-09-13T08:24:42.770750+0000","last_unstale":"2023-09-13T08:24:46.774482+0000","last_undegraded":"2023-09-13T08:24:46.774482+0000","last_fullsized":"2023-09-13T08:24:46.774482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:41:08.160337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.784024+0000","last_change":"2023-09-13T08:24:42.756007+0000","last_active":"2023-09-13T08:24:46.784024+0000","last_peered":"2023-09-13T08:24:46.784024+0000","last_clean":"2023-09-13T08:24:46.784024+0000","last_became_active":"2023-09-13T08:24:42.755730+0000","last_became_peered":"2023-09-13T08:24:42.755730+0000","last_unstale":"2023-09-13T08:24:46.784024+0000","last_undegraded":"2023-09-13T08:24:46.784024+0000","last_fullsized":"2023-09-13T08:24:46.784024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:16:34.157802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.774987+0000","last_change":"2023-09-13T08:24:42.758637+0000","last_active":"2023-09-13T08:24:46.774987+0000","last_peered":"2023-09-13T08:24:46.774987+0000","last_clean":"2023-09-13T08:24:46.774987+0000","last_became_active":"2023-09-13T08:24:42.758355+0000","last_became_peered":"2023-09-13T08:24:42.758355+0000","last_unstale":"2023-09-13T08:24:46.774987+0000","last_undegraded":"2023-09-13T08:24:46.774987+0000","last_fullsized":"2023-09-13T08:24:46.774987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:30:17.103018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.535787+0000","last_change":"2023-09-13T08:24:46.786296+0000","last_active":"2023-09-13T08:24:48.535787+0000","last_peered":"2023-09-13T08:24:48.535787+0000","last_clean":"2023-09-13T08:24:48.535787+0000","last_became_active":"2023-09-13T08:24:46.785911+0000","last_became_peered":"2023-09-13T08:24:46.785911+0000","last_unstale":"2023-09-13T08:24:48.535787+0000","last_undegraded":"2023-09-13T08:24:48.535787+0000","last_fullsized":"2023-09-13T08:24:48.535787+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:28:08.064402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.779981+0000","last_change":"2023-09-13T08:24:41.751910+0000","last_active":"2023-09-13T08:24:46.779981+0000","last_peered":"2023-09-13T08:24:46.779981+0000","last_clean":"2023-09-13T08:24:46.779981+0000","last_became_active":"2023-09-13T08:24:41.751643+0000","last_became_peered":"2023-09-13T08:24:41.751643+0000","last_unstale":"2023-09-13T08:24:46.779981+0000","last_undegraded":"2023-09-13T08:24:46.779981+0000","last_fullsized":"2023-09-13T08:24:46.779981+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:10:08.445556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.772648+0000","last_change":"2023-09-13T08:24:42.756649+0000","last_active":"2023-09-13T08:24:46.772648+0000","last_peered":"2023-09-13T08:24:46.772648+0000","last_clean":"2023-09-13T08:24:46.772648+0000","last_became_active":"2023-09-13T08:24:42.756308+0000","last_became_peered":"2023-09-13T08:24:42.756308+0000","last_unstale":"2023-09-13T08:24:46.772648+0000","last_undegraded":"2023-09-13T08:24:46.772648+0000","last_fullsized":"2023-09-13T08:24:46.772648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:17:32.912375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.535050+0000","last_change":"2023-09-13T08:24:46.798301+0000","last_active":"2023-09-13T08:24:48.535050+0000","last_peered":"2023-09-13T08:24:48.535050+0000","last_clean":"2023-09-13T08:24:48.535050+0000","last_became_active":"2023-09-13T08:24:46.797920+0000","last_became_peered":"2023-09-13T08:24:46.797920+0000","last_unstale":"2023-09-13T08:24:48.535050+0000","last_undegraded":"2023-09-13T08:24:48.535050+0000","last_fullsized":"2023-09-13T08:24:48.535050+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:41:12.187804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.772744+0000","last_change":"2023-09-13T08:24:41.762678+0000","last_active":"2023-09-13T08:24:46.772744+0000","last_peered":"2023-09-13T08:24:46.772744+0000","last_clean":"2023-09-13T08:24:46.772744+0000","last_became_active":"2023-09-13T08:24:41.762309+0000","last_became_peered":"2023-09-13T08:24:41.762309+0000","last_unstale":"2023-09-13T08:24:46.772744+0000","last_undegraded":"2023-09-13T08:24:46.772744+0000","last_fullsized":"2023-09-13T08:24:46.772744+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:40:49.395433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.779483+0000","last_change":"2023-09-13T08:24:42.764572+0000","last_active":"2023-09-13T08:24:46.779483+0000","last_peered":"2023-09-13T08:24:46.779483+0000","last_clean":"2023-09-13T08:24:46.779483+0000","last_became_active":"2023-09-13T08:24:42.764305+0000","last_became_peered":"2023-09-13T08:24:42.764305+0000","last_unstale":"2023-09-13T08:24:46.779483+0000","last_undegraded":"2023-09-13T08:24:46.779483+0000","last_fullsized":"2023-09-13T08:24:46.779483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:47:39.312215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.535234+0000","last_change":"2023-09-13T08:24:46.799685+0000","last_active":"2023-09-13T08:24:48.535234+0000","last_peered":"2023-09-13T08:24:48.535234+0000","last_clean":"2023-09-13T08:24:48.535234+0000","last_became_active":"2023-09-13T08:24:46.798723+0000","last_became_peered":"2023-09-13T08:24:46.798723+0000","last_unstale":"2023-09-13T08:24:48.535234+0000","last_undegraded":"2023-09-13T08:24:48.535234+0000","last_fullsized":"2023-09-13T08:24:48.535234+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:19:00.119006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.774765+0000","last_change":"2023-09-13T08:24:41.755988+0000","last_active":"2023-09-13T08:24:46.774765+0000","last_peered":"2023-09-13T08:24:46.774765+0000","last_clean":"2023-09-13T08:24:46.774765+0000","last_became_active":"2023-09-13T08:24:41.755711+0000","last_became_peered":"2023-09-13T08:24:41.755711+0000","last_unstale":"2023-09-13T08:24:46.774765+0000","last_undegraded":"2023-09-13T08:24:46.774765+0000","last_fullsized":"2023-09-13T08:24:46.774765+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:01:14.575510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.775792+0000","last_change":"2023-09-13T08:24:42.771141+0000","last_active":"2023-09-13T08:24:46.775792+0000","last_peered":"2023-09-13T08:24:46.775792+0000","last_clean":"2023-09-13T08:24:46.775792+0000","last_became_active":"2023-09-13T08:24:42.770716+0000","last_became_peered":"2023-09-13T08:24:42.770716+0000","last_unstale":"2023-09-13T08:24:46.775792+0000","last_undegraded":"2023-09-13T08:24:46.775792+0000","last_fullsized":"2023-09-13T08:24:46.775792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:17:32.912375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.535125+0000","last_change":"2023-09-13T08:24:46.797683+0000","last_active":"2023-09-13T08:24:48.535125+0000","last_peered":"2023-09-13T08:24:48.535125+0000","last_clean":"2023-09-13T08:24:48.535125+0000","last_became_active":"2023-09-13T08:24:46.797283+0000","last_became_peered":"2023-09-13T08:24:46.797283+0000","last_unstale":"2023-09-13T08:24:48.535125+0000","last_undegraded":"2023-09-13T08:24:48.535125+0000","last_fullsized":"2023-09-13T08:24:48.535125+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T19:57:23.132436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.773940+0000","last_change":"2023-09-13T08:24:41.757989+0000","last_active":"2023-09-13T08:24:46.773940+0000","last_peered":"2023-09-13T08:24:46.773940+0000","last_clean":"2023-09-13T08:24:46.773940+0000","last_became_active":"2023-09-13T08:24:41.757638+0000","last_became_peered":"2023-09-13T08:24:41.757638+0000","last_unstale":"2023-09-13T08:24:46.773940+0000","last_undegraded":"2023-09-13T08:24:46.773940+0000","last_fullsized":"2023-09-13T08:24:46.773940+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:28:07.813946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.776641+0000","last_change":"2023-09-13T08:24:42.771168+0000","last_active":"2023-09-13T08:24:46.776641+0000","last_peered":"2023-09-13T08:24:46.776641+0000","last_clean":"2023-09-13T08:24:46.776641+0000","last_became_active":"2023-09-13T08:24:42.770666+0000","last_became_peered":"2023-09-13T08:24:42.770666+0000","last_unstale":"2023-09-13T08:24:46.776641+0000","last_undegraded":"2023-09-13T08:24:46.776641+0000","last_fullsized":"2023-09-13T08:24:46.776641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:14:26.147276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.537048+0000","last_change":"2023-09-13T08:24:46.796942+0000","last_active":"2023-09-13T08:24:48.537048+0000","last_peered":"2023-09-13T08:24:48.537048+0000","last_clean":"2023-09-13T08:24:48.537048+0000","last_became_active":"2023-09-13T08:24:46.796351+0000","last_became_peered":"2023-09-13T08:24:46.796351+0000","last_unstale":"2023-09-13T08:24:48.537048+0000","last_undegraded":"2023-09-13T08:24:48.537048+0000","last_fullsized":"2023-09-13T08:24:48.537048+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:56:23.838830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.772437+0000","last_change":"2023-09-13T08:24:41.751550+0000","last_active":"2023-09-13T08:24:46.772437+0000","last_peered":"2023-09-13T08:24:46.772437+0000","last_clean":"2023-09-13T08:24:46.772437+0000","last_became_active":"2023-09-13T08:24:41.751239+0000","last_became_peered":"2023-09-13T08:24:41.751239+0000","last_unstale":"2023-09-13T08:24:46.772437+0000","last_undegraded":"2023-09-13T08:24:46.772437+0000","last_fullsized":"2023-09-13T08:24:46.772437+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:14:24.302634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.780775+0000","last_change":"2023-09-13T08:24:42.761870+0000","last_active":"2023-09-13T08:24:46.780775+0000","last_peered":"2023-09-13T08:24:46.780775+0000","last_clean":"2023-09-13T08:24:46.780775+0000","last_became_active":"2023-09-13T08:24:42.761353+0000","last_became_peered":"2023-09-13T08:24:42.761353+0000","last_unstale":"2023-09-13T08:24:46.780775+0000","last_undegraded":"2023-09-13T08:24:46.780775+0000","last_fullsized":"2023-09-13T08:24:46.780775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:04:13.077626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:47.773917+0000","last_change":"2023-09-13T08:24:46.790855+0000","last_active":"2023-09-13T08:24:47.773917+0000","last_peered":"2023-09-13T08:24:47.773917+0000","last_clean":"2023-09-13T08:24:47.773917+0000","last_became_active":"2023-09-13T08:24:46.790308+0000","last_became_peered":"2023-09-13T08:24:46.790308+0000","last_unstale":"2023-09-13T08:24:47.773917+0000","last_undegraded":"2023-09-13T08:24:47.773917+0000","last_fullsized":"2023-09-13T08:24:47.773917+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:39:01.027758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.785858+0000","last_change":"2023-09-13T08:24:41.750115+0000","last_active":"2023-09-13T08:24:46.785858+0000","last_peered":"2023-09-13T08:24:46.785858+0000","last_clean":"2023-09-13T08:24:46.785858+0000","last_became_active":"2023-09-13T08:24:41.749327+0000","last_became_peered":"2023-09-13T08:24:41.749327+0000","last_unstale":"2023-09-13T08:24:46.785858+0000","last_undegraded":"2023-09-13T08:24:46.785858+0000","last_fullsized":"2023-09-13T08:24:46.785858+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:51:59.235749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.777583+0000","last_change":"2023-09-13T08:24:42.746631+0000","last_active":"2023-09-13T08:24:46.777583+0000","last_peered":"2023-09-13T08:24:46.777583+0000","last_clean":"2023-09-13T08:24:46.777583+0000","last_became_active":"2023-09-13T08:24:42.745778+0000","last_became_peered":"2023-09-13T08:24:42.745778+0000","last_unstale":"2023-09-13T08:24:46.777583+0000","last_undegraded":"2023-09-13T08:24:46.777583+0000","last_fullsized":"2023-09-13T08:24:46.777583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:22:05.554377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:47.775957+0000","last_change":"2023-09-13T08:24:46.801666+0000","last_active":"2023-09-13T08:24:47.775957+0000","last_peered":"2023-09-13T08:24:47.775957+0000","last_clean":"2023-09-13T08:24:47.775957+0000","last_became_active":"2023-09-13T08:24:46.801323+0000","last_became_peered":"2023-09-13T08:24:46.801323+0000","last_unstale":"2023-09-13T08:24:47.775957+0000","last_undegraded":"2023-09-13T08:24:47.775957+0000","last_fullsized":"2023-09-13T08:24:47.775957+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:19:00.119006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.772047+0000","last_change":"2023-09-13T08:24:41.755264+0000","last_active":"2023-09-13T08:24:46.772047+0000","last_peered":"2023-09-13T08:24:46.772047+0000","last_clean":"2023-09-13T08:24:46.772047+0000","last_became_active":"2023-09-13T08:24:41.754961+0000","last_became_peered":"2023-09-13T08:24:41.754961+0000","last_unstale":"2023-09-13T08:24:46.772047+0000","last_undegraded":"2023-09-13T08:24:46.772047+0000","last_fullsized":"2023-09-13T08:24:46.772047+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:28:07.813946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.771919+0000","last_change":"2023-09-13T08:24:42.752899+0000","last_active":"2023-09-13T08:24:46.771919+0000","last_peered":"2023-09-13T08:24:46.771919+0000","last_clean":"2023-09-13T08:24:46.771919+0000","last_became_active":"2023-09-13T08:24:42.752583+0000","last_became_peered":"2023-09-13T08:24:42.752583+0000","last_unstale":"2023-09-13T08:24:46.771919+0000","last_undegraded":"2023-09-13T08:24:46.771919+0000","last_fullsized":"2023-09-13T08:24:46.771919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:01:15.582567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.534731+0000","last_change":"2023-09-13T08:24:46.795800+0000","last_active":"2023-09-13T08:24:48.534731+0000","last_peered":"2023-09-13T08:24:48.534731+0000","last_clean":"2023-09-13T08:24:48.534731+0000","last_became_active":"2023-09-13T08:24:46.794871+0000","last_became_peered":"2023-09-13T08:24:46.794871+0000","last_unstale":"2023-09-13T08:24:48.534731+0000","last_undegraded":"2023-09-13T08:24:48.534731+0000","last_fullsized":"2023-09-13T08:24:48.534731+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:35:08.086286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.774790+0000","last_change":"2023-09-13T08:24:41.749261+0000","last_active":"2023-09-13T08:24:46.774790+0000","last_peered":"2023-09-13T08:24:46.774790+0000","last_clean":"2023-09-13T08:24:46.774790+0000","last_became_active":"2023-09-13T08:24:41.748976+0000","last_became_peered":"2023-09-13T08:24:41.748976+0000","last_unstale":"2023-09-13T08:24:46.774790+0000","last_undegraded":"2023-09-13T08:24:46.774790+0000","last_fullsized":"2023-09-13T08:24:46.774790+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:04:12.070569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.778887+0000","last_change":"2023-09-13T08:24:42.756665+0000","last_active":"2023-09-13T08:24:46.778887+0000","last_peered":"2023-09-13T08:24:46.778887+0000","last_clean":"2023-09-13T08:24:46.778887+0000","last_became_active":"2023-09-13T08:24:42.756225+0000","last_became_peered":"2023-09-13T08:24:42.756225+0000","last_unstale":"2023-09-13T08:24:46.778887+0000","last_undegraded":"2023-09-13T08:24:46.778887+0000","last_fullsized":"2023-09-13T08:24:46.778887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:22:05.554377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.535610+0000","last_change":"2023-09-13T08:24:46.794973+0000","last_active":"2023-09-13T08:24:48.535610+0000","last_peered":"2023-09-13T08:24:48.535610+0000","last_clean":"2023-09-13T08:24:48.535610+0000","last_became_active":"2023-09-13T08:24:46.794625+0000","last_became_peered":"2023-09-13T08:24:46.794625+0000","last_unstale":"2023-09-13T08:24:48.535610+0000","last_undegraded":"2023-09-13T08:24:48.535610+0000","last_fullsized":"2023-09-13T08:24:48.535610+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:24:40.971505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.786879+0000","last_change":"2023-09-13T08:24:41.752295+0000","last_active":"2023-09-13T08:24:46.786879+0000","last_peered":"2023-09-13T08:24:46.786879+0000","last_clean":"2023-09-13T08:24:46.786879+0000","last_became_active":"2023-09-13T08:24:41.751730+0000","last_became_peered":"2023-09-13T08:24:41.751730+0000","last_unstale":"2023-09-13T08:24:46.786879+0000","last_undegraded":"2023-09-13T08:24:46.786879+0000","last_fullsized":"2023-09-13T08:24:46.786879+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:14:24.302634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.775290+0000","last_change":"2023-09-13T08:24:42.761292+0000","last_active":"2023-09-13T08:24:46.775290+0000","last_peered":"2023-09-13T08:24:46.775290+0000","last_clean":"2023-09-13T08:24:46.775290+0000","last_became_active":"2023-09-13T08:24:42.761004+0000","last_became_peered":"2023-09-13T08:24:42.761004+0000","last_unstale":"2023-09-13T08:24:46.775290+0000","last_undegraded":"2023-09-13T08:24:46.775290+0000","last_fullsized":"2023-09-13T08:24:46.775290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:32:01.643446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.535622+0000","last_change":"2023-09-13T08:24:46.799231+0000","last_active":"2023-09-13T08:24:48.535622+0000","last_peered":"2023-09-13T08:24:48.535622+0000","last_clean":"2023-09-13T08:24:48.535622+0000","last_became_active":"2023-09-13T08:24:46.798813+0000","last_became_peered":"2023-09-13T08:24:46.798813+0000","last_unstale":"2023-09-13T08:24:48.535622+0000","last_undegraded":"2023-09-13T08:24:48.535622+0000","last_fullsized":"2023-09-13T08:24:48.535622+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:14:40.142972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.775333+0000","last_change":"2023-09-13T08:24:41.757732+0000","last_active":"2023-09-13T08:24:46.775333+0000","last_peered":"2023-09-13T08:24:46.775333+0000","last_clean":"2023-09-13T08:24:46.775333+0000","last_became_active":"2023-09-13T08:24:41.757452+0000","last_became_peered":"2023-09-13T08:24:41.757452+0000","last_unstale":"2023-09-13T08:24:46.775333+0000","last_undegraded":"2023-09-13T08:24:46.775333+0000","last_fullsized":"2023-09-13T08:24:46.775333+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:12:03.105088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.779874+0000","last_change":"2023-09-13T08:24:42.764641+0000","last_active":"2023-09-13T08:24:46.779874+0000","last_peered":"2023-09-13T08:24:46.779874+0000","last_clean":"2023-09-13T08:24:46.779874+0000","last_became_active":"2023-09-13T08:24:42.764368+0000","last_became_peered":"2023-09-13T08:24:42.764368+0000","last_unstale":"2023-09-13T08:24:46.779874+0000","last_undegraded":"2023-09-13T08:24:46.779874+0000","last_fullsized":"2023-09-13T08:24:46.779874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:01:14.370463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.535743+0000","last_change":"2023-09-13T08:24:46.794114+0000","last_active":"2023-09-13T08:24:48.535743+0000","last_peered":"2023-09-13T08:24:48.535743+0000","last_clean":"2023-09-13T08:24:48.535743+0000","last_became_active":"2023-09-13T08:24:46.793129+0000","last_became_peered":"2023-09-13T08:24:46.793129+0000","last_unstale":"2023-09-13T08:24:48.535743+0000","last_undegraded":"2023-09-13T08:24:48.535743+0000","last_fullsized":"2023-09-13T08:24:48.535743+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:35:08.086286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.779227+0000","last_change":"2023-09-13T08:24:41.755450+0000","last_active":"2023-09-13T08:24:46.779227+0000","last_peered":"2023-09-13T08:24:46.779227+0000","last_clean":"2023-09-13T08:24:46.779227+0000","last_became_active":"2023-09-13T08:24:41.755168+0000","last_became_peered":"2023-09-13T08:24:41.755168+0000","last_unstale":"2023-09-13T08:24:46.779227+0000","last_undegraded":"2023-09-13T08:24:46.779227+0000","last_fullsized":"2023-09-13T08:24:46.779227+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:28:07.813946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.781645+0000","last_change":"2023-09-13T08:24:42.756700+0000","last_active":"2023-09-13T08:24:46.781645+0000","last_peered":"2023-09-13T08:24:46.781645+0000","last_clean":"2023-09-13T08:24:46.781645+0000","last_became_active":"2023-09-13T08:24:42.756408+0000","last_became_peered":"2023-09-13T08:24:42.756408+0000","last_unstale":"2023-09-13T08:24:46.781645+0000","last_undegraded":"2023-09-13T08:24:46.781645+0000","last_fullsized":"2023-09-13T08:24:46.781645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:28:08.821003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.535262+0000","last_change":"2023-09-13T08:24:46.793849+0000","last_active":"2023-09-13T08:24:48.535262+0000","last_peered":"2023-09-13T08:24:48.535262+0000","last_clean":"2023-09-13T08:24:48.535262+0000","last_became_active":"2023-09-13T08:24:46.793486+0000","last_became_peered":"2023-09-13T08:24:46.793486+0000","last_unstale":"2023-09-13T08:24:48.535262+0000","last_undegraded":"2023-09-13T08:24:48.535262+0000","last_fullsized":"2023-09-13T08:24:48.535262+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:49:40.361758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:52.674989+0000","last_change":"2023-09-13T08:24:41.755123+0000","last_active":"2023-09-13T08:24:52.674989+0000","last_peered":"2023-09-13T08:24:52.674989+0000","last_clean":"2023-09-13T08:24:52.674989+0000","last_became_active":"2023-09-13T08:24:41.754872+0000","last_became_peered":"2023-09-13T08:24:41.754872+0000","last_unstale":"2023-09-13T08:24:52.674989+0000","last_undegraded":"2023-09-13T08:24:52.674989+0000","last_fullsized":"2023-09-13T08:24:52.674989+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:28:07.813946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.774928+0000","last_change":"2023-09-13T08:24:42.756478+0000","last_active":"2023-09-13T08:24:46.774928+0000","last_peered":"2023-09-13T08:24:46.774928+0000","last_clean":"2023-09-13T08:24:46.774928+0000","last_became_active":"2023-09-13T08:24:42.755725+0000","last_became_peered":"2023-09-13T08:24:42.755725+0000","last_unstale":"2023-09-13T08:24:46.774928+0000","last_undegraded":"2023-09-13T08:24:46.774928+0000","last_fullsized":"2023-09-13T08:24:46.774928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:29:11.602118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:47.810994+0000","last_change":"2023-09-13T08:24:46.791174+0000","last_active":"2023-09-13T08:24:47.810994+0000","last_peered":"2023-09-13T08:24:47.810994+0000","last_clean":"2023-09-13T08:24:47.810994+0000","last_became_active":"2023-09-13T08:24:46.790577+0000","last_became_peered":"2023-09-13T08:24:46.790577+0000","last_unstale":"2023-09-13T08:24:47.810994+0000","last_undegraded":"2023-09-13T08:24:47.810994+0000","last_fullsized":"2023-09-13T08:24:47.810994+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:06:40.257204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.777835+0000","last_change":"2023-09-13T08:24:41.748341+0000","last_active":"2023-09-13T08:24:46.777835+0000","last_peered":"2023-09-13T08:24:46.777835+0000","last_clean":"2023-09-13T08:24:46.777835+0000","last_became_active":"2023-09-13T08:24:41.748090+0000","last_became_peered":"2023-09-13T08:24:41.748090+0000","last_unstale":"2023-09-13T08:24:46.777835+0000","last_undegraded":"2023-09-13T08:24:46.777835+0000","last_fullsized":"2023-09-13T08:24:46.777835+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:04:12.070569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.779335+0000","last_change":"2023-09-13T08:24:42.748471+0000","last_active":"2023-09-13T08:24:46.779335+0000","last_peered":"2023-09-13T08:24:46.779335+0000","last_clean":"2023-09-13T08:24:46.779335+0000","last_became_active":"2023-09-13T08:24:42.748243+0000","last_became_peered":"2023-09-13T08:24:42.748243+0000","last_unstale":"2023-09-13T08:24:46.779335+0000","last_undegraded":"2023-09-13T08:24:46.779335+0000","last_fullsized":"2023-09-13T08:24:46.779335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:14:25.309691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.537111+0000","last_change":"2023-09-13T08:24:46.795104+0000","last_active":"2023-09-13T08:24:48.537111+0000","last_peered":"2023-09-13T08:24:48.537111+0000","last_clean":"2023-09-13T08:24:48.537111+0000","last_became_active":"2023-09-13T08:24:46.794725+0000","last_became_peered":"2023-09-13T08:24:46.794725+0000","last_unstale":"2023-09-13T08:24:48.537111+0000","last_undegraded":"2023-09-13T08:24:48.537111+0000","last_fullsized":"2023-09-13T08:24:48.537111+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:55:26.579142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.774235+0000","last_change":"2023-09-13T08:24:41.756881+0000","last_active":"2023-09-13T08:24:46.774235+0000","last_peered":"2023-09-13T08:24:46.774235+0000","last_clean":"2023-09-13T08:24:46.774235+0000","last_became_active":"2023-09-13T08:24:41.756567+0000","last_became_peered":"2023-09-13T08:24:41.756567+0000","last_unstale":"2023-09-13T08:24:46.774235+0000","last_undegraded":"2023-09-13T08:24:46.774235+0000","last_fullsized":"2023-09-13T08:24:46.774235+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:14:24.302634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.774321+0000","last_change":"2023-09-13T08:24:42.764196+0000","last_active":"2023-09-13T08:24:46.774321+0000","last_peered":"2023-09-13T08:24:46.774321+0000","last_clean":"2023-09-13T08:24:46.774321+0000","last_became_active":"2023-09-13T08:24:42.760048+0000","last_became_peered":"2023-09-13T08:24:42.760048+0000","last_unstale":"2023-09-13T08:24:46.774321+0000","last_undegraded":"2023-09-13T08:24:46.774321+0000","last_fullsized":"2023-09-13T08:24:46.774321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:20:47.395388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.537009+0000","last_change":"2023-09-13T08:24:46.795864+0000","last_active":"2023-09-13T08:24:48.537009+0000","last_peered":"2023-09-13T08:24:48.537009+0000","last_clean":"2023-09-13T08:24:48.537009+0000","last_became_active":"2023-09-13T08:24:46.795486+0000","last_became_peered":"2023-09-13T08:24:46.795486+0000","last_unstale":"2023-09-13T08:24:48.537009+0000","last_undegraded":"2023-09-13T08:24:48.537009+0000","last_fullsized":"2023-09-13T08:24:48.537009+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:06:32.572669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.785872+0000","last_change":"2023-09-13T08:24:41.749723+0000","last_active":"2023-09-13T08:24:46.785872+0000","last_peered":"2023-09-13T08:24:46.785872+0000","last_clean":"2023-09-13T08:24:46.785872+0000","last_became_active":"2023-09-13T08:24:41.749372+0000","last_became_peered":"2023-09-13T08:24:41.749372+0000","last_unstale":"2023-09-13T08:24:46.785872+0000","last_undegraded":"2023-09-13T08:24:46.785872+0000","last_fullsized":"2023-09-13T08:24:46.785872+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:56:12.891967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.785750+0000","last_change":"2023-09-13T08:24:42.752492+0000","last_active":"2023-09-13T08:24:46.785750+0000","last_peered":"2023-09-13T08:24:46.785750+0000","last_clean":"2023-09-13T08:24:46.785750+0000","last_became_active":"2023-09-13T08:24:42.752171+0000","last_became_peered":"2023-09-13T08:24:42.752171+0000","last_unstale":"2023-09-13T08:24:46.785750+0000","last_undegraded":"2023-09-13T08:24:46.785750+0000","last_fullsized":"2023-09-13T08:24:46.785750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:38:57.000291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.534401+0000","last_change":"2023-09-13T08:24:46.796118+0000","last_active":"2023-09-13T08:24:48.534401+0000","last_peered":"2023-09-13T08:24:48.534401+0000","last_clean":"2023-09-13T08:24:48.534401+0000","last_became_active":"2023-09-13T08:24:46.795725+0000","last_became_peered":"2023-09-13T08:24:46.795725+0000","last_unstale":"2023-09-13T08:24:48.534401+0000","last_undegraded":"2023-09-13T08:24:48.534401+0000","last_fullsized":"2023-09-13T08:24:48.534401+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:19:00.119006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.778226+0000","last_change":"2023-09-13T08:24:41.749035+0000","last_active":"2023-09-13T08:24:46.778226+0000","last_peered":"2023-09-13T08:24:46.778226+0000","last_clean":"2023-09-13T08:24:46.778226+0000","last_became_active":"2023-09-13T08:24:41.748750+0000","last_became_peered":"2023-09-13T08:24:41.748750+0000","last_unstale":"2023-09-13T08:24:46.778226+0000","last_undegraded":"2023-09-13T08:24:46.778226+0000","last_fullsized":"2023-09-13T08:24:46.778226+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:10:08.445556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.775239+0000","last_change":"2023-09-13T08:24:42.756878+0000","last_active":"2023-09-13T08:24:46.775239+0000","last_peered":"2023-09-13T08:24:46.775239+0000","last_clean":"2023-09-13T08:24:46.775239+0000","last_became_active":"2023-09-13T08:24:42.756564+0000","last_became_peered":"2023-09-13T08:24:42.756564+0000","last_unstale":"2023-09-13T08:24:46.775239+0000","last_undegraded":"2023-09-13T08:24:46.775239+0000","last_fullsized":"2023-09-13T08:24:46.775239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:23:57.161158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.534913+0000","last_change":"2023-09-13T08:24:46.799955+0000","last_active":"2023-09-13T08:24:48.534913+0000","last_peered":"2023-09-13T08:24:48.534913+0000","last_clean":"2023-09-13T08:24:48.534913+0000","last_became_active":"2023-09-13T08:24:46.799140+0000","last_became_peered":"2023-09-13T08:24:46.799140+0000","last_unstale":"2023-09-13T08:24:48.534913+0000","last_undegraded":"2023-09-13T08:24:48.534913+0000","last_fullsized":"2023-09-13T08:24:48.534913+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T19:01:33.986931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.781644+0000","last_change":"2023-09-13T08:24:41.748494+0000","last_active":"2023-09-13T08:24:46.781644+0000","last_peered":"2023-09-13T08:24:46.781644+0000","last_clean":"2023-09-13T08:24:46.781644+0000","last_became_active":"2023-09-13T08:24:41.748204+0000","last_became_peered":"2023-09-13T08:24:41.748204+0000","last_unstale":"2023-09-13T08:24:46.781644+0000","last_undegraded":"2023-09-13T08:24:46.781644+0000","last_fullsized":"2023-09-13T08:24:46.781644+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:40:49.395433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.775174+0000","last_change":"2023-09-13T08:24:42.757274+0000","last_active":"2023-09-13T08:24:46.775174+0000","last_peered":"2023-09-13T08:24:46.775174+0000","last_clean":"2023-09-13T08:24:46.775174+0000","last_became_active":"2023-09-13T08:24:42.756521+0000","last_became_peered":"2023-09-13T08:24:42.756521+0000","last_unstale":"2023-09-13T08:24:46.775174+0000","last_undegraded":"2023-09-13T08:24:46.775174+0000","last_fullsized":"2023-09-13T08:24:46.775174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:41:08.160337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.535146+0000","last_change":"2023-09-13T08:24:46.792835+0000","last_active":"2023-09-13T08:24:48.535146+0000","last_peered":"2023-09-13T08:24:48.535146+0000","last_clean":"2023-09-13T08:24:48.535146+0000","last_became_active":"2023-09-13T08:24:46.792432+0000","last_became_peered":"2023-09-13T08:24:46.792432+0000","last_unstale":"2023-09-13T08:24:48.535146+0000","last_undegraded":"2023-09-13T08:24:48.535146+0000","last_fullsized":"2023-09-13T08:24:48.535146+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:19:00.119006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.779060+0000","last_change":"2023-09-13T08:24:41.747562+0000","last_active":"2023-09-13T08:24:46.779060+0000","last_peered":"2023-09-13T08:24:46.779060+0000","last_clean":"2023-09-13T08:24:46.779060+0000","last_became_active":"2023-09-13T08:24:41.747309+0000","last_became_peered":"2023-09-13T08:24:41.747309+0000","last_unstale":"2023-09-13T08:24:46.779060+0000","last_undegraded":"2023-09-13T08:24:46.779060+0000","last_fullsized":"2023-09-13T08:24:46.779060+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:16:33.150745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.776806+0000","last_change":"2023-09-13T08:24:42.771356+0000","last_active":"2023-09-13T08:24:46.776806+0000","last_peered":"2023-09-13T08:24:46.776806+0000","last_clean":"2023-09-13T08:24:46.776806+0000","last_became_active":"2023-09-13T08:24:42.768326+0000","last_became_peered":"2023-09-13T08:24:42.768326+0000","last_unstale":"2023-09-13T08:24:46.776806+0000","last_undegraded":"2023-09-13T08:24:46.776806+0000","last_fullsized":"2023-09-13T08:24:46.776806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T19:01:29.959464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.535284+0000","last_change":"2023-09-13T08:24:46.794707+0000","last_active":"2023-09-13T08:24:48.535284+0000","last_peered":"2023-09-13T08:24:48.535284+0000","last_clean":"2023-09-13T08:24:48.535284+0000","last_became_active":"2023-09-13T08:24:46.794482+0000","last_became_peered":"2023-09-13T08:24:46.794482+0000","last_unstale":"2023-09-13T08:24:48.535284+0000","last_undegraded":"2023-09-13T08:24:48.535284+0000","last_fullsized":"2023-09-13T08:24:48.535284+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:44:45.516475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.774129+0000","last_change":"2023-09-13T08:24:41.754944+0000","last_active":"2023-09-13T08:24:46.774129+0000","last_peered":"2023-09-13T08:24:46.774129+0000","last_clean":"2023-09-13T08:24:46.774129+0000","last_became_active":"2023-09-13T08:24:41.754643+0000","last_became_peered":"2023-09-13T08:24:41.754643+0000","last_unstale":"2023-09-13T08:24:46.774129+0000","last_undegraded":"2023-09-13T08:24:46.774129+0000","last_fullsized":"2023-09-13T08:24:46.774129+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:16:33.150745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.781175+0000","last_change":"2023-09-13T08:24:42.746767+0000","last_active":"2023-09-13T08:24:46.781175+0000","last_peered":"2023-09-13T08:24:46.781175+0000","last_clean":"2023-09-13T08:24:46.781175+0000","last_became_active":"2023-09-13T08:24:42.746431+0000","last_became_peered":"2023-09-13T08:24:42.746431+0000","last_unstale":"2023-09-13T08:24:46.781175+0000","last_undegraded":"2023-09-13T08:24:46.781175+0000","last_fullsized":"2023-09-13T08:24:46.781175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:14:25.309691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.536899+0000","last_change":"2023-09-13T08:24:46.791183+0000","last_active":"2023-09-13T08:24:48.536899+0000","last_peered":"2023-09-13T08:24:48.536899+0000","last_clean":"2023-09-13T08:24:48.536899+0000","last_became_active":"2023-09-13T08:24:46.790665+0000","last_became_peered":"2023-09-13T08:24:46.790665+0000","last_unstale":"2023-09-13T08:24:48.536899+0000","last_undegraded":"2023-09-13T08:24:48.536899+0000","last_fullsized":"2023-09-13T08:24:48.536899+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:35:08.793411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.779259+0000","last_change":"2023-09-13T08:24:42.763692+0000","last_active":"2023-09-13T08:24:46.779259+0000","last_peered":"2023-09-13T08:24:46.779259+0000","last_clean":"2023-09-13T08:24:46.779259+0000","last_became_active":"2023-09-13T08:24:42.763348+0000","last_became_peered":"2023-09-13T08:24:42.763348+0000","last_unstale":"2023-09-13T08:24:46.779259+0000","last_undegraded":"2023-09-13T08:24:46.779259+0000","last_fullsized":"2023-09-13T08:24:46.779259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:01:15.582567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.778942+0000","last_change":"2023-09-13T08:24:41.750528+0000","last_active":"2023-09-13T08:24:46.778942+0000","last_peered":"2023-09-13T08:24:46.778942+0000","last_clean":"2023-09-13T08:24:46.778942+0000","last_became_active":"2023-09-13T08:24:41.750238+0000","last_became_peered":"2023-09-13T08:24:41.750238+0000","last_unstale":"2023-09-13T08:24:46.778942+0000","last_undegraded":"2023-09-13T08:24:46.778942+0000","last_fullsized":"2023-09-13T08:24:46.778942+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:40:49.395433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:47.775614+0000","last_change":"2023-09-13T08:24:46.798991+0000","last_active":"2023-09-13T08:24:47.775614+0000","last_peered":"2023-09-13T08:24:47.775614+0000","last_clean":"2023-09-13T08:24:47.775614+0000","last_became_active":"2023-09-13T08:24:46.798610+0000","last_became_peered":"2023-09-13T08:24:46.798610+0000","last_unstale":"2023-09-13T08:24:47.775614+0000","last_undegraded":"2023-09-13T08:24:47.775614+0000","last_fullsized":"2023-09-13T08:24:47.775614+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T19:57:23.132436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.772327+0000","last_change":"2023-09-13T08:24:42.768328+0000","last_active":"2023-09-13T08:24:46.772327+0000","last_peered":"2023-09-13T08:24:46.772327+0000","last_clean":"2023-09-13T08:24:46.772327+0000","last_became_active":"2023-09-13T08:24:42.768076+0000","last_became_peered":"2023-09-13T08:24:42.768076+0000","last_unstale":"2023-09-13T08:24:46.772327+0000","last_undegraded":"2023-09-13T08:24:46.772327+0000","last_fullsized":"2023-09-13T08:24:46.772327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:38:57.000291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.775019+0000","last_change":"2023-09-13T08:24:41.756796+0000","last_active":"2023-09-13T08:24:46.775019+0000","last_peered":"2023-09-13T08:24:46.775019+0000","last_clean":"2023-09-13T08:24:46.775019+0000","last_became_active":"2023-09-13T08:24:41.756485+0000","last_became_peered":"2023-09-13T08:24:41.756485+0000","last_unstale":"2023-09-13T08:24:46.775019+0000","last_undegraded":"2023-09-13T08:24:46.775019+0000","last_fullsized":"2023-09-13T08:24:46.775019+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:20:29.866513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":169,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.775432+0000","last_change":"2023-09-13T08:24:30.608284+0000","last_active":"2023-09-13T08:24:46.775432+0000","last_peered":"2023-09-13T08:24:46.775432+0000","last_clean":"2023-09-13T08:24:46.775432+0000","last_became_active":"2023-09-13T08:24:30.607240+0000","last_became_peered":"2023-09-13T08:24:30.607240+0000","last_unstale":"2023-09-13T08:24:46.775432+0000","last_undegraded":"2023-09-13T08:24:46.775432+0000","last_fullsized":"2023-09-13T08:24:46.775432+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:29.424755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:29.424755+0000","last_clean_scrub_stamp":"2023-09-13T08:24:29.424755+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:57:43.427279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.534536+0000","last_change":"2023-09-13T08:24:46.796073+0000","last_active":"2023-09-13T08:24:48.534536+0000","last_peered":"2023-09-13T08:24:48.534536+0000","last_clean":"2023-09-13T08:24:48.534536+0000","last_became_active":"2023-09-13T08:24:46.795401+0000","last_became_peered":"2023-09-13T08:24:46.795401+0000","last_unstale":"2023-09-13T08:24:48.534536+0000","last_undegraded":"2023-09-13T08:24:48.534536+0000","last_fullsized":"2023-09-13T08:24:48.534536+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:49:40.361758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.778869+0000","last_change":"2023-09-13T08:24:42.742114+0000","last_active":"2023-09-13T08:24:46.778869+0000","last_peered":"2023-09-13T08:24:46.778869+0000","last_clean":"2023-09-13T08:24:46.778869+0000","last_became_active":"2023-09-13T08:24:42.741800+0000","last_became_peered":"2023-09-13T08:24:42.741800+0000","last_unstale":"2023-09-13T08:24:46.778869+0000","last_undegraded":"2023-09-13T08:24:46.778869+0000","last_fullsized":"2023-09-13T08:24:46.778869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:52:00.242806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.774235+0000","last_change":"2023-09-13T08:24:41.749496+0000","last_active":"2023-09-13T08:24:46.774235+0000","last_peered":"2023-09-13T08:24:46.774235+0000","last_clean":"2023-09-13T08:24:46.774235+0000","last_became_active":"2023-09-13T08:24:41.749111+0000","last_became_peered":"2023-09-13T08:24:41.749111+0000","last_unstale":"2023-09-13T08:24:46.774235+0000","last_undegraded":"2023-09-13T08:24:46.774235+0000","last_fullsized":"2023-09-13T08:24:46.774235+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:12:03.105088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.534661+0000","last_change":"2023-09-13T08:24:46.794473+0000","last_active":"2023-09-13T08:24:48.534661+0000","last_peered":"2023-09-13T08:24:48.534661+0000","last_clean":"2023-09-13T08:24:48.534661+0000","last_became_active":"2023-09-13T08:24:46.794060+0000","last_became_peered":"2023-09-13T08:24:46.794060+0000","last_unstale":"2023-09-13T08:24:48.534661+0000","last_undegraded":"2023-09-13T08:24:48.534661+0000","last_fullsized":"2023-09-13T08:24:48.534661+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:35:08.793411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.774664+0000","last_change":"2023-09-13T08:24:41.762626+0000","last_active":"2023-09-13T08:24:46.774664+0000","last_peered":"2023-09-13T08:24:46.774664+0000","last_clean":"2023-09-13T08:24:46.774664+0000","last_became_active":"2023-09-13T08:24:41.762370+0000","last_became_peered":"2023-09-13T08:24:41.762370+0000","last_unstale":"2023-09-13T08:24:46.774664+0000","last_undegraded":"2023-09-13T08:24:46.774664+0000","last_fullsized":"2023-09-13T08:24:46.774664+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:47:38.305158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.779166+0000","last_change":"2023-09-13T08:24:42.756318+0000","last_active":"2023-09-13T08:24:46.779166+0000","last_peered":"2023-09-13T08:24:46.779166+0000","last_clean":"2023-09-13T08:24:46.779166+0000","last_became_active":"2023-09-13T08:24:42.755533+0000","last_became_peered":"2023-09-13T08:24:42.755533+0000","last_unstale":"2023-09-13T08:24:46.779166+0000","last_undegraded":"2023-09-13T08:24:46.779166+0000","last_fullsized":"2023-09-13T08:24:46.779166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:38:57.000291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.535633+0000","last_change":"2023-09-13T08:24:46.792676+0000","last_active":"2023-09-13T08:24:48.535633+0000","last_peered":"2023-09-13T08:24:48.535633+0000","last_clean":"2023-09-13T08:24:48.535633+0000","last_became_active":"2023-09-13T08:24:46.792303+0000","last_became_peered":"2023-09-13T08:24:46.792303+0000","last_unstale":"2023-09-13T08:24:48.535633+0000","last_undegraded":"2023-09-13T08:24:48.535633+0000","last_fullsized":"2023-09-13T08:24:48.535633+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:06:40.257204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.778749+0000","last_change":"2023-09-13T08:24:41.755753+0000","last_active":"2023-09-13T08:24:46.778749+0000","last_peered":"2023-09-13T08:24:46.778749+0000","last_clean":"2023-09-13T08:24:46.778749+0000","last_became_active":"2023-09-13T08:24:41.755494+0000","last_became_peered":"2023-09-13T08:24:41.755494+0000","last_unstale":"2023-09-13T08:24:46.778749+0000","last_undegraded":"2023-09-13T08:24:46.778749+0000","last_fullsized":"2023-09-13T08:24:46.778749+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:14:24.302634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.772761+0000","last_change":"2023-09-13T08:24:42.766497+0000","last_active":"2023-09-13T08:24:46.772761+0000","last_peered":"2023-09-13T08:24:46.772761+0000","last_clean":"2023-09-13T08:24:46.772761+0000","last_became_active":"2023-09-13T08:24:42.766157+0000","last_became_peered":"2023-09-13T08:24:42.766157+0000","last_unstale":"2023-09-13T08:24:46.772761+0000","last_undegraded":"2023-09-13T08:24:46.772761+0000","last_fullsized":"2023-09-13T08:24:46.772761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:31:23.082234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.535011+0000","last_change":"2023-09-13T08:24:46.794008+0000","last_active":"2023-09-13T08:24:48.535011+0000","last_peered":"2023-09-13T08:24:48.535011+0000","last_clean":"2023-09-13T08:24:48.535011+0000","last_became_active":"2023-09-13T08:24:46.792056+0000","last_became_peered":"2023-09-13T08:24:46.792056+0000","last_unstale":"2023-09-13T08:24:48.535011+0000","last_undegraded":"2023-09-13T08:24:48.535011+0000","last_fullsized":"2023-09-13T08:24:48.535011+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:32:05.670913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.786789+0000","last_change":"2023-09-13T08:24:41.752446+0000","last_active":"2023-09-13T08:24:46.786789+0000","last_peered":"2023-09-13T08:24:46.786789+0000","last_clean":"2023-09-13T08:24:46.786789+0000","last_became_active":"2023-09-13T08:24:41.752048+0000","last_became_peered":"2023-09-13T08:24:41.752048+0000","last_unstale":"2023-09-13T08:24:46.786789+0000","last_undegraded":"2023-09-13T08:24:46.786789+0000","last_fullsized":"2023-09-13T08:24:46.786789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:16:33.150745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.777913+0000","last_change":"2023-09-13T08:24:42.761656+0000","last_active":"2023-09-13T08:24:46.777913+0000","last_peered":"2023-09-13T08:24:46.777913+0000","last_clean":"2023-09-13T08:24:46.777913+0000","last_became_active":"2023-09-13T08:24:42.761413+0000","last_became_peered":"2023-09-13T08:24:42.761413+0000","last_unstale":"2023-09-13T08:24:46.777913+0000","last_undegraded":"2023-09-13T08:24:46.777913+0000","last_fullsized":"2023-09-13T08:24:46.777913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:38:57.000291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.535562+0000","last_change":"2023-09-13T08:24:46.799414+0000","last_active":"2023-09-13T08:24:48.535562+0000","last_peered":"2023-09-13T08:24:48.535562+0000","last_clean":"2023-09-13T08:24:48.535562+0000","last_became_active":"2023-09-13T08:24:46.796678+0000","last_became_peered":"2023-09-13T08:24:46.796678+0000","last_unstale":"2023-09-13T08:24:48.535562+0000","last_undegraded":"2023-09-13T08:24:48.535562+0000","last_fullsized":"2023-09-13T08:24:48.535562+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:44:45.516475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.773672+0000","last_change":"2023-09-13T08:24:41.762705+0000","last_active":"2023-09-13T08:24:46.773672+0000","last_peered":"2023-09-13T08:24:46.773672+0000","last_clean":"2023-09-13T08:24:46.773672+0000","last_became_active":"2023-09-13T08:24:41.762433+0000","last_became_peered":"2023-09-13T08:24:41.762433+0000","last_unstale":"2023-09-13T08:24:46.773672+0000","last_undegraded":"2023-09-13T08:24:46.773672+0000","last_fullsized":"2023-09-13T08:24:46.773672+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:33:08.894982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.780733+0000","last_change":"2023-09-13T08:24:42.756676+0000","last_active":"2023-09-13T08:24:46.780733+0000","last_peered":"2023-09-13T08:24:46.780733+0000","last_clean":"2023-09-13T08:24:46.780733+0000","last_became_active":"2023-09-13T08:24:42.756186+0000","last_became_peered":"2023-09-13T08:24:42.756186+0000","last_unstale":"2023-09-13T08:24:46.780733+0000","last_undegraded":"2023-09-13T08:24:46.780733+0000","last_fullsized":"2023-09-13T08:24:46.780733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:56:13.899024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.537160+0000","last_change":"2023-09-13T08:24:46.792798+0000","last_active":"2023-09-13T08:24:48.537160+0000","last_peered":"2023-09-13T08:24:48.537160+0000","last_clean":"2023-09-13T08:24:48.537160+0000","last_became_active":"2023-09-13T08:24:46.792514+0000","last_became_peered":"2023-09-13T08:24:46.792514+0000","last_unstale":"2023-09-13T08:24:48.537160+0000","last_undegraded":"2023-09-13T08:24:48.537160+0000","last_fullsized":"2023-09-13T08:24:48.537160+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:35:08.086286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.778802+0000","last_change":"2023-09-13T08:24:41.748432+0000","last_active":"2023-09-13T08:24:46.778802+0000","last_peered":"2023-09-13T08:24:46.778802+0000","last_clean":"2023-09-13T08:24:46.778802+0000","last_became_active":"2023-09-13T08:24:41.747775+0000","last_became_peered":"2023-09-13T08:24:41.747775+0000","last_unstale":"2023-09-13T08:24:46.778802+0000","last_undegraded":"2023-09-13T08:24:46.778802+0000","last_fullsized":"2023-09-13T08:24:46.778802+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:04:12.070569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.772017+0000","last_change":"2023-09-13T08:24:42.764490+0000","last_active":"2023-09-13T08:24:46.772017+0000","last_peered":"2023-09-13T08:24:46.772017+0000","last_clean":"2023-09-13T08:24:46.772017+0000","last_became_active":"2023-09-13T08:24:42.764250+0000","last_became_peered":"2023-09-13T08:24:42.764250+0000","last_unstale":"2023-09-13T08:24:46.772017+0000","last_undegraded":"2023-09-13T08:24:46.772017+0000","last_fullsized":"2023-09-13T08:24:46.772017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:47:39.312215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.535444+0000","last_change":"2023-09-13T08:24:46.798308+0000","last_active":"2023-09-13T08:24:48.535444+0000","last_peered":"2023-09-13T08:24:48.535444+0000","last_clean":"2023-09-13T08:24:48.535444+0000","last_became_active":"2023-09-13T08:24:46.797901+0000","last_became_peered":"2023-09-13T08:24:46.797901+0000","last_unstale":"2023-09-13T08:24:48.535444+0000","last_undegraded":"2023-09-13T08:24:48.535444+0000","last_fullsized":"2023-09-13T08:24:48.535444+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:49:40.361758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.778922+0000","last_change":"2023-09-13T08:24:41.752252+0000","last_active":"2023-09-13T08:24:46.778922+0000","last_peered":"2023-09-13T08:24:46.778922+0000","last_clean":"2023-09-13T08:24:46.778922+0000","last_became_active":"2023-09-13T08:24:41.751926+0000","last_became_peered":"2023-09-13T08:24:41.751926+0000","last_unstale":"2023-09-13T08:24:46.778922+0000","last_undegraded":"2023-09-13T08:24:46.778922+0000","last_fullsized":"2023-09-13T08:24:46.778922+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:51:59.235749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.772536+0000","last_change":"2023-09-13T08:24:42.753686+0000","last_active":"2023-09-13T08:24:46.772536+0000","last_peered":"2023-09-13T08:24:46.772536+0000","last_clean":"2023-09-13T08:24:46.772536+0000","last_became_active":"2023-09-13T08:24:42.753298+0000","last_became_peered":"2023-09-13T08:24:42.753298+0000","last_unstale":"2023-09-13T08:24:46.772536+0000","last_undegraded":"2023-09-13T08:24:46.772536+0000","last_fullsized":"2023-09-13T08:24:46.772536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:23:57.161158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.535678+0000","last_change":"2023-09-13T08:24:46.791776+0000","last_active":"2023-09-13T08:24:48.535678+0000","last_peered":"2023-09-13T08:24:48.535678+0000","last_clean":"2023-09-13T08:24:48.535678+0000","last_became_active":"2023-09-13T08:24:46.791304+0000","last_became_peered":"2023-09-13T08:24:46.791304+0000","last_unstale":"2023-09-13T08:24:48.535678+0000","last_undegraded":"2023-09-13T08:24:48.535678+0000","last_fullsized":"2023-09-13T08:24:48.535678+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:35:08.793411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.773971+0000","last_change":"2023-09-13T08:24:41.748551+0000","last_active":"2023-09-13T08:24:46.773971+0000","last_peered":"2023-09-13T08:24:46.773971+0000","last_clean":"2023-09-13T08:24:46.773971+0000","last_became_active":"2023-09-13T08:24:41.748281+0000","last_became_peered":"2023-09-13T08:24:41.748281+0000","last_unstale":"2023-09-13T08:24:46.773971+0000","last_undegraded":"2023-09-13T08:24:46.773971+0000","last_fullsized":"2023-09-13T08:24:46.773971+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:07:52.055769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.785938+0000","last_change":"2023-09-13T08:24:42.755845+0000","last_active":"2023-09-13T08:24:46.785938+0000","last_peered":"2023-09-13T08:24:46.785938+0000","last_clean":"2023-09-13T08:24:46.785938+0000","last_became_active":"2023-09-13T08:24:42.755374+0000","last_became_peered":"2023-09-13T08:24:42.755374+0000","last_unstale":"2023-09-13T08:24:46.785938+0000","last_undegraded":"2023-09-13T08:24:46.785938+0000","last_fullsized":"2023-09-13T08:24:46.785938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:22:05.554377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:47.776274+0000","last_change":"2023-09-13T08:24:46.799284+0000","last_active":"2023-09-13T08:24:47.776274+0000","last_peered":"2023-09-13T08:24:47.776274+0000","last_clean":"2023-09-13T08:24:47.776274+0000","last_became_active":"2023-09-13T08:24:46.798883+0000","last_became_peered":"2023-09-13T08:24:46.798883+0000","last_unstale":"2023-09-13T08:24:47.776274+0000","last_undegraded":"2023-09-13T08:24:47.776274+0000","last_fullsized":"2023-09-13T08:24:47.776274+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:49:40.361758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.781243+0000","last_change":"2023-09-13T08:24:41.752612+0000","last_active":"2023-09-13T08:24:46.781243+0000","last_peered":"2023-09-13T08:24:46.781243+0000","last_clean":"2023-09-13T08:24:46.781243+0000","last_became_active":"2023-09-13T08:24:41.752348+0000","last_became_peered":"2023-09-13T08:24:41.752348+0000","last_unstale":"2023-09-13T08:24:46.781243+0000","last_undegraded":"2023-09-13T08:24:46.781243+0000","last_fullsized":"2023-09-13T08:24:46.781243+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:04:36.176078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.774859+0000","last_change":"2023-09-13T08:24:42.767304+0000","last_active":"2023-09-13T08:24:46.774859+0000","last_peered":"2023-09-13T08:24:46.774859+0000","last_clean":"2023-09-13T08:24:46.774859+0000","last_became_active":"2023-09-13T08:24:42.767041+0000","last_became_peered":"2023-09-13T08:24:42.767041+0000","last_unstale":"2023-09-13T08:24:46.774859+0000","last_undegraded":"2023-09-13T08:24:46.774859+0000","last_fullsized":"2023-09-13T08:24:46.774859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:03:06.113162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.534554+0000","last_change":"2023-09-13T08:24:46.791835+0000","last_active":"2023-09-13T08:24:48.534554+0000","last_peered":"2023-09-13T08:24:48.534554+0000","last_clean":"2023-09-13T08:24:48.534554+0000","last_became_active":"2023-09-13T08:24:46.791288+0000","last_became_peered":"2023-09-13T08:24:46.791288+0000","last_unstale":"2023-09-13T08:24:48.534554+0000","last_undegraded":"2023-09-13T08:24:48.534554+0000","last_fullsized":"2023-09-13T08:24:48.534554+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:44:45.516475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.779134+0000","last_change":"2023-09-13T08:24:41.747559+0000","last_active":"2023-09-13T08:24:46.779134+0000","last_peered":"2023-09-13T08:24:46.779134+0000","last_clean":"2023-09-13T08:24:46.779134+0000","last_became_active":"2023-09-13T08:24:41.747102+0000","last_became_peered":"2023-09-13T08:24:41.747102+0000","last_unstale":"2023-09-13T08:24:46.779134+0000","last_undegraded":"2023-09-13T08:24:46.779134+0000","last_fullsized":"2023-09-13T08:24:46.779134+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:56:12.891967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.776345+0000","last_change":"2023-09-13T08:24:42.770958+0000","last_active":"2023-09-13T08:24:46.776345+0000","last_peered":"2023-09-13T08:24:46.776345+0000","last_clean":"2023-09-13T08:24:46.776345+0000","last_became_active":"2023-09-13T08:24:42.769963+0000","last_became_peered":"2023-09-13T08:24:42.769963+0000","last_unstale":"2023-09-13T08:24:46.776345+0000","last_undegraded":"2023-09-13T08:24:46.776345+0000","last_fullsized":"2023-09-13T08:24:46.776345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:30:17.103018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:47.810704+0000","last_change":"2023-09-13T08:24:46.792537+0000","last_active":"2023-09-13T08:24:47.810704+0000","last_peered":"2023-09-13T08:24:47.810704+0000","last_clean":"2023-09-13T08:24:47.810704+0000","last_became_active":"2023-09-13T08:24:46.791931+0000","last_became_peered":"2023-09-13T08:24:46.791931+0000","last_unstale":"2023-09-13T08:24:47.810704+0000","last_undegraded":"2023-09-13T08:24:47.810704+0000","last_fullsized":"2023-09-13T08:24:47.810704+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:14:40.142972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.783932+0000","last_change":"2023-09-13T08:24:41.750664+0000","last_active":"2023-09-13T08:24:46.783932+0000","last_peered":"2023-09-13T08:24:46.783932+0000","last_clean":"2023-09-13T08:24:46.783932+0000","last_became_active":"2023-09-13T08:24:41.750331+0000","last_became_peered":"2023-09-13T08:24:41.750331+0000","last_unstale":"2023-09-13T08:24:46.783932+0000","last_undegraded":"2023-09-13T08:24:46.783932+0000","last_fullsized":"2023-09-13T08:24:46.783932+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:04:12.070569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.774929+0000","last_change":"2023-09-13T08:24:42.765570+0000","last_active":"2023-09-13T08:24:46.774929+0000","last_peered":"2023-09-13T08:24:46.774929+0000","last_clean":"2023-09-13T08:24:46.774929+0000","last_became_active":"2023-09-13T08:24:42.765232+0000","last_became_peered":"2023-09-13T08:24:42.765232+0000","last_unstale":"2023-09-13T08:24:46.774929+0000","last_undegraded":"2023-09-13T08:24:46.774929+0000","last_fullsized":"2023-09-13T08:24:46.774929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:32:01.643446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.785784+0000","last_change":"2023-09-13T08:24:42.759999+0000","last_active":"2023-09-13T08:24:46.785784+0000","last_peered":"2023-09-13T08:24:46.785784+0000","last_clean":"2023-09-13T08:24:46.785784+0000","last_became_active":"2023-09-13T08:24:42.759710+0000","last_became_peered":"2023-09-13T08:24:42.759710+0000","last_unstale":"2023-09-13T08:24:46.785784+0000","last_undegraded":"2023-09-13T08:24:46.785784+0000","last_fullsized":"2023-09-13T08:24:46.785784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:07:53.062826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.779042+0000","last_change":"2023-09-13T08:24:42.763001+0000","last_active":"2023-09-13T08:24:46.779042+0000","last_peered":"2023-09-13T08:24:46.779042+0000","last_clean":"2023-09-13T08:24:46.779042+0000","last_became_active":"2023-09-13T08:24:42.762686+0000","last_became_peered":"2023-09-13T08:24:42.762686+0000","last_unstale":"2023-09-13T08:24:46.779042+0000","last_undegraded":"2023-09-13T08:24:46.779042+0000","last_fullsized":"2023-09-13T08:24:46.779042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:28:08.821003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.774332+0000","last_change":"2023-09-13T08:24:42.762039+0000","last_active":"2023-09-13T08:24:46.774332+0000","last_peered":"2023-09-13T08:24:46.774332+0000","last_clean":"2023-09-13T08:24:46.774332+0000","last_became_active":"2023-09-13T08:24:42.761685+0000","last_became_peered":"2023-09-13T08:24:42.761685+0000","last_unstale":"2023-09-13T08:24:46.774332+0000","last_undegraded":"2023-09-13T08:24:46.774332+0000","last_fullsized":"2023-09-13T08:24:46.774332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:03:06.113162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.777670+0000","last_change":"2023-09-13T08:24:42.751302+0000","last_active":"2023-09-13T08:24:46.777670+0000","last_peered":"2023-09-13T08:24:46.777670+0000","last_clean":"2023-09-13T08:24:46.777670+0000","last_became_active":"2023-09-13T08:24:42.751016+0000","last_became_peered":"2023-09-13T08:24:42.751016+0000","last_unstale":"2023-09-13T08:24:46.777670+0000","last_undegraded":"2023-09-13T08:24:46.777670+0000","last_fullsized":"2023-09-13T08:24:46.777670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:07:53.062826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.772384+0000","last_change":"2023-09-13T08:24:42.752520+0000","last_active":"2023-09-13T08:24:46.772384+0000","last_peered":"2023-09-13T08:24:46.772384+0000","last_clean":"2023-09-13T08:24:46.772384+0000","last_became_active":"2023-09-13T08:24:42.752216+0000","last_became_peered":"2023-09-13T08:24:42.752216+0000","last_unstale":"2023-09-13T08:24:46.772384+0000","last_undegraded":"2023-09-13T08:24:46.772384+0000","last_fullsized":"2023-09-13T08:24:46.772384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:30:17.103018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.779033+0000","last_change":"2023-09-13T08:24:42.758492+0000","last_active":"2023-09-13T08:24:46.779033+0000","last_peered":"2023-09-13T08:24:46.779033+0000","last_clean":"2023-09-13T08:24:46.779033+0000","last_became_active":"2023-09-13T08:24:42.758226+0000","last_became_peered":"2023-09-13T08:24:42.758226+0000","last_unstale":"2023-09-13T08:24:46.779033+0000","last_undegraded":"2023-09-13T08:24:46.779033+0000","last_fullsized":"2023-09-13T08:24:46.779033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:31:23.082234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.786631+0000","last_change":"2023-09-13T08:24:42.765380+0000","last_active":"2023-09-13T08:24:46.786631+0000","last_peered":"2023-09-13T08:24:46.786631+0000","last_clean":"2023-09-13T08:24:46.786631+0000","last_became_active":"2023-09-13T08:24:42.764743+0000","last_became_peered":"2023-09-13T08:24:42.764743+0000","last_unstale":"2023-09-13T08:24:46.786631+0000","last_undegraded":"2023-09-13T08:24:46.786631+0000","last_fullsized":"2023-09-13T08:24:46.786631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:23:57.161158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.772975+0000","last_change":"2023-09-13T08:24:42.752773+0000","last_active":"2023-09-13T08:24:46.772975+0000","last_peered":"2023-09-13T08:24:46.772975+0000","last_clean":"2023-09-13T08:24:46.772975+0000","last_became_active":"2023-09-13T08:24:42.752417+0000","last_became_peered":"2023-09-13T08:24:42.752417+0000","last_unstale":"2023-09-13T08:24:46.772975+0000","last_undegraded":"2023-09-13T08:24:46.772975+0000","last_fullsized":"2023-09-13T08:24:46.772975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:01:14.370463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.774852+0000","last_change":"2023-09-13T08:24:42.761893+0000","last_active":"2023-09-13T08:24:46.774852+0000","last_peered":"2023-09-13T08:24:46.774852+0000","last_clean":"2023-09-13T08:24:46.774852+0000","last_became_active":"2023-09-13T08:24:42.761302+0000","last_became_peered":"2023-09-13T08:24:42.761302+0000","last_unstale":"2023-09-13T08:24:46.774852+0000","last_undegraded":"2023-09-13T08:24:46.774852+0000","last_fullsized":"2023-09-13T08:24:46.774852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:20:47.395388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.772142+0000","last_change":"2023-09-13T08:24:42.752632+0000","last_active":"2023-09-13T08:24:46.772142+0000","last_peered":"2023-09-13T08:24:46.772142+0000","last_clean":"2023-09-13T08:24:46.772142+0000","last_became_active":"2023-09-13T08:24:42.752332+0000","last_became_peered":"2023-09-13T08:24:42.752332+0000","last_unstale":"2023-09-13T08:24:46.772142+0000","last_undegraded":"2023-09-13T08:24:46.772142+0000","last_fullsized":"2023-09-13T08:24:46.772142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:07:53.062826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.774683+0000","last_change":"2023-09-13T08:24:42.764523+0000","last_active":"2023-09-13T08:24:46.774683+0000","last_peered":"2023-09-13T08:24:46.774683+0000","last_clean":"2023-09-13T08:24:46.774683+0000","last_became_active":"2023-09-13T08:24:42.764276+0000","last_became_peered":"2023-09-13T08:24:42.764276+0000","last_unstale":"2023-09-13T08:24:46.774683+0000","last_undegraded":"2023-09-13T08:24:46.774683+0000","last_fullsized":"2023-09-13T08:24:46.774683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:23:57.161158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.777757+0000","last_change":"2023-09-13T08:24:42.750926+0000","last_active":"2023-09-13T08:24:46.777757+0000","last_peered":"2023-09-13T08:24:46.777757+0000","last_clean":"2023-09-13T08:24:46.777757+0000","last_became_active":"2023-09-13T08:24:42.750569+0000","last_became_peered":"2023-09-13T08:24:42.750569+0000","last_unstale":"2023-09-13T08:24:46.777757+0000","last_undegraded":"2023-09-13T08:24:46.777757+0000","last_fullsized":"2023-09-13T08:24:46.777757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:31:23.082234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.786084+0000","last_change":"2023-09-13T08:24:42.752653+0000","last_active":"2023-09-13T08:24:46.786084+0000","last_peered":"2023-09-13T08:24:46.786084+0000","last_clean":"2023-09-13T08:24:46.786084+0000","last_became_active":"2023-09-13T08:24:42.752390+0000","last_became_peered":"2023-09-13T08:24:42.752390+0000","last_unstale":"2023-09-13T08:24:46.786084+0000","last_undegraded":"2023-09-13T08:24:46.786084+0000","last_fullsized":"2023-09-13T08:24:46.786084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:31:23.082234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":851968,"data_stored":690730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]}]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":99940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82099999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":860160,"data_stored":690786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]}]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":253952,"data_stored":99780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82999999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":99906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]}]},{"osd":5,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":99870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-13T08:25:06.925 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-13T08:25:07.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.073+0000 7f88b5fa2700 1 Processor -- start 2023-09-13T08:25:07.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.073+0000 7f88b5fa2700 1 -- start start 2023-09-13T08:25:07.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.074+0000 7f88b5fa2700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f88b006d8c0 0x7f88b0070a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:07.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.074+0000 7f88b5fa2700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f88b0070f90 0x7f88b015d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:07.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.074+0000 7f88b5fa2700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88b0071420 con 0x7f88b0159790 2023-09-13T08:25:07.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.074+0000 7f88b5fa2700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88b00ca320 con 0x7f88b006d8c0 2023-09-13T08:25:07.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.074+0000 7f88b5fa2700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88b006dd20 con 0x7f88b0070f90 2023-09-13T08:25:07.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.074+0000 7f88b57a1700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f88b0070f90 0x7f88b015d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:07.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.074+0000 7f88affff700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f88b006d8c0 0x7f88b0070a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:07.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.074+0000 7f88b57a1700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f88b0070f90 0x7f88b015d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.84:53590/0 (socket says 172.21.15.84:53590) 2023-09-13T08:25:07.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.074+0000 7f88affff700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f88b006d8c0 0x7f88b0070a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.84:39496/0 (socket says 172.21.15.84:39496) 2023-09-13T08:25:07.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.074+0000 7f88b57a1700 1 -- 172.21.15.84:0/3317648792 learned_addr learned my addr 172.21.15.84:0/3317648792 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:07.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.075+0000 7f88b57a1700 1 -- 172.21.15.84:0/3317648792 >> v2:172.21.15.161:3300/0 conn(0x7f88b006d8c0 msgr2=0x7f88b0070a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:07.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.075+0000 7f88b57a1700 1 --2- 172.21.15.84:0/3317648792 >> v2:172.21.15.161:3300/0 conn(0x7f88b006d8c0 0x7f88b0070a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:07.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.075+0000 7f88b57a1700 1 -- 172.21.15.84:0/3317648792 >> v1:172.21.15.161:6789/0 conn(0x7f88b0159790 legacy=0x7f88b00c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:07.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.075+0000 7f88b57a1700 1 -- 172.21.15.84:0/3317648792 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88b00cd4f0 con 0x7f88b0070f90 2023-09-13T08:25:07.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.075+0000 7f88affff700 1 --2- 172.21.15.84:0/3317648792 >> v2:172.21.15.161:3300/0 conn(0x7f88b006d8c0 0x7f88b0070a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T08:25:07.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.075+0000 7f88b57a1700 1 --2- 172.21.15.84:0/3317648792 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f88b0070f90 0x7f88b015d7d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f88a8009e50 tx=0x7f88a800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86c3295cd296a003 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:07.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.075+0000 7f88af7fe700 1 -- 172.21.15.84:0/3317648792 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a800e070 con 0x7f88b0070f90 2023-09-13T08:25:07.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.075+0000 7f88af7fe700 1 -- 172.21.15.84:0/3317648792 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88a800b910 con 0x7f88b0070f90 2023-09-13T08:25:07.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.075+0000 7f88af7fe700 1 -- 172.21.15.84:0/3317648792 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a800bcc0 con 0x7f88b0070f90 2023-09-13T08:25:07.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.076+0000 7f88b5fa2700 1 -- 172.21.15.84:0/3317648792 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f88b0070f90 msgr2=0x7f88b015d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:07.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.076+0000 7f88b5fa2700 1 --2- 172.21.15.84:0/3317648792 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f88b0070f90 0x7f88b015d7d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f88a8009e50 tx=0x7f88a800b330 comp rx=0 tx=0).stop 2023-09-13T08:25:07.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.076+0000 7f88b5fa2700 1 -- 172.21.15.84:0/3317648792 shutdown_connections 2023-09-13T08:25:07.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.076+0000 7f88b5fa2700 1 --2- 172.21.15.84:0/3317648792 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f88b0070f90 0x7f88b015d7d0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:07.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.076+0000 7f88b5fa2700 1 --2- 172.21.15.84:0/3317648792 >> v2:172.21.15.161:3300/0 conn(0x7f88b006d8c0 0x7f88b0070a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:07.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.076+0000 7f88b5fa2700 1 -- 172.21.15.84:0/3317648792 >> 172.21.15.84:0/3317648792 conn(0x7f88b00cf580 msgr2=0x7f88b00cf990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:07.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.076+0000 7f88b5fa2700 1 -- 172.21.15.84:0/3317648792 shutdown_connections 2023-09-13T08:25:07.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.076+0000 7f88b5fa2700 1 -- 172.21.15.84:0/3317648792 wait complete. 2023-09-13T08:25:07.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.077+0000 7f88b5fa2700 1 Processor -- start 2023-09-13T08:25:07.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.077+0000 7f88b5fa2700 1 -- start start 2023-09-13T08:25:07.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.078+0000 7f88b5fa2700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88b006d8c0 0x7f88b00c9440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:07.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.078+0000 7f88b5fa2700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f88b0070f90 0x7f88b0152e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:07.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.078+0000 7f88b5fa2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88b0159790 0x7f88b0159db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:07.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.078+0000 7f88b5fa2700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88b00c9980 con 0x7f88b0159790 2023-09-13T08:25:07.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.078+0000 7f88b5fa2700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88b0157140 con 0x7f88b006d8c0 2023-09-13T08:25:07.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.078+0000 7f88b5fa2700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88b0154430 con 0x7f88b0070f90 2023-09-13T08:25:07.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.078+0000 7f88b57a1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88b0159790 0x7f88b0159db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:07.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.078+0000 7f88affff700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f88b0070f90 0x7f88b0152e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:07.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.078+0000 7f88b57a1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88b0159790 0x7f88b0159db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43732/0 (socket says 172.21.15.84:43732) 2023-09-13T08:25:07.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.078+0000 7f88affff700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f88b0070f90 0x7f88b0152e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.84:53594/0 (socket says 172.21.15.84:53594) 2023-09-13T08:25:07.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.078+0000 7f88b57a1700 1 -- 172.21.15.84:0/2453085201 learned_addr learned my addr 172.21.15.84:0/2453085201 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:07.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.078+0000 7f88b4fa0700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88b006d8c0 0x7f88b00c9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:07.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.078+0000 7f88b57a1700 1 -- 172.21.15.84:0/2453085201 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f88b0070f90 msgr2=0x7f88b0152e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:07.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.078+0000 7f88b57a1700 1 --2- 172.21.15.84:0/2453085201 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f88b0070f90 0x7f88b0152e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:07.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.078+0000 7f88b57a1700 1 -- 172.21.15.84:0/2453085201 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88b006d8c0 msgr2=0x7f88b00c9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:07.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.078+0000 7f88b57a1700 1 --2- 172.21.15.84:0/2453085201 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88b006d8c0 0x7f88b00c9440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:07.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.078+0000 7f88b57a1700 1 -- 172.21.15.84:0/2453085201 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f889c0094a0 con 0x7f88b0159790 2023-09-13T08:25:07.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.078+0000 7f88b4fa0700 1 --2- 172.21.15.84:0/2453085201 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88b006d8c0 0x7f88b00c9440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T08:25:07.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.078+0000 7f88b57a1700 1 --2- 172.21.15.84:0/2453085201 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88b0159790 0x7f88b0159db0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f88b006de60 tx=0x7f88a8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:07.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.078+0000 7f88ad7fa700 1 -- 172.21.15.84:0/2453085201 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a8003ea0 con 0x7f88b0159790 2023-09-13T08:25:07.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.079+0000 7f88ad7fa700 1 -- 172.21.15.84:0/2453085201 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88a80048e0 con 0x7f88b0159790 2023-09-13T08:25:07.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.079+0000 7f88b5fa2700 1 -- 172.21.15.84:0/2453085201 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88a8009b30 con 0x7f88b0159790 2023-09-13T08:25:07.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.079+0000 7f88ad7fa700 1 -- 172.21.15.84:0/2453085201 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a801c680 con 0x7f88b0159790 2023-09-13T08:25:07.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.079+0000 7f88b5fa2700 1 -- 172.21.15.84:0/2453085201 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88b01547c0 con 0x7f88b0159790 2023-09-13T08:25:07.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.080+0000 7f88b5fa2700 1 -- 172.21.15.84:0/2453085201 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88b00c6630 con 0x7f88b0159790 2023-09-13T08:25:07.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.080+0000 7f88ad7fa700 1 -- 172.21.15.84:0/2453085201 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f88a801c7e0 con 0x7f88b0159790 2023-09-13T08:25:07.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.080+0000 7f88ad7fa700 1 --2- 172.21.15.84:0/2453085201 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f889406a580 0x7f889406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:07.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.080+0000 7f88ad7fa700 1 -- 172.21.15.84:0/2453085201 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f88a808a5e0 con 0x7f88b0159790 2023-09-13T08:25:07.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.080+0000 7f88b4fa0700 1 --2- 172.21.15.84:0/2453085201 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f889406a580 0x7f889406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:07.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.081+0000 7f88b4fa0700 1 --2- 172.21.15.84:0/2453085201 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f889406a580 0x7f889406ca40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f88a4001d70 tx=0x7f88a400b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:07.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.085+0000 7f88ad7fa700 1 -- 172.21.15.84:0/2453085201 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f88a80557f0 con 0x7f88b0159790 2023-09-13T08:25:07.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.271+0000 7f88b5fa2700 1 -- 172.21.15.84:0/2453085201 --> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f88b00cd7d0 con 0x7f889406a580 2023-09-13T08:25:07.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.281+0000 7f88ad7fa700 1 -- 172.21.15.84:0/2453085201 <== mgr.4104 v2:172.21.15.84:6832/3568908055 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345313 (secure 0 0 0) 0x7f88a4011a50 con 0x7f889406a580 2023-09-13T08:25:07.285 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:25:07.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.284+0000 7f88b5fa2700 1 -- 172.21.15.84:0/2453085201 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f889406a580 msgr2=0x7f889406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:07.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.284+0000 7f88b5fa2700 1 --2- 172.21.15.84:0/2453085201 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f889406a580 0x7f889406ca40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f88a4001d70 tx=0x7f88a400b040 comp rx=0 tx=0).stop 2023-09-13T08:25:07.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.284+0000 7f88b5fa2700 1 -- 172.21.15.84:0/2453085201 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88b0159790 msgr2=0x7f88b0159db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:07.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.284+0000 7f88b5fa2700 1 --2- 172.21.15.84:0/2453085201 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88b0159790 0x7f88b0159db0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f88b006de60 tx=0x7f88a8004ad0 comp rx=0 tx=0).stop 2023-09-13T08:25:07.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.284+0000 7f88b5fa2700 1 -- 172.21.15.84:0/2453085201 shutdown_connections 2023-09-13T08:25:07.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.284+0000 7f88b5fa2700 1 --2- 172.21.15.84:0/2453085201 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88b0159790 0x7f88b0159db0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:07.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.284+0000 7f88b5fa2700 1 --2- 172.21.15.84:0/2453085201 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f889406a580 0x7f889406ca40 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:07.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.284+0000 7f88b5fa2700 1 --2- 172.21.15.84:0/2453085201 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88b006d8c0 0x7f88b00c9440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:07.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.284+0000 7f88b5fa2700 1 --2- 172.21.15.84:0/2453085201 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f88b0070f90 0x7f88b0152e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:07.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.284+0000 7f88b5fa2700 1 -- 172.21.15.84:0/2453085201 >> 172.21.15.84:0/2453085201 conn(0x7f88b00cf580 msgr2=0x7f88b00b0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:07.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.284+0000 7f88b5fa2700 1 -- 172.21.15.84:0/2453085201 shutdown_connections 2023-09-13T08:25:07.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.284+0000 7f88b5fa2700 1 -- 172.21.15.84:0/2453085201 wait complete. 2023-09-13T08:25:07.290 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-09-13T08:25:07.296 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2023-09-13T08:25:06.546377+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219368,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755352,"statfs":{"total":773094113280,"available":772869480448,"internally_reserved":0,"allocated":3284992,"data_stored":1988256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003043"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.774842+0000","last_change":"2023-09-13T08:24:42.765440+0000","last_active":"2023-09-13T08:24:46.774842+0000","last_peered":"2023-09-13T08:24:46.774842+0000","last_clean":"2023-09-13T08:24:46.774842+0000","last_became_active":"2023-09-13T08:24:42.764929+0000","last_became_peered":"2023-09-13T08:24:42.764929+0000","last_unstale":"2023-09-13T08:24:46.774842+0000","last_undegraded":"2023-09-13T08:24:46.774842+0000","last_fullsized":"2023-09-13T08:24:46.774842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:14:26.147276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.778909+0000","last_change":"2023-09-13T08:24:42.755837+0000","last_active":"2023-09-13T08:24:46.778909+0000","last_peered":"2023-09-13T08:24:46.778909+0000","last_clean":"2023-09-13T08:24:46.778909+0000","last_became_active":"2023-09-13T08:24:42.755520+0000","last_became_peered":"2023-09-13T08:24:42.755520+0000","last_unstale":"2023-09-13T08:24:46.778909+0000","last_undegraded":"2023-09-13T08:24:46.778909+0000","last_fullsized":"2023-09-13T08:24:46.778909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:01:14.370463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.778319+0000","last_change":"2023-09-13T08:24:42.751148+0000","last_active":"2023-09-13T08:24:46.778319+0000","last_peered":"2023-09-13T08:24:46.778319+0000","last_clean":"2023-09-13T08:24:46.778319+0000","last_became_active":"2023-09-13T08:24:42.750784+0000","last_became_peered":"2023-09-13T08:24:42.750784+0000","last_unstale":"2023-09-13T08:24:46.778319+0000","last_undegraded":"2023-09-13T08:24:46.778319+0000","last_fullsized":"2023-09-13T08:24:46.778319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:01:15.582567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.775884+0000","last_change":"2023-09-13T08:24:42.766616+0000","last_active":"2023-09-13T08:24:46.775884+0000","last_peered":"2023-09-13T08:24:46.775884+0000","last_clean":"2023-09-13T08:24:46.775884+0000","last_became_active":"2023-09-13T08:24:42.766318+0000","last_became_peered":"2023-09-13T08:24:42.766318+0000","last_unstale":"2023-09-13T08:24:46.775884+0000","last_undegraded":"2023-09-13T08:24:46.775884+0000","last_fullsized":"2023-09-13T08:24:46.775884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:29:11.602118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.773834+0000","last_change":"2023-09-13T08:24:42.760772+0000","last_active":"2023-09-13T08:24:46.773834+0000","last_peered":"2023-09-13T08:24:46.773834+0000","last_clean":"2023-09-13T08:24:46.773834+0000","last_became_active":"2023-09-13T08:24:42.760319+0000","last_became_peered":"2023-09-13T08:24:42.760319+0000","last_unstale":"2023-09-13T08:24:46.773834+0000","last_undegraded":"2023-09-13T08:24:46.773834+0000","last_fullsized":"2023-09-13T08:24:46.773834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:17:32.912375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.774449+0000","last_change":"2023-09-13T08:24:42.765841+0000","last_active":"2023-09-13T08:24:46.774449+0000","last_peered":"2023-09-13T08:24:46.774449+0000","last_clean":"2023-09-13T08:24:46.774449+0000","last_became_active":"2023-09-13T08:24:42.764312+0000","last_became_peered":"2023-09-13T08:24:42.764312+0000","last_unstale":"2023-09-13T08:24:46.774449+0000","last_undegraded":"2023-09-13T08:24:46.774449+0000","last_fullsized":"2023-09-13T08:24:46.774449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:31:23.082234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.773749+0000","last_change":"2023-09-13T08:24:42.753624+0000","last_active":"2023-09-13T08:24:46.773749+0000","last_peered":"2023-09-13T08:24:46.773749+0000","last_clean":"2023-09-13T08:24:46.773749+0000","last_became_active":"2023-09-13T08:24:42.753354+0000","last_became_peered":"2023-09-13T08:24:42.753354+0000","last_unstale":"2023-09-13T08:24:46.773749+0000","last_undegraded":"2023-09-13T08:24:46.773749+0000","last_fullsized":"2023-09-13T08:24:46.773749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:31:23.082234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.772638+0000","last_change":"2023-09-13T08:24:42.770839+0000","last_active":"2023-09-13T08:24:46.772638+0000","last_peered":"2023-09-13T08:24:46.772638+0000","last_clean":"2023-09-13T08:24:46.772638+0000","last_became_active":"2023-09-13T08:24:42.770596+0000","last_became_peered":"2023-09-13T08:24:42.770596+0000","last_unstale":"2023-09-13T08:24:46.772638+0000","last_undegraded":"2023-09-13T08:24:46.772638+0000","last_fullsized":"2023-09-13T08:24:46.772638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:38:04.836936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.774754+0000","last_change":"2023-09-13T08:24:42.768552+0000","last_active":"2023-09-13T08:24:46.774754+0000","last_peered":"2023-09-13T08:24:46.774754+0000","last_clean":"2023-09-13T08:24:46.774754+0000","last_became_active":"2023-09-13T08:24:42.768084+0000","last_became_peered":"2023-09-13T08:24:42.768084+0000","last_unstale":"2023-09-13T08:24:46.774754+0000","last_undegraded":"2023-09-13T08:24:46.774754+0000","last_fullsized":"2023-09-13T08:24:46.774754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T19:01:29.959464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.786411+0000","last_change":"2023-09-13T08:24:42.765506+0000","last_active":"2023-09-13T08:24:46.786411+0000","last_peered":"2023-09-13T08:24:46.786411+0000","last_clean":"2023-09-13T08:24:46.786411+0000","last_became_active":"2023-09-13T08:24:42.765119+0000","last_became_peered":"2023-09-13T08:24:42.765119+0000","last_unstale":"2023-09-13T08:24:46.786411+0000","last_undegraded":"2023-09-13T08:24:46.786411+0000","last_fullsized":"2023-09-13T08:24:46.786411+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:17:32.912375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.786113+0000","last_change":"2023-09-13T08:24:42.768066+0000","last_active":"2023-09-13T08:24:46.786113+0000","last_peered":"2023-09-13T08:24:46.786113+0000","last_clean":"2023-09-13T08:24:46.786113+0000","last_became_active":"2023-09-13T08:24:42.767857+0000","last_became_peered":"2023-09-13T08:24:42.767857+0000","last_unstale":"2023-09-13T08:24:46.786113+0000","last_undegraded":"2023-09-13T08:24:46.786113+0000","last_fullsized":"2023-09-13T08:24:46.786113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:01:14.370463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.781776+0000","last_change":"2023-09-13T08:24:42.750028+0000","last_active":"2023-09-13T08:24:46.781776+0000","last_peered":"2023-09-13T08:24:46.781776+0000","last_clean":"2023-09-13T08:24:46.781776+0000","last_became_active":"2023-09-13T08:24:42.749472+0000","last_became_peered":"2023-09-13T08:24:42.749472+0000","last_unstale":"2023-09-13T08:24:46.781776+0000","last_undegraded":"2023-09-13T08:24:46.781776+0000","last_fullsized":"2023-09-13T08:24:46.781776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:16:34.157802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.772598+0000","last_change":"2023-09-13T08:24:42.756966+0000","last_active":"2023-09-13T08:24:46.772598+0000","last_peered":"2023-09-13T08:24:46.772598+0000","last_clean":"2023-09-13T08:24:46.772598+0000","last_became_active":"2023-09-13T08:24:42.756694+0000","last_became_peered":"2023-09-13T08:24:42.756694+0000","last_unstale":"2023-09-13T08:24:46.772598+0000","last_undegraded":"2023-09-13T08:24:46.772598+0000","last_fullsized":"2023-09-13T08:24:46.772598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:22:05.554377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.779252+0000","last_change":"2023-09-13T08:24:42.761359+0000","last_active":"2023-09-13T08:24:46.779252+0000","last_peered":"2023-09-13T08:24:46.779252+0000","last_clean":"2023-09-13T08:24:46.779252+0000","last_became_active":"2023-09-13T08:24:42.761113+0000","last_became_peered":"2023-09-13T08:24:42.761113+0000","last_unstale":"2023-09-13T08:24:46.779252+0000","last_undegraded":"2023-09-13T08:24:46.779252+0000","last_fullsized":"2023-09-13T08:24:46.779252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:38:04.836936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.778710+0000","last_change":"2023-09-13T08:24:42.756240+0000","last_active":"2023-09-13T08:24:46.778710+0000","last_peered":"2023-09-13T08:24:46.778710+0000","last_clean":"2023-09-13T08:24:46.778710+0000","last_became_active":"2023-09-13T08:24:42.755563+0000","last_became_peered":"2023-09-13T08:24:42.755563+0000","last_unstale":"2023-09-13T08:24:46.778710+0000","last_undegraded":"2023-09-13T08:24:46.778710+0000","last_fullsized":"2023-09-13T08:24:46.778710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:07:53.062826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.774724+0000","last_change":"2023-09-13T08:24:42.762083+0000","last_active":"2023-09-13T08:24:46.774724+0000","last_peered":"2023-09-13T08:24:46.774724+0000","last_clean":"2023-09-13T08:24:46.774724+0000","last_became_active":"2023-09-13T08:24:42.761624+0000","last_became_peered":"2023-09-13T08:24:42.761624+0000","last_unstale":"2023-09-13T08:24:46.774724+0000","last_undegraded":"2023-09-13T08:24:46.774724+0000","last_fullsized":"2023-09-13T08:24:46.774724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:01:14.370463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.774482+0000","last_change":"2023-09-13T08:24:42.771083+0000","last_active":"2023-09-13T08:24:46.774482+0000","last_peered":"2023-09-13T08:24:46.774482+0000","last_clean":"2023-09-13T08:24:46.774482+0000","last_became_active":"2023-09-13T08:24:42.770750+0000","last_became_peered":"2023-09-13T08:24:42.770750+0000","last_unstale":"2023-09-13T08:24:46.774482+0000","last_undegraded":"2023-09-13T08:24:46.774482+0000","last_fullsized":"2023-09-13T08:24:46.774482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:41:08.160337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.784024+0000","last_change":"2023-09-13T08:24:42.756007+0000","last_active":"2023-09-13T08:24:46.784024+0000","last_peered":"2023-09-13T08:24:46.784024+0000","last_clean":"2023-09-13T08:24:46.784024+0000","last_became_active":"2023-09-13T08:24:42.755730+0000","last_became_peered":"2023-09-13T08:24:42.755730+0000","last_unstale":"2023-09-13T08:24:46.784024+0000","last_undegraded":"2023-09-13T08:24:46.784024+0000","last_fullsized":"2023-09-13T08:24:46.784024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:16:34.157802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.774987+0000","last_change":"2023-09-13T08:24:42.758637+0000","last_active":"2023-09-13T08:24:46.774987+0000","last_peered":"2023-09-13T08:24:46.774987+0000","last_clean":"2023-09-13T08:24:46.774987+0000","last_became_active":"2023-09-13T08:24:42.758355+0000","last_became_peered":"2023-09-13T08:24:42.758355+0000","last_unstale":"2023-09-13T08:24:46.774987+0000","last_undegraded":"2023-09-13T08:24:46.774987+0000","last_fullsized":"2023-09-13T08:24:46.774987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:30:17.103018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.535787+0000","last_change":"2023-09-13T08:24:46.786296+0000","last_active":"2023-09-13T08:24:48.535787+0000","last_peered":"2023-09-13T08:24:48.535787+0000","last_clean":"2023-09-13T08:24:48.535787+0000","last_became_active":"2023-09-13T08:24:46.785911+0000","last_became_peered":"2023-09-13T08:24:46.785911+0000","last_unstale":"2023-09-13T08:24:48.535787+0000","last_undegraded":"2023-09-13T08:24:48.535787+0000","last_fullsized":"2023-09-13T08:24:48.535787+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:28:08.064402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.779981+0000","last_change":"2023-09-13T08:24:41.751910+0000","last_active":"2023-09-13T08:24:46.779981+0000","last_peered":"2023-09-13T08:24:46.779981+0000","last_clean":"2023-09-13T08:24:46.779981+0000","last_became_active":"2023-09-13T08:24:41.751643+0000","last_became_peered":"2023-09-13T08:24:41.751643+0000","last_unstale":"2023-09-13T08:24:46.779981+0000","last_undegraded":"2023-09-13T08:24:46.779981+0000","last_fullsized":"2023-09-13T08:24:46.779981+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:10:08.445556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.772648+0000","last_change":"2023-09-13T08:24:42.756649+0000","last_active":"2023-09-13T08:24:46.772648+0000","last_peered":"2023-09-13T08:24:46.772648+0000","last_clean":"2023-09-13T08:24:46.772648+0000","last_became_active":"2023-09-13T08:24:42.756308+0000","last_became_peered":"2023-09-13T08:24:42.756308+0000","last_unstale":"2023-09-13T08:24:46.772648+0000","last_undegraded":"2023-09-13T08:24:46.772648+0000","last_fullsized":"2023-09-13T08:24:46.772648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:17:32.912375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.535050+0000","last_change":"2023-09-13T08:24:46.798301+0000","last_active":"2023-09-13T08:24:48.535050+0000","last_peered":"2023-09-13T08:24:48.535050+0000","last_clean":"2023-09-13T08:24:48.535050+0000","last_became_active":"2023-09-13T08:24:46.797920+0000","last_became_peered":"2023-09-13T08:24:46.797920+0000","last_unstale":"2023-09-13T08:24:48.535050+0000","last_undegraded":"2023-09-13T08:24:48.535050+0000","last_fullsized":"2023-09-13T08:24:48.535050+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:41:12.187804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.772744+0000","last_change":"2023-09-13T08:24:41.762678+0000","last_active":"2023-09-13T08:24:46.772744+0000","last_peered":"2023-09-13T08:24:46.772744+0000","last_clean":"2023-09-13T08:24:46.772744+0000","last_became_active":"2023-09-13T08:24:41.762309+0000","last_became_peered":"2023-09-13T08:24:41.762309+0000","last_unstale":"2023-09-13T08:24:46.772744+0000","last_undegraded":"2023-09-13T08:24:46.772744+0000","last_fullsized":"2023-09-13T08:24:46.772744+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:40:49.395433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.779483+0000","last_change":"2023-09-13T08:24:42.764572+0000","last_active":"2023-09-13T08:24:46.779483+0000","last_peered":"2023-09-13T08:24:46.779483+0000","last_clean":"2023-09-13T08:24:46.779483+0000","last_became_active":"2023-09-13T08:24:42.764305+0000","last_became_peered":"2023-09-13T08:24:42.764305+0000","last_unstale":"2023-09-13T08:24:46.779483+0000","last_undegraded":"2023-09-13T08:24:46.779483+0000","last_fullsized":"2023-09-13T08:24:46.779483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:47:39.312215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.535234+0000","last_change":"2023-09-13T08:24:46.799685+0000","last_active":"2023-09-13T08:24:48.535234+0000","last_peered":"2023-09-13T08:24:48.535234+0000","last_clean":"2023-09-13T08:24:48.535234+0000","last_became_active":"2023-09-13T08:24:46.798723+0000","last_became_peered":"2023-09-13T08:24:46.798723+0000","last_unstale":"2023-09-13T08:24:48.535234+0000","last_undegraded":"2023-09-13T08:24:48.535234+0000","last_fullsized":"2023-09-13T08:24:48.535234+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:19:00.119006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.774765+0000","last_change":"2023-09-13T08:24:41.755988+0000","last_active":"2023-09-13T08:24:46.774765+0000","last_peered":"2023-09-13T08:24:46.774765+0000","last_clean":"2023-09-13T08:24:46.774765+0000","last_became_active":"2023-09-13T08:24:41.755711+0000","last_became_peered":"2023-09-13T08:24:41.755711+0000","last_unstale":"2023-09-13T08:24:46.774765+0000","last_undegraded":"2023-09-13T08:24:46.774765+0000","last_fullsized":"2023-09-13T08:24:46.774765+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:01:14.575510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.775792+0000","last_change":"2023-09-13T08:24:42.771141+0000","last_active":"2023-09-13T08:24:46.775792+0000","last_peered":"2023-09-13T08:24:46.775792+0000","last_clean":"2023-09-13T08:24:46.775792+0000","last_became_active":"2023-09-13T08:24:42.770716+0000","last_became_peered":"2023-09-13T08:24:42.770716+0000","last_unstale":"2023-09-13T08:24:46.775792+0000","last_undegraded":"2023-09-13T08:24:46.775792+0000","last_fullsized":"2023-09-13T08:24:46.775792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:17:32.912375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.535125+0000","last_change":"2023-09-13T08:24:46.797683+0000","last_active":"2023-09-13T08:24:48.535125+0000","last_peered":"2023-09-13T08:24:48.535125+0000","last_clean":"2023-09-13T08:24:48.535125+0000","last_became_active":"2023-09-13T08:24:46.797283+0000","last_became_peered":"2023-09-13T08:24:46.797283+0000","last_unstale":"2023-09-13T08:24:48.535125+0000","last_undegraded":"2023-09-13T08:24:48.535125+0000","last_fullsized":"2023-09-13T08:24:48.535125+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T19:57:23.132436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.773940+0000","last_change":"2023-09-13T08:24:41.757989+0000","last_active":"2023-09-13T08:24:46.773940+0000","last_peered":"2023-09-13T08:24:46.773940+0000","last_clean":"2023-09-13T08:24:46.773940+0000","last_became_active":"2023-09-13T08:24:41.757638+0000","last_became_peered":"2023-09-13T08:24:41.757638+0000","last_unstale":"2023-09-13T08:24:46.773940+0000","last_undegraded":"2023-09-13T08:24:46.773940+0000","last_fullsized":"2023-09-13T08:24:46.773940+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:28:07.813946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.776641+0000","last_change":"2023-09-13T08:24:42.771168+0000","last_active":"2023-09-13T08:24:46.776641+0000","last_peered":"2023-09-13T08:24:46.776641+0000","last_clean":"2023-09-13T08:24:46.776641+0000","last_became_active":"2023-09-13T08:24:42.770666+0000","last_became_peered":"2023-09-13T08:24:42.770666+0000","last_unstale":"2023-09-13T08:24:46.776641+0000","last_undegraded":"2023-09-13T08:24:46.776641+0000","last_fullsized":"2023-09-13T08:24:46.776641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:14:26.147276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.537048+0000","last_change":"2023-09-13T08:24:46.796942+0000","last_active":"2023-09-13T08:24:48.537048+0000","last_peered":"2023-09-13T08:24:48.537048+0000","last_clean":"2023-09-13T08:24:48.537048+0000","last_became_active":"2023-09-13T08:24:46.796351+0000","last_became_peered":"2023-09-13T08:24:46.796351+0000","last_unstale":"2023-09-13T08:24:48.537048+0000","last_undegraded":"2023-09-13T08:24:48.537048+0000","last_fullsized":"2023-09-13T08:24:48.537048+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:56:23.838830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.772437+0000","last_change":"2023-09-13T08:24:41.751550+0000","last_active":"2023-09-13T08:24:46.772437+0000","last_peered":"2023-09-13T08:24:46.772437+0000","last_clean":"2023-09-13T08:24:46.772437+0000","last_became_active":"2023-09-13T08:24:41.751239+0000","last_became_peered":"2023-09-13T08:24:41.751239+0000","last_unstale":"2023-09-13T08:24:46.772437+0000","last_undegraded":"2023-09-13T08:24:46.772437+0000","last_fullsized":"2023-09-13T08:24:46.772437+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:14:24.302634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.780775+0000","last_change":"2023-09-13T08:24:42.761870+0000","last_active":"2023-09-13T08:24:46.780775+0000","last_peered":"2023-09-13T08:24:46.780775+0000","last_clean":"2023-09-13T08:24:46.780775+0000","last_became_active":"2023-09-13T08:24:42.761353+0000","last_became_peered":"2023-09-13T08:24:42.761353+0000","last_unstale":"2023-09-13T08:24:46.780775+0000","last_undegraded":"2023-09-13T08:24:46.780775+0000","last_fullsized":"2023-09-13T08:24:46.780775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:04:13.077626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:47.773917+0000","last_change":"2023-09-13T08:24:46.790855+0000","last_active":"2023-09-13T08:24:47.773917+0000","last_peered":"2023-09-13T08:24:47.773917+0000","last_clean":"2023-09-13T08:24:47.773917+0000","last_became_active":"2023-09-13T08:24:46.790308+0000","last_became_peered":"2023-09-13T08:24:46.790308+0000","last_unstale":"2023-09-13T08:24:47.773917+0000","last_undegraded":"2023-09-13T08:24:47.773917+0000","last_fullsized":"2023-09-13T08:24:47.773917+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:39:01.027758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.785858+0000","last_change":"2023-09-13T08:24:41.750115+0000","last_active":"2023-09-13T08:24:46.785858+0000","last_peered":"2023-09-13T08:24:46.785858+0000","last_clean":"2023-09-13T08:24:46.785858+0000","last_became_active":"2023-09-13T08:24:41.749327+0000","last_became_peered":"2023-09-13T08:24:41.749327+0000","last_unstale":"2023-09-13T08:24:46.785858+0000","last_undegraded":"2023-09-13T08:24:46.785858+0000","last_fullsized":"2023-09-13T08:24:46.785858+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:51:59.235749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.777583+0000","last_change":"2023-09-13T08:24:42.746631+0000","last_active":"2023-09-13T08:24:46.777583+0000","last_peered":"2023-09-13T08:24:46.777583+0000","last_clean":"2023-09-13T08:24:46.777583+0000","last_became_active":"2023-09-13T08:24:42.745778+0000","last_became_peered":"2023-09-13T08:24:42.745778+0000","last_unstale":"2023-09-13T08:24:46.777583+0000","last_undegraded":"2023-09-13T08:24:46.777583+0000","last_fullsized":"2023-09-13T08:24:46.777583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:22:05.554377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:47.775957+0000","last_change":"2023-09-13T08:24:46.801666+0000","last_active":"2023-09-13T08:24:47.775957+0000","last_peered":"2023-09-13T08:24:47.775957+0000","last_clean":"2023-09-13T08:24:47.775957+0000","last_became_active":"2023-09-13T08:24:46.801323+0000","last_became_peered":"2023-09-13T08:24:46.801323+0000","last_unstale":"2023-09-13T08:24:47.775957+0000","last_undegraded":"2023-09-13T08:24:47.775957+0000","last_fullsized":"2023-09-13T08:24:47.775957+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:19:00.119006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.772047+0000","last_change":"2023-09-13T08:24:41.755264+0000","last_active":"2023-09-13T08:24:46.772047+0000","last_peered":"2023-09-13T08:24:46.772047+0000","last_clean":"2023-09-13T08:24:46.772047+0000","last_became_active":"2023-09-13T08:24:41.754961+0000","last_became_peered":"2023-09-13T08:24:41.754961+0000","last_unstale":"2023-09-13T08:24:46.772047+0000","last_undegraded":"2023-09-13T08:24:46.772047+0000","last_fullsized":"2023-09-13T08:24:46.772047+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:28:07.813946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.771919+0000","last_change":"2023-09-13T08:24:42.752899+0000","last_active":"2023-09-13T08:24:46.771919+0000","last_peered":"2023-09-13T08:24:46.771919+0000","last_clean":"2023-09-13T08:24:46.771919+0000","last_became_active":"2023-09-13T08:24:42.752583+0000","last_became_peered":"2023-09-13T08:24:42.752583+0000","last_unstale":"2023-09-13T08:24:46.771919+0000","last_undegraded":"2023-09-13T08:24:46.771919+0000","last_fullsized":"2023-09-13T08:24:46.771919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:01:15.582567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.534731+0000","last_change":"2023-09-13T08:24:46.795800+0000","last_active":"2023-09-13T08:24:48.534731+0000","last_peered":"2023-09-13T08:24:48.534731+0000","last_clean":"2023-09-13T08:24:48.534731+0000","last_became_active":"2023-09-13T08:24:46.794871+0000","last_became_peered":"2023-09-13T08:24:46.794871+0000","last_unstale":"2023-09-13T08:24:48.534731+0000","last_undegraded":"2023-09-13T08:24:48.534731+0000","last_fullsized":"2023-09-13T08:24:48.534731+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:35:08.086286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.774790+0000","last_change":"2023-09-13T08:24:41.749261+0000","last_active":"2023-09-13T08:24:46.774790+0000","last_peered":"2023-09-13T08:24:46.774790+0000","last_clean":"2023-09-13T08:24:46.774790+0000","last_became_active":"2023-09-13T08:24:41.748976+0000","last_became_peered":"2023-09-13T08:24:41.748976+0000","last_unstale":"2023-09-13T08:24:46.774790+0000","last_undegraded":"2023-09-13T08:24:46.774790+0000","last_fullsized":"2023-09-13T08:24:46.774790+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:04:12.070569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.778887+0000","last_change":"2023-09-13T08:24:42.756665+0000","last_active":"2023-09-13T08:24:46.778887+0000","last_peered":"2023-09-13T08:24:46.778887+0000","last_clean":"2023-09-13T08:24:46.778887+0000","last_became_active":"2023-09-13T08:24:42.756225+0000","last_became_peered":"2023-09-13T08:24:42.756225+0000","last_unstale":"2023-09-13T08:24:46.778887+0000","last_undegraded":"2023-09-13T08:24:46.778887+0000","last_fullsized":"2023-09-13T08:24:46.778887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:22:05.554377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.535610+0000","last_change":"2023-09-13T08:24:46.794973+0000","last_active":"2023-09-13T08:24:48.535610+0000","last_peered":"2023-09-13T08:24:48.535610+0000","last_clean":"2023-09-13T08:24:48.535610+0000","last_became_active":"2023-09-13T08:24:46.794625+0000","last_became_peered":"2023-09-13T08:24:46.794625+0000","last_unstale":"2023-09-13T08:24:48.535610+0000","last_undegraded":"2023-09-13T08:24:48.535610+0000","last_fullsized":"2023-09-13T08:24:48.535610+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:24:40.971505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.786879+0000","last_change":"2023-09-13T08:24:41.752295+0000","last_active":"2023-09-13T08:24:46.786879+0000","last_peered":"2023-09-13T08:24:46.786879+0000","last_clean":"2023-09-13T08:24:46.786879+0000","last_became_active":"2023-09-13T08:24:41.751730+0000","last_became_peered":"2023-09-13T08:24:41.751730+0000","last_unstale":"2023-09-13T08:24:46.786879+0000","last_undegraded":"2023-09-13T08:24:46.786879+0000","last_fullsized":"2023-09-13T08:24:46.786879+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:14:24.302634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.775290+0000","last_change":"2023-09-13T08:24:42.761292+0000","last_active":"2023-09-13T08:24:46.775290+0000","last_peered":"2023-09-13T08:24:46.775290+0000","last_clean":"2023-09-13T08:24:46.775290+0000","last_became_active":"2023-09-13T08:24:42.761004+0000","last_became_peered":"2023-09-13T08:24:42.761004+0000","last_unstale":"2023-09-13T08:24:46.775290+0000","last_undegraded":"2023-09-13T08:24:46.775290+0000","last_fullsized":"2023-09-13T08:24:46.775290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:32:01.643446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.535622+0000","last_change":"2023-09-13T08:24:46.799231+0000","last_active":"2023-09-13T08:24:48.535622+0000","last_peered":"2023-09-13T08:24:48.535622+0000","last_clean":"2023-09-13T08:24:48.535622+0000","last_became_active":"2023-09-13T08:24:46.798813+0000","last_became_peered":"2023-09-13T08:24:46.798813+0000","last_unstale":"2023-09-13T08:24:48.535622+0000","last_undegraded":"2023-09-13T08:24:48.535622+0000","last_fullsized":"2023-09-13T08:24:48.535622+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:14:40.142972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.775333+0000","last_change":"2023-09-13T08:24:41.757732+0000","last_active":"2023-09-13T08:24:46.775333+0000","last_peered":"2023-09-13T08:24:46.775333+0000","last_clean":"2023-09-13T08:24:46.775333+0000","last_became_active":"2023-09-13T08:24:41.757452+0000","last_became_peered":"2023-09-13T08:24:41.757452+0000","last_unstale":"2023-09-13T08:24:46.775333+0000","last_undegraded":"2023-09-13T08:24:46.775333+0000","last_fullsized":"2023-09-13T08:24:46.775333+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:12:03.105088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.779874+0000","last_change":"2023-09-13T08:24:42.764641+0000","last_active":"2023-09-13T08:24:46.779874+0000","last_peered":"2023-09-13T08:24:46.779874+0000","last_clean":"2023-09-13T08:24:46.779874+0000","last_became_active":"2023-09-13T08:24:42.764368+0000","last_became_peered":"2023-09-13T08:24:42.764368+0000","last_unstale":"2023-09-13T08:24:46.779874+0000","last_undegraded":"2023-09-13T08:24:46.779874+0000","last_fullsized":"2023-09-13T08:24:46.779874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:01:14.370463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.535743+0000","last_change":"2023-09-13T08:24:46.794114+0000","last_active":"2023-09-13T08:24:48.535743+0000","last_peered":"2023-09-13T08:24:48.535743+0000","last_clean":"2023-09-13T08:24:48.535743+0000","last_became_active":"2023-09-13T08:24:46.793129+0000","last_became_peered":"2023-09-13T08:24:46.793129+0000","last_unstale":"2023-09-13T08:24:48.535743+0000","last_undegraded":"2023-09-13T08:24:48.535743+0000","last_fullsized":"2023-09-13T08:24:48.535743+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:35:08.086286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.779227+0000","last_change":"2023-09-13T08:24:41.755450+0000","last_active":"2023-09-13T08:24:46.779227+0000","last_peered":"2023-09-13T08:24:46.779227+0000","last_clean":"2023-09-13T08:24:46.779227+0000","last_became_active":"2023-09-13T08:24:41.755168+0000","last_became_peered":"2023-09-13T08:24:41.755168+0000","last_unstale":"2023-09-13T08:24:46.779227+0000","last_undegraded":"2023-09-13T08:24:46.779227+0000","last_fullsized":"2023-09-13T08:24:46.779227+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:28:07.813946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.781645+0000","last_change":"2023-09-13T08:24:42.756700+0000","last_active":"2023-09-13T08:24:46.781645+0000","last_peered":"2023-09-13T08:24:46.781645+0000","last_clean":"2023-09-13T08:24:46.781645+0000","last_became_active":"2023-09-13T08:24:42.756408+0000","last_became_peered":"2023-09-13T08:24:42.756408+0000","last_unstale":"2023-09-13T08:24:46.781645+0000","last_undegraded":"2023-09-13T08:24:46.781645+0000","last_fullsized":"2023-09-13T08:24:46.781645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:28:08.821003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.535262+0000","last_change":"2023-09-13T08:24:46.793849+0000","last_active":"2023-09-13T08:24:48.535262+0000","last_peered":"2023-09-13T08:24:48.535262+0000","last_clean":"2023-09-13T08:24:48.535262+0000","last_became_active":"2023-09-13T08:24:46.793486+0000","last_became_peered":"2023-09-13T08:24:46.793486+0000","last_unstale":"2023-09-13T08:24:48.535262+0000","last_undegraded":"2023-09-13T08:24:48.535262+0000","last_fullsized":"2023-09-13T08:24:48.535262+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:49:40.361758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:52.674989+0000","last_change":"2023-09-13T08:24:41.755123+0000","last_active":"2023-09-13T08:24:52.674989+0000","last_peered":"2023-09-13T08:24:52.674989+0000","last_clean":"2023-09-13T08:24:52.674989+0000","last_became_active":"2023-09-13T08:24:41.754872+0000","last_became_peered":"2023-09-13T08:24:41.754872+0000","last_unstale":"2023-09-13T08:24:52.674989+0000","last_undegraded":"2023-09-13T08:24:52.674989+0000","last_fullsized":"2023-09-13T08:24:52.674989+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:28:07.813946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.774928+0000","last_change":"2023-09-13T08:24:42.756478+0000","last_active":"2023-09-13T08:24:46.774928+0000","last_peered":"2023-09-13T08:24:46.774928+0000","last_clean":"2023-09-13T08:24:46.774928+0000","last_became_active":"2023-09-13T08:24:42.755725+0000","last_became_peered":"2023-09-13T08:24:42.755725+0000","last_unstale":"2023-09-13T08:24:46.774928+0000","last_undegraded":"2023-09-13T08:24:46.774928+0000","last_fullsized":"2023-09-13T08:24:46.774928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:29:11.602118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:47.810994+0000","last_change":"2023-09-13T08:24:46.791174+0000","last_active":"2023-09-13T08:24:47.810994+0000","last_peered":"2023-09-13T08:24:47.810994+0000","last_clean":"2023-09-13T08:24:47.810994+0000","last_became_active":"2023-09-13T08:24:46.790577+0000","last_became_peered":"2023-09-13T08:24:46.790577+0000","last_unstale":"2023-09-13T08:24:47.810994+0000","last_undegraded":"2023-09-13T08:24:47.810994+0000","last_fullsized":"2023-09-13T08:24:47.810994+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:06:40.257204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.777835+0000","last_change":"2023-09-13T08:24:41.748341+0000","last_active":"2023-09-13T08:24:46.777835+0000","last_peered":"2023-09-13T08:24:46.777835+0000","last_clean":"2023-09-13T08:24:46.777835+0000","last_became_active":"2023-09-13T08:24:41.748090+0000","last_became_peered":"2023-09-13T08:24:41.748090+0000","last_unstale":"2023-09-13T08:24:46.777835+0000","last_undegraded":"2023-09-13T08:24:46.777835+0000","last_fullsized":"2023-09-13T08:24:46.777835+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:04:12.070569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.779335+0000","last_change":"2023-09-13T08:24:42.748471+0000","last_active":"2023-09-13T08:24:46.779335+0000","last_peered":"2023-09-13T08:24:46.779335+0000","last_clean":"2023-09-13T08:24:46.779335+0000","last_became_active":"2023-09-13T08:24:42.748243+0000","last_became_peered":"2023-09-13T08:24:42.748243+0000","last_unstale":"2023-09-13T08:24:46.779335+0000","last_undegraded":"2023-09-13T08:24:46.779335+0000","last_fullsized":"2023-09-13T08:24:46.779335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:14:25.309691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.537111+0000","last_change":"2023-09-13T08:24:46.795104+0000","last_active":"2023-09-13T08:24:48.537111+0000","last_peered":"2023-09-13T08:24:48.537111+0000","last_clean":"2023-09-13T08:24:48.537111+0000","last_became_active":"2023-09-13T08:24:46.794725+0000","last_became_peered":"2023-09-13T08:24:46.794725+0000","last_unstale":"2023-09-13T08:24:48.537111+0000","last_undegraded":"2023-09-13T08:24:48.537111+0000","last_fullsized":"2023-09-13T08:24:48.537111+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:55:26.579142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.774235+0000","last_change":"2023-09-13T08:24:41.756881+0000","last_active":"2023-09-13T08:24:46.774235+0000","last_peered":"2023-09-13T08:24:46.774235+0000","last_clean":"2023-09-13T08:24:46.774235+0000","last_became_active":"2023-09-13T08:24:41.756567+0000","last_became_peered":"2023-09-13T08:24:41.756567+0000","last_unstale":"2023-09-13T08:24:46.774235+0000","last_undegraded":"2023-09-13T08:24:46.774235+0000","last_fullsized":"2023-09-13T08:24:46.774235+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:14:24.302634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.774321+0000","last_change":"2023-09-13T08:24:42.764196+0000","last_active":"2023-09-13T08:24:46.774321+0000","last_peered":"2023-09-13T08:24:46.774321+0000","last_clean":"2023-09-13T08:24:46.774321+0000","last_became_active":"2023-09-13T08:24:42.760048+0000","last_became_peered":"2023-09-13T08:24:42.760048+0000","last_unstale":"2023-09-13T08:24:46.774321+0000","last_undegraded":"2023-09-13T08:24:46.774321+0000","last_fullsized":"2023-09-13T08:24:46.774321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:20:47.395388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.537009+0000","last_change":"2023-09-13T08:24:46.795864+0000","last_active":"2023-09-13T08:24:48.537009+0000","last_peered":"2023-09-13T08:24:48.537009+0000","last_clean":"2023-09-13T08:24:48.537009+0000","last_became_active":"2023-09-13T08:24:46.795486+0000","last_became_peered":"2023-09-13T08:24:46.795486+0000","last_unstale":"2023-09-13T08:24:48.537009+0000","last_undegraded":"2023-09-13T08:24:48.537009+0000","last_fullsized":"2023-09-13T08:24:48.537009+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:06:32.572669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.785872+0000","last_change":"2023-09-13T08:24:41.749723+0000","last_active":"2023-09-13T08:24:46.785872+0000","last_peered":"2023-09-13T08:24:46.785872+0000","last_clean":"2023-09-13T08:24:46.785872+0000","last_became_active":"2023-09-13T08:24:41.749372+0000","last_became_peered":"2023-09-13T08:24:41.749372+0000","last_unstale":"2023-09-13T08:24:46.785872+0000","last_undegraded":"2023-09-13T08:24:46.785872+0000","last_fullsized":"2023-09-13T08:24:46.785872+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:56:12.891967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.785750+0000","last_change":"2023-09-13T08:24:42.752492+0000","last_active":"2023-09-13T08:24:46.785750+0000","last_peered":"2023-09-13T08:24:46.785750+0000","last_clean":"2023-09-13T08:24:46.785750+0000","last_became_active":"2023-09-13T08:24:42.752171+0000","last_became_peered":"2023-09-13T08:24:42.752171+0000","last_unstale":"2023-09-13T08:24:46.785750+0000","last_undegraded":"2023-09-13T08:24:46.785750+0000","last_fullsized":"2023-09-13T08:24:46.785750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:38:57.000291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.534401+0000","last_change":"2023-09-13T08:24:46.796118+0000","last_active":"2023-09-13T08:24:48.534401+0000","last_peered":"2023-09-13T08:24:48.534401+0000","last_clean":"2023-09-13T08:24:48.534401+0000","last_became_active":"2023-09-13T08:24:46.795725+0000","last_became_peered":"2023-09-13T08:24:46.795725+0000","last_unstale":"2023-09-13T08:24:48.534401+0000","last_undegraded":"2023-09-13T08:24:48.534401+0000","last_fullsized":"2023-09-13T08:24:48.534401+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:19:00.119006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.778226+0000","last_change":"2023-09-13T08:24:41.749035+0000","last_active":"2023-09-13T08:24:46.778226+0000","last_peered":"2023-09-13T08:24:46.778226+0000","last_clean":"2023-09-13T08:24:46.778226+0000","last_became_active":"2023-09-13T08:24:41.748750+0000","last_became_peered":"2023-09-13T08:24:41.748750+0000","last_unstale":"2023-09-13T08:24:46.778226+0000","last_undegraded":"2023-09-13T08:24:46.778226+0000","last_fullsized":"2023-09-13T08:24:46.778226+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:10:08.445556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.775239+0000","last_change":"2023-09-13T08:24:42.756878+0000","last_active":"2023-09-13T08:24:46.775239+0000","last_peered":"2023-09-13T08:24:46.775239+0000","last_clean":"2023-09-13T08:24:46.775239+0000","last_became_active":"2023-09-13T08:24:42.756564+0000","last_became_peered":"2023-09-13T08:24:42.756564+0000","last_unstale":"2023-09-13T08:24:46.775239+0000","last_undegraded":"2023-09-13T08:24:46.775239+0000","last_fullsized":"2023-09-13T08:24:46.775239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:23:57.161158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.534913+0000","last_change":"2023-09-13T08:24:46.799955+0000","last_active":"2023-09-13T08:24:48.534913+0000","last_peered":"2023-09-13T08:24:48.534913+0000","last_clean":"2023-09-13T08:24:48.534913+0000","last_became_active":"2023-09-13T08:24:46.799140+0000","last_became_peered":"2023-09-13T08:24:46.799140+0000","last_unstale":"2023-09-13T08:24:48.534913+0000","last_undegraded":"2023-09-13T08:24:48.534913+0000","last_fullsized":"2023-09-13T08:24:48.534913+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T19:01:33.986931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.781644+0000","last_change":"2023-09-13T08:24:41.748494+0000","last_active":"2023-09-13T08:24:46.781644+0000","last_peered":"2023-09-13T08:24:46.781644+0000","last_clean":"2023-09-13T08:24:46.781644+0000","last_became_active":"2023-09-13T08:24:41.748204+0000","last_became_peered":"2023-09-13T08:24:41.748204+0000","last_unstale":"2023-09-13T08:24:46.781644+0000","last_undegraded":"2023-09-13T08:24:46.781644+0000","last_fullsized":"2023-09-13T08:24:46.781644+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:40:49.395433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.775174+0000","last_change":"2023-09-13T08:24:42.757274+0000","last_active":"2023-09-13T08:24:46.775174+0000","last_peered":"2023-09-13T08:24:46.775174+0000","last_clean":"2023-09-13T08:24:46.775174+0000","last_became_active":"2023-09-13T08:24:42.756521+0000","last_became_peered":"2023-09-13T08:24:42.756521+0000","last_unstale":"2023-09-13T08:24:46.775174+0000","last_undegraded":"2023-09-13T08:24:46.775174+0000","last_fullsized":"2023-09-13T08:24:46.775174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:41:08.160337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.535146+0000","last_change":"2023-09-13T08:24:46.792835+0000","last_active":"2023-09-13T08:24:48.535146+0000","last_peered":"2023-09-13T08:24:48.535146+0000","last_clean":"2023-09-13T08:24:48.535146+0000","last_became_active":"2023-09-13T08:24:46.792432+0000","last_became_peered":"2023-09-13T08:24:46.792432+0000","last_unstale":"2023-09-13T08:24:48.535146+0000","last_undegraded":"2023-09-13T08:24:48.535146+0000","last_fullsized":"2023-09-13T08:24:48.535146+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:19:00.119006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.779060+0000","last_change":"2023-09-13T08:24:41.747562+0000","last_active":"2023-09-13T08:24:46.779060+0000","last_peered":"2023-09-13T08:24:46.779060+0000","last_clean":"2023-09-13T08:24:46.779060+0000","last_became_active":"2023-09-13T08:24:41.747309+0000","last_became_peered":"2023-09-13T08:24:41.747309+0000","last_unstale":"2023-09-13T08:24:46.779060+0000","last_undegraded":"2023-09-13T08:24:46.779060+0000","last_fullsized":"2023-09-13T08:24:46.779060+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:16:33.150745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.776806+0000","last_change":"2023-09-13T08:24:42.771356+0000","last_active":"2023-09-13T08:24:46.776806+0000","last_peered":"2023-09-13T08:24:46.776806+0000","last_clean":"2023-09-13T08:24:46.776806+0000","last_became_active":"2023-09-13T08:24:42.768326+0000","last_became_peered":"2023-09-13T08:24:42.768326+0000","last_unstale":"2023-09-13T08:24:46.776806+0000","last_undegraded":"2023-09-13T08:24:46.776806+0000","last_fullsized":"2023-09-13T08:24:46.776806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T19:01:29.959464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.535284+0000","last_change":"2023-09-13T08:24:46.794707+0000","last_active":"2023-09-13T08:24:48.535284+0000","last_peered":"2023-09-13T08:24:48.535284+0000","last_clean":"2023-09-13T08:24:48.535284+0000","last_became_active":"2023-09-13T08:24:46.794482+0000","last_became_peered":"2023-09-13T08:24:46.794482+0000","last_unstale":"2023-09-13T08:24:48.535284+0000","last_undegraded":"2023-09-13T08:24:48.535284+0000","last_fullsized":"2023-09-13T08:24:48.535284+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:44:45.516475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.774129+0000","last_change":"2023-09-13T08:24:41.754944+0000","last_active":"2023-09-13T08:24:46.774129+0000","last_peered":"2023-09-13T08:24:46.774129+0000","last_clean":"2023-09-13T08:24:46.774129+0000","last_became_active":"2023-09-13T08:24:41.754643+0000","last_became_peered":"2023-09-13T08:24:41.754643+0000","last_unstale":"2023-09-13T08:24:46.774129+0000","last_undegraded":"2023-09-13T08:24:46.774129+0000","last_fullsized":"2023-09-13T08:24:46.774129+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:16:33.150745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.781175+0000","last_change":"2023-09-13T08:24:42.746767+0000","last_active":"2023-09-13T08:24:46.781175+0000","last_peered":"2023-09-13T08:24:46.781175+0000","last_clean":"2023-09-13T08:24:46.781175+0000","last_became_active":"2023-09-13T08:24:42.746431+0000","last_became_peered":"2023-09-13T08:24:42.746431+0000","last_unstale":"2023-09-13T08:24:46.781175+0000","last_undegraded":"2023-09-13T08:24:46.781175+0000","last_fullsized":"2023-09-13T08:24:46.781175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:14:25.309691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.536899+0000","last_change":"2023-09-13T08:24:46.791183+0000","last_active":"2023-09-13T08:24:48.536899+0000","last_peered":"2023-09-13T08:24:48.536899+0000","last_clean":"2023-09-13T08:24:48.536899+0000","last_became_active":"2023-09-13T08:24:46.790665+0000","last_became_peered":"2023-09-13T08:24:46.790665+0000","last_unstale":"2023-09-13T08:24:48.536899+0000","last_undegraded":"2023-09-13T08:24:48.536899+0000","last_fullsized":"2023-09-13T08:24:48.536899+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:35:08.793411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.779259+0000","last_change":"2023-09-13T08:24:42.763692+0000","last_active":"2023-09-13T08:24:46.779259+0000","last_peered":"2023-09-13T08:24:46.779259+0000","last_clean":"2023-09-13T08:24:46.779259+0000","last_became_active":"2023-09-13T08:24:42.763348+0000","last_became_peered":"2023-09-13T08:24:42.763348+0000","last_unstale":"2023-09-13T08:24:46.779259+0000","last_undegraded":"2023-09-13T08:24:46.779259+0000","last_fullsized":"2023-09-13T08:24:46.779259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:01:15.582567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.778942+0000","last_change":"2023-09-13T08:24:41.750528+0000","last_active":"2023-09-13T08:24:46.778942+0000","last_peered":"2023-09-13T08:24:46.778942+0000","last_clean":"2023-09-13T08:24:46.778942+0000","last_became_active":"2023-09-13T08:24:41.750238+0000","last_became_peered":"2023-09-13T08:24:41.750238+0000","last_unstale":"2023-09-13T08:24:46.778942+0000","last_undegraded":"2023-09-13T08:24:46.778942+0000","last_fullsized":"2023-09-13T08:24:46.778942+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:40:49.395433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:47.775614+0000","last_change":"2023-09-13T08:24:46.798991+0000","last_active":"2023-09-13T08:24:47.775614+0000","last_peered":"2023-09-13T08:24:47.775614+0000","last_clean":"2023-09-13T08:24:47.775614+0000","last_became_active":"2023-09-13T08:24:46.798610+0000","last_became_peered":"2023-09-13T08:24:46.798610+0000","last_unstale":"2023-09-13T08:24:47.775614+0000","last_undegraded":"2023-09-13T08:24:47.775614+0000","last_fullsized":"2023-09-13T08:24:47.775614+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T19:57:23.132436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.772327+0000","last_change":"2023-09-13T08:24:42.768328+0000","last_active":"2023-09-13T08:24:46.772327+0000","last_peered":"2023-09-13T08:24:46.772327+0000","last_clean":"2023-09-13T08:24:46.772327+0000","last_became_active":"2023-09-13T08:24:42.768076+0000","last_became_peered":"2023-09-13T08:24:42.768076+0000","last_unstale":"2023-09-13T08:24:46.772327+0000","last_undegraded":"2023-09-13T08:24:46.772327+0000","last_fullsized":"2023-09-13T08:24:46.772327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:38:57.000291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.775019+0000","last_change":"2023-09-13T08:24:41.756796+0000","last_active":"2023-09-13T08:24:46.775019+0000","last_peered":"2023-09-13T08:24:46.775019+0000","last_clean":"2023-09-13T08:24:46.775019+0000","last_became_active":"2023-09-13T08:24:41.756485+0000","last_became_peered":"2023-09-13T08:24:41.756485+0000","last_unstale":"2023-09-13T08:24:46.775019+0000","last_undegraded":"2023-09-13T08:24:46.775019+0000","last_fullsized":"2023-09-13T08:24:46.775019+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:20:29.866513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":169,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.775432+0000","last_change":"2023-09-13T08:24:30.608284+0000","last_active":"2023-09-13T08:24:46.775432+0000","last_peered":"2023-09-13T08:24:46.775432+0000","last_clean":"2023-09-13T08:24:46.775432+0000","last_became_active":"2023-09-13T08:24:30.607240+0000","last_became_peered":"2023-09-13T08:24:30.607240+0000","last_unstale":"2023-09-13T08:24:46.775432+0000","last_undegraded":"2023-09-13T08:24:46.775432+0000","last_fullsized":"2023-09-13T08:24:46.775432+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:29.424755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:29.424755+0000","last_clean_scrub_stamp":"2023-09-13T08:24:29.424755+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:57:43.427279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.534536+0000","last_change":"2023-09-13T08:24:46.796073+0000","last_active":"2023-09-13T08:24:48.534536+0000","last_peered":"2023-09-13T08:24:48.534536+0000","last_clean":"2023-09-13T08:24:48.534536+0000","last_became_active":"2023-09-13T08:24:46.795401+0000","last_became_peered":"2023-09-13T08:24:46.795401+0000","last_unstale":"2023-09-13T08:24:48.534536+0000","last_undegraded":"2023-09-13T08:24:48.534536+0000","last_fullsized":"2023-09-13T08:24:48.534536+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:49:40.361758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.778869+0000","last_change":"2023-09-13T08:24:42.742114+0000","last_active":"2023-09-13T08:24:46.778869+0000","last_peered":"2023-09-13T08:24:46.778869+0000","last_clean":"2023-09-13T08:24:46.778869+0000","last_became_active":"2023-09-13T08:24:42.741800+0000","last_became_peered":"2023-09-13T08:24:42.741800+0000","last_unstale":"2023-09-13T08:24:46.778869+0000","last_undegraded":"2023-09-13T08:24:46.778869+0000","last_fullsized":"2023-09-13T08:24:46.778869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:52:00.242806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.774235+0000","last_change":"2023-09-13T08:24:41.749496+0000","last_active":"2023-09-13T08:24:46.774235+0000","last_peered":"2023-09-13T08:24:46.774235+0000","last_clean":"2023-09-13T08:24:46.774235+0000","last_became_active":"2023-09-13T08:24:41.749111+0000","last_became_peered":"2023-09-13T08:24:41.749111+0000","last_unstale":"2023-09-13T08:24:46.774235+0000","last_undegraded":"2023-09-13T08:24:46.774235+0000","last_fullsized":"2023-09-13T08:24:46.774235+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:12:03.105088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.534661+0000","last_change":"2023-09-13T08:24:46.794473+0000","last_active":"2023-09-13T08:24:48.534661+0000","last_peered":"2023-09-13T08:24:48.534661+0000","last_clean":"2023-09-13T08:24:48.534661+0000","last_became_active":"2023-09-13T08:24:46.794060+0000","last_became_peered":"2023-09-13T08:24:46.794060+0000","last_unstale":"2023-09-13T08:24:48.534661+0000","last_undegraded":"2023-09-13T08:24:48.534661+0000","last_fullsized":"2023-09-13T08:24:48.534661+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:35:08.793411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.774664+0000","last_change":"2023-09-13T08:24:41.762626+0000","last_active":"2023-09-13T08:24:46.774664+0000","last_peered":"2023-09-13T08:24:46.774664+0000","last_clean":"2023-09-13T08:24:46.774664+0000","last_became_active":"2023-09-13T08:24:41.762370+0000","last_became_peered":"2023-09-13T08:24:41.762370+0000","last_unstale":"2023-09-13T08:24:46.774664+0000","last_undegraded":"2023-09-13T08:24:46.774664+0000","last_fullsized":"2023-09-13T08:24:46.774664+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:47:38.305158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.779166+0000","last_change":"2023-09-13T08:24:42.756318+0000","last_active":"2023-09-13T08:24:46.779166+0000","last_peered":"2023-09-13T08:24:46.779166+0000","last_clean":"2023-09-13T08:24:46.779166+0000","last_became_active":"2023-09-13T08:24:42.755533+0000","last_became_peered":"2023-09-13T08:24:42.755533+0000","last_unstale":"2023-09-13T08:24:46.779166+0000","last_undegraded":"2023-09-13T08:24:46.779166+0000","last_fullsized":"2023-09-13T08:24:46.779166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:38:57.000291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.535633+0000","last_change":"2023-09-13T08:24:46.792676+0000","last_active":"2023-09-13T08:24:48.535633+0000","last_peered":"2023-09-13T08:24:48.535633+0000","last_clean":"2023-09-13T08:24:48.535633+0000","last_became_active":"2023-09-13T08:24:46.792303+0000","last_became_peered":"2023-09-13T08:24:46.792303+0000","last_unstale":"2023-09-13T08:24:48.535633+0000","last_undegraded":"2023-09-13T08:24:48.535633+0000","last_fullsized":"2023-09-13T08:24:48.535633+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:06:40.257204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.778749+0000","last_change":"2023-09-13T08:24:41.755753+0000","last_active":"2023-09-13T08:24:46.778749+0000","last_peered":"2023-09-13T08:24:46.778749+0000","last_clean":"2023-09-13T08:24:46.778749+0000","last_became_active":"2023-09-13T08:24:41.755494+0000","last_became_peered":"2023-09-13T08:24:41.755494+0000","last_unstale":"2023-09-13T08:24:46.778749+0000","last_undegraded":"2023-09-13T08:24:46.778749+0000","last_fullsized":"2023-09-13T08:24:46.778749+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:14:24.302634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.772761+0000","last_change":"2023-09-13T08:24:42.766497+0000","last_active":"2023-09-13T08:24:46.772761+0000","last_peered":"2023-09-13T08:24:46.772761+0000","last_clean":"2023-09-13T08:24:46.772761+0000","last_became_active":"2023-09-13T08:24:42.766157+0000","last_became_peered":"2023-09-13T08:24:42.766157+0000","last_unstale":"2023-09-13T08:24:46.772761+0000","last_undegraded":"2023-09-13T08:24:46.772761+0000","last_fullsized":"2023-09-13T08:24:46.772761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:31:23.082234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.535011+0000","last_change":"2023-09-13T08:24:46.794008+0000","last_active":"2023-09-13T08:24:48.535011+0000","last_peered":"2023-09-13T08:24:48.535011+0000","last_clean":"2023-09-13T08:24:48.535011+0000","last_became_active":"2023-09-13T08:24:46.792056+0000","last_became_peered":"2023-09-13T08:24:46.792056+0000","last_unstale":"2023-09-13T08:24:48.535011+0000","last_undegraded":"2023-09-13T08:24:48.535011+0000","last_fullsized":"2023-09-13T08:24:48.535011+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:32:05.670913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.786789+0000","last_change":"2023-09-13T08:24:41.752446+0000","last_active":"2023-09-13T08:24:46.786789+0000","last_peered":"2023-09-13T08:24:46.786789+0000","last_clean":"2023-09-13T08:24:46.786789+0000","last_became_active":"2023-09-13T08:24:41.752048+0000","last_became_peered":"2023-09-13T08:24:41.752048+0000","last_unstale":"2023-09-13T08:24:46.786789+0000","last_undegraded":"2023-09-13T08:24:46.786789+0000","last_fullsized":"2023-09-13T08:24:46.786789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:16:33.150745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.777913+0000","last_change":"2023-09-13T08:24:42.761656+0000","last_active":"2023-09-13T08:24:46.777913+0000","last_peered":"2023-09-13T08:24:46.777913+0000","last_clean":"2023-09-13T08:24:46.777913+0000","last_became_active":"2023-09-13T08:24:42.761413+0000","last_became_peered":"2023-09-13T08:24:42.761413+0000","last_unstale":"2023-09-13T08:24:46.777913+0000","last_undegraded":"2023-09-13T08:24:46.777913+0000","last_fullsized":"2023-09-13T08:24:46.777913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:38:57.000291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.535562+0000","last_change":"2023-09-13T08:24:46.799414+0000","last_active":"2023-09-13T08:24:48.535562+0000","last_peered":"2023-09-13T08:24:48.535562+0000","last_clean":"2023-09-13T08:24:48.535562+0000","last_became_active":"2023-09-13T08:24:46.796678+0000","last_became_peered":"2023-09-13T08:24:46.796678+0000","last_unstale":"2023-09-13T08:24:48.535562+0000","last_undegraded":"2023-09-13T08:24:48.535562+0000","last_fullsized":"2023-09-13T08:24:48.535562+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:44:45.516475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.773672+0000","last_change":"2023-09-13T08:24:41.762705+0000","last_active":"2023-09-13T08:24:46.773672+0000","last_peered":"2023-09-13T08:24:46.773672+0000","last_clean":"2023-09-13T08:24:46.773672+0000","last_became_active":"2023-09-13T08:24:41.762433+0000","last_became_peered":"2023-09-13T08:24:41.762433+0000","last_unstale":"2023-09-13T08:24:46.773672+0000","last_undegraded":"2023-09-13T08:24:46.773672+0000","last_fullsized":"2023-09-13T08:24:46.773672+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:33:08.894982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.780733+0000","last_change":"2023-09-13T08:24:42.756676+0000","last_active":"2023-09-13T08:24:46.780733+0000","last_peered":"2023-09-13T08:24:46.780733+0000","last_clean":"2023-09-13T08:24:46.780733+0000","last_became_active":"2023-09-13T08:24:42.756186+0000","last_became_peered":"2023-09-13T08:24:42.756186+0000","last_unstale":"2023-09-13T08:24:46.780733+0000","last_undegraded":"2023-09-13T08:24:46.780733+0000","last_fullsized":"2023-09-13T08:24:46.780733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:56:13.899024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.537160+0000","last_change":"2023-09-13T08:24:46.792798+0000","last_active":"2023-09-13T08:24:48.537160+0000","last_peered":"2023-09-13T08:24:48.537160+0000","last_clean":"2023-09-13T08:24:48.537160+0000","last_became_active":"2023-09-13T08:24:46.792514+0000","last_became_peered":"2023-09-13T08:24:46.792514+0000","last_unstale":"2023-09-13T08:24:48.537160+0000","last_undegraded":"2023-09-13T08:24:48.537160+0000","last_fullsized":"2023-09-13T08:24:48.537160+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:35:08.086286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.778802+0000","last_change":"2023-09-13T08:24:41.748432+0000","last_active":"2023-09-13T08:24:46.778802+0000","last_peered":"2023-09-13T08:24:46.778802+0000","last_clean":"2023-09-13T08:24:46.778802+0000","last_became_active":"2023-09-13T08:24:41.747775+0000","last_became_peered":"2023-09-13T08:24:41.747775+0000","last_unstale":"2023-09-13T08:24:46.778802+0000","last_undegraded":"2023-09-13T08:24:46.778802+0000","last_fullsized":"2023-09-13T08:24:46.778802+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:04:12.070569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.772017+0000","last_change":"2023-09-13T08:24:42.764490+0000","last_active":"2023-09-13T08:24:46.772017+0000","last_peered":"2023-09-13T08:24:46.772017+0000","last_clean":"2023-09-13T08:24:46.772017+0000","last_became_active":"2023-09-13T08:24:42.764250+0000","last_became_peered":"2023-09-13T08:24:42.764250+0000","last_unstale":"2023-09-13T08:24:46.772017+0000","last_undegraded":"2023-09-13T08:24:46.772017+0000","last_fullsized":"2023-09-13T08:24:46.772017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:47:39.312215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.535444+0000","last_change":"2023-09-13T08:24:46.798308+0000","last_active":"2023-09-13T08:24:48.535444+0000","last_peered":"2023-09-13T08:24:48.535444+0000","last_clean":"2023-09-13T08:24:48.535444+0000","last_became_active":"2023-09-13T08:24:46.797901+0000","last_became_peered":"2023-09-13T08:24:46.797901+0000","last_unstale":"2023-09-13T08:24:48.535444+0000","last_undegraded":"2023-09-13T08:24:48.535444+0000","last_fullsized":"2023-09-13T08:24:48.535444+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:49:40.361758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.778922+0000","last_change":"2023-09-13T08:24:41.752252+0000","last_active":"2023-09-13T08:24:46.778922+0000","last_peered":"2023-09-13T08:24:46.778922+0000","last_clean":"2023-09-13T08:24:46.778922+0000","last_became_active":"2023-09-13T08:24:41.751926+0000","last_became_peered":"2023-09-13T08:24:41.751926+0000","last_unstale":"2023-09-13T08:24:46.778922+0000","last_undegraded":"2023-09-13T08:24:46.778922+0000","last_fullsized":"2023-09-13T08:24:46.778922+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:51:59.235749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.772536+0000","last_change":"2023-09-13T08:24:42.753686+0000","last_active":"2023-09-13T08:24:46.772536+0000","last_peered":"2023-09-13T08:24:46.772536+0000","last_clean":"2023-09-13T08:24:46.772536+0000","last_became_active":"2023-09-13T08:24:42.753298+0000","last_became_peered":"2023-09-13T08:24:42.753298+0000","last_unstale":"2023-09-13T08:24:46.772536+0000","last_undegraded":"2023-09-13T08:24:46.772536+0000","last_fullsized":"2023-09-13T08:24:46.772536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:23:57.161158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.535678+0000","last_change":"2023-09-13T08:24:46.791776+0000","last_active":"2023-09-13T08:24:48.535678+0000","last_peered":"2023-09-13T08:24:48.535678+0000","last_clean":"2023-09-13T08:24:48.535678+0000","last_became_active":"2023-09-13T08:24:46.791304+0000","last_became_peered":"2023-09-13T08:24:46.791304+0000","last_unstale":"2023-09-13T08:24:48.535678+0000","last_undegraded":"2023-09-13T08:24:48.535678+0000","last_fullsized":"2023-09-13T08:24:48.535678+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:35:08.793411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.773971+0000","last_change":"2023-09-13T08:24:41.748551+0000","last_active":"2023-09-13T08:24:46.773971+0000","last_peered":"2023-09-13T08:24:46.773971+0000","last_clean":"2023-09-13T08:24:46.773971+0000","last_became_active":"2023-09-13T08:24:41.748281+0000","last_became_peered":"2023-09-13T08:24:41.748281+0000","last_unstale":"2023-09-13T08:24:46.773971+0000","last_undegraded":"2023-09-13T08:24:46.773971+0000","last_fullsized":"2023-09-13T08:24:46.773971+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:07:52.055769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.785938+0000","last_change":"2023-09-13T08:24:42.755845+0000","last_active":"2023-09-13T08:24:46.785938+0000","last_peered":"2023-09-13T08:24:46.785938+0000","last_clean":"2023-09-13T08:24:46.785938+0000","last_became_active":"2023-09-13T08:24:42.755374+0000","last_became_peered":"2023-09-13T08:24:42.755374+0000","last_unstale":"2023-09-13T08:24:46.785938+0000","last_undegraded":"2023-09-13T08:24:46.785938+0000","last_fullsized":"2023-09-13T08:24:46.785938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:22:05.554377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:47.776274+0000","last_change":"2023-09-13T08:24:46.799284+0000","last_active":"2023-09-13T08:24:47.776274+0000","last_peered":"2023-09-13T08:24:47.776274+0000","last_clean":"2023-09-13T08:24:47.776274+0000","last_became_active":"2023-09-13T08:24:46.798883+0000","last_became_peered":"2023-09-13T08:24:46.798883+0000","last_unstale":"2023-09-13T08:24:47.776274+0000","last_undegraded":"2023-09-13T08:24:47.776274+0000","last_fullsized":"2023-09-13T08:24:47.776274+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:49:40.361758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.781243+0000","last_change":"2023-09-13T08:24:41.752612+0000","last_active":"2023-09-13T08:24:46.781243+0000","last_peered":"2023-09-13T08:24:46.781243+0000","last_clean":"2023-09-13T08:24:46.781243+0000","last_became_active":"2023-09-13T08:24:41.752348+0000","last_became_peered":"2023-09-13T08:24:41.752348+0000","last_unstale":"2023-09-13T08:24:46.781243+0000","last_undegraded":"2023-09-13T08:24:46.781243+0000","last_fullsized":"2023-09-13T08:24:46.781243+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:04:36.176078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.774859+0000","last_change":"2023-09-13T08:24:42.767304+0000","last_active":"2023-09-13T08:24:46.774859+0000","last_peered":"2023-09-13T08:24:46.774859+0000","last_clean":"2023-09-13T08:24:46.774859+0000","last_became_active":"2023-09-13T08:24:42.767041+0000","last_became_peered":"2023-09-13T08:24:42.767041+0000","last_unstale":"2023-09-13T08:24:46.774859+0000","last_undegraded":"2023-09-13T08:24:46.774859+0000","last_fullsized":"2023-09-13T08:24:46.774859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:03:06.113162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.534554+0000","last_change":"2023-09-13T08:24:46.791835+0000","last_active":"2023-09-13T08:24:48.534554+0000","last_peered":"2023-09-13T08:24:48.534554+0000","last_clean":"2023-09-13T08:24:48.534554+0000","last_became_active":"2023-09-13T08:24:46.791288+0000","last_became_peered":"2023-09-13T08:24:46.791288+0000","last_unstale":"2023-09-13T08:24:48.534554+0000","last_undegraded":"2023-09-13T08:24:48.534554+0000","last_fullsized":"2023-09-13T08:24:48.534554+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:44:45.516475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.779134+0000","last_change":"2023-09-13T08:24:41.747559+0000","last_active":"2023-09-13T08:24:46.779134+0000","last_peered":"2023-09-13T08:24:46.779134+0000","last_clean":"2023-09-13T08:24:46.779134+0000","last_became_active":"2023-09-13T08:24:41.747102+0000","last_became_peered":"2023-09-13T08:24:41.747102+0000","last_unstale":"2023-09-13T08:24:46.779134+0000","last_undegraded":"2023-09-13T08:24:46.779134+0000","last_fullsized":"2023-09-13T08:24:46.779134+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:56:12.891967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.776345+0000","last_change":"2023-09-13T08:24:42.770958+0000","last_active":"2023-09-13T08:24:46.776345+0000","last_peered":"2023-09-13T08:24:46.776345+0000","last_clean":"2023-09-13T08:24:46.776345+0000","last_became_active":"2023-09-13T08:24:42.769963+0000","last_became_peered":"2023-09-13T08:24:42.769963+0000","last_unstale":"2023-09-13T08:24:46.776345+0000","last_undegraded":"2023-09-13T08:24:46.776345+0000","last_fullsized":"2023-09-13T08:24:46.776345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:30:17.103018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:47.810704+0000","last_change":"2023-09-13T08:24:46.792537+0000","last_active":"2023-09-13T08:24:47.810704+0000","last_peered":"2023-09-13T08:24:47.810704+0000","last_clean":"2023-09-13T08:24:47.810704+0000","last_became_active":"2023-09-13T08:24:46.791931+0000","last_became_peered":"2023-09-13T08:24:46.791931+0000","last_unstale":"2023-09-13T08:24:47.810704+0000","last_undegraded":"2023-09-13T08:24:47.810704+0000","last_fullsized":"2023-09-13T08:24:47.810704+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:14:40.142972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.783932+0000","last_change":"2023-09-13T08:24:41.750664+0000","last_active":"2023-09-13T08:24:46.783932+0000","last_peered":"2023-09-13T08:24:46.783932+0000","last_clean":"2023-09-13T08:24:46.783932+0000","last_became_active":"2023-09-13T08:24:41.750331+0000","last_became_peered":"2023-09-13T08:24:41.750331+0000","last_unstale":"2023-09-13T08:24:46.783932+0000","last_undegraded":"2023-09-13T08:24:46.783932+0000","last_fullsized":"2023-09-13T08:24:46.783932+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:04:12.070569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.774929+0000","last_change":"2023-09-13T08:24:42.765570+0000","last_active":"2023-09-13T08:24:46.774929+0000","last_peered":"2023-09-13T08:24:46.774929+0000","last_clean":"2023-09-13T08:24:46.774929+0000","last_became_active":"2023-09-13T08:24:42.765232+0000","last_became_peered":"2023-09-13T08:24:42.765232+0000","last_unstale":"2023-09-13T08:24:46.774929+0000","last_undegraded":"2023-09-13T08:24:46.774929+0000","last_fullsized":"2023-09-13T08:24:46.774929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:32:01.643446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.785784+0000","last_change":"2023-09-13T08:24:42.759999+0000","last_active":"2023-09-13T08:24:46.785784+0000","last_peered":"2023-09-13T08:24:46.785784+0000","last_clean":"2023-09-13T08:24:46.785784+0000","last_became_active":"2023-09-13T08:24:42.759710+0000","last_became_peered":"2023-09-13T08:24:42.759710+0000","last_unstale":"2023-09-13T08:24:46.785784+0000","last_undegraded":"2023-09-13T08:24:46.785784+0000","last_fullsized":"2023-09-13T08:24:46.785784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:07:53.062826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.779042+0000","last_change":"2023-09-13T08:24:42.763001+0000","last_active":"2023-09-13T08:24:46.779042+0000","last_peered":"2023-09-13T08:24:46.779042+0000","last_clean":"2023-09-13T08:24:46.779042+0000","last_became_active":"2023-09-13T08:24:42.762686+0000","last_became_peered":"2023-09-13T08:24:42.762686+0000","last_unstale":"2023-09-13T08:24:46.779042+0000","last_undegraded":"2023-09-13T08:24:46.779042+0000","last_fullsized":"2023-09-13T08:24:46.779042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:28:08.821003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.774332+0000","last_change":"2023-09-13T08:24:42.762039+0000","last_active":"2023-09-13T08:24:46.774332+0000","last_peered":"2023-09-13T08:24:46.774332+0000","last_clean":"2023-09-13T08:24:46.774332+0000","last_became_active":"2023-09-13T08:24:42.761685+0000","last_became_peered":"2023-09-13T08:24:42.761685+0000","last_unstale":"2023-09-13T08:24:46.774332+0000","last_undegraded":"2023-09-13T08:24:46.774332+0000","last_fullsized":"2023-09-13T08:24:46.774332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:03:06.113162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.777670+0000","last_change":"2023-09-13T08:24:42.751302+0000","last_active":"2023-09-13T08:24:46.777670+0000","last_peered":"2023-09-13T08:24:46.777670+0000","last_clean":"2023-09-13T08:24:46.777670+0000","last_became_active":"2023-09-13T08:24:42.751016+0000","last_became_peered":"2023-09-13T08:24:42.751016+0000","last_unstale":"2023-09-13T08:24:46.777670+0000","last_undegraded":"2023-09-13T08:24:46.777670+0000","last_fullsized":"2023-09-13T08:24:46.777670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:07:53.062826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.772384+0000","last_change":"2023-09-13T08:24:42.752520+0000","last_active":"2023-09-13T08:24:46.772384+0000","last_peered":"2023-09-13T08:24:46.772384+0000","last_clean":"2023-09-13T08:24:46.772384+0000","last_became_active":"2023-09-13T08:24:42.752216+0000","last_became_peered":"2023-09-13T08:24:42.752216+0000","last_unstale":"2023-09-13T08:24:46.772384+0000","last_undegraded":"2023-09-13T08:24:46.772384+0000","last_fullsized":"2023-09-13T08:24:46.772384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:30:17.103018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.779033+0000","last_change":"2023-09-13T08:24:42.758492+0000","last_active":"2023-09-13T08:24:46.779033+0000","last_peered":"2023-09-13T08:24:46.779033+0000","last_clean":"2023-09-13T08:24:46.779033+0000","last_became_active":"2023-09-13T08:24:42.758226+0000","last_became_peered":"2023-09-13T08:24:42.758226+0000","last_unstale":"2023-09-13T08:24:46.779033+0000","last_undegraded":"2023-09-13T08:24:46.779033+0000","last_fullsized":"2023-09-13T08:24:46.779033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:31:23.082234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.786631+0000","last_change":"2023-09-13T08:24:42.765380+0000","last_active":"2023-09-13T08:24:46.786631+0000","last_peered":"2023-09-13T08:24:46.786631+0000","last_clean":"2023-09-13T08:24:46.786631+0000","last_became_active":"2023-09-13T08:24:42.764743+0000","last_became_peered":"2023-09-13T08:24:42.764743+0000","last_unstale":"2023-09-13T08:24:46.786631+0000","last_undegraded":"2023-09-13T08:24:46.786631+0000","last_fullsized":"2023-09-13T08:24:46.786631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:23:57.161158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.772975+0000","last_change":"2023-09-13T08:24:42.752773+0000","last_active":"2023-09-13T08:24:46.772975+0000","last_peered":"2023-09-13T08:24:46.772975+0000","last_clean":"2023-09-13T08:24:46.772975+0000","last_became_active":"2023-09-13T08:24:42.752417+0000","last_became_peered":"2023-09-13T08:24:42.752417+0000","last_unstale":"2023-09-13T08:24:46.772975+0000","last_undegraded":"2023-09-13T08:24:46.772975+0000","last_fullsized":"2023-09-13T08:24:46.772975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:01:14.370463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.774852+0000","last_change":"2023-09-13T08:24:42.761893+0000","last_active":"2023-09-13T08:24:46.774852+0000","last_peered":"2023-09-13T08:24:46.774852+0000","last_clean":"2023-09-13T08:24:46.774852+0000","last_became_active":"2023-09-13T08:24:42.761302+0000","last_became_peered":"2023-09-13T08:24:42.761302+0000","last_unstale":"2023-09-13T08:24:46.774852+0000","last_undegraded":"2023-09-13T08:24:46.774852+0000","last_fullsized":"2023-09-13T08:24:46.774852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:20:47.395388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.772142+0000","last_change":"2023-09-13T08:24:42.752632+0000","last_active":"2023-09-13T08:24:46.772142+0000","last_peered":"2023-09-13T08:24:46.772142+0000","last_clean":"2023-09-13T08:24:46.772142+0000","last_became_active":"2023-09-13T08:24:42.752332+0000","last_became_peered":"2023-09-13T08:24:42.752332+0000","last_unstale":"2023-09-13T08:24:46.772142+0000","last_undegraded":"2023-09-13T08:24:46.772142+0000","last_fullsized":"2023-09-13T08:24:46.772142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:07:53.062826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.774683+0000","last_change":"2023-09-13T08:24:42.764523+0000","last_active":"2023-09-13T08:24:46.774683+0000","last_peered":"2023-09-13T08:24:46.774683+0000","last_clean":"2023-09-13T08:24:46.774683+0000","last_became_active":"2023-09-13T08:24:42.764276+0000","last_became_peered":"2023-09-13T08:24:42.764276+0000","last_unstale":"2023-09-13T08:24:46.774683+0000","last_undegraded":"2023-09-13T08:24:46.774683+0000","last_fullsized":"2023-09-13T08:24:46.774683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:23:57.161158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.777757+0000","last_change":"2023-09-13T08:24:42.750926+0000","last_active":"2023-09-13T08:24:46.777757+0000","last_peered":"2023-09-13T08:24:46.777757+0000","last_clean":"2023-09-13T08:24:46.777757+0000","last_became_active":"2023-09-13T08:24:42.750569+0000","last_became_peered":"2023-09-13T08:24:42.750569+0000","last_unstale":"2023-09-13T08:24:46.777757+0000","last_undegraded":"2023-09-13T08:24:46.777757+0000","last_fullsized":"2023-09-13T08:24:46.777757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:31:23.082234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.786084+0000","last_change":"2023-09-13T08:24:42.752653+0000","last_active":"2023-09-13T08:24:46.786084+0000","last_peered":"2023-09-13T08:24:46.786084+0000","last_clean":"2023-09-13T08:24:46.786084+0000","last_became_active":"2023-09-13T08:24:42.752390+0000","last_became_peered":"2023-09-13T08:24:42.752390+0000","last_unstale":"2023-09-13T08:24:46.786084+0000","last_undegraded":"2023-09-13T08:24:46.786084+0000","last_fullsized":"2023-09-13T08:24:46.786084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:31:23.082234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":851968,"data_stored":690730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]}]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":99940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82099999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":860160,"data_stored":690786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]}]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":253952,"data_stored":99780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82999999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":99906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]}]},{"osd":5,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":99870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-13T08:25:07.304 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-09-13T08:25:07.304 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-09-13T08:25:07.305 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-09-13T08:25:07.305 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-09-13T08:25:07.306 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-09-13T08:25:07.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.457+0000 7f69ed77d700 1 Processor -- start 2023-09-13T08:25:07.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.457+0000 7f69ed77d700 1 -- start start 2023-09-13T08:25:07.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.458+0000 7f69ed77d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f69e80d3e50 0x7f69e80b7410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:07.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.458+0000 7f69ed77d700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69e80b6870 con 0x7f69e80d0450 2023-09-13T08:25:07.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.458+0000 7f69ed77d700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69e80ceef0 con 0x7f69e815d6d0 2023-09-13T08:25:07.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.458+0000 7f69ed77d700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69e80cf1d0 con 0x7f69e80d3e50 2023-09-13T08:25:07.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.458+0000 7f69e77fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f69e80d3e50 0x7f69e80b7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:07.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.458+0000 7f69e67fc700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f69e80d0450 0x7f69e80b6d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:46382/0 (socket says 172.21.15.84:46382) 2023-09-13T08:25:07.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.458+0000 7f69e67fc700 1 -- 172.21.15.84:0/2052358861 learned_addr learned my addr 172.21.15.84:0/2052358861 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:25:07.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.458+0000 7f69e77fe700 1 -- 172.21.15.84:0/2052358861 >> v1:172.21.15.161:6789/0 conn(0x7f69e815d6d0 legacy=0x7f69e80cfd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:07.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.458+0000 7f69e77fe700 1 -- 172.21.15.84:0/2052358861 >> v1:172.21.15.84:6789/0 conn(0x7f69e80d0450 legacy=0x7f69e80b6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:07.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.458+0000 7f69e77fe700 1 -- 172.21.15.84:0/2052358861 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69e80b6220 con 0x7f69e80d3e50 2023-09-13T08:25:07.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.458+0000 7f69e5ffb700 1 -- 172.21.15.84:0/2052358861 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 612587892 0 0) 0x7f69e80b6870 con 0x7f69e80d0450 2023-09-13T08:25:07.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.458+0000 7f69e77fe700 1 --2- 172.21.15.84:0/2052358861 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f69e80d3e50 0x7f69e80b7410 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f69e0009d90 tx=0x7f69e000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=501b88953f10ee server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:07.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.458+0000 7f69e5ffb700 1 -- 172.21.15.84:0/2052358861 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e000e070 con 0x7f69e80d3e50 2023-09-13T08:25:07.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.458+0000 7f69e5ffb700 1 -- 172.21.15.84:0/2052358861 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69e000bbd0 con 0x7f69e80d3e50 2023-09-13T08:25:07.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.458+0000 7f69e5ffb700 1 -- 172.21.15.84:0/2052358861 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e0012430 con 0x7f69e80d3e50 2023-09-13T08:25:07.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.459+0000 7f69ed77d700 1 -- 172.21.15.84:0/2052358861 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f69e80d3e50 msgr2=0x7f69e80b7410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:07.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.459+0000 7f69ed77d700 1 --2- 172.21.15.84:0/2052358861 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f69e80d3e50 0x7f69e80b7410 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f69e0009d90 tx=0x7f69e000b330 comp rx=0 tx=0).stop 2023-09-13T08:25:07.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.459+0000 7f69ed77d700 1 -- 172.21.15.84:0/2052358861 shutdown_connections 2023-09-13T08:25:07.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.459+0000 7f69ed77d700 1 --2- 172.21.15.84:0/2052358861 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f69e80d3e50 0x7f69e80b7410 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:07.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.459+0000 7f69ed77d700 1 -- 172.21.15.84:0/2052358861 >> 172.21.15.84:0/2052358861 conn(0x7f69e80d3330 msgr2=0x7f69e80d3740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:07.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.459+0000 7f69ed77d700 1 -- 172.21.15.84:0/2052358861 shutdown_connections 2023-09-13T08:25:07.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.459+0000 7f69ed77d700 1 -- 172.21.15.84:0/2052358861 wait complete. 2023-09-13T08:25:07.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.460+0000 7f69ed77d700 1 Processor -- start 2023-09-13T08:25:07.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.460+0000 7f69ed77d700 1 -- start start 2023-09-13T08:25:07.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.461+0000 7f69ed77d700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f69e80d0450 0x7f69e80cade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:07.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.461+0000 7f69ed77d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f69e80d3e50 0x7f69e80cce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:07.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.461+0000 7f69ed77d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f69e815d6d0 0x7f69e8159490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:07.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.461+0000 7f69ed77d700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69e80c78f0 con 0x7f69e80d3e50 2023-09-13T08:25:07.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.461+0000 7f69ed77d700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69e80cb630 con 0x7f69e815d6d0 2023-09-13T08:25:07.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.461+0000 7f69ed77d700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69e80c6f50 con 0x7f69e80d0450 2023-09-13T08:25:07.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.461+0000 7f69e67fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f69e80d3e50 0x7f69e80cce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:07.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.461+0000 7f69e67fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f69e80d3e50 0x7f69e80cce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43744/0 (socket says 172.21.15.84:43744) 2023-09-13T08:25:07.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.461+0000 7f69e67fc700 1 -- 172.21.15.84:0/1915779798 learned_addr learned my addr 172.21.15.84:0/1915779798 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:07.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.461+0000 7f69e6ffd700 1 --2- 172.21.15.84:0/1915779798 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f69e80d0450 0x7f69e80cade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:07.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.461+0000 7f69e77fe700 1 --2- 172.21.15.84:0/1915779798 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f69e815d6d0 0x7f69e8159490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:07.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.461+0000 7f69e67fc700 1 -- 172.21.15.84:0/1915779798 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f69e80d0450 msgr2=0x7f69e80cade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:07.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.461+0000 7f69e67fc700 1 --2- 172.21.15.84:0/1915779798 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f69e80d0450 0x7f69e80cade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:07.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.461+0000 7f69e67fc700 1 -- 172.21.15.84:0/1915779798 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f69e815d6d0 msgr2=0x7f69e8159490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:07.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.461+0000 7f69e67fc700 1 --2- 172.21.15.84:0/1915779798 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f69e815d6d0 0x7f69e8159490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:07.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.461+0000 7f69e67fc700 1 -- 172.21.15.84:0/1915779798 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69e0009a70 con 0x7f69e80d3e50 2023-09-13T08:25:07.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.462+0000 7f69e67fc700 1 --2- 172.21.15.84:0/1915779798 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f69e80d3e50 0x7f69e80cce60 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f69dc00c520 tx=0x7f69dc00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:07.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.462+0000 7f69cf7fe700 1 -- 172.21.15.84:0/1915779798 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69dc004c80 con 0x7f69e80d3e50 2023-09-13T08:25:07.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.462+0000 7f69cf7fe700 1 -- 172.21.15.84:0/1915779798 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69dc004e00 con 0x7f69e80d3e50 2023-09-13T08:25:07.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.462+0000 7f69ed77d700 1 -- 172.21.15.84:0/1915779798 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69e80c7230 con 0x7f69e80d3e50 2023-09-13T08:25:07.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.462+0000 7f69cf7fe700 1 -- 172.21.15.84:0/1915779798 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69dc007310 con 0x7f69e80d3e50 2023-09-13T08:25:07.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.462+0000 7f69ed77d700 1 -- 172.21.15.84:0/1915779798 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69e80cb320 con 0x7f69e80d3e50 2023-09-13T08:25:07.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.463+0000 7f69ed77d700 1 -- 172.21.15.84:0/1915779798 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69e80c7a30 con 0x7f69e80d3e50 2023-09-13T08:25:07.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.463+0000 7f69cf7fe700 1 -- 172.21.15.84:0/1915779798 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f69dc007470 con 0x7f69e80d3e50 2023-09-13T08:25:07.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.464+0000 7f69cf7fe700 1 --2- 172.21.15.84:0/1915779798 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f69d406a580 0x7f69d406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:07.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.464+0000 7f69e6ffd700 1 --2- 172.21.15.84:0/1915779798 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f69d406a580 0x7f69d406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:07.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.464+0000 7f69cf7fe700 1 -- 172.21.15.84:0/1915779798 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f69dc088b10 con 0x7f69e80d3e50 2023-09-13T08:25:07.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.464+0000 7f69e6ffd700 1 --2- 172.21.15.84:0/1915779798 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f69d406a580 0x7f69d406ca40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f69d8000f60 tx=0x7f69d8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:07.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.468+0000 7f69cf7fe700 1 -- 172.21.15.84:0/1915779798 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f69e80c7a30 con 0x7f69e80d3e50 2023-09-13T08:25:07.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.711+0000 7f69ed77d700 1 -- 172.21.15.84:0/1915779798 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f69e80c7a30 con 0x7f69e80d3e50 2023-09-13T08:25:07.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.714+0000 7f69cf7fe700 1 -- 172.21.15.84:0/1915779798 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+170104 (secure 0 0 0) 0x7f69e80c7a30 con 0x7f69e80d3e50 2023-09-13T08:25:07.717 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:25:07.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.717+0000 7f69ed77d700 1 -- 172.21.15.84:0/1915779798 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f69d406a580 msgr2=0x7f69d406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:07.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.717+0000 7f69ed77d700 1 --2- 172.21.15.84:0/1915779798 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f69d406a580 0x7f69d406ca40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f69d8000f60 tx=0x7f69d8009040 comp rx=0 tx=0).stop 2023-09-13T08:25:07.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.717+0000 7f69ed77d700 1 -- 172.21.15.84:0/1915779798 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f69e80d3e50 msgr2=0x7f69e80cce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:07.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.717+0000 7f69ed77d700 1 --2- 172.21.15.84:0/1915779798 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f69e80d3e50 0x7f69e80cce60 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f69dc00c520 tx=0x7f69dc00c8e0 comp rx=0 tx=0).stop 2023-09-13T08:25:07.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.717+0000 7f69ed77d700 1 -- 172.21.15.84:0/1915779798 shutdown_connections 2023-09-13T08:25:07.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.717+0000 7f69ed77d700 1 --2- 172.21.15.84:0/1915779798 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f69d406a580 0x7f69d406ca40 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:07.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.717+0000 7f69ed77d700 1 --2- 172.21.15.84:0/1915779798 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f69e815d6d0 0x7f69e8159490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:07.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.717+0000 7f69ed77d700 1 --2- 172.21.15.84:0/1915779798 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f69e80d0450 0x7f69e80cade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:07.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.717+0000 7f69ed77d700 1 --2- 172.21.15.84:0/1915779798 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f69e80d3e50 0x7f69e80cce60 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:07.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.717+0000 7f69ed77d700 1 -- 172.21.15.84:0/1915779798 >> 172.21.15.84:0/1915779798 conn(0x7f69e80d3330 msgr2=0x7f69e80cde00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:07.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.717+0000 7f69ed77d700 1 -- 172.21.15.84:0/1915779798 shutdown_connections 2023-09-13T08:25:07.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.717+0000 7f69ed77d700 1 -- 172.21.15.84:0/1915779798 wait complete. 2023-09-13T08:25:07.729 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":5,"active_gid":4104,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":3568908055},{"type":"v1","addr":"172.21.15.84:6833","nonce":3568908055}]},"active_addr":"172.21.15.84:6833/3568908055","active_change":"2023-09-13T08:24:22.532024+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4111,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.84:0","nonce":2176463275}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.84:0","nonce":3827957986}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.84:0","nonce":3586468201}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.84:0","nonce":3594842411}]}]} 2023-09-13T08:25:07.733 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-09-13T08:25:07.734 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-09-13T08:25:07.734 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T08:25:07.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.855+0000 7f4337f0d700 1 Processor -- start 2023-09-13T08:25:07.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.855+0000 7f4337f0d700 1 -- start start 2023-09-13T08:25:07.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.856+0000 7f4337f0d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f433006cc50 0x7f433006d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:07.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.856+0000 7f4337f0d700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f433006b510 0x7f43300caf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:07.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.856+0000 7f4337f0d700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43300cb560 con 0x7f433015d6b0 2023-09-13T08:25:07.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.856+0000 7f4337f0d700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f433006d570 con 0x7f433006cc50 2023-09-13T08:25:07.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.856+0000 7f4337f0d700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f433006a750 con 0x7f433006b510 2023-09-13T08:25:07.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.856+0000 7f4335ca9700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f433006cc50 0x7f433006d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:07.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.856+0000 7f43354a8700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f433015d6b0 0x7f43300ca830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:46396/0 (socket says 172.21.15.84:46396) 2023-09-13T08:25:07.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.856+0000 7f43354a8700 1 -- 172.21.15.84:0/2874158414 learned_addr learned my addr 172.21.15.84:0/2874158414 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:25:07.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.856+0000 7f43364aa700 1 --2- 172.21.15.84:0/2874158414 >> v2:172.21.15.161:3300/0 conn(0x7f433006b510 0x7f43300caf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:07.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.856+0000 7f4335ca9700 1 -- 172.21.15.84:0/2874158414 >> v2:172.21.15.161:3300/0 conn(0x7f433006b510 msgr2=0x7f43300caf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:07.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.856+0000 7f4335ca9700 1 --2- 172.21.15.84:0/2874158414 >> v2:172.21.15.161:3300/0 conn(0x7f433006b510 0x7f43300caf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:07.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.856+0000 7f4335ca9700 1 -- 172.21.15.84:0/2874158414 >> v1:172.21.15.84:6789/0 conn(0x7f433015d6b0 legacy=0x7f43300ca830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:07.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.856+0000 7f4335ca9700 1 -- 172.21.15.84:0/2874158414 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f433006aa30 con 0x7f433006cc50 2023-09-13T08:25:07.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.856+0000 7f4334ca7700 1 -- 172.21.15.84:0/2874158414 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2036089486 0 0) 0x7f43300cb560 con 0x7f433015d6b0 2023-09-13T08:25:07.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.857+0000 7f4335ca9700 1 --2- 172.21.15.84:0/2874158414 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f433006cc50 0x7f433006d030 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f43300accc0 tx=0x7f4320009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=470bde251c1c752b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:07.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.857+0000 7f4334ca7700 1 -- 172.21.15.84:0/2874158414 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4320011830 con 0x7f433006cc50 2023-09-13T08:25:07.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.857+0000 7f4334ca7700 1 -- 172.21.15.84:0/2874158414 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4320011990 con 0x7f433006cc50 2023-09-13T08:25:07.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.857+0000 7f4334ca7700 1 -- 172.21.15.84:0/2874158414 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4320011d20 con 0x7f433006cc50 2023-09-13T08:25:07.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.857+0000 7f4337f0d700 1 -- 172.21.15.84:0/2874158414 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f433006cc50 msgr2=0x7f433006d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:07.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.857+0000 7f4337f0d700 1 --2- 172.21.15.84:0/2874158414 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f433006cc50 0x7f433006d030 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f43300accc0 tx=0x7f4320009b20 comp rx=0 tx=0).stop 2023-09-13T08:25:07.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.857+0000 7f4337f0d700 1 -- 172.21.15.84:0/2874158414 shutdown_connections 2023-09-13T08:25:07.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.857+0000 7f4337f0d700 1 --2- 172.21.15.84:0/2874158414 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f433006cc50 0x7f433006d030 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:07.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.857+0000 7f4337f0d700 1 --2- 172.21.15.84:0/2874158414 >> v2:172.21.15.161:3300/0 conn(0x7f433006b510 0x7f43300caf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:07.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.857+0000 7f4337f0d700 1 -- 172.21.15.84:0/2874158414 >> 172.21.15.84:0/2874158414 conn(0x7f43300cc230 msgr2=0x7f43300cc640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:07.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.857+0000 7f4337f0d700 1 -- 172.21.15.84:0/2874158414 shutdown_connections 2023-09-13T08:25:07.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.857+0000 7f4337f0d700 1 -- 172.21.15.84:0/2874158414 wait complete. 2023-09-13T08:25:07.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.858+0000 7f4337f0d700 1 Processor -- start 2023-09-13T08:25:07.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.859+0000 7f4337f0d700 1 -- start start 2023-09-13T08:25:07.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.859+0000 7f4337f0d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f433006b510 0x7f43300aebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:07.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.859+0000 7f4337f0d700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f433006cc50 0x7f43301511c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:07.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.859+0000 7f4337f0d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f433015d6b0 0x7f43301e9290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:07.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.859+0000 7f4337f0d700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43300af120 con 0x7f433006b510 2023-09-13T08:25:07.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.859+0000 7f4337f0d700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43300c6420 con 0x7f433015d6b0 2023-09-13T08:25:07.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.859+0000 7f4337f0d700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43300c6920 con 0x7f433006cc50 2023-09-13T08:25:07.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.859+0000 7f4335ca9700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f433006b510 0x7f43300aebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:07.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.859+0000 7f4335ca9700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f433006b510 0x7f43300aebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43754/0 (socket says 172.21.15.84:43754) 2023-09-13T08:25:07.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.859+0000 7f4335ca9700 1 -- 172.21.15.84:0/99186426 learned_addr learned my addr 172.21.15.84:0/99186426 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:07.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.860+0000 7f43364aa700 1 --2- 172.21.15.84:0/99186426 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f433015d6b0 0x7f43301e9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:07.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.860+0000 7f43354a8700 1 --2- 172.21.15.84:0/99186426 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f433006cc50 0x7f43301511c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:07.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.860+0000 7f4335ca9700 1 -- 172.21.15.84:0/99186426 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f433006cc50 msgr2=0x7f43301511c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:07.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.860+0000 7f4335ca9700 1 --2- 172.21.15.84:0/99186426 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f433006cc50 0x7f43301511c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:07.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.860+0000 7f4335ca9700 1 -- 172.21.15.84:0/99186426 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f433015d6b0 msgr2=0x7f43301e9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:07.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.860+0000 7f4335ca9700 1 --2- 172.21.15.84:0/99186426 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f433015d6b0 0x7f43301e9290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:07.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.860+0000 7f4335ca9700 1 -- 172.21.15.84:0/99186426 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43200094a0 con 0x7f433006b510 2023-09-13T08:25:07.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.860+0000 7f43364aa700 1 --2- 172.21.15.84:0/99186426 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f433015d6b0 0x7f43301e9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T08:25:07.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.860+0000 7f4335ca9700 1 --2- 172.21.15.84:0/99186426 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f433006b510 0x7f43300aebe0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4320000c00 tx=0x7f4320004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:07.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.860+0000 7f43267fc700 1 -- 172.21.15.84:0/99186426 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43200038a0 con 0x7f433006b510 2023-09-13T08:25:07.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.860+0000 7f43267fc700 1 -- 172.21.15.84:0/99186426 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f432001f070 con 0x7f433006b510 2023-09-13T08:25:07.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.860+0000 7f4337f0d700 1 -- 172.21.15.84:0/99186426 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43300c6bc0 con 0x7f433006b510 2023-09-13T08:25:07.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.860+0000 7f43267fc700 1 -- 172.21.15.84:0/99186426 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4320003c40 con 0x7f433006b510 2023-09-13T08:25:07.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.860+0000 7f4337f0d700 1 -- 172.21.15.84:0/99186426 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43300c6f50 con 0x7f433006b510 2023-09-13T08:25:07.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.861+0000 7f4337f0d700 1 -- 172.21.15.84:0/99186426 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43300cc610 con 0x7f433006b510 2023-09-13T08:25:07.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.861+0000 7f43267fc700 1 -- 172.21.15.84:0/99186426 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f4320026480 con 0x7f433006b510 2023-09-13T08:25:07.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.862+0000 7f43267fc700 1 --2- 172.21.15.84:0/99186426 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f431406a580 0x7f431406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:07.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.862+0000 7f43267fc700 1 -- 172.21.15.84:0/99186426 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4320021070 con 0x7f433006b510 2023-09-13T08:25:07.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.862+0000 7f43354a8700 1 --2- 172.21.15.84:0/99186426 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f431406a580 0x7f431406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:07.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.862+0000 7f43354a8700 1 --2- 172.21.15.84:0/99186426 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f431406a580 0x7f431406ca40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f43300c9da0 tx=0x7f432c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:07.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:07.866+0000 7f43267fc700 1 -- 172.21.15.84:0/99186426 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f4320055b10 con 0x7f433006b510 2023-09-13T08:25:08.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.057+0000 7f4337f0d700 1 -- 172.21.15.84:0/99186426 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f433004e9b0 con 0x7f433006b510 2023-09-13T08:25:08.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.058+0000 7f43267fc700 1 -- 172.21.15.84:0/99186426 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18322 (secure 0 0 0) 0x7f4320015090 con 0x7f433006b510 2023-09-13T08:25:08.059 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:25:08.059 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":24,"fsid":"0107440b-b634-42c5-a643-5d31ea826116","created":"2023-09-13T08:24:16.931917+0000","modified":"2023-09-13T08:24:47.176259+0000","last_up_change":"2023-09-13T08:24:28.422631+0000","last_in_change":"2023-09-13T08:24:19.425578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T08:24:28.583720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-13T08:24:39.862832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-13T08:24:41.145511+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-13T08:24:44.775160+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4a53ec12-1469-4356-b4e1-2b8fc9b7c0f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6817","nonce":1599532366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6819","nonce":1599532366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6823","nonce":1599532366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6821","nonce":1599532366}]},"public_addr":"172.21.15.84:6817/1599532366","cluster_addr":"172.21.15.84:6819/1599532366","heartbeat_back_addr":"172.21.15.84:6823/1599532366","heartbeat_front_addr":"172.21.15.84:6821/1599532366","state":["exists","up"]},{"osd":1,"uuid":"11e964a0-b80c-4afc-bfbf-e2067969db29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6825","nonce":461860977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6827","nonce":461860977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6831","nonce":461860977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6829","nonce":461860977}]},"public_addr":"172.21.15.84:6825/461860977","cluster_addr":"172.21.15.84:6827/461860977","heartbeat_back_addr":"172.21.15.84:6831/461860977","heartbeat_front_addr":"172.21.15.84:6829/461860977","state":["exists","up"]},{"osd":2,"uuid":"3ce74529-4dd1-44c7-9576-968f5fdc0c25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6809","nonce":1168316165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6811","nonce":1168316165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6815","nonce":1168316165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6813","nonce":1168316165}]},"public_addr":"172.21.15.84:6809/1168316165","cluster_addr":"172.21.15.84:6811/1168316165","heartbeat_back_addr":"172.21.15.84:6815/1168316165","heartbeat_front_addr":"172.21.15.84:6813/1168316165","state":["exists","up"]},{"osd":3,"uuid":"460cb5c5-590a-4d06-a4d9-5bac2fdf33b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6801","nonce":1661609810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6803","nonce":1661609810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6807","nonce":1661609810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6805","nonce":1661609810}]},"public_addr":"172.21.15.84:6801/1661609810","cluster_addr":"172.21.15.84:6803/1661609810","heartbeat_back_addr":"172.21.15.84:6807/1661609810","heartbeat_front_addr":"172.21.15.84:6805/1661609810","state":["exists","up"]},{"osd":4,"uuid":"bf237dd0-3ebd-44b5-8078-24a63e00d792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6801","nonce":1303562374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6803","nonce":1303562374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6807","nonce":1303562374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6805","nonce":1303562374}]},"public_addr":"172.21.15.161:6801/1303562374","cluster_addr":"172.21.15.161:6803/1303562374","heartbeat_back_addr":"172.21.15.161:6807/1303562374","heartbeat_front_addr":"172.21.15.161:6805/1303562374","state":["exists","up"]},{"osd":5,"uuid":"e1e538e0-5844-456b-8c6e-434d3a914af1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6818","nonce":961120854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6822","nonce":961120854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6830","nonce":961120854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6826","nonce":961120854}]},"public_addr":"172.21.15.161:6818/961120854","cluster_addr":"172.21.15.161:6822/961120854","heartbeat_back_addr":"172.21.15.161:6830/961120854","heartbeat_front_addr":"172.21.15.161:6826/961120854","state":["exists","up"]},{"osd":6,"uuid":"5cb1785e-960f-4dd4-b295-9e21b2c3f875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6809","nonce":980533466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6811","nonce":980533466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6815","nonce":980533466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6813","nonce":980533466}]},"public_addr":"172.21.15.161:6809/980533466","cluster_addr":"172.21.15.161:6811/980533466","heartbeat_back_addr":"172.21.15.161:6815/980533466","heartbeat_front_addr":"172.21.15.161:6813/980533466","state":["exists","up"]},{"osd":7,"uuid":"5acb6619-e933-4b46-b1c2-60af30acb839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6817","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6819","nonce":2479691549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6821","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6823","nonce":2479691549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6829","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6831","nonce":2479691549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6825","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6827","nonce":2479691549}]},"public_addr":"172.21.15.161:6819/2479691549","cluster_addr":"172.21.15.161:6823/2479691549","heartbeat_back_addr":"172.21.15.161:6831/2479691549","heartbeat_front_addr":"172.21.15.161:6827/2479691549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.678857+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.685341+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.613603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.634940+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.564387+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.697347+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.637437+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.619397+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T08:25:08.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.060+0000 7f4337f0d700 1 -- 172.21.15.84:0/99186426 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f431406a580 msgr2=0x7f431406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:08.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.060+0000 7f4337f0d700 1 --2- 172.21.15.84:0/99186426 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f431406a580 0x7f431406ca40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f43300c9da0 tx=0x7f432c009040 comp rx=0 tx=0).stop 2023-09-13T08:25:08.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.060+0000 7f4337f0d700 1 -- 172.21.15.84:0/99186426 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f433006b510 msgr2=0x7f43300aebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:08.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.060+0000 7f4337f0d700 1 --2- 172.21.15.84:0/99186426 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f433006b510 0x7f43300aebe0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4320000c00 tx=0x7f4320004750 comp rx=0 tx=0).stop 2023-09-13T08:25:08.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.060+0000 7f4337f0d700 1 -- 172.21.15.84:0/99186426 shutdown_connections 2023-09-13T08:25:08.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.060+0000 7f4337f0d700 1 --2- 172.21.15.84:0/99186426 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f431406a580 0x7f431406ca40 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:08.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.060+0000 7f4337f0d700 1 --2- 172.21.15.84:0/99186426 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f433015d6b0 0x7f43301e9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:08.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.060+0000 7f4337f0d700 1 --2- 172.21.15.84:0/99186426 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f433006b510 0x7f43300aebe0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:08.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.060+0000 7f4337f0d700 1 --2- 172.21.15.84:0/99186426 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f433006cc50 0x7f43301511c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:08.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.060+0000 7f4337f0d700 1 -- 172.21.15.84:0/99186426 >> 172.21.15.84:0/99186426 conn(0x7f43300cc230 msgr2=0x7f433015b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:08.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.061+0000 7f4337f0d700 1 -- 172.21.15.84:0/99186426 shutdown_connections 2023-09-13T08:25:08.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.061+0000 7f4337f0d700 1 -- 172.21.15.84:0/99186426 wait complete. 2023-09-13T08:25:08.073 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-09-13T08:25:08.073 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T08:25:08.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.193+0000 7fca76bf6700 1 Processor -- start 2023-09-13T08:25:08.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.193+0000 7fca76bf6700 1 -- start start 2023-09-13T08:25:08.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.194+0000 7fca76bf6700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fca7015b560 0x7fca700ced90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:08.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.194+0000 7fca76bf6700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fca700b0630 0x7fca700ae160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:08.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.194+0000 7fca76bf6700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca7015b940 con 0x7fca700d1ce0 2023-09-13T08:25:08.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.194+0000 7fca76bf6700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca700d2170 con 0x7fca700b0630 2023-09-13T08:25:08.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.194+0000 7fca76bf6700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca700cc980 con 0x7fca7015b560 2023-09-13T08:25:08.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.194+0000 7fca75193700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fca700b0630 0x7fca700ae160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:08.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.194+0000 7fca75193700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fca700b0630 0x7fca700ae160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43766/0 (socket says 172.21.15.84:43766) 2023-09-13T08:25:08.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.194+0000 7fca75193700 1 -- 172.21.15.84:0/746710464 learned_addr learned my addr 172.21.15.84:0/746710464 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:08.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.194+0000 7fca74992700 1 --2- 172.21.15.84:0/746710464 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fca7015b560 0x7fca700ced90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:08.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.194+0000 7fca75193700 1 -- 172.21.15.84:0/746710464 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fca7015b560 msgr2=0x7fca700ced90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:08.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.194+0000 7fca75193700 1 --2- 172.21.15.84:0/746710464 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fca7015b560 0x7fca700ced90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:08.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.194+0000 7fca75193700 1 -- 172.21.15.84:0/746710464 >> v1:172.21.15.161:6789/0 conn(0x7fca700d1ce0 legacy=0x7fca700cf2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:08.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.194+0000 7fca75193700 1 -- 172.21.15.84:0/746710464 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca700ccc20 con 0x7fca700b0630 2023-09-13T08:25:08.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.194+0000 7fca75193700 1 --2- 172.21.15.84:0/746710464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca700b0630 0x7fca700ae160 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fca68009e50 tx=0x7fca6800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc3ae9088e4a8ad1 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:08.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.194+0000 7fca6f7fe700 1 -- 172.21.15.84:0/746710464 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6800e070 con 0x7fca700b0630 2023-09-13T08:25:08.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.195+0000 7fca6f7fe700 1 -- 172.21.15.84:0/746710464 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca6800b9c0 con 0x7fca700b0630 2023-09-13T08:25:08.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.195+0000 7fca6f7fe700 1 -- 172.21.15.84:0/746710464 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6800bd70 con 0x7fca700b0630 2023-09-13T08:25:08.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.195+0000 7fca76bf6700 1 -- 172.21.15.84:0/746710464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca700b0630 msgr2=0x7fca700ae160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:08.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.195+0000 7fca76bf6700 1 --2- 172.21.15.84:0/746710464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca700b0630 0x7fca700ae160 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fca68009e50 tx=0x7fca6800b330 comp rx=0 tx=0).stop 2023-09-13T08:25:08.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.195+0000 7fca76bf6700 1 -- 172.21.15.84:0/746710464 shutdown_connections 2023-09-13T08:25:08.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.195+0000 7fca76bf6700 1 --2- 172.21.15.84:0/746710464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca700b0630 0x7fca700ae160 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:08.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.195+0000 7fca76bf6700 1 --2- 172.21.15.84:0/746710464 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fca7015b560 0x7fca700ced90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:08.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.195+0000 7fca76bf6700 1 -- 172.21.15.84:0/746710464 >> 172.21.15.84:0/746710464 conn(0x7fca700d11c0 msgr2=0x7fca700d15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:08.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.195+0000 7fca76bf6700 1 -- 172.21.15.84:0/746710464 shutdown_connections 2023-09-13T08:25:08.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.195+0000 7fca76bf6700 1 -- 172.21.15.84:0/746710464 wait complete. 2023-09-13T08:25:08.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.196+0000 7fca76bf6700 1 Processor -- start 2023-09-13T08:25:08.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.196+0000 7fca76bf6700 1 -- start start 2023-09-13T08:25:08.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.197+0000 7fca76bf6700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fca700b0630 0x7fca700b0a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:08.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.197+0000 7fca76bf6700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca7015b560 0x7fca701f0860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:08.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.197+0000 7fca76bf6700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fca700c8290 0x7fca701f0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:08.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.197+0000 7fca76bf6700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca700c9310 con 0x7fca7015b560 2023-09-13T08:25:08.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.197+0000 7fca76bf6700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca700c8790 con 0x7fca700c8290 2023-09-13T08:25:08.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.197+0000 7fca76bf6700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca700c8a70 con 0x7fca700b0630 2023-09-13T08:25:08.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.197+0000 7fca6ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca7015b560 0x7fca701f0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:08.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.197+0000 7fca6ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca7015b560 0x7fca701f0860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43770/0 (socket says 172.21.15.84:43770) 2023-09-13T08:25:08.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.197+0000 7fca6ffff700 1 -- 172.21.15.84:0/3109310450 learned_addr learned my addr 172.21.15.84:0/3109310450 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:08.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.197+0000 7fca75193700 1 --2- 172.21.15.84:0/3109310450 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fca700c8290 0x7fca701f0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:08.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.197+0000 7fca74992700 1 --2- 172.21.15.84:0/3109310450 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fca700b0630 0x7fca700b0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:08.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.197+0000 7fca6ffff700 1 -- 172.21.15.84:0/3109310450 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fca700b0630 msgr2=0x7fca700b0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:08.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.197+0000 7fca6ffff700 1 --2- 172.21.15.84:0/3109310450 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fca700b0630 0x7fca700b0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:08.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.197+0000 7fca6ffff700 1 -- 172.21.15.84:0/3109310450 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fca700c8290 msgr2=0x7fca701f0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:08.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.197+0000 7fca6ffff700 1 --2- 172.21.15.84:0/3109310450 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fca700c8290 0x7fca701f0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:08.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.197+0000 7fca6ffff700 1 -- 172.21.15.84:0/3109310450 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca68009b30 con 0x7fca7015b560 2023-09-13T08:25:08.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.198+0000 7fca74992700 1 --2- 172.21.15.84:0/3109310450 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fca700b0630 0x7fca700b0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T08:25:08.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.198+0000 7fca6ffff700 1 --2- 172.21.15.84:0/3109310450 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca7015b560 0x7fca701f0860 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fca5c00c450 tx=0x7fca5c00c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:08.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.198+0000 7fca6d7fa700 1 -- 172.21.15.84:0/3109310450 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca5c0052d0 con 0x7fca7015b560 2023-09-13T08:25:08.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.198+0000 7fca6d7fa700 1 -- 172.21.15.84:0/3109310450 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca5c005430 con 0x7fca7015b560 2023-09-13T08:25:08.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.198+0000 7fca6d7fa700 1 -- 172.21.15.84:0/3109310450 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca5c0038c0 con 0x7fca7015b560 2023-09-13T08:25:08.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.198+0000 7fca76bf6700 1 -- 172.21.15.84:0/3109310450 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca700c8d50 con 0x7fca7015b560 2023-09-13T08:25:08.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.198+0000 7fca76bf6700 1 -- 172.21.15.84:0/3109310450 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca700c9d40 con 0x7fca7015b560 2023-09-13T08:25:08.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.199+0000 7fca76bf6700 1 -- 172.21.15.84:0/3109310450 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca7004e9b0 con 0x7fca7015b560 2023-09-13T08:25:08.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.199+0000 7fca6d7fa700 1 -- 172.21.15.84:0/3109310450 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fca5c003a20 con 0x7fca7015b560 2023-09-13T08:25:08.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.200+0000 7fca6d7fa700 1 --2- 172.21.15.84:0/3109310450 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fca5406a580 0x7fca5406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:08.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.200+0000 7fca6d7fa700 1 -- 172.21.15.84:0/3109310450 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fca5c088040 con 0x7fca7015b560 2023-09-13T08:25:08.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.200+0000 7fca74992700 1 --2- 172.21.15.84:0/3109310450 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fca5406a580 0x7fca5406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:08.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.200+0000 7fca74992700 1 --2- 172.21.15.84:0/3109310450 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fca5406a580 0x7fca5406ca40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fca64007a50 tx=0x7fca64008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:08.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.204+0000 7fca6d7fa700 1 -- 172.21.15.84:0/3109310450 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fca5c053360 con 0x7fca7015b560 2023-09-13T08:25:08.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.397+0000 7fca76bf6700 1 -- 172.21.15.84:0/3109310450 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fca7006f640 con 0x7fca7015b560 2023-09-13T08:25:08.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.398+0000 7fca6d7fa700 1 -- 172.21.15.84:0/3109310450 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18322 (secure 0 0 0) 0x7fca5c056980 con 0x7fca7015b560 2023-09-13T08:25:08.398 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:25:08.399 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":24,"fsid":"0107440b-b634-42c5-a643-5d31ea826116","created":"2023-09-13T08:24:16.931917+0000","modified":"2023-09-13T08:24:47.176259+0000","last_up_change":"2023-09-13T08:24:28.422631+0000","last_in_change":"2023-09-13T08:24:19.425578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T08:24:28.583720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-13T08:24:39.862832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-13T08:24:41.145511+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-13T08:24:44.775160+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4a53ec12-1469-4356-b4e1-2b8fc9b7c0f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6817","nonce":1599532366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6819","nonce":1599532366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6823","nonce":1599532366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6821","nonce":1599532366}]},"public_addr":"172.21.15.84:6817/1599532366","cluster_addr":"172.21.15.84:6819/1599532366","heartbeat_back_addr":"172.21.15.84:6823/1599532366","heartbeat_front_addr":"172.21.15.84:6821/1599532366","state":["exists","up"]},{"osd":1,"uuid":"11e964a0-b80c-4afc-bfbf-e2067969db29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6825","nonce":461860977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6827","nonce":461860977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6831","nonce":461860977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6829","nonce":461860977}]},"public_addr":"172.21.15.84:6825/461860977","cluster_addr":"172.21.15.84:6827/461860977","heartbeat_back_addr":"172.21.15.84:6831/461860977","heartbeat_front_addr":"172.21.15.84:6829/461860977","state":["exists","up"]},{"osd":2,"uuid":"3ce74529-4dd1-44c7-9576-968f5fdc0c25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6809","nonce":1168316165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6811","nonce":1168316165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6815","nonce":1168316165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6813","nonce":1168316165}]},"public_addr":"172.21.15.84:6809/1168316165","cluster_addr":"172.21.15.84:6811/1168316165","heartbeat_back_addr":"172.21.15.84:6815/1168316165","heartbeat_front_addr":"172.21.15.84:6813/1168316165","state":["exists","up"]},{"osd":3,"uuid":"460cb5c5-590a-4d06-a4d9-5bac2fdf33b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6801","nonce":1661609810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6803","nonce":1661609810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6807","nonce":1661609810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6805","nonce":1661609810}]},"public_addr":"172.21.15.84:6801/1661609810","cluster_addr":"172.21.15.84:6803/1661609810","heartbeat_back_addr":"172.21.15.84:6807/1661609810","heartbeat_front_addr":"172.21.15.84:6805/1661609810","state":["exists","up"]},{"osd":4,"uuid":"bf237dd0-3ebd-44b5-8078-24a63e00d792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6801","nonce":1303562374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6803","nonce":1303562374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6807","nonce":1303562374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6805","nonce":1303562374}]},"public_addr":"172.21.15.161:6801/1303562374","cluster_addr":"172.21.15.161:6803/1303562374","heartbeat_back_addr":"172.21.15.161:6807/1303562374","heartbeat_front_addr":"172.21.15.161:6805/1303562374","state":["exists","up"]},{"osd":5,"uuid":"e1e538e0-5844-456b-8c6e-434d3a914af1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6818","nonce":961120854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6822","nonce":961120854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6830","nonce":961120854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6826","nonce":961120854}]},"public_addr":"172.21.15.161:6818/961120854","cluster_addr":"172.21.15.161:6822/961120854","heartbeat_back_addr":"172.21.15.161:6830/961120854","heartbeat_front_addr":"172.21.15.161:6826/961120854","state":["exists","up"]},{"osd":6,"uuid":"5cb1785e-960f-4dd4-b295-9e21b2c3f875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6809","nonce":980533466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6811","nonce":980533466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6815","nonce":980533466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6813","nonce":980533466}]},"public_addr":"172.21.15.161:6809/980533466","cluster_addr":"172.21.15.161:6811/980533466","heartbeat_back_addr":"172.21.15.161:6815/980533466","heartbeat_front_addr":"172.21.15.161:6813/980533466","state":["exists","up"]},{"osd":7,"uuid":"5acb6619-e933-4b46-b1c2-60af30acb839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6817","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6819","nonce":2479691549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6821","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6823","nonce":2479691549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6829","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6831","nonce":2479691549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6825","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6827","nonce":2479691549}]},"public_addr":"172.21.15.161:6819/2479691549","cluster_addr":"172.21.15.161:6823/2479691549","heartbeat_back_addr":"172.21.15.161:6831/2479691549","heartbeat_front_addr":"172.21.15.161:6827/2479691549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.678857+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.685341+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.613603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.634940+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.564387+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.697347+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.637437+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.619397+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T08:25:08.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.400+0000 7fca76bf6700 1 -- 172.21.15.84:0/3109310450 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fca5406a580 msgr2=0x7fca5406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:08.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.400+0000 7fca76bf6700 1 --2- 172.21.15.84:0/3109310450 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fca5406a580 0x7fca5406ca40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fca64007a50 tx=0x7fca64008040 comp rx=0 tx=0).stop 2023-09-13T08:25:08.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.400+0000 7fca76bf6700 1 -- 172.21.15.84:0/3109310450 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca7015b560 msgr2=0x7fca701f0860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:08.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.400+0000 7fca76bf6700 1 --2- 172.21.15.84:0/3109310450 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca7015b560 0x7fca701f0860 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fca5c00c450 tx=0x7fca5c00c760 comp rx=0 tx=0).stop 2023-09-13T08:25:08.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.400+0000 7fca76bf6700 1 -- 172.21.15.84:0/3109310450 shutdown_connections 2023-09-13T08:25:08.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.400+0000 7fca76bf6700 1 --2- 172.21.15.84:0/3109310450 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fca5406a580 0x7fca5406ca40 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:08.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.400+0000 7fca76bf6700 1 --2- 172.21.15.84:0/3109310450 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fca700c8290 0x7fca701f0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:08.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.400+0000 7fca76bf6700 1 --2- 172.21.15.84:0/3109310450 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fca700b0630 0x7fca700b0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:08.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.400+0000 7fca76bf6700 1 --2- 172.21.15.84:0/3109310450 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca7015b560 0x7fca701f0860 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:08.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.400+0000 7fca76bf6700 1 -- 172.21.15.84:0/3109310450 >> 172.21.15.84:0/3109310450 conn(0x7fca700d11c0 msgr2=0x7fca700af500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:08.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.400+0000 7fca76bf6700 1 -- 172.21.15.84:0/3109310450 shutdown_connections 2023-09-13T08:25:08.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.400+0000 7fca76bf6700 1 -- 172.21.15.84:0/3109310450 wait complete. 2023-09-13T08:25:08.413 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-09-13T08:25:08.413 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-09-13T08:25:08.414 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-09-13T08:25:08.414 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-09-13T08:25:08.415 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-09-13T08:25:08.415 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-09-13T08:25:08.416 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-09-13T08:25:08.417 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-09-13T08:25:08.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.627+0000 7ff7faf6c700 1 Processor -- start 2023-09-13T08:25:08.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.627+0000 7ff7faf6c700 1 -- start start 2023-09-13T08:25:08.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.628+0000 7fbd49b14700 1 Processor -- start 2023-09-13T08:25:08.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.628+0000 7f613dc7e700 1 Processor -- start 2023-09-13T08:25:08.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.628+0000 7f613dc7e700 1 -- start start 2023-09-13T08:25:08.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.628+0000 7ff7faf6c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff7f40b1540 0x7ff7f406cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:08.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.628+0000 7fc3c5a7e700 1 Processor -- start 2023-09-13T08:25:08.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.628+0000 7ff7faf6c700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff7f40c9770 0x7ff7f4159550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:08.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.628+0000 7ff7faf6c700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff7f4070300 0x7ff7f4070770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:08.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.628+0000 7ff7faf6c700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7f40cd070 con 0x7ff7f40b1540 2023-09-13T08:25:08.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.628+0000 7ff7faf6c700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7f40ccd40 con 0x7ff7f40c9770 2023-09-13T08:25:08.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.628+0000 7ff7faf6c700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f406d4b0 con 0x7ff7f4070300 2023-09-13T08:25:08.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.628+0000 7ff7f8d08700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff7f40b1540 0x7ff7f406cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:08.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.628+0000 7ff7f8d08700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff7f40b1540 0x7ff7f406cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43778/0 (socket says 172.21.15.84:43778) 2023-09-13T08:25:08.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.628+0000 7ff7f8d08700 1 -- 172.21.15.84:0/983214647 learned_addr learned my addr 172.21.15.84:0/983214647 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:08.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.628+0000 7fc3c5a7e700 1 -- start start 2023-09-13T08:25:08.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.628+0000 7fbd49b14700 1 -- start start 2023-09-13T08:25:08.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.628+0000 7ff7f9509700 1 --2- 172.21.15.84:0/983214647 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff7f4070300 0x7ff7f4070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:08.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.629+0000 7ff7f3fff700 1 --2- 172.21.15.84:0/983214647 >> v2:172.21.15.161:3300/0 conn(0x7ff7f40c9770 0x7ff7f4159550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:08.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.629+0000 7ff7f8d08700 1 -- 172.21.15.84:0/983214647 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff7f4070300 msgr2=0x7ff7f4070770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:08.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.629+0000 7ff7f8d08700 1 --2- 172.21.15.84:0/983214647 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff7f4070300 0x7ff7f4070770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:08.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.629+0000 7ff7f8d08700 1 -- 172.21.15.84:0/983214647 >> v2:172.21.15.161:3300/0 conn(0x7ff7f40c9770 msgr2=0x7ff7f4159550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:08.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.629+0000 7ff7f8d08700 1 --2- 172.21.15.84:0/983214647 >> v2:172.21.15.161:3300/0 conn(0x7ff7f40c9770 0x7ff7f4159550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:08.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.629+0000 7ff7f8d08700 1 -- 172.21.15.84:0/983214647 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7f4159a90 con 0x7ff7f40b1540 2023-09-13T08:25:08.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.629+0000 7f613dc7e700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f613815b2b0 0x7f61380b1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:08.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.629+0000 7f613dc7e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f61380702c0 0x7f6138070750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:08.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.629+0000 7f613dc7e700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f613815b690 con 0x7f613806c4f0 2023-09-13T08:25:08.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.629+0000 7f613dc7e700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6138070c90 con 0x7f61380702c0 2023-09-13T08:25:08.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.629+0000 7f613dc7e700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f613806c980 con 0x7f613815b2b0 2023-09-13T08:25:08.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.629+0000 7f6137fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f61380702c0 0x7f6138070750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:08.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.629+0000 7f6137fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f61380702c0 0x7f6138070750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43782/0 (socket says 172.21.15.84:43782) 2023-09-13T08:25:08.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.629+0000 7f6137fff700 1 -- 172.21.15.84:0/1887120068 learned_addr learned my addr 172.21.15.84:0/1887120068 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:08.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.629+0000 7ff7f8d08700 1 --2- 172.21.15.84:0/983214647 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7f40b1540 0x7ff7f406cf70 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff7f40ae960 tx=0x7ff7e8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a884d53aafa1c37 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:08.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.629+0000 7f6137fff700 1 -- 172.21.15.84:0/1887120068 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f613815b2b0 msgr2=0x7f61380b1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:08.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.629+0000 7f61377fe700 1 --2- 172.21.15.84:0/1887120068 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f613815b2b0 0x7f61380b1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:08.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.629+0000 7fc3c5a7e700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc3c01618f0 0x7fc3c00c9560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:08.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.629+0000 7fc3c5a7e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc3c00c9aa0 0x7fc3c00cb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:08.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.629+0000 7fc3c5a7e700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3c0166010 con 0x7fc3c00cbc00 2023-09-13T08:25:08.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.629+0000 7fc3c5a7e700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3c00c9f20 con 0x7fc3c00c9aa0 2023-09-13T08:25:08.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.629+0000 7fc3c5a7e700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c0161cd0 con 0x7fc3c01618f0 2023-09-13T08:25:08.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.629+0000 7fbd49b14700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fbd441618f0 0x7fbd440c9560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:08.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.629+0000 7fbd49b14700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd44166010 con 0x7fbd440cbdd0 2023-09-13T08:25:08.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.629+0000 7fbd49b14700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd44161cd0 con 0x7fbd440c9aa0 2023-09-13T08:25:08.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.629+0000 7fbd49b14700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd440c9f20 con 0x7fbd441618f0 2023-09-13T08:25:08.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.630+0000 7f6137fff700 1 --2- 172.21.15.84:0/1887120068 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f613815b2b0 0x7f61380b1d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:08.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.630+0000 7f6137fff700 1 -- 172.21.15.84:0/1887120068 >> v1:172.21.15.84:6789/0 conn(0x7f613806c4f0 legacy=0x7f6138072160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:08.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.630+0000 7f6137fff700 1 -- 172.21.15.84:0/1887120068 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f613806cc60 con 0x7f61380702c0 2023-09-13T08:25:08.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.630+0000 7ff7f37fe700 1 -- 172.21.15.84:0/983214647 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e800b870 con 0x7ff7f40b1540 2023-09-13T08:25:08.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.630+0000 7fc3bffff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fc3c00cbc00 0x7fc3c006c4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:46436/0 (socket says 172.21.15.84:46436) 2023-09-13T08:25:08.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.630+0000 7fc3bffff700 1 -- 172.21.15.84:0/448598336 learned_addr learned my addr 172.21.15.84:0/448598336 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:25:08.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.630+0000 7fc3bf7fe700 1 --2- 172.21.15.84:0/448598336 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc3c01618f0 0x7fc3c00c9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:08.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.630+0000 7ff7f37fe700 1 -- 172.21.15.84:0/983214647 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7e800b9d0 con 0x7ff7f40b1540 2023-09-13T08:25:08.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.630+0000 7ff7f37fe700 1 -- 172.21.15.84:0/983214647 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e800bd60 con 0x7ff7f40b1540 2023-09-13T08:25:08.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.630+0000 7f6137fff700 1 --2- 172.21.15.84:0/1887120068 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61380702c0 0x7f6138070750 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6130009e50 tx=0x7f613000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b44252f60bbc481 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:08.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.630+0000 7f61377fe700 1 --2- 172.21.15.84:0/1887120068 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f613815b2b0 0x7f61380b1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T08:25:08.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.630+0000 7f61367fc700 1 -- 172.21.15.84:0/1887120068 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f613000e070 con 0x7f61380702c0 2023-09-13T08:25:08.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.630+0000 7f61367fc700 1 -- 172.21.15.84:0/1887120068 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f613000b9c0 con 0x7f61380702c0 2023-09-13T08:25:08.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.630+0000 7f61367fc700 1 -- 172.21.15.84:0/1887120068 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f613000bd50 con 0x7f61380702c0 2023-09-13T08:25:08.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.630+0000 7fc3bf7fe700 1 -- 172.21.15.84:0/448598336 >> v2:172.21.15.84:3300/0 conn(0x7fc3c00c9aa0 msgr2=0x7fc3c00cb6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:08.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.630+0000 7fc3bf7fe700 1 --2- 172.21.15.84:0/448598336 >> v2:172.21.15.84:3300/0 conn(0x7fc3c00c9aa0 0x7fc3c00cb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:08.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.630+0000 7fc3bf7fe700 1 -- 172.21.15.84:0/448598336 >> v1:172.21.15.84:6789/0 conn(0x7fc3c00cbc00 legacy=0x7fc3c006c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:08.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.630+0000 7fc3bf7fe700 1 -- 172.21.15.84:0/448598336 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3c0165440 con 0x7fc3c01618f0 2023-09-13T08:25:08.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.630+0000 7fbd43fff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fbd440cbdd0 0x7fbd440ccae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:46444/0 (socket says 172.21.15.84:46444) 2023-09-13T08:25:08.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.631+0000 7fbd43fff700 1 -- 172.21.15.84:0/1514234517 learned_addr learned my addr 172.21.15.84:0/1514234517 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:25:08.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.631+0000 7fbd437fe700 1 --2- 172.21.15.84:0/1514234517 >> v2:172.21.15.84:3300/0 conn(0x7fbd441618f0 0x7fbd440c9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:08.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.631+0000 7fc3bf7fe700 1 --2- 172.21.15.84:0/448598336 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc3c01618f0 0x7fc3c00c9560 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc3b8009d90 tx=0x7fc3b800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58dfc87934478162 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:08.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.631+0000 7ff7faf6c700 1 -- 172.21.15.84:0/983214647 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7f40b1540 msgr2=0x7ff7f406cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:08.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.631+0000 7ff7faf6c700 1 --2- 172.21.15.84:0/983214647 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7f40b1540 0x7ff7f406cf70 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff7f40ae960 tx=0x7ff7e8009bd0 comp rx=0 tx=0).stop 2023-09-13T08:25:08.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.631+0000 7ff7faf6c700 1 -- 172.21.15.84:0/983214647 shutdown_connections 2023-09-13T08:25:08.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.631+0000 7ff7faf6c700 1 --2- 172.21.15.84:0/983214647 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff7f4070300 0x7ff7f4070770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:08.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.631+0000 7ff7faf6c700 1 --2- 172.21.15.84:0/983214647 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7f40b1540 0x7ff7f406cf70 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:08.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.631+0000 7ff7faf6c700 1 --2- 172.21.15.84:0/983214647 >> v2:172.21.15.161:3300/0 conn(0x7ff7f40c9770 0x7ff7f4159550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:08.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.631+0000 7ff7faf6c700 1 -- 172.21.15.84:0/983214647 >> 172.21.15.84:0/983214647 conn(0x7ff7f40b0a20 msgr2=0x7ff7f40b0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:08.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.631+0000 7f613dc7e700 1 -- 172.21.15.84:0/1887120068 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61380702c0 msgr2=0x7f6138070750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:08.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.631+0000 7f613dc7e700 1 --2- 172.21.15.84:0/1887120068 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61380702c0 0x7f6138070750 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6130009e50 tx=0x7f613000b330 comp rx=0 tx=0).stop 2023-09-13T08:25:08.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.631+0000 7fc3be7fc700 1 -- 172.21.15.84:0/448598336 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b800e070 con 0x7fc3c01618f0 2023-09-13T08:25:08.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.631+0000 7f613dc7e700 1 -- 172.21.15.84:0/1887120068 shutdown_connections 2023-09-13T08:25:08.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.631+0000 7f613dc7e700 1 --2- 172.21.15.84:0/1887120068 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61380702c0 0x7f6138070750 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:08.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.631+0000 7f613dc7e700 1 --2- 172.21.15.84:0/1887120068 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f613815b2b0 0x7f61380b1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:08.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.631+0000 7f613dc7e700 1 -- 172.21.15.84:0/1887120068 >> 172.21.15.84:0/1887120068 conn(0x7f61380b0a20 msgr2=0x7f61380b0e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:08.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.631+0000 7ff7faf6c700 1 -- 172.21.15.84:0/983214647 shutdown_connections 2023-09-13T08:25:08.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.631+0000 7fbd427fc700 1 -- 172.21.15.84:0/1514234517 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1986103076 0 0) 0x7fbd44166010 con 0x7fbd440cbdd0 2023-09-13T08:25:08.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.631+0000 7fbd427fc700 1 -- 172.21.15.84:0/1514234517 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd2c0035b0 con 0x7fbd440cbdd0 2023-09-13T08:25:08.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.631+0000 7fbd427fc700 1 -- 172.21.15.84:0/1514234517 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2115433742 0 0) 0x7fbd44161cd0 con 0x7fbd440c9aa0 2023-09-13T08:25:08.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.631+0000 7fbd427fc700 1 -- 172.21.15.84:0/1514234517 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd44166010 con 0x7fbd440c9aa0 2023-09-13T08:25:08.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.631+0000 7f613dc7e700 1 -- 172.21.15.84:0/1887120068 shutdown_connections 2023-09-13T08:25:08.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.631+0000 7fbd437fe700 1 -- 172.21.15.84:0/1514234517 >> v1:172.21.15.161:6789/0 conn(0x7fbd440c9aa0 legacy=0x7fbd440cb6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:08.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.631+0000 7fbd437fe700 1 -- 172.21.15.84:0/1514234517 >> v1:172.21.15.84:6789/0 conn(0x7fbd440cbdd0 legacy=0x7fbd440ccae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:08.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.631+0000 7fbd437fe700 1 -- 172.21.15.84:0/1514234517 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd44165440 con 0x7fbd441618f0 2023-09-13T08:25:08.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.632+0000 7fbd437fe700 1 --2- 172.21.15.84:0/1514234517 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd441618f0 0x7fbd440c9560 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fbd34009840 tx=0x7fbd34009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32172530d2b989d8 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:08.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.632+0000 7fbd427fc700 1 -- 172.21.15.84:0/1514234517 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd34004230 con 0x7fbd441618f0 2023-09-13T08:25:08.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.631+0000 7fc3be7fc700 1 -- 172.21.15.84:0/448598336 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3b800bbd0 con 0x7fc3c01618f0 2023-09-13T08:25:08.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.631+0000 7fc3be7fc700 1 -- 172.21.15.84:0/448598336 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b8012430 con 0x7fc3c01618f0 2023-09-13T08:25:08.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.632+0000 7fc3c5a7e700 1 -- 172.21.15.84:0/448598336 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc3c01618f0 msgr2=0x7fc3c00c9560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:08.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.632+0000 7fc3c5a7e700 1 --2- 172.21.15.84:0/448598336 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc3c01618f0 0x7fc3c00c9560 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc3b8009d90 tx=0x7fc3b800b330 comp rx=0 tx=0).stop 2023-09-13T08:25:08.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.632+0000 7fbd427fc700 1 -- 172.21.15.84:0/1514234517 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd34004390 con 0x7fbd441618f0 2023-09-13T08:25:08.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.632+0000 7fbd427fc700 1 -- 172.21.15.84:0/1514234517 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd340036a0 con 0x7fbd441618f0 2023-09-13T08:25:08.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.633+0000 7fbd49b14700 1 -- 172.21.15.84:0/1514234517 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd441618f0 msgr2=0x7fbd440c9560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:08.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.633+0000 7fbd49b14700 1 --2- 172.21.15.84:0/1514234517 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd441618f0 0x7fbd440c9560 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fbd34009840 tx=0x7fbd34009b50 comp rx=0 tx=0).stop 2023-09-13T08:25:08.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.633+0000 7fbd49b14700 1 -- 172.21.15.84:0/1514234517 shutdown_connections 2023-09-13T08:25:08.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.633+0000 7fbd49b14700 1 --2- 172.21.15.84:0/1514234517 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd441618f0 0x7fbd440c9560 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:08.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.633+0000 7fbd49b14700 1 -- 172.21.15.84:0/1514234517 >> 172.21.15.84:0/1514234517 conn(0x7fbd440b0a20 msgr2=0x7fbd440b0e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:08.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.631+0000 7ff7faf6c700 1 -- 172.21.15.84:0/983214647 wait complete. 2023-09-13T08:25:08.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.633+0000 7ff7faf6c700 1 Processor -- start 2023-09-13T08:25:08.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.631+0000 7f613dc7e700 1 -- 172.21.15.84:0/1887120068 wait complete. 2023-09-13T08:25:08.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.633+0000 7f613dc7e700 1 Processor -- start 2023-09-13T08:25:08.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.633+0000 7fbd49b14700 1 -- 172.21.15.84:0/1514234517 shutdown_connections 2023-09-13T08:25:08.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.633+0000 7fbd49b14700 1 -- 172.21.15.84:0/1514234517 wait complete. 2023-09-13T08:25:08.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.634+0000 7f613dc7e700 1 -- start start 2023-09-13T08:25:08.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.633+0000 7ff7faf6c700 1 -- start start 2023-09-13T08:25:08.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.634+0000 7ff7faf6c700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff7f4070300 0x7ff7f4145ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:08.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.634+0000 7ff7faf6c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff7f40b1540 0x7ff7f40c4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:08.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.634+0000 7ff7faf6c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7f40c9770 0x7ff7f40c5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:08.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.634+0000 7ff7faf6c700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f40c7c80 con 0x7ff7f40c9770 2023-09-13T08:25:08.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.634+0000 7ff7faf6c700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f40c59c0 con 0x7ff7f40b1540 2023-09-13T08:25:08.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.634+0000 7ff7faf6c700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f40c72e0 con 0x7ff7f4070300 2023-09-13T08:25:08.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.634+0000 7ff7f8d08700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff7f4070300 0x7ff7f4145ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:08.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.634+0000 7ff7f8d08700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff7f4070300 0x7ff7f4145ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.84:53664/0 (socket says 172.21.15.84:53664) 2023-09-13T08:25:08.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.634+0000 7ff7f8d08700 1 -- 172.21.15.84:0/714817765 learned_addr learned my addr 172.21.15.84:0/714817765 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:08.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.634+0000 7ff7f3fff700 1 --2- 172.21.15.84:0/714817765 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff7f40b1540 0x7ff7f40c4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:08.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.635+0000 7ff7f9509700 1 --2- 172.21.15.84:0/714817765 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7f40c9770 0x7ff7f40c5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:08.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.635+0000 7ff7f3fff700 1 -- 172.21.15.84:0/714817765 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff7f4070300 msgr2=0x7ff7f4145ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:08.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.635+0000 7ff7f3fff700 1 --2- 172.21.15.84:0/714817765 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff7f4070300 0x7ff7f4145ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:08.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.635+0000 7ff7f3fff700 1 -- 172.21.15.84:0/714817765 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7f40c9770 msgr2=0x7ff7f40c5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:08.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.635+0000 7ff7f3fff700 1 --2- 172.21.15.84:0/714817765 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7f40c9770 0x7ff7f40c5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:08.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.635+0000 7ff7f3fff700 1 -- 172.21.15.84:0/714817765 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7e8009550 con 0x7ff7f40b1540 2023-09-13T08:25:08.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.635+0000 7fc3c5a7e700 1 -- 172.21.15.84:0/448598336 shutdown_connections 2023-09-13T08:25:08.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.635+0000 7fc3c5a7e700 1 --2- 172.21.15.84:0/448598336 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc3c01618f0 0x7fc3c00c9560 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:08.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.635+0000 7fbd49b14700 1 Processor -- start 2023-09-13T08:25:08.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.635+0000 7fc3c5a7e700 1 --2- 172.21.15.84:0/448598336 >> v2:172.21.15.84:3300/0 conn(0x7fc3c00c9aa0 0x7fc3c00cb6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:08.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.635+0000 7fc3c5a7e700 1 -- 172.21.15.84:0/448598336 >> 172.21.15.84:0/448598336 conn(0x7fc3c00b0a20 msgr2=0x7fc3c00b0e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:08.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.635+0000 7f613dc7e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61380702c0 0x7f61381feab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:08.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.635+0000 7f613dc7e700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f613815b2b0 0x7f6138151c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:08.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.635+0000 7ff7f3fff700 1 --2- 172.21.15.84:0/714817765 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff7f40b1540 0x7ff7f40c4f40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff7e000e7e0 tx=0x7ff7e000eaf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:08.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.635+0000 7fc3c5a7e700 1 -- 172.21.15.84:0/448598336 shutdown_connections 2023-09-13T08:25:08.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.635+0000 7f613dc7e700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6138152190 0x7f61380c5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:08.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.635+0000 7f613dc7e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6138152620 con 0x7f61380702c0 2023-09-13T08:25:08.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.635+0000 7f613dc7e700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f613815b9c0 con 0x7f613815b2b0 2023-09-13T08:25:08.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.635+0000 7f613dc7e700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f613815bca0 con 0x7f6138152190 2023-09-13T08:25:08.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.635+0000 7f6136ffd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f613815b2b0 0x7f6138151c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:08.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.635+0000 7f6136ffd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f613815b2b0 0x7f6138151c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.84:39578/0 (socket says 172.21.15.84:39578) 2023-09-13T08:25:08.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.635+0000 7f6136ffd700 1 -- 172.21.15.84:0/3725963699 learned_addr learned my addr 172.21.15.84:0/3725963699 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:08.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.635+0000 7f61377fe700 1 --2- 172.21.15.84:0/3725963699 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61380702c0 0x7f61381feab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:08.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.635+0000 7fbd49b14700 1 -- start start 2023-09-13T08:25:08.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.635+0000 7f6137fff700 1 --2- 172.21.15.84:0/3725963699 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6138152190 0x7f61380c5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:08.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.636+0000 7f61377fe700 1 -- 172.21.15.84:0/3725963699 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6138152190 msgr2=0x7f61380c5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:08.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.636+0000 7f61377fe700 1 --2- 172.21.15.84:0/3725963699 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6138152190 0x7f61380c5150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:08.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.636+0000 7f61377fe700 1 -- 172.21.15.84:0/3725963699 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f613815b2b0 msgr2=0x7f6138151c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:08.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.636+0000 7f61377fe700 1 --2- 172.21.15.84:0/3725963699 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f613815b2b0 0x7f6138151c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:08.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.636+0000 7f61377fe700 1 -- 172.21.15.84:0/3725963699 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6130009b30 con 0x7f61380702c0 2023-09-13T08:25:08.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.636+0000 7f6136ffd700 1 --2- 172.21.15.84:0/3725963699 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f613815b2b0 0x7f6138151c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T08:25:08.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.636+0000 7f6137fff700 1 --2- 172.21.15.84:0/3725963699 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6138152190 0x7f61380c5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T08:25:08.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.636+0000 7f61377fe700 1 --2- 172.21.15.84:0/3725963699 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61380702c0 0x7f61381feab0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f612800c7c0 tx=0x7f612800cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:08.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.636+0000 7f611ffff700 1 -- 172.21.15.84:0/3725963699 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6128011800 con 0x7f61380702c0 2023-09-13T08:25:08.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.636+0000 7f613dc7e700 1 -- 172.21.15.84:0/3725963699 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f613815bf80 con 0x7f61380702c0 2023-09-13T08:25:08.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.636+0000 7fbd49b14700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd440c9aa0 0x7fbd441f49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:08.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.636+0000 7fbd49b14700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbd440cbdd0 0x7fbd44164300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:08.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.636+0000 7fbd49b14700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbd44164840 0x7fbd441fae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:08.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.636+0000 7fbd49b14700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd44164cf0 con 0x7fbd440c9aa0 2023-09-13T08:25:08.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.636+0000 7fbd49b14700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd441f7530 con 0x7fbd44164840 2023-09-13T08:25:08.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.636+0000 7fbd49b14700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd441f77f0 con 0x7fbd440cbdd0 2023-09-13T08:25:08.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.637+0000 7fbd42ffd700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbd440cbdd0 0x7fbd44164300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:08.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.637+0000 7fbd42ffd700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbd440cbdd0 0x7fbd44164300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.84:53678/0 (socket says 172.21.15.84:53678) 2023-09-13T08:25:08.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.637+0000 7fbd42ffd700 1 -- 172.21.15.84:0/3622525167 learned_addr learned my addr 172.21.15.84:0/3622525167 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:08.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.635+0000 7fc3c5a7e700 1 -- 172.21.15.84:0/448598336 wait complete. 2023-09-13T08:25:08.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.637+0000 7fc3c5a7e700 1 Processor -- start 2023-09-13T08:25:08.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.637+0000 7ff7f17fa700 1 -- 172.21.15.84:0/714817765 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e000c070 con 0x7ff7f40b1540 2023-09-13T08:25:08.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.637+0000 7fbd42ffd700 1 -- 172.21.15.84:0/3622525167 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbd44164840 msgr2=0x7fbd441fae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:08.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.637+0000 7fbd42ffd700 1 --2- 172.21.15.84:0/3622525167 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbd44164840 0x7fbd441fae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:08.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.637+0000 7fbd42ffd700 1 -- 172.21.15.84:0/3622525167 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd440c9aa0 msgr2=0x7fbd441f49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:08.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.637+0000 7fbd42ffd700 1 --2- 172.21.15.84:0/3622525167 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd440c9aa0 0x7fbd441f49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:08.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.637+0000 7fbd42ffd700 1 -- 172.21.15.84:0/3622525167 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd340094a0 con 0x7fbd440cbdd0 2023-09-13T08:25:08.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.637+0000 7fbd42ffd700 1 --2- 172.21.15.84:0/3622525167 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbd440cbdd0 0x7fbd44164300 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c00c8c0 tx=0x7fbd3c00cc80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:08.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.636+0000 7f613dc7e700 1 -- 172.21.15.84:0/3725963699 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f613815c540 con 0x7f61380702c0 2023-09-13T08:25:08.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.636+0000 7f611ffff700 1 -- 172.21.15.84:0/3725963699 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6128011960 con 0x7f61380702c0 2023-09-13T08:25:08.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.636+0000 7f611ffff700 1 -- 172.21.15.84:0/3725963699 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6128011cd0 con 0x7f61380702c0 2023-09-13T08:25:08.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.637+0000 7f613dc7e700 1 -- 172.21.15.84:0/3725963699 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6118000fc0 con 0x7f61380702c0 2023-09-13T08:25:08.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.637+0000 7fbd2bfff700 1 -- 172.21.15.84:0/3622525167 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd3c003e30 con 0x7fbd440cbdd0 2023-09-13T08:25:08.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.638+0000 7fbd2bfff700 1 -- 172.21.15.84:0/3622525167 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd3c005070 con 0x7fbd440cbdd0 2023-09-13T08:25:08.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.638+0000 7fbd49b14700 1 -- 172.21.15.84:0/3622525167 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd441f7ad0 con 0x7fbd440cbdd0 2023-09-13T08:25:08.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.638+0000 7fbd49b14700 1 -- 172.21.15.84:0/3622525167 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd441f8090 con 0x7fbd440cbdd0 2023-09-13T08:25:08.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.638+0000 7f2c81ffe700 1 Processor -- start 2023-09-13T08:25:08.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.639+0000 7ff7f17fa700 1 -- 172.21.15.84:0/714817765 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7e0013610 con 0x7ff7f40b1540 2023-09-13T08:25:08.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.639+0000 7ff7f17fa700 1 -- 172.21.15.84:0/714817765 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e0013980 con 0x7ff7f40b1540 2023-09-13T08:25:08.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.638+0000 7fbd2bfff700 1 -- 172.21.15.84:0/3622525167 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd3c005420 con 0x7fbd440cbdd0 2023-09-13T08:25:08.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.638+0000 7fbd49b14700 1 -- 172.21.15.84:0/3622525167 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbd441656e0 con 0x7fbd440cbdd0 2023-09-13T08:25:08.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.637+0000 7fc3c5a7e700 1 -- start start 2023-09-13T08:25:08.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.638+0000 7fc3c5a7e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3c00c9aa0 0x7fc3c00afde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:08.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.638+0000 7fc3c5a7e700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc3c00cbc00 0x7fc3c00b33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:08.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.638+0000 7fc3c5a7e700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc3c01618f0 0x7fc3c00b38e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:08.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.638+0000 7fc3c5a7e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c01f7100 con 0x7fc3c00c9aa0 2023-09-13T08:25:08.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.638+0000 7fc3c5a7e700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c00c9040 con 0x7fc3c01618f0 2023-09-13T08:25:08.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.638+0000 7fc3c5a7e700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c01f72f0 con 0x7fc3c00cbc00 2023-09-13T08:25:08.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.639+0000 7fc3bf7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3c00c9aa0 0x7fc3c00afde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:08.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.639+0000 7fc3bf7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3c00c9aa0 0x7fc3c00afde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43820/0 (socket says 172.21.15.84:43820) 2023-09-13T08:25:08.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.639+0000 7fc3bf7fe700 1 -- 172.21.15.84:0/823583436 learned_addr learned my addr 172.21.15.84:0/823583436 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:08.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.639+0000 7fc3bffff700 1 --2- 172.21.15.84:0/823583436 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc3c01618f0 0x7fc3c00b38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:08.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.640+0000 7fc3beffd700 1 --2- 172.21.15.84:0/823583436 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc3c00cbc00 0x7fc3c00b33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:08.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.640+0000 7fc3bf7fe700 1 -- 172.21.15.84:0/823583436 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc3c00cbc00 msgr2=0x7fc3c00b33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:08.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.640+0000 7fc3bf7fe700 1 --2- 172.21.15.84:0/823583436 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc3c00cbc00 0x7fc3c00b33a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:08.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.640+0000 7fc3bf7fe700 1 -- 172.21.15.84:0/823583436 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc3c01618f0 msgr2=0x7fc3c00b38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:08.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.640+0000 7fc3bf7fe700 1 --2- 172.21.15.84:0/823583436 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc3c01618f0 0x7fc3c00b38e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:08.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.640+0000 7fc3bf7fe700 1 -- 172.21.15.84:0/823583436 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3b8009a70 con 0x7fc3c00c9aa0 2023-09-13T08:25:08.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.640+0000 7ff7faf6c700 1 -- 172.21.15.84:0/714817765 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7f40c75c0 con 0x7ff7f40b1540 2023-09-13T08:25:08.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.640+0000 7ff7faf6c700 1 -- 172.21.15.84:0/714817765 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7f41465f0 con 0x7ff7f40b1540 2023-09-13T08:25:08.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.640+0000 7fc3bf7fe700 1 --2- 172.21.15.84:0/823583436 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3c00c9aa0 0x7fc3c00afde0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc3c00ca060 tx=0x7fc3b8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:08.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.638+0000 7f2c81ffe700 1 -- start start 2023-09-13T08:25:08.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.640+0000 7f2c81ffe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2c7c0b2b20 0x7f2c7c0b2f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:08.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.640+0000 7f2c81ffe700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2c7c161b90 0x7f2c7c162000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:08.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.640+0000 7f2c81ffe700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c7c0b3440 con 0x7f2c7c0ce780 2023-09-13T08:25:08.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.640+0000 7f2c81ffe700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c7c162540 con 0x7f2c7c0b2b20 2023-09-13T08:25:08.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.640+0000 7f2c81ffe700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c7c162730 con 0x7f2c7c161b90 2023-09-13T08:25:08.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.640+0000 7f2c7affd700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f2c7c0ce780 0x7f2c7c070530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.84:60872/0 (socket says 172.21.15.84:60872) 2023-09-13T08:25:08.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.640+0000 7f2c7affd700 1 -- 172.21.15.84:0/3037758440 learned_addr learned my addr 172.21.15.84:0/3037758440 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:25:08.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.640+0000 7f2c7b7fe700 1 --2- 172.21.15.84:0/3037758440 >> v2:172.21.15.84:3300/0 conn(0x7f2c7c0b2b20 0x7f2c7c0b2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:08.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.640+0000 7f2c7bfff700 1 --2- 172.21.15.84:0/3037758440 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2c7c161b90 0x7f2c7c162000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:08.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.640+0000 7f2c7b7fe700 1 -- 172.21.15.84:0/3037758440 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2c7c161b90 msgr2=0x7f2c7c162000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:08.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.640+0000 7f2c7b7fe700 1 --2- 172.21.15.84:0/3037758440 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2c7c161b90 0x7f2c7c162000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:08.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.640+0000 7f2c7b7fe700 1 -- 172.21.15.84:0/3037758440 >> v1:172.21.15.161:6789/0 conn(0x7f2c7c0ce780 legacy=0x7f2c7c070530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:08.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.640+0000 7f2c7b7fe700 1 -- 172.21.15.84:0/3037758440 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c7c162a10 con 0x7f2c7c0b2b20 2023-09-13T08:25:08.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.640+0000 7fbd2bfff700 1 -- 172.21.15.84:0/3622525167 <== mon.2 v2:172.21.15.161:3301/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fbd3c005580 con 0x7fbd440cbdd0 2023-09-13T08:25:08.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.640+0000 7fbd2bfff700 1 --2- 172.21.15.84:0/3622525167 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fbd3006a5d0 0x7fbd3006ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:08.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.640+0000 7fbd2bfff700 1 -- 172.21.15.84:0/3622525167 <== mon.2 v2:172.21.15.161:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbd3c089320 con 0x7fbd440cbdd0 2023-09-13T08:25:08.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.640+0000 7fbd2bfff700 1 --2- 172.21.15.84:0/3622525167 >> [v2:172.21.15.161:6817/2479691549,v1:172.21.15.161:6819/2479691549] conn(0x7fbd30073c10 0x7fbd30076050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:08.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.640+0000 7fbd2bfff700 1 -- 172.21.15.84:0/3622525167 --> [v2:172.21.15.161:6817/2479691549,v1:172.21.15.161:6819/2479691549] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbd30076720 con 0x7fbd30073c10 2023-09-13T08:25:08.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.640+0000 7fbd2bfff700 1 -- 172.21.15.84:0/3622525167 <== mon.2 v2:172.21.15.161:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbd3c0897c0 con 0x7fbd440cbdd0 2023-09-13T08:25:08.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.640+0000 7f177a87e700 1 Processor -- start 2023-09-13T08:25:08.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.641+0000 7f2c7b7fe700 1 --2- 172.21.15.84:0/3037758440 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c7c0b2b20 0x7f2c7c0b2f00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2c70009840 tx=0x7f2c70009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4707faa09d8fe35a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:08.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.641+0000 7f177a87e700 1 -- start start 2023-09-13T08:25:08.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.641+0000 7f83e3c10700 1 Processor -- start 2023-09-13T08:25:08.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.641+0000 7f611ffff700 1 -- 172.21.15.84:0/3725963699 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f61280233e0 con 0x7f61380702c0 2023-09-13T08:25:08.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.641+0000 7f611ffff700 1 --2- 172.21.15.84:0/3725963699 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f612406a580 0x7f612406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:08.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.641+0000 7f611ffff700 1 -- 172.21.15.84:0/3725963699 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6128089110 con 0x7f61380702c0 2023-09-13T08:25:08.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.641+0000 7f6136ffd700 1 --2- 172.21.15.84:0/3725963699 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f612406a580 0x7f612406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:08.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.641+0000 7f611ffff700 1 --2- 172.21.15.84:0/3725963699 >> [v2:172.21.15.84:6808/1168316165,v1:172.21.15.84:6809/1168316165] conn(0x7f6124073ac0 0x7f6124075f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:08.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.642+0000 7f177a87e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f177415d6b0 0x7f17740ca830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:08.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.642+0000 7f177a87e700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17740cb560 con 0x7f177406cc50 2023-09-13T08:25:08.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.642+0000 7f177a87e700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f177406a750 con 0x7f177406b510 2023-09-13T08:25:08.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.642+0000 7f177a87e700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f177406aa30 con 0x7f177415d6b0 2023-09-13T08:25:08.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.641+0000 7fbd43fff700 1 --2- 172.21.15.84:0/3622525167 >> [v2:172.21.15.161:6817/2479691549,v1:172.21.15.161:6819/2479691549] conn(0x7fbd30073c10 0x7fbd30076050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:08.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.641+0000 7fbd43fff700 1 --2- 172.21.15.84:0/3622525167 >> [v2:172.21.15.161:6817/2479691549,v1:172.21.15.161:6819/2479691549] conn(0x7fbd30073c10 0x7fbd30076050 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:08.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.642+0000 7f2c7a7fc700 1 -- 172.21.15.84:0/3037758440 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c70011830 con 0x7f2c7c0b2b20 2023-09-13T08:25:08.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.642+0000 7f2c7a7fc700 1 -- 172.21.15.84:0/3037758440 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c70011990 con 0x7f2c7c0b2b20 2023-09-13T08:25:08.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.642+0000 7f1778e1b700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f177406b510 0x7f17740cad70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.84:60888/0 (socket says 172.21.15.84:60888) 2023-09-13T08:25:08.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.642+0000 7f1778e1b700 1 -- 172.21.15.84:0/1453563380 learned_addr learned my addr 172.21.15.84:0/1453563380 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:25:08.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.641+0000 7f83e3c10700 1 -- start start 2023-09-13T08:25:08.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.642+0000 7f83e3c10700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f83dc0c9770 0x7f83dc070300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:08.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.642+0000 7f83e3c10700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f83dc070840 0x7f83dc0cb860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:08.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.642+0000 7f83e3c10700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83dc0cd070 con 0x7f83dc1595e0 2023-09-13T08:25:08.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.642+0000 7f83e3c10700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83dc0ccd40 con 0x7f83dc070840 2023-09-13T08:25:08.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.642+0000 7f83e3c10700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83dc0c9d30 con 0x7f83dc0c9770 2023-09-13T08:25:08.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.642+0000 7f83e21ad700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f83dc070840 0x7f83dc0cb860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:08.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.642+0000 7f83e21ad700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f83dc070840 0x7f83dc0cb860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43842/0 (socket says 172.21.15.84:43842) 2023-09-13T08:25:08.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.642+0000 7f83e21ad700 1 -- 172.21.15.84:0/4278868192 learned_addr learned my addr 172.21.15.84:0/4278868192 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:08.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.642+0000 7fc3a7fff700 1 -- 172.21.15.84:0/823583436 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b8007000 con 0x7fc3c00c9aa0 2023-09-13T08:25:08.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.642+0000 7fc3a7fff700 1 -- 172.21.15.84:0/823583436 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3b8004250 con 0x7fc3c00c9aa0 2023-09-13T08:25:08.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.642+0000 7fc3a7fff700 1 -- 172.21.15.84:0/823583436 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b8012430 con 0x7fc3c00c9aa0 2023-09-13T08:25:08.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.642+0000 7f2c7a7fc700 1 -- 172.21.15.84:0/3037758440 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c70011d20 con 0x7f2c7c0b2b20 2023-09-13T08:25:08.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.643+0000 7f2c81ffe700 1 -- 172.21.15.84:0/3037758440 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c7c0b2b20 msgr2=0x7f2c7c0b2f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:08.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.643+0000 7f2c81ffe700 1 --2- 172.21.15.84:0/3037758440 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c7c0b2b20 0x7f2c7c0b2f00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2c70009840 tx=0x7f2c70009b50 comp rx=0 tx=0).stop 2023-09-13T08:25:08.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.643+0000 7f2c81ffe700 1 -- 172.21.15.84:0/3037758440 shutdown_connections 2023-09-13T08:25:08.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.643+0000 7f2c81ffe700 1 --2- 172.21.15.84:0/3037758440 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c7c0b2b20 0x7f2c7c0b2f00 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:08.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.643+0000 7f2c81ffe700 1 --2- 172.21.15.84:0/3037758440 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2c7c161b90 0x7f2c7c162000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:08.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.643+0000 7f2c81ffe700 1 -- 172.21.15.84:0/3037758440 >> 172.21.15.84:0/3037758440 conn(0x7f2c7c0cdb20 msgr2=0x7f2c7c0cdf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:08.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.642+0000 7f611ffff700 1 -- 172.21.15.84:0/3725963699 --> [v2:172.21.15.84:6808/1168316165,v1:172.21.15.84:6809/1168316165] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f61240765d0 con 0x7f6124073ac0 2023-09-13T08:25:08.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.642+0000 7f611ffff700 1 -- 172.21.15.84:0/3725963699 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6128089560 con 0x7f61380702c0 2023-09-13T08:25:08.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.642+0000 7f6137fff700 1 --2- 172.21.15.84:0/3725963699 >> [v2:172.21.15.84:6808/1168316165,v1:172.21.15.84:6809/1168316165] conn(0x7f6124073ac0 0x7f6124075f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:08.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.642+0000 7f6137fff700 1 --2- 172.21.15.84:0/3725963699 >> [v2:172.21.15.84:6808/1168316165,v1:172.21.15.84:6809/1168316165] conn(0x7f6124073ac0 0x7f6124075f00 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:08.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.643+0000 7f6136ffd700 1 --2- 172.21.15.84:0/3725963699 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f612406a580 0x7f612406ca40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6138152880 tx=0x7f612c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:08.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.643+0000 7f611ffff700 1 -- 172.21.15.84:0/3725963699 <== osd.2 v2:172.21.15.84:6808/1168316165 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f61240765d0 con 0x7f6124073ac0 2023-09-13T08:25:08.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.643+0000 7f1772ffd700 1 -- 172.21.15.84:0/1453563380 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 731765187 0 0) 0x7f177406a750 con 0x7f177406b510 2023-09-13T08:25:08.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.643+0000 7f1772ffd700 1 -- 172.21.15.84:0/1453563380 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f175c0035b0 con 0x7f177406b510 2023-09-13T08:25:08.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.643+0000 7f1772ffd700 1 -- 172.21.15.84:0/1453563380 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3643971481 0 0) 0x7f17740cb560 con 0x7f177406cc50 2023-09-13T08:25:08.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.643+0000 7f1772ffd700 1 -- 172.21.15.84:0/1453563380 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f177406a750 con 0x7f177406cc50 2023-09-13T08:25:08.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.643+0000 7f83e09aa700 1 -- 172.21.15.84:0/4278868192 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1507758465 0 0) 0x7f83dc0cd070 con 0x7f83dc1595e0 2023-09-13T08:25:08.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.643+0000 7f83e09aa700 1 -- 172.21.15.84:0/4278868192 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83c80035b0 con 0x7f83dc1595e0 2023-09-13T08:25:08.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.643+0000 7f83e21ad700 1 -- 172.21.15.84:0/4278868192 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f83dc0c9770 msgr2=0x7f83dc070300 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-13T08:25:08.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.643+0000 7f83e21ad700 1 --2- 172.21.15.84:0/4278868192 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f83dc0c9770 0x7f83dc070300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:08.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.643+0000 7f83e21ad700 1 -- 172.21.15.84:0/4278868192 >> v1:172.21.15.161:6789/0 conn(0x7f83dc1595e0 legacy=0x7f83dc06cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:08.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.643+0000 7f83e21ad700 1 -- 172.21.15.84:0/4278868192 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83dc0ca010 con 0x7f83dc070840 2023-09-13T08:25:08.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.643+0000 7fbd2bfff700 1 -- 172.21.15.84:0/3622525167 <== osd.7 v2:172.21.15.161:6817/2479691549 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fbd30076720 con 0x7fbd30073c10 2023-09-13T08:25:08.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.643+0000 7fbd437fe700 1 --2- 172.21.15.84:0/3622525167 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fbd3006a5d0 0x7fbd3006ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:08.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.644+0000 7f1772ffd700 1 -- 172.21.15.84:0/1453563380 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3253722117 0 0) 0x7f177406a750 con 0x7f177406cc50 2023-09-13T08:25:08.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.644+0000 7f1772ffd700 1 -- 172.21.15.84:0/1453563380 >> v2:172.21.15.84:3300/0 conn(0x7f177415d6b0 msgr2=0x7f17740ca830 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-13T08:25:08.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.644+0000 7f1772ffd700 1 --2- 172.21.15.84:0/1453563380 >> v2:172.21.15.84:3300/0 conn(0x7f177415d6b0 0x7f17740ca830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:08.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.644+0000 7f1772ffd700 1 -- 172.21.15.84:0/1453563380 >> v1:172.21.15.161:6789/0 conn(0x7f177406b510 legacy=0x7f17740cad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:08.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.643+0000 7fc3c5a7e700 1 -- 172.21.15.84:0/823583436 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3c01f75d0 con 0x7fc3c00c9aa0 2023-09-13T08:25:08.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.643+0000 7fc3c5a7e700 1 -- 172.21.15.84:0/823583436 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3c01f7b90 con 0x7fc3c00c9aa0 2023-09-13T08:25:08.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.644+0000 7fbd437fe700 1 --2- 172.21.15.84:0/3622525167 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fbd3006a5d0 0x7fbd3006ca90 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbd34009840 tx=0x7fbd34010000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:08.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.644+0000 7ff7f17fa700 1 -- 172.21.15.84:0/714817765 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7ff7e0013ae0 con 0x7ff7f40b1540 2023-09-13T08:25:08.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.644+0000 7fc3c5a7e700 1 -- 172.21.15.84:0/823583436 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc3c01659c0 con 0x7fc3c00c9aa0 2023-09-13T08:25:08.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.644+0000 7f83e21ad700 1 --2- 172.21.15.84:0/4278868192 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83dc070840 0x7f83dc0cb860 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f83d4007980 tx=0x7f83d400d650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=368047aae5c1f3a2 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:08.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.644+0000 7ff7faf6c700 1 -- 172.21.15.84:0/714817765 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff7f40ca010 con 0x7ff7f40b1540 2023-09-13T08:25:08.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.644+0000 7ff7f17fa700 1 --2- 172.21.15.84:0/714817765 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7ff7d806a650 0x7ff7d806cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:08.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.644+0000 7f83e09aa700 1 -- 172.21.15.84:0/4278868192 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83d4007d30 con 0x7f83dc070840 2023-09-13T08:25:08.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.644+0000 7f1772ffd700 1 -- 172.21.15.84:0/1453563380 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f177406ad10 con 0x7f177406cc50 2023-09-13T08:25:08.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.644+0000 7f1772ffd700 1 -- 172.21.15.84:0/1453563380 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2302733408 0 0) 0x7f176c001920 con 0x7f177406cc50 2023-09-13T08:25:08.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.644+0000 7f1772ffd700 1 -- 172.21.15.84:0/1453563380 >> v1:172.21.15.84:6789/0 conn(0x7f177406cc50 legacy=0x7f177406d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:08.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.644+0000 7f1772ffd700 1 --2- 172.21.15.84:0/1453563380 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f175c003bc0 0x7f175c003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:08.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.644+0000 7f1772ffd700 1 --2- 172.21.15.84:0/1453563380 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f175c004850 0x7f175c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:08.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.644+0000 7f1772ffd700 1 --2- 172.21.15.84:0/1453563380 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f175c005410 0x7f175c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:08.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.644+0000 7f1772ffd700 1 -- 172.21.15.84:0/1453563380 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1764001230 con 0x7f175c005410 2023-09-13T08:25:08.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.644+0000 7f1772ffd700 1 -- 172.21.15.84:0/1453563380 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f177406aa30 con 0x7f175c004850 2023-09-13T08:25:08.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.644+0000 7f1772ffd700 1 -- 172.21.15.84:0/1453563380 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f175c00c350 con 0x7f175c003bc0 2023-09-13T08:25:08.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.644+0000 7f1778e1b700 1 --2- 172.21.15.84:0/1453563380 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f175c005410 0x7f175c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:08.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.645+0000 7f1778e1b700 1 -- 172.21.15.84:0/1453563380 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f175c003bc0 msgr2=0x7f175c003fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:08.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.645+0000 7f1778e1b700 1 --2- 172.21.15.84:0/1453563380 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f175c003bc0 0x7f175c003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:08.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.645+0000 7f1778e1b700 1 -- 172.21.15.84:0/1453563380 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f175c004850 msgr2=0x7f175c004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:08.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.645+0000 7f1778e1b700 1 --2- 172.21.15.84:0/1453563380 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f175c004850 0x7f175c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:08.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.645+0000 7f1778e1b700 1 -- 172.21.15.84:0/1453563380 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f177406ad10 con 0x7f175c005410 2023-09-13T08:25:08.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.645+0000 7f1778e1b700 1 -- 172.21.15.84:0/1453563380 reap_dead start 2023-09-13T08:25:08.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.645+0000 7ff7f8d08700 1 --2- 172.21.15.84:0/714817765 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7ff7d806a650 0x7ff7d806cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:08.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.645+0000 7ff7f17fa700 1 -- 172.21.15.84:0/714817765 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff7e0088a00 con 0x7ff7f40b1540 2023-09-13T08:25:08.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.645+0000 7ff7f17fa700 1 --2- 172.21.15.84:0/714817765 >> [v2:172.21.15.161:6800/1303562374,v1:172.21.15.161:6801/1303562374] conn(0x7ff7d8073c10 0x7ff7d8076050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:08.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.645+0000 7ff7f17fa700 1 -- 172.21.15.84:0/714817765 --> [v2:172.21.15.161:6800/1303562374,v1:172.21.15.161:6801/1303562374] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff7d8076720 con 0x7ff7d8073c10 2023-09-13T08:25:08.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.645+0000 7ff7f17fa700 1 -- 172.21.15.84:0/714817765 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff7e0009ea0 con 0x7ff7f40b1540 2023-09-13T08:25:08.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.645+0000 7f1778e1b700 1 --2- 172.21.15.84:0/1453563380 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f175c005410 0x7f175c00ba10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f176400c190 tx=0x7f175c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5872a01eb9138749 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:08.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.645+0000 7ff7f8d08700 1 --2- 172.21.15.84:0/714817765 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7ff7d806a650 0x7ff7d806cb10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff7e8009130 tx=0x7ff7e8008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:08.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.645+0000 7f1772ffd700 1 -- 172.21.15.84:0/1453563380 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f176400ccf0 con 0x7f175c005410 2023-09-13T08:25:08.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.645+0000 7f1772ffd700 1 -- 172.21.15.84:0/1453563380 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f176400ce50 con 0x7f175c005410 2023-09-13T08:25:08.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.645+0000 7f1772ffd700 1 -- 172.21.15.84:0/1453563380 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1764004b50 con 0x7f175c005410 2023-09-13T08:25:08.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.646+0000 7f7394ddb700 1 Processor -- start 2023-09-13T08:25:08.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.645+0000 7f83e09aa700 1 -- 172.21.15.84:0/4278868192 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83d4007e90 con 0x7f83dc070840 2023-09-13T08:25:08.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.645+0000 7f83e09aa700 1 -- 172.21.15.84:0/4278868192 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83d40126d0 con 0x7f83dc070840 2023-09-13T08:25:08.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.646+0000 7f83e3c10700 1 -- 172.21.15.84:0/4278868192 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83dc070840 msgr2=0x7f83dc0cb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:08.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.646+0000 7f83e3c10700 1 --2- 172.21.15.84:0/4278868192 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83dc070840 0x7f83dc0cb860 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f83d4007980 tx=0x7f83d400d650 comp rx=0 tx=0).stop 2023-09-13T08:25:08.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.646+0000 7fc3a7fff700 1 -- 172.21.15.84:0/823583436 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fc3b80045e0 con 0x7fc3c00c9aa0 2023-09-13T08:25:08.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.646+0000 7f83e3c10700 1 -- 172.21.15.84:0/4278868192 shutdown_connections 2023-09-13T08:25:08.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.646+0000 7f83e3c10700 1 --2- 172.21.15.84:0/4278868192 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83dc070840 0x7f83dc0cb860 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:08.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.646+0000 7f83e3c10700 1 --2- 172.21.15.84:0/4278868192 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f83dc0c9770 0x7f83dc070300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:08.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.646+0000 7f83e3c10700 1 -- 172.21.15.84:0/4278868192 >> 172.21.15.84:0/4278868192 conn(0x7f83dc0b0a20 msgr2=0x7f83dc0b0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:08.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.646+0000 7fc3a7fff700 1 --2- 172.21.15.84:0/823583436 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fc3ac06a5d0 0x7fc3ac06ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:08.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.646+0000 7f177a87e700 1 -- 172.21.15.84:0/1453563380 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f175c005410 msgr2=0x7f175c00ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:08.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.646+0000 7f83e3c10700 1 -- 172.21.15.84:0/4278868192 shutdown_connections 2023-09-13T08:25:08.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.646+0000 7fc3a7fff700 1 -- 172.21.15.84:0/823583436 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc3b808b450 con 0x7fc3c00c9aa0 2023-09-13T08:25:08.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.646+0000 7f177a87e700 1 --2- 172.21.15.84:0/1453563380 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f175c005410 0x7f175c00ba10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f176400c190 tx=0x7f175c005880 comp rx=0 tx=0).stop 2023-09-13T08:25:08.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.646+0000 7fc3a7fff700 1 --2- 172.21.15.84:0/823583436 >> [v2:172.21.15.84:6816/1599532366,v1:172.21.15.84:6817/1599532366] conn(0x7fc3ac073c10 0x7fc3ac076050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:08.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.646+0000 7f177a87e700 1 -- 172.21.15.84:0/1453563380 shutdown_connections 2023-09-13T08:25:08.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.646+0000 7f177a87e700 1 --2- 172.21.15.84:0/1453563380 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f175c005410 0x7f175c00ba10 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:08.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.646+0000 7f177a87e700 1 -- 172.21.15.84:0/1453563380 >> 172.21.15.84:0/1453563380 conn(0x7f17740cc230 msgr2=0x7f17740cc640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:08.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.646+0000 7fc3a7fff700 1 -- 172.21.15.84:0/823583436 --> [v2:172.21.15.84:6816/1599532366,v1:172.21.15.84:6817/1599532366] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc3ac076720 con 0x7fc3ac073c10 2023-09-13T08:25:08.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.646+0000 7fc3a7fff700 1 -- 172.21.15.84:0/823583436 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc3b808b8f0 con 0x7fc3c00c9aa0 2023-09-13T08:25:08.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.646+0000 7f83e3c10700 1 -- 172.21.15.84:0/4278868192 wait complete. 2023-09-13T08:25:08.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.646+0000 7fc3bffff700 1 --2- 172.21.15.84:0/823583436 >> [v2:172.21.15.84:6816/1599532366,v1:172.21.15.84:6817/1599532366] conn(0x7fc3ac073c10 0x7fc3ac076050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:08.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.647+0000 7fc3bffff700 1 --2- 172.21.15.84:0/823583436 >> [v2:172.21.15.84:6816/1599532366,v1:172.21.15.84:6817/1599532366] conn(0x7fc3ac073c10 0x7fc3ac076050 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:08.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.646+0000 7f7394ddb700 1 -- start start 2023-09-13T08:25:08.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.647+0000 7f7394ddb700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f73901595e0 0x7f739006cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:08.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.647+0000 7f7394ddb700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f73900c9770 0x7f7390070300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:08.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.647+0000 7f7394ddb700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73900cd070 con 0x7f7390070840 2023-09-13T08:25:08.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.647+0000 7f7394ddb700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73900ccd40 con 0x7f73900c9770 2023-09-13T08:25:08.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.647+0000 7f7394ddb700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f739006d4b0 con 0x7f73901595e0 2023-09-13T08:25:08.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.647+0000 7f738ed9d700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f7390070840 0x7f73900cb860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:46508/0 (socket says 172.21.15.84:46508) 2023-09-13T08:25:08.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.647+0000 7f738ed9d700 1 -- 172.21.15.84:0/3829465274 learned_addr learned my addr 172.21.15.84:0/3829465274 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:25:08.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.647+0000 7f738e59c700 1 --2- 172.21.15.84:0/3829465274 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f73901595e0 0x7f739006cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:08.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.648+0000 7f738dd9b700 1 --2- 172.21.15.84:0/3829465274 >> v2:172.21.15.161:3300/0 conn(0x7f73900c9770 0x7f7390070300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:08.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.648+0000 7f738d59a700 1 -- 172.21.15.84:0/3829465274 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2684968807 0 0) 0x7f73900cd070 con 0x7f7390070840 2023-09-13T08:25:08.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.648+0000 7f738e59c700 1 -- 172.21.15.84:0/3829465274 >> v2:172.21.15.161:3300/0 conn(0x7f73900c9770 msgr2=0x7f7390070300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:08.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.648+0000 7f738e59c700 1 --2- 172.21.15.84:0/3829465274 >> v2:172.21.15.161:3300/0 conn(0x7f73900c9770 0x7f7390070300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:08.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.648+0000 7f738e59c700 1 -- 172.21.15.84:0/3829465274 >> v1:172.21.15.84:6789/0 conn(0x7f7390070840 legacy=0x7f73900cb860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:08.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.648+0000 7f738e59c700 1 -- 172.21.15.84:0/3829465274 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73900c9d30 con 0x7f73901595e0 2023-09-13T08:25:08.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.648+0000 7f738dd9b700 1 --2- 172.21.15.84:0/3829465274 >> v2:172.21.15.161:3300/0 conn(0x7f73900c9770 0x7f7390070300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T08:25:08.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.648+0000 7f738e59c700 1 --2- 172.21.15.84:0/3829465274 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f73901595e0 0x7f739006cf70 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f73840091b0 tx=0x7f73840094c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed2b6bb4c6ae4516 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:08.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.648+0000 7f2c81ffe700 1 -- 172.21.15.84:0/3037758440 shutdown_connections 2023-09-13T08:25:08.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.648+0000 7f83e3c10700 1 Processor -- start 2023-09-13T08:25:08.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.648+0000 7fc3a7fff700 1 -- 172.21.15.84:0/823583436 <== osd.0 v2:172.21.15.84:6816/1599532366 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fc3ac076720 con 0x7fc3ac073c10 2023-09-13T08:25:08.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.648+0000 7fc3beffd700 1 --2- 172.21.15.84:0/823583436 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fc3ac06a5d0 0x7fc3ac06ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:08.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.648+0000 7f2c81ffe700 1 -- 172.21.15.84:0/3037758440 wait complete. 2023-09-13T08:25:08.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.648+0000 7f738d59a700 1 -- 172.21.15.84:0/3829465274 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7384011830 con 0x7f73901595e0 2023-09-13T08:25:08.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.648+0000 7f738d59a700 1 -- 172.21.15.84:0/3829465274 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7384011990 con 0x7f73901595e0 2023-09-13T08:25:08.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.648+0000 7f738d59a700 1 -- 172.21.15.84:0/3829465274 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7384011d20 con 0x7f73901595e0 2023-09-13T08:25:08.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.649+0000 7f7394ddb700 1 -- 172.21.15.84:0/3829465274 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f73901595e0 msgr2=0x7f739006cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:08.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.649+0000 7f7394ddb700 1 --2- 172.21.15.84:0/3829465274 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f73901595e0 0x7f739006cf70 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f73840091b0 tx=0x7f73840094c0 comp rx=0 tx=0).stop 2023-09-13T08:25:08.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.648+0000 7f83e3c10700 1 -- start start 2023-09-13T08:25:08.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.650+0000 7f83e3c10700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83dc070840 0x7f83dc14d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:08.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.650+0000 7f83e3c10700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f83dc0c9770 0x7f83dc0c7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:08.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.650+0000 7f83e3c10700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83dc1595e0 0x7f83dc0c83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:08.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.650+0000 7f83e3c10700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83dc14d8d0 con 0x7f83dc1595e0 2023-09-13T08:25:08.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.650+0000 7f83e3c10700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83dc0b1b40 con 0x7f83dc070840 2023-09-13T08:25:08.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.650+0000 7f83e3c10700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83dc0b29a0 con 0x7f83dc0c9770 2023-09-13T08:25:08.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.650+0000 7f83e19ac700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83dc070840 0x7f83dc14d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:08.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.650+0000 7f83e19ac700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83dc070840 0x7f83dc14d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.84:39638/0 (socket says 172.21.15.84:39638) 2023-09-13T08:25:08.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.650+0000 7f83e19ac700 1 -- 172.21.15.84:0/1720986359 learned_addr learned my addr 172.21.15.84:0/1720986359 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:08.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.650+0000 7f83e21ad700 1 --2- 172.21.15.84:0/1720986359 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83dc1595e0 0x7f83dc0c83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:08.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.650+0000 7f83e19ac700 1 -- 172.21.15.84:0/1720986359 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f83dc0c9770 msgr2=0x7f83dc0c7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:08.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.650+0000 7f83e19ac700 1 --2- 172.21.15.84:0/1720986359 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f83dc0c9770 0x7f83dc0c7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:08.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.650+0000 7f83e19ac700 1 -- 172.21.15.84:0/1720986359 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83dc1595e0 msgr2=0x7f83dc0c83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:08.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.650+0000 7f83e19ac700 1 --2- 172.21.15.84:0/1720986359 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83dc1595e0 0x7f83dc0c83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:08.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.650+0000 7f83e19ac700 1 -- 172.21.15.84:0/1720986359 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83d400d050 con 0x7f83dc070840 2023-09-13T08:25:08.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.650+0000 7f83e21ad700 1 --2- 172.21.15.84:0/1720986359 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83dc1595e0 0x7f83dc0c83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T08:25:08.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.651+0000 7fc3beffd700 1 --2- 172.21.15.84:0/823583436 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fc3ac06a5d0 0x7fc3ac06ca90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc3c006c4a0 tx=0x7fc3b0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:08.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.650+0000 7f83e19ac700 1 --2- 172.21.15.84:0/1720986359 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83dc070840 0x7f83dc14d390 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f83d800c500 tx=0x7f83d800c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:08.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.650+0000 7f2c81ffe700 1 Processor -- start 2023-09-13T08:25:08.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.650+0000 7f2c81ffe700 1 -- start start 2023-09-13T08:25:08.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.649+0000 7f7394ddb700 1 -- 172.21.15.84:0/3829465274 shutdown_connections 2023-09-13T08:25:08.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.649+0000 7f7394ddb700 1 --2- 172.21.15.84:0/3829465274 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f73901595e0 0x7f739006cf70 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:08.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.649+0000 7f7394ddb700 1 --2- 172.21.15.84:0/3829465274 >> v2:172.21.15.161:3300/0 conn(0x7f73900c9770 0x7f7390070300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:08.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.649+0000 7f7394ddb700 1 -- 172.21.15.84:0/3829465274 >> 172.21.15.84:0/3829465274 conn(0x7f73900b0a20 msgr2=0x7f73900b0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:08.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.649+0000 7f7394ddb700 1 -- 172.21.15.84:0/3829465274 shutdown_connections 2023-09-13T08:25:08.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.649+0000 7f7394ddb700 1 -- 172.21.15.84:0/3829465274 wait complete. 2023-09-13T08:25:08.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.651+0000 7f7394ddb700 1 Processor -- start 2023-09-13T08:25:08.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.651+0000 7f2c81ffe700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2c7c0b2b20 0x7f2c7c15ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:08.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.651+0000 7f2c81ffe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2c7c0ce780 0x7f2c7c0b66b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:08.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.652+0000 7f2c81ffe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c7c161b90 0x7f2c7c143010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:08.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.652+0000 7f2c81ffe700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c7c0b6bf0 con 0x7f2c7c161b90 2023-09-13T08:25:08.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.652+0000 7f2c81ffe700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c7c13df50 con 0x7f2c7c0ce780 2023-09-13T08:25:08.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.652+0000 7f2c81ffe700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c7c13e230 con 0x7f2c7c0b2b20 2023-09-13T08:25:08.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.652+0000 7f2c7bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c7c161b90 0x7f2c7c143010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:08.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.651+0000 7f7394ddb700 1 -- start start 2023-09-13T08:25:08.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.652+0000 7f7394ddb700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7390070840 0x7f7390158560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:08.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.652+0000 7f7394ddb700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73900c9770 0x7f73900c4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:08.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.652+0000 7f7394ddb700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f73901595e0 0x7f73900c7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:08.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.652+0000 7f7394ddb700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73900b4940 con 0x7f73900c9770 2023-09-13T08:25:08.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.652+0000 7f7394ddb700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73900c3690 con 0x7f73901595e0 2023-09-13T08:25:08.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.652+0000 7f7394ddb700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73900c3970 con 0x7f7390070840 2023-09-13T08:25:08.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.652+0000 7f738e59c700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7390070840 0x7f7390158560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:08.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.652+0000 7f738e59c700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7390070840 0x7f7390158560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.84:53742/0 (socket says 172.21.15.84:53742) 2023-09-13T08:25:08.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.652+0000 7f738e59c700 1 -- 172.21.15.84:0/1421267535 learned_addr learned my addr 172.21.15.84:0/1421267535 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:08.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.652+0000 7f2c7bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c7c161b90 0x7f2c7c143010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43874/0 (socket says 172.21.15.84:43874) 2023-09-13T08:25:08.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.652+0000 7f2c7bfff700 1 -- 172.21.15.84:0/2637983962 learned_addr learned my addr 172.21.15.84:0/2637983962 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:08.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.652+0000 7f2c7b7fe700 1 --2- 172.21.15.84:0/2637983962 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2c7c0b2b20 0x7f2c7c15ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:08.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.652+0000 7f738ed9d700 1 --2- 172.21.15.84:0/1421267535 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f73901595e0 0x7f73900c7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:08.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.652+0000 7f738e59c700 1 -- 172.21.15.84:0/1421267535 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f73901595e0 msgr2=0x7f73900c7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:08.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.652+0000 7f738e59c700 1 --2- 172.21.15.84:0/1421267535 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f73901595e0 0x7f73900c7ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:08.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.652+0000 7f738e59c700 1 -- 172.21.15.84:0/1421267535 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73900c9770 msgr2=0x7f73900c4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:08.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.652+0000 7f738e59c700 1 --2- 172.21.15.84:0/1421267535 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73900c9770 0x7f73900c4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:08.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.652+0000 7f738e59c700 1 -- 172.21.15.84:0/1421267535 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7384009d30 con 0x7f7390070840 2023-09-13T08:25:08.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.653+0000 7f738e59c700 1 --2- 172.21.15.84:0/1421267535 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7390070840 0x7f7390158560 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f73840090b0 tx=0x7f7384004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:08.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.653+0000 7f2c7b7fe700 1 -- 172.21.15.84:0/2637983962 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2c7c0ce780 msgr2=0x7f2c7c0b66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:08.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.653+0000 7f2c7b7fe700 1 --2- 172.21.15.84:0/2637983962 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2c7c0ce780 0x7f2c7c0b66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:08.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.653+0000 7f2c7b7fe700 1 -- 172.21.15.84:0/2637983962 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c7c161b90 msgr2=0x7f2c7c143010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:08.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.653+0000 7f2c7b7fe700 1 --2- 172.21.15.84:0/2637983962 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c7c161b90 0x7f2c7c143010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:08.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.653+0000 7f2c7b7fe700 1 -- 172.21.15.84:0/2637983962 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c700094a0 con 0x7f2c7c0b2b20 2023-09-13T08:25:08.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.653+0000 7f737effd700 1 -- 172.21.15.84:0/1421267535 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73840036a0 con 0x7f7390070840 2023-09-13T08:25:08.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.653+0000 7f737effd700 1 -- 172.21.15.84:0/1421267535 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f738401f070 con 0x7f7390070840 2023-09-13T08:25:08.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.653+0000 7f737effd700 1 -- 172.21.15.84:0/1421267535 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7384003a20 con 0x7f7390070840 2023-09-13T08:25:08.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.653+0000 7f2c7b7fe700 1 --2- 172.21.15.84:0/2637983962 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2c7c0b2b20 0x7f2c7c15ea30 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2c70016000 tx=0x7f2c70004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:08.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.653+0000 7f7394ddb700 1 -- 172.21.15.84:0/1421267535 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73900c3c50 con 0x7f7390070840 2023-09-13T08:25:08.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.654+0000 7f7394ddb700 1 -- 172.21.15.84:0/1421267535 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73900c4210 con 0x7f7390070840 2023-09-13T08:25:08.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.654+0000 7f7394ddb700 1 -- 172.21.15.84:0/1421267535 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f73900ca2f0 con 0x7f7390070840 2023-09-13T08:25:08.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.655+0000 7f737effd700 1 -- 172.21.15.84:0/1421267535 <== mon.2 v2:172.21.15.161:3301/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f7384003b80 con 0x7f7390070840 2023-09-13T08:25:08.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.655+0000 7f737effd700 1 --2- 172.21.15.84:0/1421267535 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f737006a5d0 0x7f737006ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:08.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.656+0000 7f737effd700 1 -- 172.21.15.84:0/1421267535 <== mon.2 v2:172.21.15.161:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7384021070 con 0x7f7390070840 2023-09-13T08:25:08.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.656+0000 7f738dd9b700 1 --2- 172.21.15.84:0/1421267535 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f737006a5d0 0x7f737006ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:08.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.656+0000 7f737effd700 1 --2- 172.21.15.84:0/1421267535 >> [v2:172.21.15.161:6808/980533466,v1:172.21.15.161:6809/980533466] conn(0x7f7370073c10 0x7f7370076050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:08.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.656+0000 7f737effd700 1 -- 172.21.15.84:0/1421267535 --> [v2:172.21.15.161:6808/980533466,v1:172.21.15.161:6809/980533466] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7370076720 con 0x7f7370073c10 2023-09-13T08:25:08.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.656+0000 7f737effd700 1 -- 172.21.15.84:0/1421267535 <== mon.2 v2:172.21.15.161:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f738408c9e0 con 0x7f7390070840 2023-09-13T08:25:08.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.656+0000 7f738ed9d700 1 --2- 172.21.15.84:0/1421267535 >> [v2:172.21.15.161:6808/980533466,v1:172.21.15.161:6809/980533466] conn(0x7f7370073c10 0x7f7370076050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:08.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.656+0000 7f738dd9b700 1 --2- 172.21.15.84:0/1421267535 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f737006a5d0 0x7f737006ca90 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f73900b3750 tx=0x7f738000a3f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:08.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.656+0000 7f738ed9d700 1 --2- 172.21.15.84:0/1421267535 >> [v2:172.21.15.161:6808/980533466,v1:172.21.15.161:6809/980533466] conn(0x7f7370073c10 0x7f7370076050 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:08.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.657+0000 7f737effd700 1 -- 172.21.15.84:0/1421267535 <== osd.6 v2:172.21.15.161:6808/980533466 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f7370076720 con 0x7f7370073c10 2023-09-13T08:25:08.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.649+0000 7ff7f9509700 1 --2- 172.21.15.84:0/714817765 >> [v2:172.21.15.161:6800/1303562374,v1:172.21.15.161:6801/1303562374] conn(0x7ff7d8073c10 0x7ff7d8076050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:08.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.649+0000 7ff7f9509700 1 --2- 172.21.15.84:0/714817765 >> [v2:172.21.15.161:6800/1303562374,v1:172.21.15.161:6801/1303562374] conn(0x7ff7d8073c10 0x7ff7d8076050 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:08.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.651+0000 7ff7f17fa700 1 -- 172.21.15.84:0/714817765 <== osd.4 v2:172.21.15.161:6800/1303562374 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7ff7d8076720 con 0x7ff7d8073c10 2023-09-13T08:25:08.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.659+0000 7f177a87e700 1 -- 172.21.15.84:0/1453563380 shutdown_connections 2023-09-13T08:25:08.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.659+0000 7f83d27fc700 1 -- 172.21.15.84:0/1720986359 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83d80052d0 con 0x7f83dc070840 2023-09-13T08:25:08.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.659+0000 7f83d27fc700 1 -- 172.21.15.84:0/1720986359 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83d8005430 con 0x7f83dc070840 2023-09-13T08:25:08.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.659+0000 7f83d27fc700 1 -- 172.21.15.84:0/1720986359 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83d80038a0 con 0x7f83dc070840 2023-09-13T08:25:08.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.660+0000 7f177a87e700 1 -- 172.21.15.84:0/1453563380 wait complete. 2023-09-13T08:25:08.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.661+0000 7f177a87e700 1 Processor -- start 2023-09-13T08:25:08.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.662+0000 7f83e3c10700 1 -- 172.21.15.84:0/1720986359 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83dc0b1d90 con 0x7f83dc070840 2023-09-13T08:25:08.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.662+0000 7f83e3c10700 1 -- 172.21.15.84:0/1720986359 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83dc0b2350 con 0x7f83dc070840 2023-09-13T08:25:08.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.663+0000 7f83e3c10700 1 -- 172.21.15.84:0/1720986359 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f83dc0ca2f0 con 0x7f83dc070840 2023-09-13T08:25:08.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.661+0000 7f177a87e700 1 -- start start 2023-09-13T08:25:08.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.663+0000 7f177a87e700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f175c005410 0x7f17741f2d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:08.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.663+0000 7f177a87e700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f17741f63d0 0x7f177415a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:08.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.663+0000 7f177a87e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17740c43b0 0x7f17740b0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:08.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.663+0000 7f177a87e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f177415df70 con 0x7f17740c43b0 2023-09-13T08:25:08.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.663+0000 7f177a87e700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17741f36c0 con 0x7f175c005410 2023-09-13T08:25:08.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.663+0000 7f177a87e700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17741f39a0 con 0x7f17741f63d0 2023-09-13T08:25:08.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.663+0000 7f1778e1b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17740c43b0 0x7f17740b0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:08.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.663+0000 7f1778e1b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17740c43b0 0x7f17740b0990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43890/0 (socket says 172.21.15.84:43890) 2023-09-13T08:25:08.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.663+0000 7f1778e1b700 1 -- 172.21.15.84:0/1592835198 learned_addr learned my addr 172.21.15.84:0/1592835198 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:08.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.664+0000 7f1773fff700 1 --2- 172.21.15.84:0/1592835198 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f175c005410 0x7f17741f2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:08.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.664+0000 7f1773fff700 1 -- 172.21.15.84:0/1592835198 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f17741f63d0 msgr2=0x7f177415a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:08.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.664+0000 7f1773fff700 1 --2- 172.21.15.84:0/1592835198 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f17741f63d0 0x7f177415a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:08.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.664+0000 7f1773fff700 1 -- 172.21.15.84:0/1592835198 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17740c43b0 msgr2=0x7f17740b0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:08.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.664+0000 7f1773fff700 1 --2- 172.21.15.84:0/1592835198 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17740c43b0 0x7f17740b0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:08.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.664+0000 7f1773fff700 1 -- 172.21.15.84:0/1592835198 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17741f3c80 con 0x7f175c005410 2023-09-13T08:25:08.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.663+0000 7f83d27fc700 1 -- 172.21.15.84:0/1720986359 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f83d8003a00 con 0x7f83dc070840 2023-09-13T08:25:08.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.664+0000 7f83d27fc700 1 --2- 172.21.15.84:0/1720986359 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f83c006a5d0 0x7f83c006ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:08.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.664+0000 7f83d27fc700 1 -- 172.21.15.84:0/1720986359 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f83d8088720 con 0x7f83dc070840 2023-09-13T08:25:08.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.664+0000 7f83e11ab700 1 --2- 172.21.15.84:0/1720986359 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f83c006a5d0 0x7f83c006ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:08.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.664+0000 7f83d27fc700 1 --2- 172.21.15.84:0/1720986359 >> [v2:172.21.15.161:6816/961120854,v1:172.21.15.161:6818/961120854] conn(0x7f83c0073c10 0x7f83c0076050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:08.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.664+0000 7f83d27fc700 1 -- 172.21.15.84:0/1720986359 --> [v2:172.21.15.161:6816/961120854,v1:172.21.15.161:6818/961120854] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f83c0076720 con 0x7f83c0073c10 2023-09-13T08:25:08.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.664+0000 7f83d27fc700 1 -- 172.21.15.84:0/1720986359 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f83d8088a90 con 0x7f83dc070840 2023-09-13T08:25:08.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.664+0000 7f83e11ab700 1 --2- 172.21.15.84:0/1720986359 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f83c006a5d0 0x7f83c006ca90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f83dc15e1d0 tx=0x7f83cc006cd0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:08.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.666+0000 7fbd49b14700 1 -- 172.21.15.84:0/3622525167 --> [v2:172.21.15.161:6817/2479691549,v1:172.21.15.161:6819/2479691549] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbd440cc260 con 0x7fbd30073c10 2023-09-13T08:25:08.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.667+0000 7fbd2bfff700 1 -- 172.21.15.84:0/3622525167 <== osd.7 v2:172.21.15.161:6817/2479691549 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbd380011c0 con 0x7fbd30073c10 2023-09-13T08:25:08.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.667+0000 7fbd49b14700 1 -- 172.21.15.84:0/3622525167 >> [v2:172.21.15.161:6817/2479691549,v1:172.21.15.161:6819/2479691549] conn(0x7fbd30073c10 msgr2=0x7fbd30076050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:08.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.667+0000 7fbd49b14700 1 --2- 172.21.15.84:0/3622525167 >> [v2:172.21.15.161:6817/2479691549,v1:172.21.15.161:6819/2479691549] conn(0x7fbd30073c10 0x7fbd30076050 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:08.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.667+0000 7fbd49b14700 1 -- 172.21.15.84:0/3622525167 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fbd3006a5d0 msgr2=0x7fbd3006ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:08.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.667+0000 7fbd49b14700 1 --2- 172.21.15.84:0/3622525167 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fbd3006a5d0 0x7fbd3006ca90 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbd34009840 tx=0x7fbd34010000 comp rx=0 tx=0).stop 2023-09-13T08:25:08.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.667+0000 7fbd49b14700 1 -- 172.21.15.84:0/3622525167 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbd440cbdd0 msgr2=0x7fbd44164300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:08.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.667+0000 7fbd49b14700 1 --2- 172.21.15.84:0/3622525167 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbd440cbdd0 0x7fbd44164300 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c00c8c0 tx=0x7fbd3c00cc80 comp rx=0 tx=0).stop 2023-09-13T08:25:08.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.667+0000 7fbd43fff700 1 -- 172.21.15.84:0/3622525167 reap_dead start 2023-09-13T08:25:08.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.667+0000 7fbd49b14700 1 -- 172.21.15.84:0/3622525167 shutdown_connections 2023-09-13T08:25:08.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.667+0000 7fbd49b14700 1 -- 172.21.15.84:0/3622525167 >> 172.21.15.84:0/3622525167 conn(0x7fbd440b0a20 msgr2=0x7fbd44070230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:08.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.667+0000 7fbd49b14700 1 -- 172.21.15.84:0/3622525167 shutdown_connections 2023-09-13T08:25:08.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.667+0000 7fbd49b14700 1 -- 172.21.15.84:0/3622525167 wait complete. 2023-09-13T08:25:08.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.668+0000 7f83e21ad700 1 --2- 172.21.15.84:0/1720986359 >> [v2:172.21.15.161:6816/961120854,v1:172.21.15.161:6818/961120854] conn(0x7f83c0073c10 0x7f83c0076050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:08.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.668+0000 7f83e21ad700 1 --2- 172.21.15.84:0/1720986359 >> [v2:172.21.15.161:6816/961120854,v1:172.21.15.161:6818/961120854] conn(0x7f83c0073c10 0x7f83c0076050 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:08.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.669+0000 7f83d27fc700 1 -- 172.21.15.84:0/1720986359 <== osd.5 v2:172.21.15.161:6816/961120854 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f83c0076720 con 0x7f83c0073c10 2023-09-13T08:25:08.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.672+0000 7f1773fff700 1 --2- 172.21.15.84:0/1592835198 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f175c005410 0x7f17741f2d70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1774069440 tx=0x7f176c00ccd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:08.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.672+0000 7f1770ff9700 1 -- 172.21.15.84:0/1592835198 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f176c003a00 con 0x7f175c005410 2023-09-13T08:25:08.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.672+0000 7f1770ff9700 1 -- 172.21.15.84:0/1592835198 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f176c003b60 con 0x7f175c005410 2023-09-13T08:25:08.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.672+0000 7f1770ff9700 1 -- 172.21.15.84:0/1592835198 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f176c0050d0 con 0x7f175c005410 2023-09-13T08:25:08.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.673+0000 7f177a87e700 1 -- 172.21.15.84:0/1592835198 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f177415db90 con 0x7f175c005410 2023-09-13T08:25:08.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.673+0000 7f177a87e700 1 -- 172.21.15.84:0/1592835198 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17741f3490 con 0x7f175c005410 2023-09-13T08:25:08.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.675+0000 7f1770ff9700 1 -- 172.21.15.84:0/1592835198 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f176c005230 con 0x7f175c005410 2023-09-13T08:25:08.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.676+0000 7f1770ff9700 1 --2- 172.21.15.84:0/1592835198 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f176006a580 0x7f176006ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:08.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.676+0000 7f1770ff9700 1 -- 172.21.15.84:0/1592835198 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f176c088190 con 0x7f175c005410 2023-09-13T08:25:08.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.679+0000 7f17737fe700 1 --2- 172.21.15.84:0/1592835198 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f176006a580 0x7f176006ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:08.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.679+0000 7f17737fe700 1 --2- 172.21.15.84:0/1592835198 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f176006a580 0x7f176006ca40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f17741f6810 tx=0x7f1768006cd0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:08.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.680+0000 7f177a87e700 1 --2- 172.21.15.84:0/1592835198 >> [v2:172.21.15.84:6800/1661609810,v1:172.21.15.84:6801/1661609810] conn(0x7f17740b0ed0 0x7f17740ca5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:08.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.680+0000 7f177a87e700 1 -- 172.21.15.84:0/1592835198 --> [v2:172.21.15.84:6800/1661609810,v1:172.21.15.84:6801/1661609810] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f177415e0b0 con 0x7f17740b0ed0 2023-09-13T08:25:08.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.680+0000 7fc3c5a7e700 1 -- 172.21.15.84:0/823583436 --> [v2:172.21.15.84:6816/1599532366,v1:172.21.15.84:6817/1599532366] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc3c01656e0 con 0x7fc3ac073c10 2023-09-13T08:25:08.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.680+0000 7fc3a7fff700 1 -- 172.21.15.84:0/823583436 <== osd.0 v2:172.21.15.84:6816/1599532366 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc3b4001500 con 0x7fc3ac073c10 2023-09-13T08:25:08.797 INFO:teuthology.orchestra.run.smithi084.stdout:55834574859 2023-09-13T08:25:08.798 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-09-13T08:25:08.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.682+0000 7fc3c5a7e700 1 -- 172.21.15.84:0/823583436 >> [v2:172.21.15.84:6816/1599532366,v1:172.21.15.84:6817/1599532366] conn(0x7fc3ac073c10 msgr2=0x7fc3ac076050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:08.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.682+0000 7fc3c5a7e700 1 --2- 172.21.15.84:0/823583436 >> [v2:172.21.15.84:6816/1599532366,v1:172.21.15.84:6817/1599532366] conn(0x7fc3ac073c10 0x7fc3ac076050 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:08.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.682+0000 7fc3c5a7e700 1 -- 172.21.15.84:0/823583436 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fc3ac06a5d0 msgr2=0x7fc3ac06ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:08.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.682+0000 7fc3c5a7e700 1 --2- 172.21.15.84:0/823583436 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fc3ac06a5d0 0x7fc3ac06ca90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc3c006c4a0 tx=0x7fc3b0008040 comp rx=0 tx=0).stop 2023-09-13T08:25:08.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.682+0000 7fc3c5a7e700 1 -- 172.21.15.84:0/823583436 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3c00c9aa0 msgr2=0x7fc3c00afde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:08.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.682+0000 7fc3c5a7e700 1 --2- 172.21.15.84:0/823583436 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3c00c9aa0 0x7fc3c00afde0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc3c00ca060 tx=0x7fc3b8004ad0 comp rx=0 tx=0).stop 2023-09-13T08:25:08.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.682+0000 7fc3bffff700 1 -- 172.21.15.84:0/823583436 reap_dead start 2023-09-13T08:25:08.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.682+0000 7fc3c5a7e700 1 -- 172.21.15.84:0/823583436 shutdown_connections 2023-09-13T08:25:08.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.682+0000 7fc3c5a7e700 1 -- 172.21.15.84:0/823583436 >> 172.21.15.84:0/823583436 conn(0x7fc3c00b0a20 msgr2=0x7fc3c015bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:08.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.682+0000 7fc3c5a7e700 1 -- 172.21.15.84:0/823583436 shutdown_connections 2023-09-13T08:25:08.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.682+0000 7fc3c5a7e700 1 -- 172.21.15.84:0/823583436 wait complete. 2023-09-13T08:25:08.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.682+0000 7ff7faf6c700 1 -- 172.21.15.84:0/714817765 --> [v2:172.21.15.161:6800/1303562374,v1:172.21.15.161:6801/1303562374] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff7f40c3950 con 0x7ff7d8073c10 2023-09-13T08:25:08.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.682+0000 7f2c63fff700 1 -- 172.21.15.84:0/2637983962 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c70004590 con 0x7f2c7c0b2b20 2023-09-13T08:25:08.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.683+0000 7f2c63fff700 1 -- 172.21.15.84:0/2637983962 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c7001f070 con 0x7f2c7c0b2b20 2023-09-13T08:25:08.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.683+0000 7f1778e1b700 1 --2- 172.21.15.84:0/1592835198 >> [v2:172.21.15.84:6800/1661609810,v1:172.21.15.84:6801/1661609810] conn(0x7f17740b0ed0 0x7f17740ca5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:08.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.683+0000 7f2c63fff700 1 -- 172.21.15.84:0/2637983962 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c700038e0 con 0x7f2c7c0b2b20 2023-09-13T08:25:08.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.683+0000 7f1778e1b700 1 --2- 172.21.15.84:0/1592835198 >> [v2:172.21.15.84:6800/1661609810,v1:172.21.15.84:6801/1661609810] conn(0x7f17740b0ed0 0x7f17740ca5e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:08.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.684+0000 7ff7f17fa700 1 -- 172.21.15.84:0/714817765 <== osd.4 v2:172.21.15.161:6800/1303562374 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff7f40c3950 con 0x7ff7d8073c10 2023-09-13T08:25:08.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.684+0000 7f613dc7e700 1 -- 172.21.15.84:0/3725963699 --> [v2:172.21.15.84:6808/1168316165,v1:172.21.15.84:6809/1168316165] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6118002d40 con 0x7f6124073ac0 2023-09-13T08:25:08.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.683+0000 7f2c81ffe700 1 -- 172.21.15.84:0/2637983962 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c7c13e510 con 0x7f2c7c0b2b20 2023-09-13T08:25:08.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.683+0000 7f2c81ffe700 1 -- 172.21.15.84:0/2637983962 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c7c13ead0 con 0x7f2c7c0b2b20 2023-09-13T08:25:08.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.684+0000 7f2c81ffe700 1 -- 172.21.15.84:0/2637983962 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2c5c000fc0 con 0x7f2c7c0b2b20 2023-09-13T08:25:08.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.684+0000 7f611ffff700 1 -- 172.21.15.84:0/3725963699 <== osd.2 v2:172.21.15.84:6808/1168316165 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6118002d40 con 0x7f6124073ac0 2023-09-13T08:25:08.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.684+0000 7ff7faf6c700 1 -- 172.21.15.84:0/714817765 >> [v2:172.21.15.161:6800/1303562374,v1:172.21.15.161:6801/1303562374] conn(0x7ff7d8073c10 msgr2=0x7ff7d8076050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:08.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.684+0000 7ff7faf6c700 1 --2- 172.21.15.84:0/714817765 >> [v2:172.21.15.161:6800/1303562374,v1:172.21.15.161:6801/1303562374] conn(0x7ff7d8073c10 0x7ff7d8076050 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:08.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.684+0000 7f1770ff9700 1 -- 172.21.15.84:0/1592835198 <== osd.3 v2:172.21.15.84:6800/1661609810 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f177415e0b0 con 0x7f17740b0ed0 2023-09-13T08:25:08.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.684+0000 7ff7faf6c700 1 -- 172.21.15.84:0/714817765 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7ff7d806a650 msgr2=0x7ff7d806cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:08.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.684+0000 7ff7faf6c700 1 --2- 172.21.15.84:0/714817765 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7ff7d806a650 0x7ff7d806cb10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff7e8009130 tx=0x7ff7e8008030 comp rx=0 tx=0).stop 2023-09-13T08:25:08.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.684+0000 7ff7faf6c700 1 -- 172.21.15.84:0/714817765 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff7f40b1540 msgr2=0x7ff7f40c4f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:08.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.684+0000 7ff7faf6c700 1 --2- 172.21.15.84:0/714817765 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff7f40b1540 0x7ff7f40c4f40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff7e000e7e0 tx=0x7ff7e000eaf0 comp rx=0 tx=0).stop 2023-09-13T08:25:08.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.684+0000 7ff7f9509700 1 -- 172.21.15.84:0/714817765 reap_dead start 2023-09-13T08:25:08.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.685+0000 7ff7faf6c700 1 -- 172.21.15.84:0/714817765 shutdown_connections 2023-09-13T08:25:08.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.685+0000 7ff7faf6c700 1 -- 172.21.15.84:0/714817765 >> 172.21.15.84:0/714817765 conn(0x7ff7f40b0a20 msgr2=0x7ff7f40aef90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:08.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.685+0000 7ff7faf6c700 1 -- 172.21.15.84:0/714817765 shutdown_connections 2023-09-13T08:25:08.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.685+0000 7ff7faf6c700 1 -- 172.21.15.84:0/714817765 wait complete. 2023-09-13T08:25:08.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.687+0000 7f613dc7e700 1 -- 172.21.15.84:0/3725963699 >> [v2:172.21.15.84:6808/1168316165,v1:172.21.15.84:6809/1168316165] conn(0x7f6124073ac0 msgr2=0x7f6124075f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:08.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.687+0000 7f613dc7e700 1 --2- 172.21.15.84:0/3725963699 >> [v2:172.21.15.84:6808/1168316165,v1:172.21.15.84:6809/1168316165] conn(0x7f6124073ac0 0x7f6124075f00 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:08.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.688+0000 7f7394ddb700 1 -- 172.21.15.84:0/1421267535 --> [v2:172.21.15.161:6808/980533466,v1:172.21.15.161:6809/980533466] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f73900ca010 con 0x7f7370073c10 2023-09-13T08:25:08.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.688+0000 7f737effd700 1 -- 172.21.15.84:0/1421267535 <== osd.6 v2:172.21.15.161:6808/980533466 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7388002060 con 0x7f7370073c10 2023-09-13T08:25:08.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.689+0000 7f2c63fff700 1 -- 172.21.15.84:0/2637983962 <== mon.2 v2:172.21.15.161:3301/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f2c70003a40 con 0x7f2c7c0b2b20 2023-09-13T08:25:08.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.689+0000 7f7394ddb700 1 -- 172.21.15.84:0/1421267535 >> [v2:172.21.15.161:6808/980533466,v1:172.21.15.161:6809/980533466] conn(0x7f7370073c10 msgr2=0x7f7370076050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:08.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.689+0000 7f7394ddb700 1 --2- 172.21.15.84:0/1421267535 >> [v2:172.21.15.161:6808/980533466,v1:172.21.15.161:6809/980533466] conn(0x7f7370073c10 0x7f7370076050 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:08.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.689+0000 7f2c63fff700 1 --2- 172.21.15.84:0/2637983962 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f2c6806a5d0 0x7f2c6806ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:08.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.689+0000 7f7394ddb700 1 -- 172.21.15.84:0/1421267535 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f737006a5d0 msgr2=0x7f737006ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:08.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.689+0000 7f7394ddb700 1 --2- 172.21.15.84:0/1421267535 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f737006a5d0 0x7f737006ca90 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f73900b3750 tx=0x7f738000a3f0 comp rx=0 tx=0).stop 2023-09-13T08:25:08.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.689+0000 7f7394ddb700 1 -- 172.21.15.84:0/1421267535 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7390070840 msgr2=0x7f7390158560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:08.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.689+0000 7f2c63fff700 1 -- 172.21.15.84:0/2637983962 <== mon.2 v2:172.21.15.161:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2c70021070 con 0x7f2c7c0b2b20 2023-09-13T08:25:08.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.689+0000 7f7394ddb700 1 --2- 172.21.15.84:0/1421267535 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7390070840 0x7f7390158560 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f73840090b0 tx=0x7f7384004750 comp rx=0 tx=0).stop 2023-09-13T08:25:08.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.689+0000 7f738ed9d700 1 -- 172.21.15.84:0/1421267535 reap_dead start 2023-09-13T08:25:08.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.689+0000 7f7394ddb700 1 -- 172.21.15.84:0/1421267535 shutdown_connections 2023-09-13T08:25:08.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.689+0000 7f7394ddb700 1 -- 172.21.15.84:0/1421267535 >> 172.21.15.84:0/1421267535 conn(0x7f73900b0a20 msgr2=0x7f73900aec80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:08.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.690+0000 7f2c63fff700 1 --2- 172.21.15.84:0/2637983962 >> [v2:172.21.15.84:6824/461860977,v1:172.21.15.84:6825/461860977] conn(0x7f2c68073c10 0x7f2c68076050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:08.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.690+0000 7f7394ddb700 1 -- 172.21.15.84:0/1421267535 shutdown_connections 2023-09-13T08:25:08.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.690+0000 7f2c63fff700 1 -- 172.21.15.84:0/2637983962 --> [v2:172.21.15.84:6824/461860977,v1:172.21.15.84:6825/461860977] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2c68076720 con 0x7f2c68073c10 2023-09-13T08:25:08.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.690+0000 7f2c63fff700 1 -- 172.21.15.84:0/2637983962 <== mon.2 v2:172.21.15.161:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2c7008ae20 con 0x7f2c7c0b2b20 2023-09-13T08:25:08.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.690+0000 7f7394ddb700 1 -- 172.21.15.84:0/1421267535 wait complete. 2023-09-13T08:25:08.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.690+0000 7f83e3c10700 1 -- 172.21.15.84:0/1720986359 --> [v2:172.21.15.161:6816/961120854,v1:172.21.15.161:6818/961120854] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f83dc0b2ae0 con 0x7f83c0073c10 2023-09-13T08:25:08.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.691+0000 7f613dc7e700 1 -- 172.21.15.84:0/3725963699 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f612406a580 msgr2=0x7f612406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:08.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.691+0000 7f613dc7e700 1 --2- 172.21.15.84:0/3725963699 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f612406a580 0x7f612406ca40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6138152880 tx=0x7f612c009040 comp rx=0 tx=0).stop 2023-09-13T08:25:08.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.691+0000 7f613dc7e700 1 -- 172.21.15.84:0/3725963699 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61380702c0 msgr2=0x7f61381feab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:08.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.691+0000 7f83d27fc700 1 -- 172.21.15.84:0/1720986359 <== osd.5 v2:172.21.15.161:6816/961120854 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f83d40079b0 con 0x7f83c0073c10 2023-09-13T08:25:08.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.691+0000 7f613dc7e700 1 --2- 172.21.15.84:0/3725963699 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61380702c0 0x7f61381feab0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f612800c7c0 tx=0x7f612800cad0 comp rx=0 tx=0).stop 2023-09-13T08:25:08.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.691+0000 7f6137fff700 1 -- 172.21.15.84:0/3725963699 reap_dead start 2023-09-13T08:25:08.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.691+0000 7f613dc7e700 1 -- 172.21.15.84:0/3725963699 shutdown_connections 2023-09-13T08:25:08.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.691+0000 7f613dc7e700 1 -- 172.21.15.84:0/3725963699 >> 172.21.15.84:0/3725963699 conn(0x7f61380b0a20 msgr2=0x7f61380aefb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:08.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.691+0000 7f2c7affd700 1 --2- 172.21.15.84:0/2637983962 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f2c6806a5d0 0x7f2c6806ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:08.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.691+0000 7f2c7affd700 1 --2- 172.21.15.84:0/2637983962 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f2c6806a5d0 0x7f2c6806ca90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2c7c15ef70 tx=0x7f2c6c007ad0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:08.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.693+0000 7f613dc7e700 1 -- 172.21.15.84:0/3725963699 shutdown_connections 2023-09-13T08:25:08.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.693+0000 7f613dc7e700 1 -- 172.21.15.84:0/3725963699 wait complete. 2023-09-13T08:25:08.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.695+0000 7f83e3c10700 1 -- 172.21.15.84:0/1720986359 >> [v2:172.21.15.161:6816/961120854,v1:172.21.15.161:6818/961120854] conn(0x7f83c0073c10 msgr2=0x7f83c0076050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:08.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.695+0000 7f83e3c10700 1 --2- 172.21.15.84:0/1720986359 >> [v2:172.21.15.161:6816/961120854,v1:172.21.15.161:6818/961120854] conn(0x7f83c0073c10 0x7f83c0076050 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:08.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.695+0000 7f83e3c10700 1 -- 172.21.15.84:0/1720986359 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f83c006a5d0 msgr2=0x7f83c006ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:08.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.695+0000 7f83e3c10700 1 --2- 172.21.15.84:0/1720986359 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f83c006a5d0 0x7f83c006ca90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f83dc15e1d0 tx=0x7f83cc006cd0 comp rx=0 tx=0).stop 2023-09-13T08:25:08.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.695+0000 7f83e3c10700 1 -- 172.21.15.84:0/1720986359 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83dc070840 msgr2=0x7f83dc14d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:08.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.695+0000 7f83e3c10700 1 --2- 172.21.15.84:0/1720986359 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83dc070840 0x7f83dc14d390 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f83d800c500 tx=0x7f83d800c8c0 comp rx=0 tx=0).stop 2023-09-13T08:25:08.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.695+0000 7f83e21ad700 1 -- 172.21.15.84:0/1720986359 reap_dead start 2023-09-13T08:25:08.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.700+0000 7f2c7bfff700 1 --2- 172.21.15.84:0/2637983962 >> [v2:172.21.15.84:6824/461860977,v1:172.21.15.84:6825/461860977] conn(0x7f2c68073c10 0x7f2c68076050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:08.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.700+0000 7f83e3c10700 1 -- 172.21.15.84:0/1720986359 shutdown_connections 2023-09-13T08:25:08.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.700+0000 7f83e3c10700 1 -- 172.21.15.84:0/1720986359 >> 172.21.15.84:0/1720986359 conn(0x7f83dc0b0a20 msgr2=0x7f83dc0cf4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:08.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.700+0000 7f83e3c10700 1 -- 172.21.15.84:0/1720986359 shutdown_connections 2023-09-13T08:25:08.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.700+0000 7f83e3c10700 1 -- 172.21.15.84:0/1720986359 wait complete. 2023-09-13T08:25:08.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.700+0000 7f2c7bfff700 1 --2- 172.21.15.84:0/2637983962 >> [v2:172.21.15.84:6824/461860977,v1:172.21.15.84:6825/461860977] conn(0x7f2c68073c10 0x7f2c68076050 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:08.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.701+0000 7f2c63fff700 1 -- 172.21.15.84:0/2637983962 <== osd.1 v2:172.21.15.84:6824/461860977 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f2c68076720 con 0x7f2c68073c10 2023-09-13T08:25:08.826 INFO:teuthology.orchestra.run.smithi084.stdout:55834574859 2023-09-13T08:25:08.827 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-09-13T08:25:08.828 INFO:teuthology.orchestra.run.smithi084.stdout:55834574860 2023-09-13T08:25:08.828 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-13T08:25:08.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.706+0000 7f177a87e700 1 -- 172.21.15.84:0/1592835198 --> [v2:172.21.15.84:6800/1661609810,v1:172.21.15.84:6801/1661609810] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f177404e9b0 con 0x7f17740b0ed0 2023-09-13T08:25:08.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.707+0000 7f1770ff9700 1 -- 172.21.15.84:0/1592835198 <== osd.3 v2:172.21.15.84:6800/1661609810 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f177404e9b0 con 0x7f17740b0ed0 2023-09-13T08:25:08.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.708+0000 7f177a87e700 1 -- 172.21.15.84:0/1592835198 >> [v2:172.21.15.84:6800/1661609810,v1:172.21.15.84:6801/1661609810] conn(0x7f17740b0ed0 msgr2=0x7f17740ca5e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:08.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.708+0000 7f177a87e700 1 --2- 172.21.15.84:0/1592835198 >> [v2:172.21.15.84:6800/1661609810,v1:172.21.15.84:6801/1661609810] conn(0x7f17740b0ed0 0x7f17740ca5e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:08.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.708+0000 7f177a87e700 1 -- 172.21.15.84:0/1592835198 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f176006a580 msgr2=0x7f176006ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:08.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.708+0000 7f177a87e700 1 --2- 172.21.15.84:0/1592835198 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f176006a580 0x7f176006ca40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f17741f6810 tx=0x7f1768006cd0 comp rx=0 tx=0).stop 2023-09-13T08:25:08.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.708+0000 7f177a87e700 1 -- 172.21.15.84:0/1592835198 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f175c005410 msgr2=0x7f17741f2d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:08.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.708+0000 7f177a87e700 1 --2- 172.21.15.84:0/1592835198 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f175c005410 0x7f17741f2d70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1774069440 tx=0x7f176c00ccd0 comp rx=0 tx=0).stop 2023-09-13T08:25:08.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.708+0000 7f1778e1b700 1 -- 172.21.15.84:0/1592835198 reap_dead start 2023-09-13T08:25:08.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.708+0000 7f177a87e700 1 -- 172.21.15.84:0/1592835198 shutdown_connections 2023-09-13T08:25:08.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.708+0000 7f177a87e700 1 -- 172.21.15.84:0/1592835198 >> 172.21.15.84:0/1592835198 conn(0x7f17740cc230 msgr2=0x7f17740add90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:08.832 INFO:teuthology.orchestra.run.smithi084.stdout:55834574861 2023-09-13T08:25:08.833 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-09-13T08:25:08.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.711+0000 7f177a87e700 1 -- 172.21.15.84:0/1592835198 shutdown_connections 2023-09-13T08:25:08.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.711+0000 7f177a87e700 1 -- 172.21.15.84:0/1592835198 wait complete. 2023-09-13T08:25:08.834 INFO:teuthology.orchestra.run.smithi084.stdout:55834574860 2023-09-13T08:25:08.835 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-13T08:25:08.836 INFO:teuthology.orchestra.run.smithi084.stdout:55834574861 2023-09-13T08:25:08.836 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-09-13T08:25:08.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.719+0000 7f2c81ffe700 1 -- 172.21.15.84:0/2637983962 --> [v2:172.21.15.84:6824/461860977,v1:172.21.15.84:6825/461860977] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2c5c002d40 con 0x7f2c68073c10 2023-09-13T08:25:08.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.720+0000 7f2c63fff700 1 -- 172.21.15.84:0/2637983962 <== osd.1 v2:172.21.15.84:6824/461860977 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2c5c002d40 con 0x7f2c68073c10 2023-09-13T08:25:08.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.720+0000 7f2c81ffe700 1 -- 172.21.15.84:0/2637983962 >> [v2:172.21.15.84:6824/461860977,v1:172.21.15.84:6825/461860977] conn(0x7f2c68073c10 msgr2=0x7f2c68076050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:08.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.720+0000 7f2c81ffe700 1 --2- 172.21.15.84:0/2637983962 >> [v2:172.21.15.84:6824/461860977,v1:172.21.15.84:6825/461860977] conn(0x7f2c68073c10 0x7f2c68076050 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:08.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.720+0000 7f2c81ffe700 1 -- 172.21.15.84:0/2637983962 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f2c6806a5d0 msgr2=0x7f2c6806ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:08.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.720+0000 7f2c81ffe700 1 --2- 172.21.15.84:0/2637983962 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f2c6806a5d0 0x7f2c6806ca90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2c7c15ef70 tx=0x7f2c6c007ad0 comp rx=0 tx=0).stop 2023-09-13T08:25:08.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.720+0000 7f2c81ffe700 1 -- 172.21.15.84:0/2637983962 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2c7c0b2b20 msgr2=0x7f2c7c15ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:08.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.720+0000 7f2c81ffe700 1 --2- 172.21.15.84:0/2637983962 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2c7c0b2b20 0x7f2c7c15ea30 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2c70016000 tx=0x7f2c70004750 comp rx=0 tx=0).stop 2023-09-13T08:25:08.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.720+0000 7f2c7bfff700 1 -- 172.21.15.84:0/2637983962 reap_dead start 2023-09-13T08:25:08.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.720+0000 7f2c81ffe700 1 -- 172.21.15.84:0/2637983962 shutdown_connections 2023-09-13T08:25:08.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.720+0000 7f2c81ffe700 1 -- 172.21.15.84:0/2637983962 >> 172.21.15.84:0/2637983962 conn(0x7f2c7c0cdb20 msgr2=0x7f2c7c0cb6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:08.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.721+0000 7f2c81ffe700 1 -- 172.21.15.84:0/2637983962 shutdown_connections 2023-09-13T08:25:08.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:08.721+0000 7f2c81ffe700 1 -- 172.21.15.84:0/2637983962 wait complete. 2023-09-13T08:25:08.841 INFO:teuthology.orchestra.run.smithi084.stdout:55834574859 2023-09-13T08:25:08.841 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-13T08:25:08.842 INFO:teuthology.orchestra.run.smithi084.stdout:55834574859 2023-09-13T08:25:08.843 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-13T08:25:09.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.077+0000 7f3e58797700 1 Processor -- start 2023-09-13T08:25:09.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.075+0000 7f3c607fb700 1 Processor -- start 2023-09-13T08:25:09.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.075+0000 7f3c607fb700 1 -- start start 2023-09-13T08:25:09.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.076+0000 7f3c607fb700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3c581595e0 0x7f3c580cb860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:09.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.076+0000 7f3c607fb700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f3c58071c80 0x7f3c580cbda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:09.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.076+0000 7f3c607fb700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3c580721d0 0x7f3c5806c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:09.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.076+0000 7f3c607fb700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c580ccf40 con 0x7f3c580721d0 2023-09-13T08:25:09.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.076+0000 7f3c607fb700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c58070300 con 0x7f3c58071c80 2023-09-13T08:25:09.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.076+0000 7f3c607fb700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c580cc2e0 con 0x7f3c581595e0 2023-09-13T08:25:09.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.077+0000 7f3c5e597700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3c581595e0 0x7f3c580cb860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:09.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.077+0000 7f3c5e597700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3c581595e0 0x7f3c580cb860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.84:53770/0 (socket says 172.21.15.84:53770) 2023-09-13T08:25:09.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.077+0000 7f3c5e597700 1 -- 172.21.15.84:0/2278965007 learned_addr learned my addr 172.21.15.84:0/2278965007 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:09.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.077+0000 7f3c5dd96700 1 --2- 172.21.15.84:0/2278965007 >> v2:172.21.15.161:3300/0 conn(0x7f3c58071c80 0x7f3c580cbda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:09.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.077+0000 7f3c5e597700 1 -- 172.21.15.84:0/2278965007 >> v2:172.21.15.161:3300/0 conn(0x7f3c58071c80 msgr2=0x7f3c580cbda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:09.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.077+0000 7f3c5e597700 1 --2- 172.21.15.84:0/2278965007 >> v2:172.21.15.161:3300/0 conn(0x7f3c58071c80 0x7f3c580cbda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:09.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.077+0000 7f3c5e597700 1 -- 172.21.15.84:0/2278965007 >> v2:172.21.15.84:3300/0 conn(0x7f3c580721d0 msgr2=0x7f3c5806c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:09.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.077+0000 7f3c5e597700 1 --2- 172.21.15.84:0/2278965007 >> v2:172.21.15.84:3300/0 conn(0x7f3c580721d0 0x7f3c5806c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:09.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.077+0000 7f3c5e597700 1 -- 172.21.15.84:0/2278965007 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c580cd900 con 0x7f3c581595e0 2023-09-13T08:25:09.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.077+0000 7f3c5e597700 1 --2- 172.21.15.84:0/2278965007 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3c581595e0 0x7f3c580cb860 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3c58073e80 tx=0x7f3c48009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=113e6c146d5a0ec4 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:09.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.075+0000 7f53d7405700 1 Processor -- start 2023-09-13T08:25:09.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.075+0000 7f53d7405700 1 -- start start 2023-09-13T08:25:09.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.077+0000 7f53d7405700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f53d01619d0 0x7f53d00b6110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:09.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.077+0000 7f53d7405700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f53d00b26a0 0x7f53d00d0e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:09.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.077+0000 7f53d7405700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53d00b8010 con 0x7f53d00b6650 2023-09-13T08:25:09.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.077+0000 7f53d7405700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53d00b6b00 con 0x7f53d01619d0 2023-09-13T08:25:09.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.077+0000 7f53d7405700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53d00b82b0 con 0x7f53d00b26a0 2023-09-13T08:25:09.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.077+0000 7f53d59a2700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f53d00b26a0 0x7f53d00d0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:09.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.077+0000 7f53d59a2700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f53d00b26a0 0x7f53d00d0e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.84:53780/0 (socket says 172.21.15.84:53780) 2023-09-13T08:25:09.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.077+0000 7f53d59a2700 1 -- 172.21.15.84:0/2017164863 learned_addr learned my addr 172.21.15.84:0/2017164863 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:09.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.077+0000 7f53d51a1700 1 --2- 172.21.15.84:0/2017164863 >> v2:172.21.15.84:3300/0 conn(0x7f53d01619d0 0x7f53d00b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:09.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.077+0000 7f53d59a2700 1 -- 172.21.15.84:0/2017164863 >> v2:172.21.15.84:3300/0 conn(0x7f53d01619d0 msgr2=0x7f53d00b6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:09.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.077+0000 7f53d59a2700 1 --2- 172.21.15.84:0/2017164863 >> v2:172.21.15.84:3300/0 conn(0x7f53d01619d0 0x7f53d00b6110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:09.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.077+0000 7f53d59a2700 1 -- 172.21.15.84:0/2017164863 >> v1:172.21.15.161:6789/0 conn(0x7f53d00b6650 legacy=0x7f53d00b1f90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-13T08:25:09.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.077+0000 7f53d59a2700 1 -- 172.21.15.84:0/2017164863 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53d00b8590 con 0x7f53d00b26a0 2023-09-13T08:25:09.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.077+0000 7f53d51a1700 1 --2- 172.21.15.84:0/2017164863 >> v2:172.21.15.84:3300/0 conn(0x7f53d01619d0 0x7f53d00b6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T08:25:09.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.078+0000 7f53d59a2700 1 --2- 172.21.15.84:0/2017164863 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f53d00b26a0 0x7f53d00d0e90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f53c8009e50 tx=0x7f53c800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7746cb05b492a03 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:09.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.078+0000 7f3e58797700 1 -- start start 2023-09-13T08:25:09.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.078+0000 7f53c7fff700 1 -- 172.21.15.84:0/2017164863 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c800e070 con 0x7f53d00b26a0 2023-09-13T08:25:09.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.078+0000 7f53c7fff700 1 -- 172.21.15.84:0/2017164863 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53c8003a20 con 0x7f53d00b26a0 2023-09-13T08:25:09.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.078+0000 7f53c7fff700 1 -- 172.21.15.84:0/2017164863 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c8003dd0 con 0x7f53d00b26a0 2023-09-13T08:25:09.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.078+0000 7f2312452700 1 Processor -- start 2023-09-13T08:25:09.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.079+0000 7f53d7405700 1 -- 172.21.15.84:0/2017164863 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f53d00b26a0 msgr2=0x7f53d00d0e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:09.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.079+0000 7f53d7405700 1 --2- 172.21.15.84:0/2017164863 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f53d00b26a0 0x7f53d00d0e90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f53c8009e50 tx=0x7f53c800b330 comp rx=0 tx=0).stop 2023-09-13T08:25:09.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.079+0000 7f3e58797700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f3e500cb860 0x7f3e500cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:09.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.079+0000 7f3e58797700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e500cd070 con 0x7f3e500c9770 2023-09-13T08:25:09.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.079+0000 7f3e58797700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e500ccd40 con 0x7f3e501595e0 2023-09-13T08:25:09.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.079+0000 7f3e58797700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e500c9d30 con 0x7f3e500cb860 2023-09-13T08:25:09.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.079+0000 7f2312452700 1 -- start start 2023-09-13T08:25:09.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.079+0000 7f3c5d595700 1 -- 172.21.15.84:0/2278965007 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c48011630 con 0x7f3c581595e0 2023-09-13T08:25:09.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.079+0000 7f3e55d32700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f3e500c9770 0x7f3e50070300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:46566/0 (socket says 172.21.15.84:46566) 2023-09-13T08:25:09.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.079+0000 7f3e55d32700 1 -- 172.21.15.84:0/3040505689 learned_addr learned my addr 172.21.15.84:0/3040505689 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:25:09.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.079+0000 7f3e56d34700 1 --2- 172.21.15.84:0/3040505689 >> v2:172.21.15.161:3300/0 conn(0x7f3e500cb860 0x7f3e500cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:09.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.079+0000 7f3c5d595700 1 -- 172.21.15.84:0/2278965007 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c48011790 con 0x7f3c581595e0 2023-09-13T08:25:09.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.079+0000 7f3c5d595700 1 -- 172.21.15.84:0/2278965007 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c48011b20 con 0x7f3c581595e0 2023-09-13T08:25:09.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.080+0000 7f53d7405700 1 -- 172.21.15.84:0/2017164863 shutdown_connections 2023-09-13T08:25:09.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.080+0000 7f53d7405700 1 --2- 172.21.15.84:0/2017164863 >> v2:172.21.15.84:3300/0 conn(0x7f53d01619d0 0x7f53d00b6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:09.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.080+0000 7f53d7405700 1 --2- 172.21.15.84:0/2017164863 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f53d00b26a0 0x7f53d00d0e90 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:09.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.080+0000 7f53d7405700 1 -- 172.21.15.84:0/2017164863 >> 172.21.15.84:0/2017164863 conn(0x7f53d00d32c0 msgr2=0x7f53d00d36a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:09.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.080+0000 7f53d7405700 1 -- 172.21.15.84:0/2017164863 shutdown_connections 2023-09-13T08:25:09.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.080+0000 7f53d7405700 1 -- 172.21.15.84:0/2017164863 wait complete. 2023-09-13T08:25:09.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.080+0000 7f2312452700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f230c15d590 0x7f230c0ae3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:09.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.080+0000 7f2312452700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f230c161190 0x7f230c0c95a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:09.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.080+0000 7f2312452700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f230c0acb10 con 0x7f230c0cb8e0 2023-09-13T08:25:09.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.080+0000 7f2312452700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f230c162110 con 0x7f230c161190 2023-09-13T08:25:09.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.080+0000 7f2312452700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f230c161610 con 0x7f230c15d590 2023-09-13T08:25:09.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.080+0000 7f230bfff700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f230c15d590 0x7f230c0ae3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:09.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.080+0000 7f230bfff700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f230c15d590 0x7f230c0ae3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.84:53788/0 (socket says 172.21.15.84:53788) 2023-09-13T08:25:09.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.080+0000 7f230bfff700 1 -- 172.21.15.84:0/3367244710 learned_addr learned my addr 172.21.15.84:0/3367244710 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:09.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.083+0000 7f230b7fe700 1 --2- 172.21.15.84:0/3367244710 >> v2:172.21.15.161:3300/0 conn(0x7f230c161190 0x7f230c0c95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:09.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.083+0000 7f230bfff700 1 -- 172.21.15.84:0/3367244710 >> v2:172.21.15.161:3300/0 conn(0x7f230c161190 msgr2=0x7f230c0c95a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:09.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.083+0000 7f230bfff700 1 --2- 172.21.15.84:0/3367244710 >> v2:172.21.15.161:3300/0 conn(0x7f230c161190 0x7f230c0c95a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:09.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.083+0000 7f230bfff700 1 -- 172.21.15.84:0/3367244710 >> v1:172.21.15.84:6789/0 conn(0x7f230c0cb8e0 legacy=0x7f230c0acfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:09.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.083+0000 7f230bfff700 1 -- 172.21.15.84:0/3367244710 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f230c0c9ae0 con 0x7f230c15d590 2023-09-13T08:25:09.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.083+0000 7f230bfff700 1 --2- 172.21.15.84:0/3367244710 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f230c15d590 0x7f230c0ae3c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f23000098f0 tx=0x7f2300009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ba8e1282a098fb4 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:09.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.083+0000 7f230affd700 1 -- 172.21.15.84:0/3367244710 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2300004230 con 0x7f230c15d590 2023-09-13T08:25:09.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.083+0000 7f230affd700 1 -- 172.21.15.84:0/3367244710 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2300004390 con 0x7f230c15d590 2023-09-13T08:25:09.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.083+0000 7f230affd700 1 -- 172.21.15.84:0/3367244710 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23000036a0 con 0x7f230c15d590 2023-09-13T08:25:09.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.080+0000 7f3e56d34700 1 -- 172.21.15.84:0/3040505689 >> v1:172.21.15.161:6789/0 conn(0x7f3e501595e0 legacy=0x7f3e5006cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:09.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.080+0000 7f3e56d34700 1 -- 172.21.15.84:0/3040505689 >> v1:172.21.15.84:6789/0 conn(0x7f3e500c9770 legacy=0x7f3e50070300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:09.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.080+0000 7f3e56d34700 1 -- 172.21.15.84:0/3040505689 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e500ca010 con 0x7f3e500cb860 2023-09-13T08:25:09.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.080+0000 7f3e56d34700 1 --2- 172.21.15.84:0/3040505689 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3e500cb860 0x7f3e500cbcb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3e40009840 tx=0x7f3e40009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91404ee264f71582 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:09.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.080+0000 7f3c607fb700 1 -- 172.21.15.84:0/2278965007 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3c581595e0 msgr2=0x7f3c580cb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:09.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.080+0000 7f3c607fb700 1 --2- 172.21.15.84:0/2278965007 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3c581595e0 0x7f3c580cb860 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3c58073e80 tx=0x7f3c48009bd0 comp rx=0 tx=0).stop 2023-09-13T08:25:09.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.080+0000 7f3c607fb700 1 -- 172.21.15.84:0/2278965007 shutdown_connections 2023-09-13T08:25:09.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.080+0000 7f3c607fb700 1 --2- 172.21.15.84:0/2278965007 >> v2:172.21.15.84:3300/0 conn(0x7f3c580721d0 0x7f3c5806c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:09.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.080+0000 7f3c607fb700 1 --2- 172.21.15.84:0/2278965007 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3c581595e0 0x7f3c580cb860 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:09.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.080+0000 7f3c607fb700 1 --2- 172.21.15.84:0/2278965007 >> v2:172.21.15.161:3300/0 conn(0x7f3c58071c80 0x7f3c580cbda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:09.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.080+0000 7f3c607fb700 1 -- 172.21.15.84:0/2278965007 >> 172.21.15.84:0/2278965007 conn(0x7f3c580b0a20 msgr2=0x7f3c580b0e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:09.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.081+0000 7f3c607fb700 1 -- 172.21.15.84:0/2278965007 shutdown_connections 2023-09-13T08:25:09.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.081+0000 7f3c607fb700 1 -- 172.21.15.84:0/2278965007 wait complete. 2023-09-13T08:25:09.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.082+0000 7f3c607fb700 1 Processor -- start 2023-09-13T08:25:09.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.083+0000 7f3c607fb700 1 -- start start 2023-09-13T08:25:09.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.081+0000 7f53d7405700 1 Processor -- start 2023-09-13T08:25:09.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.081+0000 7f53d7405700 1 -- start start 2023-09-13T08:25:09.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.082+0000 7f53d7405700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f53d00b26a0 0x7f53d00c7d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:09.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.082+0000 7f53d7405700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f53d00b6650 0x7f53d01fa490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:09.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.082+0000 7f53d7405700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f53d01619d0 0x7f53d00ce540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:09.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.082+0000 7f53d7405700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d015e570 con 0x7f53d00b26a0 2023-09-13T08:25:09.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.082+0000 7f53d7405700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d015e850 con 0x7f53d01619d0 2023-09-13T08:25:09.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.082+0000 7f53d7405700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53d015eb30 con 0x7f53d00b6650 2023-09-13T08:25:09.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.082+0000 7f53d59a2700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f53d01619d0 0x7f53d00ce540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:09.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.082+0000 7f53d49a0700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f53d00b6650 0x7f53d01fa490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:09.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.082+0000 7f53d49a0700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f53d00b6650 0x7f53d01fa490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.84:53796/0 (socket says 172.21.15.84:53796) 2023-09-13T08:25:09.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.082+0000 7f53d59a2700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f53d01619d0 0x7f53d00ce540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.84:39706/0 (socket says 172.21.15.84:39706) 2023-09-13T08:25:09.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.082+0000 7f53d49a0700 1 -- 172.21.15.84:0/2015150998 learned_addr learned my addr 172.21.15.84:0/2015150998 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:09.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.083+0000 7f53d49a0700 1 -- 172.21.15.84:0/2015150998 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f53d01619d0 msgr2=0x7f53d00ce540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:09.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.083+0000 7f53d49a0700 1 --2- 172.21.15.84:0/2015150998 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f53d01619d0 0x7f53d00ce540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:09.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.083+0000 7f53d49a0700 1 -- 172.21.15.84:0/2015150998 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f53d00b26a0 msgr2=0x7f53d00c7d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:09.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.083+0000 7f53d49a0700 1 --2- 172.21.15.84:0/2015150998 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f53d00b26a0 0x7f53d00c7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:09.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.083+0000 7f53d49a0700 1 -- 172.21.15.84:0/2015150998 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53c8009b30 con 0x7f53d00b6650 2023-09-13T08:25:09.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.083+0000 7f53d49a0700 1 --2- 172.21.15.84:0/2015150998 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f53d00b6650 0x7f53d01fa490 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f53c000b470 tx=0x7f53c000b780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:09.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.084+0000 7f53d59a2700 1 --2- 172.21.15.84:0/2015150998 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f53d01619d0 0x7f53d00ce540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T08:25:09.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.084+0000 7f3e55531700 1 -- 172.21.15.84:0/3040505689 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e40004230 con 0x7f3e500cb860 2023-09-13T08:25:09.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.084+0000 7f3e55531700 1 -- 172.21.15.84:0/3040505689 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e40004390 con 0x7f3e500cb860 2023-09-13T08:25:09.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.084+0000 7f3e55531700 1 -- 172.21.15.84:0/3040505689 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e400036a0 con 0x7f3e500cb860 2023-09-13T08:25:09.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.084+0000 7f3c607fb700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3c58071c80 0x7f3c5815c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:09.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.084+0000 7f3c607fb700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c580721d0 0x7f3c580b4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:09.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.084+0000 7f3c607fb700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3c581595e0 0x7f3c581419f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:09.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.084+0000 7f3c607fb700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c580b4a60 con 0x7f3c580721d0 2023-09-13T08:25:09.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.084+0000 7f3c607fb700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c58149030 con 0x7f3c58071c80 2023-09-13T08:25:09.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.084+0000 7f3c607fb700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c58149310 con 0x7f3c581595e0 2023-09-13T08:25:09.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.084+0000 7f3c5e597700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3c58071c80 0x7f3c5815c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:09.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.084+0000 7f3c5e597700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3c58071c80 0x7f3c5815c750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.84:39708/0 (socket says 172.21.15.84:39708) 2023-09-13T08:25:09.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.084+0000 7f3c5e597700 1 -- 172.21.15.84:0/731429875 learned_addr learned my addr 172.21.15.84:0/731429875 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:09.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.084+0000 7f3c5dd96700 1 --2- 172.21.15.84:0/731429875 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c580721d0 0x7f3c580b4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:09.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.084+0000 7f3c5e597700 1 -- 172.21.15.84:0/731429875 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3c581595e0 msgr2=0x7f3c581419f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-13T08:25:09.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.084+0000 7f3c5e597700 1 --2- 172.21.15.84:0/731429875 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3c581595e0 0x7f3c581419f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:09.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.084+0000 7f3c5e597700 1 -- 172.21.15.84:0/731429875 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c580721d0 msgr2=0x7f3c580b4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:09.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.084+0000 7f3c5e597700 1 --2- 172.21.15.84:0/731429875 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c580721d0 0x7f3c580b4520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:09.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.084+0000 7f3c5e597700 1 -- 172.21.15.84:0/731429875 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c48009550 con 0x7f3c58071c80 2023-09-13T08:25:09.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.084+0000 7f2312452700 1 -- 172.21.15.84:0/3367244710 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f230c15d590 msgr2=0x7f230c0ae3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:09.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.084+0000 7f2312452700 1 --2- 172.21.15.84:0/3367244710 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f230c15d590 0x7f230c0ae3c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f23000098f0 tx=0x7f2300009c00 comp rx=0 tx=0).stop 2023-09-13T08:25:09.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.084+0000 7f2312452700 1 -- 172.21.15.84:0/3367244710 shutdown_connections 2023-09-13T08:25:09.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.084+0000 7f2312452700 1 --2- 172.21.15.84:0/3367244710 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f230c15d590 0x7f230c0ae3c0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:09.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.084+0000 7f2312452700 1 --2- 172.21.15.84:0/3367244710 >> v2:172.21.15.161:3300/0 conn(0x7f230c161190 0x7f230c0c95a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:09.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.084+0000 7f2312452700 1 -- 172.21.15.84:0/3367244710 >> 172.21.15.84:0/3367244710 conn(0x7f230c0b0a20 msgr2=0x7f230c0b0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:09.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.084+0000 7f2312452700 1 -- 172.21.15.84:0/3367244710 shutdown_connections 2023-09-13T08:25:09.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.084+0000 7f2312452700 1 -- 172.21.15.84:0/3367244710 wait complete. 2023-09-13T08:25:09.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.084+0000 7f3c5e597700 1 --2- 172.21.15.84:0/731429875 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3c58071c80 0x7f3c5815c750 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3c48039040 tx=0x7f3c48004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:09.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.085+0000 7f3c4effd700 1 -- 172.21.15.84:0/731429875 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c48011d10 con 0x7f3c58071c80 2023-09-13T08:25:09.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.085+0000 7f3c4effd700 1 -- 172.21.15.84:0/731429875 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c48041070 con 0x7f3c58071c80 2023-09-13T08:25:09.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.085+0000 7f3c4effd700 1 -- 172.21.15.84:0/731429875 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c480036a0 con 0x7f3c58071c80 2023-09-13T08:25:09.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.085+0000 7f3c607fb700 1 -- 172.21.15.84:0/731429875 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c581495f0 con 0x7f3c58071c80 2023-09-13T08:25:09.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.085+0000 7f3e58797700 1 -- 172.21.15.84:0/3040505689 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3e500cb860 msgr2=0x7f3e500cbcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:09.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.085+0000 7f3e58797700 1 --2- 172.21.15.84:0/3040505689 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3e500cb860 0x7f3e500cbcb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3e40009840 tx=0x7f3e40009b50 comp rx=0 tx=0).stop 2023-09-13T08:25:09.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.085+0000 7f3e58797700 1 -- 172.21.15.84:0/3040505689 shutdown_connections 2023-09-13T08:25:09.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.085+0000 7f3e58797700 1 --2- 172.21.15.84:0/3040505689 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3e500cb860 0x7f3e500cbcb0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:09.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.085+0000 7f3e58797700 1 -- 172.21.15.84:0/3040505689 >> 172.21.15.84:0/3040505689 conn(0x7f3e500b0a20 msgr2=0x7f3e500b0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:09.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.085+0000 7f3e58797700 1 -- 172.21.15.84:0/3040505689 shutdown_connections 2023-09-13T08:25:09.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.085+0000 7f3c607fb700 1 -- 172.21.15.84:0/731429875 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c58149bb0 con 0x7f3c58071c80 2023-09-13T08:25:09.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.086+0000 7f2312452700 1 Processor -- start 2023-09-13T08:25:09.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.086+0000 7f2312452700 1 -- start start 2023-09-13T08:25:09.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.087+0000 7f5e1be20700 1 Processor -- start 2023-09-13T08:25:09.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.087+0000 7f3c607fb700 1 -- 172.21.15.84:0/731429875 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c580ced10 con 0x7f3c58071c80 2023-09-13T08:25:09.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.085+0000 7f3e58797700 1 -- 172.21.15.84:0/3040505689 wait complete. 2023-09-13T08:25:09.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.087+0000 7f3e58797700 1 Processor -- start 2023-09-13T08:25:09.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.087+0000 7f3e58797700 1 -- start start 2023-09-13T08:25:09.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.088+0000 7f3c4effd700 1 -- 172.21.15.84:0/731429875 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f3c48003800 con 0x7f3c58071c80 2023-09-13T08:25:09.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.087+0000 7f53c5ffb700 1 -- 172.21.15.84:0/2015150998 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c0011830 con 0x7f53d00b6650 2023-09-13T08:25:09.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.087+0000 7f53c5ffb700 1 -- 172.21.15.84:0/2015150998 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53c00119b0 con 0x7f53d00b6650 2023-09-13T08:25:09.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.087+0000 7f53c5ffb700 1 -- 172.21.15.84:0/2015150998 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c0011d60 con 0x7f53d00b6650 2023-09-13T08:25:09.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.087+0000 7f53d7405700 1 -- 172.21.15.84:0/2015150998 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53d01fa9d0 con 0x7f53d00b6650 2023-09-13T08:25:09.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.087+0000 7f53d7405700 1 -- 172.21.15.84:0/2015150998 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53d00c8310 con 0x7f53d00b6650 2023-09-13T08:25:09.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.088+0000 7f3e58797700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e500c9770 0x7f3e5014ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:09.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.088+0000 7f3e58797700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3e500cb860 0x7f3e500b31b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:09.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.087+0000 7f2312452700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f230c0cb8e0 0x7f230c1ff560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:09.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.087+0000 7f2312452700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f230c15d590 0x7f230c0b3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:09.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.087+0000 7f2312452700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f230c161190 0x7f230c0b3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:09.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.087+0000 7f2312452700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f230c160910 con 0x7f230c0cb8e0 2023-09-13T08:25:09.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.087+0000 7f2312452700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f230c15fd00 con 0x7f230c15d590 2023-09-13T08:25:09.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.087+0000 7f2312452700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f230c15ffe0 con 0x7f230c161190 2023-09-13T08:25:09.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.088+0000 7f3c4effd700 1 --2- 172.21.15.84:0/731429875 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f3c3c06a580 0x7f3c3c06ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:09.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.088+0000 7f23109ef700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f230c161190 0x7f230c0b3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:09.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.089+0000 7f23109ef700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f230c161190 0x7f230c0b3c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.84:53806/0 (socket says 172.21.15.84:53806) 2023-09-13T08:25:09.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.089+0000 7f23109ef700 1 -- 172.21.15.84:0/3693315336 learned_addr learned my addr 172.21.15.84:0/3693315336 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:09.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.089+0000 7f230b7fe700 1 --2- 172.21.15.84:0/3693315336 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f230c15d590 0x7f230c0b3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:09.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.088+0000 7f3e58797700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3e501595e0 0x7f3e500b1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:09.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.088+0000 7f3e58797700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e500c2a40 con 0x7f3e500c9770 2023-09-13T08:25:09.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.088+0000 7f3e58797700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e500b3b20 con 0x7f3e501595e0 2023-09-13T08:25:09.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.088+0000 7f3e58797700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e500c2c90 con 0x7f3e500cb860 2023-09-13T08:25:09.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.088+0000 7f3e56d34700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3e501595e0 0x7f3e500b1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:09.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.089+0000 7f3e56d34700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3e501595e0 0x7f3e500b1ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.84:39722/0 (socket says 172.21.15.84:39722) 2023-09-13T08:25:09.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.089+0000 7f3e56d34700 1 -- 172.21.15.84:0/990028513 learned_addr learned my addr 172.21.15.84:0/990028513 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:09.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.089+0000 7f3e55d32700 1 --2- 172.21.15.84:0/990028513 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3e500cb860 0x7f3e500b31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:09.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.088+0000 7f3c4effd700 1 -- 172.21.15.84:0/731429875 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3c48043070 con 0x7f3c58071c80 2023-09-13T08:25:09.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.089+0000 7f3c5dd96700 1 --2- 172.21.15.84:0/731429875 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f3c3c06a580 0x7f3c3c06ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:09.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.089+0000 7f53d7405700 1 -- 172.21.15.84:0/2015150998 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53d004e9b0 con 0x7f53d00b6650 2023-09-13T08:25:09.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.089+0000 7f3e56d34700 1 -- 172.21.15.84:0/990028513 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3e500cb860 msgr2=0x7f3e500b31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:09.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.089+0000 7f3e56d34700 1 --2- 172.21.15.84:0/990028513 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3e500cb860 0x7f3e500b31b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:09.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.089+0000 7f3e56d34700 1 -- 172.21.15.84:0/990028513 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e500c9770 msgr2=0x7f3e5014ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:09.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.089+0000 7f3e56d34700 1 --2- 172.21.15.84:0/990028513 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e500c9770 0x7f3e5014ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:09.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.089+0000 7f3e56d34700 1 -- 172.21.15.84:0/990028513 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e400094a0 con 0x7f3e501595e0 2023-09-13T08:25:09.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.089+0000 7f230b7fe700 1 -- 172.21.15.84:0/3693315336 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f230c161190 msgr2=0x7f230c0b3c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:09.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.089+0000 7f230b7fe700 1 --2- 172.21.15.84:0/3693315336 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f230c161190 0x7f230c0b3c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:09.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.089+0000 7f230b7fe700 1 -- 172.21.15.84:0/3693315336 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f230c0cb8e0 msgr2=0x7f230c1ff560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:09.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.089+0000 7f230b7fe700 1 --2- 172.21.15.84:0/3693315336 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f230c0cb8e0 0x7f230c1ff560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:09.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.088+0000 7f5e1be20700 1 -- start start 2023-09-13T08:25:09.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.089+0000 7f230b7fe700 1 -- 172.21.15.84:0/3693315336 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2300009550 con 0x7f230c15d590 2023-09-13T08:25:09.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.089+0000 7f5e1be20700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5e141595e0 0x7f5e1406cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:09.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.089+0000 7f5e1be20700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5e140c9770 0x7f5e14070300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:09.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.089+0000 7f5e1be20700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e140cd070 con 0x7f5e14070840 2023-09-13T08:25:09.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.089+0000 7f5e1be20700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e140ccd40 con 0x7f5e140c9770 2023-09-13T08:25:09.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.089+0000 7f5e1be20700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e1406d4b0 con 0x7f5e141595e0 2023-09-13T08:25:09.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.090+0000 7f3c5dd96700 1 --2- 172.21.15.84:0/731429875 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f3c3c06a580 0x7f3c3c06ca40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3c5806c780 tx=0x7f3c5000b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:09.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.090+0000 7f5e193bb700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5e140c9770 0x7f5e14070300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:09.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.090+0000 7f5e19bbc700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5e141595e0 0x7f5e1406cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:09.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.090+0000 7f5e193bb700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5e140c9770 0x7f5e14070300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43956/0 (socket says 172.21.15.84:43956) 2023-09-13T08:25:09.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.090+0000 7f3e56d34700 1 --2- 172.21.15.84:0/990028513 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3e501595e0 0x7f3e500b1ad0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3e500678f0 tx=0x7f3e40004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:09.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.090+0000 7f5e193bb700 1 -- 172.21.15.84:0/3947062524 learned_addr learned my addr 172.21.15.84:0/3947062524 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:09.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.090+0000 7f53c5ffb700 1 -- 172.21.15.84:0/2015150998 <== mon.2 v2:172.21.15.161:3301/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f53c001a400 con 0x7f53d00b6650 2023-09-13T08:25:09.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.090+0000 7f230b7fe700 1 --2- 172.21.15.84:0/3693315336 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f230c15d590 0x7f230c0b3710 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f22fc00e870 tx=0x7f22fc00eb80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:09.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.090+0000 7f5e19bbc700 1 -- 172.21.15.84:0/3947062524 >> v2:172.21.15.84:3300/0 conn(0x7f5e140c9770 msgr2=0x7f5e14070300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:09.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.090+0000 7f5e19bbc700 1 --2- 172.21.15.84:0/3947062524 >> v2:172.21.15.84:3300/0 conn(0x7f5e140c9770 0x7f5e14070300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:09.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.090+0000 7f5e19bbc700 1 -- 172.21.15.84:0/3947062524 >> v1:172.21.15.161:6789/0 conn(0x7f5e14070840 legacy=0x7f5e140cb860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:09.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.090+0000 7f5e19bbc700 1 -- 172.21.15.84:0/3947062524 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e140c9d30 con 0x7f5e141595e0 2023-09-13T08:25:09.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.090+0000 7f53c5ffb700 1 --2- 172.21.15.84:0/2015150998 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f53b406a620 0x7f53b406cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:09.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.090+0000 7f5e19bbc700 1 --2- 172.21.15.84:0/3947062524 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5e141595e0 0x7f5e1406cf70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5e140cc680 tx=0x7f5e04009490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd6960c46cfdf9e7 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:09.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.090+0000 7f53c5ffb700 1 -- 172.21.15.84:0/2015150998 <== mon.2 v2:172.21.15.161:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f53c0089310 con 0x7f53d00b6650 2023-09-13T08:25:09.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.091+0000 7f53d51a1700 1 --2- 172.21.15.84:0/2015150998 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f53b406a620 0x7f53b406cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:09.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.091+0000 7f53d51a1700 1 --2- 172.21.15.84:0/2015150998 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f53b406a620 0x7f53b406cae0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f53cc007920 tx=0x7f53cc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:09.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.091+0000 7f682bc11700 1 Processor -- start 2023-09-13T08:25:09.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.091+0000 7f682bc11700 1 -- start start 2023-09-13T08:25:09.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.092+0000 7f13ad58e700 1 Processor -- start 2023-09-13T08:25:09.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.092+0000 7f13ad58e700 1 -- start start 2023-09-13T08:25:09.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.092+0000 7f682bc11700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f68240b6820 0x7f68240b1f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:09.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.092+0000 7f682bc11700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68240b8010 con 0x7f68241619d0 2023-09-13T08:25:09.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.092+0000 7f682bc11700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68240b2960 con 0x7f68240b24d0 2023-09-13T08:25:09.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.092+0000 7f682bc11700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68240b82b0 con 0x7f68240b6820 2023-09-13T08:25:09.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.092+0000 7f68299ad700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f68241619d0 0x7f68240b6110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:46608/0 (socket says 172.21.15.84:46608) 2023-09-13T08:25:09.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.092+0000 7f68299ad700 1 -- 172.21.15.84:0/3957107472 learned_addr learned my addr 172.21.15.84:0/3957107472 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:25:09.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.092+0000 7f68291ac700 1 --2- 172.21.15.84:0/3957107472 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f68240b6820 0x7f68240b1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:09.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.093+0000 7f68289ab700 1 -- 172.21.15.84:0/3957107472 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4100187712 0 0) 0x7f68240b8010 con 0x7f68241619d0 2023-09-13T08:25:09.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.093+0000 7f68289ab700 1 -- 172.21.15.84:0/3957107472 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68100035b0 con 0x7f68241619d0 2023-09-13T08:25:09.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.093+0000 7f68291ac700 1 -- 172.21.15.84:0/3957107472 >> v1:172.21.15.161:6789/0 conn(0x7f68240b24d0 legacy=0x7f68240d0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:09.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.093+0000 7f68291ac700 1 -- 172.21.15.84:0/3957107472 >> v1:172.21.15.84:6789/0 conn(0x7f68241619d0 legacy=0x7f68240b6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:09.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.093+0000 7f68291ac700 1 -- 172.21.15.84:0/3957107472 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68240b8590 con 0x7f68240b6820 2023-09-13T08:25:09.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.093+0000 7f13ad58e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f13a815b420 0x7f13a80b1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:09.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.093+0000 7f13ad58e700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13a80af210 con 0x7f13a806d360 2023-09-13T08:25:09.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.093+0000 7f13ad58e700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13a80af4f0 con 0x7f13a80aec10 2023-09-13T08:25:09.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.093+0000 7f13ad58e700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13a80b0330 con 0x7f13a815b420 2023-09-13T08:25:09.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.093+0000 7f13a77fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f13a806d360 0x7f13a80b2600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:46618/0 (socket says 172.21.15.84:46618) 2023-09-13T08:25:09.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.093+0000 7f13a77fe700 1 -- 172.21.15.84:0/1838591667 learned_addr learned my addr 172.21.15.84:0/1838591667 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:25:09.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.093+0000 7f68291ac700 1 --2- 172.21.15.84:0/3957107472 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f68240b6820 0x7f68240b1f90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f6814009870 tx=0x7f6814009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5886735ee3e857dd server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:09.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.093+0000 7f13a6ffd700 1 --2- 172.21.15.84:0/1838591667 >> v2:172.21.15.84:3300/0 conn(0x7f13a815b420 0x7f13a80b1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:09.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.093+0000 7f13a5ffb700 1 -- 172.21.15.84:0/1838591667 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2411289487 0 0) 0x7f13a80af210 con 0x7f13a806d360 2023-09-13T08:25:09.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.093+0000 7f13a5ffb700 1 -- 172.21.15.84:0/1838591667 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13900035b0 con 0x7f13a806d360 2023-09-13T08:25:09.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.093+0000 7f5e18bba700 1 -- 172.21.15.84:0/3947062524 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e04004230 con 0x7f5e141595e0 2023-09-13T08:25:09.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.094+0000 7f2308ff9700 1 -- 172.21.15.84:0/3693315336 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22fc013680 con 0x7f230c15d590 2023-09-13T08:25:09.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.094+0000 7f2308ff9700 1 -- 172.21.15.84:0/3693315336 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22fc0137e0 con 0x7f230c15d590 2023-09-13T08:25:09.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.094+0000 7f2308ff9700 1 -- 172.21.15.84:0/3693315336 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22fc013b70 con 0x7f230c15d590 2023-09-13T08:25:09.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.094+0000 7f2312452700 1 -- 172.21.15.84:0/3693315336 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f230c1602c0 con 0x7f230c15d590 2023-09-13T08:25:09.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.094+0000 7f2312452700 1 -- 172.21.15.84:0/3693315336 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f230c1ffaa0 con 0x7f230c15d590 2023-09-13T08:25:09.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.093+0000 7f3e46ffd700 1 -- 172.21.15.84:0/990028513 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e40011830 con 0x7f3e501595e0 2023-09-13T08:25:09.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.094+0000 7f3e46ffd700 1 -- 172.21.15.84:0/990028513 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e4001e070 con 0x7f3e501595e0 2023-09-13T08:25:09.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.094+0000 7f3e58797700 1 -- 172.21.15.84:0/990028513 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e500c2f70 con 0x7f3e501595e0 2023-09-13T08:25:09.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.094+0000 7f3e58797700 1 -- 172.21.15.84:0/990028513 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e5014b1b0 con 0x7f3e501595e0 2023-09-13T08:25:09.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.093+0000 7f13a5ffb700 1 -- 172.21.15.84:0/1838591667 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 233501457 0 0) 0x7f13a80af4f0 con 0x7f13a80aec10 2023-09-13T08:25:09.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.094+0000 7f13a5ffb700 1 -- 172.21.15.84:0/1838591667 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13a80af210 con 0x7f13a80aec10 2023-09-13T08:25:09.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.094+0000 7f5e18bba700 1 -- 172.21.15.84:0/3947062524 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e04004390 con 0x7f5e141595e0 2023-09-13T08:25:09.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.094+0000 7f5e18bba700 1 -- 172.21.15.84:0/3947062524 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e040036a0 con 0x7f5e141595e0 2023-09-13T08:25:09.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.095+0000 7f5e1be20700 1 -- 172.21.15.84:0/3947062524 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5e141595e0 msgr2=0x7f5e1406cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:09.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.095+0000 7f5e1be20700 1 --2- 172.21.15.84:0/3947062524 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5e141595e0 0x7f5e1406cf70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5e140cc680 tx=0x7f5e04009490 comp rx=0 tx=0).stop 2023-09-13T08:25:09.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.095+0000 7f3e58797700 1 -- 172.21.15.84:0/990028513 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e500b0810 con 0x7f3e501595e0 2023-09-13T08:25:09.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.095+0000 7f68289ab700 1 -- 172.21.15.84:0/3957107472 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6814011830 con 0x7f68240b6820 2023-09-13T08:25:09.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.095+0000 7f2312452700 1 -- 172.21.15.84:0/3693315336 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f230c04e9b0 con 0x7f230c15d590 2023-09-13T08:25:09.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.095+0000 7f53c5ffb700 1 -- 172.21.15.84:0/2015150998 <== mon.2 v2:172.21.15.161:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f53c0054580 con 0x7f53d00b6650 2023-09-13T08:25:09.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.096+0000 7f5e1be20700 1 -- 172.21.15.84:0/3947062524 shutdown_connections 2023-09-13T08:25:09.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.096+0000 7f5e1be20700 1 --2- 172.21.15.84:0/3947062524 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5e141595e0 0x7f5e1406cf70 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:09.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.096+0000 7f5e1be20700 1 --2- 172.21.15.84:0/3947062524 >> v2:172.21.15.84:3300/0 conn(0x7f5e140c9770 0x7f5e14070300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:09.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.096+0000 7f5e1be20700 1 -- 172.21.15.84:0/3947062524 >> 172.21.15.84:0/3947062524 conn(0x7f5e140b0a20 msgr2=0x7f5e140b0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:09.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.096+0000 7f68289ab700 1 -- 172.21.15.84:0/3957107472 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6814011990 con 0x7f68240b6820 2023-09-13T08:25:09.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.096+0000 7f68289ab700 1 -- 172.21.15.84:0/3957107472 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6814011d00 con 0x7f68240b6820 2023-09-13T08:25:09.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.096+0000 7f5e1be20700 1 -- 172.21.15.84:0/3947062524 shutdown_connections 2023-09-13T08:25:09.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.096+0000 7f5e1be20700 1 -- 172.21.15.84:0/3947062524 wait complete. 2023-09-13T08:25:09.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.096+0000 7f2308ff9700 1 -- 172.21.15.84:0/3693315336 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f22fc013cd0 con 0x7f230c15d590 2023-09-13T08:25:09.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.096+0000 7f2308ff9700 1 --2- 172.21.15.84:0/3693315336 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f22f806a580 0x7f22f806ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:09.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.097+0000 7f2308ff9700 1 -- 172.21.15.84:0/3693315336 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f22fc088ab0 con 0x7f230c15d590 2023-09-13T08:25:09.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.097+0000 7f682bc11700 1 -- 172.21.15.84:0/3957107472 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f68240b6820 msgr2=0x7f68240b1f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:09.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.097+0000 7f682bc11700 1 --2- 172.21.15.84:0/3957107472 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f68240b6820 0x7f68240b1f90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f6814009870 tx=0x7f6814009b80 comp rx=0 tx=0).stop 2023-09-13T08:25:09.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.097+0000 7f3e46ffd700 1 -- 172.21.15.84:0/990028513 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e40011bd0 con 0x7f3e501595e0 2023-09-13T08:25:09.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.097+0000 7f682bc11700 1 -- 172.21.15.84:0/3957107472 shutdown_connections 2023-09-13T08:25:09.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.097+0000 7f682bc11700 1 --2- 172.21.15.84:0/3957107472 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f68240b6820 0x7f68240b1f90 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:09.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.097+0000 7f682bc11700 1 -- 172.21.15.84:0/3957107472 >> 172.21.15.84:0/3957107472 conn(0x7f68240d32c0 msgr2=0x7f68240d36a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:09.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.094+0000 7f3c4effd700 1 -- 172.21.15.84:0/731429875 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f3c480777d0 con 0x7f3c58071c80 2023-09-13T08:25:09.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.098+0000 7f682bc11700 1 -- 172.21.15.84:0/3957107472 shutdown_connections 2023-09-13T08:25:09.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.094+0000 7f13a6ffd700 1 -- 172.21.15.84:0/1838591667 >> v1:172.21.15.161:6789/0 conn(0x7f13a80aec10 legacy=0x7f13a806cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:09.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.094+0000 7f13a6ffd700 1 -- 172.21.15.84:0/1838591667 >> v1:172.21.15.84:6789/0 conn(0x7f13a806d360 legacy=0x7f13a80b2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:09.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.094+0000 7f13a6ffd700 1 -- 172.21.15.84:0/1838591667 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13a80aff50 con 0x7f13a815b420 2023-09-13T08:25:09.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.094+0000 7f13a6ffd700 1 --2- 172.21.15.84:0/1838591667 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13a815b420 0x7f13a80b1da0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f1398009840 tx=0x7f1398009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8d1622911c4259e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:09.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.094+0000 7f13a5ffb700 1 -- 172.21.15.84:0/1838591667 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1398011830 con 0x7f13a815b420 2023-09-13T08:25:09.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.095+0000 7f13a5ffb700 1 -- 172.21.15.84:0/1838591667 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1398011990 con 0x7f13a815b420 2023-09-13T08:25:09.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.095+0000 7f13a5ffb700 1 -- 172.21.15.84:0/1838591667 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1398011d20 con 0x7f13a815b420 2023-09-13T08:25:09.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.098+0000 7f5e1be20700 1 Processor -- start 2023-09-13T08:25:09.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.096+0000 7f13ad58e700 1 -- 172.21.15.84:0/1838591667 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13a815b420 msgr2=0x7f13a80b1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:09.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.096+0000 7f13ad58e700 1 --2- 172.21.15.84:0/1838591667 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13a815b420 0x7f13a80b1da0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f1398009840 tx=0x7f1398009b50 comp rx=0 tx=0).stop 2023-09-13T08:25:09.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.097+0000 7f13ad58e700 1 -- 172.21.15.84:0/1838591667 shutdown_connections 2023-09-13T08:25:09.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.097+0000 7f13ad58e700 1 --2- 172.21.15.84:0/1838591667 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13a815b420 0x7f13a80b1da0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:09.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.097+0000 7f13ad58e700 1 -- 172.21.15.84:0/1838591667 >> 172.21.15.84:0/1838591667 conn(0x7f13a80cc230 msgr2=0x7f13a80cc640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:09.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.097+0000 7f13ad58e700 1 -- 172.21.15.84:0/1838591667 shutdown_connections 2023-09-13T08:25:09.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.097+0000 7f13ad58e700 1 -- 172.21.15.84:0/1838591667 wait complete. 2023-09-13T08:25:09.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.098+0000 7f682bc11700 1 -- 172.21.15.84:0/3957107472 wait complete. 2023-09-13T08:25:09.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.098+0000 7f5e1be20700 1 -- start start 2023-09-13T08:25:09.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.099+0000 7f13ad58e700 1 Processor -- start 2023-09-13T08:25:09.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.099+0000 7f5e1be20700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5e14070840 0x7f5e1414f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:09.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.099+0000 7f5e1be20700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5e140c9770 0x7f5e140aefc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:09.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.099+0000 7f5e1be20700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e141595e0 0x7f5e140af500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:09.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.099+0000 7f5e1be20700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e1414f4c0 con 0x7f5e141595e0 2023-09-13T08:25:09.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.099+0000 7f5e1be20700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e1414e8b0 con 0x7f5e140c9770 2023-09-13T08:25:09.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.099+0000 7f5e1be20700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e1414eb90 con 0x7f5e14070840 2023-09-13T08:25:09.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.099+0000 7f5e19bbc700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5e14070840 0x7f5e1414f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:09.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.099+0000 7f5e19bbc700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5e14070840 0x7f5e1414f950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.84:53838/0 (socket says 172.21.15.84:53838) 2023-09-13T08:25:09.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.099+0000 7f5e19bbc700 1 -- 172.21.15.84:0/3066569012 learned_addr learned my addr 172.21.15.84:0/3066569012 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:09.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.099+0000 7f5e193bb700 1 --2- 172.21.15.84:0/3066569012 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5e140c9770 0x7f5e140aefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:09.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.099+0000 7f682bc11700 1 Processor -- start 2023-09-13T08:25:09.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.099+0000 7f682bc11700 1 -- start start 2023-09-13T08:25:09.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.099+0000 7f5e193bb700 1 -- 172.21.15.84:0/3066569012 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5e14070840 msgr2=0x7f5e1414f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:09.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.100+0000 7f5e193bb700 1 --2- 172.21.15.84:0/3066569012 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5e14070840 0x7f5e1414f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:09.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.100+0000 7f5e193bb700 1 -- 172.21.15.84:0/3066569012 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e141595e0 msgr2=0x7f5e140af500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:09.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.100+0000 7f5e193bb700 1 --2- 172.21.15.84:0/3066569012 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e141595e0 0x7f5e140af500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:09.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.100+0000 7f5e193bb700 1 -- 172.21.15.84:0/3066569012 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e04009d30 con 0x7f5e140c9770 2023-09-13T08:25:09.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.100+0000 7f5e19bbc700 1 --2- 172.21.15.84:0/3066569012 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5e14070840 0x7f5e1414f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T08:25:09.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.100+0000 7f5e193bb700 1 --2- 172.21.15.84:0/3066569012 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5e140c9770 0x7f5e140aefc0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5e1000f980 tx=0x7f5e1000fc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:09.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.099+0000 7f13ad58e700 1 -- start start 2023-09-13T08:25:09.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.100+0000 7f13ad58e700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f13a806d360 0x7f13a80c92f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:09.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.100+0000 7f13ad58e700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f13a80aec10 0x7f13a815d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:09.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.100+0000 7f13ad58e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13a815b420 0x7f13a814d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:09.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.100+0000 7f13ad58e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13a815df30 con 0x7f13a815b420 2023-09-13T08:25:09.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.100+0000 7f13ad58e700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13a815e170 con 0x7f13a806d360 2023-09-13T08:25:09.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.100+0000 7f13ad58e700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13a815e450 con 0x7f13a80aec10 2023-09-13T08:25:09.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.100+0000 7f13a6ffd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f13a806d360 0x7f13a80c92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:09.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.100+0000 7f13a77fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13a815b420 0x7f13a814d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:09.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.100+0000 7f13a6ffd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f13a806d360 0x7f13a80c92f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.84:39752/0 (socket says 172.21.15.84:39752) 2023-09-13T08:25:09.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.100+0000 7f13a67fc700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f13a80aec10 0x7f13a815d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:09.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.100+0000 7f13a6ffd700 1 -- 172.21.15.84:0/3520586814 learned_addr learned my addr 172.21.15.84:0/3520586814 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:09.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.100+0000 7f13a6ffd700 1 -- 172.21.15.84:0/3520586814 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f13a80aec10 msgr2=0x7f13a815d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:09.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.101+0000 7f13a6ffd700 1 --2- 172.21.15.84:0/3520586814 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f13a80aec10 0x7f13a815d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:09.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.101+0000 7f13a6ffd700 1 -- 172.21.15.84:0/3520586814 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13a815b420 msgr2=0x7f13a814d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:09.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.101+0000 7f13a6ffd700 1 --2- 172.21.15.84:0/3520586814 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13a815b420 0x7f13a814d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:09.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.101+0000 7f13a6ffd700 1 -- 172.21.15.84:0/3520586814 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13980094a0 con 0x7f13a806d360 2023-09-13T08:25:09.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.101+0000 7f13a67fc700 1 --2- 172.21.15.84:0/3520586814 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f13a80aec10 0x7f13a815d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T08:25:09.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.101+0000 7f682bc11700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68240b24d0 0x7f68240ca390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:09.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.101+0000 7f682bc11700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f68240b6820 0x7f6824158ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:09.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.101+0000 7f682bc11700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68241619d0 0x7f68240d1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:09.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.101+0000 7f682bc11700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68240ca0d0 con 0x7f68241619d0 2023-09-13T08:25:09.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.101+0000 7f682bc11700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6824158ff0 con 0x7f68240b24d0 2023-09-13T08:25:09.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.101+0000 7f682bc11700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68240c9450 con 0x7f68240b6820 2023-09-13T08:25:09.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.101+0000 7f682a1ae700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68241619d0 0x7f68240d1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:09.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.101+0000 7f13a6ffd700 1 --2- 172.21.15.84:0/3520586814 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f13a806d360 0x7f13a80c92f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f13980090b0 tx=0x7f1398004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:09.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.101+0000 7f682a1ae700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68241619d0 0x7f68240d1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43990/0 (socket says 172.21.15.84:43990) 2023-09-13T08:25:09.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.101+0000 7f682a1ae700 1 -- 172.21.15.84:0/2783333905 learned_addr learned my addr 172.21.15.84:0/2783333905 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:09.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.101+0000 7f68291ac700 1 --2- 172.21.15.84:0/2783333905 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f68240b6820 0x7f6824158ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:09.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.101+0000 7f682a1ae700 1 -- 172.21.15.84:0/2783333905 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f68240b6820 msgr2=0x7f6824158ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:09.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.101+0000 7f682a1ae700 1 --2- 172.21.15.84:0/2783333905 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f68240b6820 0x7f6824158ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:09.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.101+0000 7f682a1ae700 1 -- 172.21.15.84:0/2783333905 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68240b24d0 msgr2=0x7f68240ca390 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-09-13T08:25:09.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.101+0000 7f682a1ae700 1 --2- 172.21.15.84:0/2783333905 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68240b24d0 0x7f68240ca390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:09.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.101+0000 7f682a1ae700 1 -- 172.21.15.84:0/2783333905 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68140094a0 con 0x7f68241619d0 2023-09-13T08:25:09.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.101+0000 7f682a1ae700 1 --2- 172.21.15.84:0/2783333905 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68241619d0 0x7f68240d1710 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f681c00cb50 tx=0x7f681c00ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:09.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.101+0000 7f681a7fc700 1 -- 172.21.15.84:0/2783333905 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f681c003c00 con 0x7f68241619d0 2023-09-13T08:25:09.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.101+0000 7f2308ff9700 1 -- 172.21.15.84:0/3693315336 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f22fc053dd0 con 0x7f230c15d590 2023-09-13T08:25:09.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.102+0000 7f681a7fc700 1 -- 172.21.15.84:0/2783333905 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f681c003d60 con 0x7f68241619d0 2023-09-13T08:25:09.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.102+0000 7f681a7fc700 1 -- 172.21.15.84:0/2783333905 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f681c00aac0 con 0x7f68241619d0 2023-09-13T08:25:09.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.102+0000 7f682bc11700 1 -- 172.21.15.84:0/2783333905 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68240c9730 con 0x7f68241619d0 2023-09-13T08:25:09.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.101+0000 7f5e0a7fc700 1 -- 172.21.15.84:0/3066569012 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e1000c070 con 0x7f5e140c9770 2023-09-13T08:25:09.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.102+0000 7f5e1be20700 1 -- 172.21.15.84:0/3066569012 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e1414ee70 con 0x7f5e140c9770 2023-09-13T08:25:09.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.102+0000 7f5e1be20700 1 -- 172.21.15.84:0/3066569012 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e1414fe90 con 0x7f5e140c9770 2023-09-13T08:25:09.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.103+0000 7f5e1be20700 1 -- 172.21.15.84:0/3066569012 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e1404e9b0 con 0x7f5e140c9770 2023-09-13T08:25:09.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.102+0000 7f138f7fe700 1 -- 172.21.15.84:0/3520586814 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1398024620 con 0x7f13a806d360 2023-09-13T08:25:09.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.102+0000 7f138f7fe700 1 -- 172.21.15.84:0/3520586814 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13980247a0 con 0x7f13a806d360 2023-09-13T08:25:09.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.102+0000 7f138f7fe700 1 -- 172.21.15.84:0/3520586814 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1398024b50 con 0x7f13a806d360 2023-09-13T08:25:09.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.104+0000 7f13ad58e700 1 -- 172.21.15.84:0/3520586814 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13a80c69b0 con 0x7f13a806d360 2023-09-13T08:25:09.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.104+0000 7f13ad58e700 1 -- 172.21.15.84:0/3520586814 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13a814d9d0 con 0x7f13a806d360 2023-09-13T08:25:09.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.104+0000 7f3e46ffd700 1 -- 172.21.15.84:0/990028513 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f3e40011d30 con 0x7f3e501595e0 2023-09-13T08:25:09.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.104+0000 7f3e46ffd700 1 --2- 172.21.15.84:0/990028513 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f3e3406a580 0x7f3e3406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:09.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.105+0000 7f230bfff700 1 --2- 172.21.15.84:0/3693315336 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f22f806a580 0x7f22f806ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:09.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.105+0000 7f3e46ffd700 1 -- 172.21.15.84:0/990028513 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3e4008a7b0 con 0x7f3e501595e0 2023-09-13T08:25:09.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.105+0000 7f3e56533700 1 --2- 172.21.15.84:0/990028513 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f3e3406a580 0x7f3e3406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:09.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.105+0000 7f5e0a7fc700 1 -- 172.21.15.84:0/3066569012 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e1000fed0 con 0x7f5e140c9770 2023-09-13T08:25:09.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.105+0000 7f5e0a7fc700 1 -- 172.21.15.84:0/3066569012 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e1000dd80 con 0x7f5e140c9770 2023-09-13T08:25:09.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.105+0000 7f230bfff700 1 --2- 172.21.15.84:0/3693315336 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f22f806a580 0x7f22f806ca40 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2300000c00 tx=0x7f2300010000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:09.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.105+0000 7f3e56533700 1 --2- 172.21.15.84:0/990028513 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f3e3406a580 0x7f3e3406ca40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3e48007fd0 tx=0x7f3e48007da0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:09.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.102+0000 7f682bc11700 1 -- 172.21.15.84:0/2783333905 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68240c9cf0 con 0x7f68241619d0 2023-09-13T08:25:09.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.103+0000 7f681a7fc700 1 -- 172.21.15.84:0/2783333905 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f681c00ac20 con 0x7f68241619d0 2023-09-13T08:25:09.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.104+0000 7f681a7fc700 1 --2- 172.21.15.84:0/2783333905 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f680806a580 0x7f680806ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:09.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.104+0000 7f681a7fc700 1 -- 172.21.15.84:0/2783333905 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f681c088d30 con 0x7f68241619d0 2023-09-13T08:25:09.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.107+0000 7f3e46ffd700 1 -- 172.21.15.84:0/990028513 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f3e40055ab0 con 0x7f3e501595e0 2023-09-13T08:25:09.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.107+0000 7f682bc11700 1 -- 172.21.15.84:0/2783333905 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f682404e9b0 con 0x7f68241619d0 2023-09-13T08:25:09.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.108+0000 7f13ad58e700 1 -- 172.21.15.84:0/3520586814 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13a80c6ed0 con 0x7f13a806d360 2023-09-13T08:25:09.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.108+0000 7f5e0a7fc700 1 -- 172.21.15.84:0/3066569012 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f5e10012460 con 0x7f5e140c9770 2023-09-13T08:25:09.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.108+0000 7f5e0a7fc700 1 --2- 172.21.15.84:0/3066569012 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f5df806a580 0x7f5df806ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:09.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.109+0000 7f5e0a7fc700 1 -- 172.21.15.84:0/3066569012 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5e10089410 con 0x7f5e140c9770 2023-09-13T08:25:09.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.108+0000 7f138f7fe700 1 -- 172.21.15.84:0/3520586814 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f1398022070 con 0x7f13a806d360 2023-09-13T08:25:09.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.109+0000 7f138f7fe700 1 --2- 172.21.15.84:0/3520586814 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f139406a5d0 0x7f139406ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:09.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.109+0000 7f138f7fe700 1 -- 172.21.15.84:0/3520586814 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1398089fd0 con 0x7f13a806d360 2023-09-13T08:25:09.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.110+0000 7f13a67fc700 1 --2- 172.21.15.84:0/3520586814 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f139406a5d0 0x7f139406ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:09.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.110+0000 7f5e19bbc700 1 --2- 172.21.15.84:0/3066569012 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f5df806a580 0x7f5df806ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:09.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.110+0000 7f68299ad700 1 --2- 172.21.15.84:0/2783333905 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f680806a580 0x7f680806ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:09.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.110+0000 7f5e19bbc700 1 --2- 172.21.15.84:0/3066569012 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f5df806a580 0x7f5df806ca40 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5e04000c00 tx=0x7f5e04008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:09.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.111+0000 7f13a67fc700 1 --2- 172.21.15.84:0/3520586814 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f139406a5d0 0x7f139406ca90 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f13a81511d0 tx=0x7f139c007db0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:09.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.111+0000 7f68299ad700 1 --2- 172.21.15.84:0/2783333905 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f680806a580 0x7f680806ca40 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6820007fd0 tx=0x7f6820007980 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:09.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.112+0000 7f5e0a7fc700 1 -- 172.21.15.84:0/3066569012 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f5e10054790 con 0x7f5e140c9770 2023-09-13T08:25:09.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.113+0000 7f8de78a2700 1 Processor -- start 2023-09-13T08:25:09.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.113+0000 7f8de78a2700 1 -- start start 2023-09-13T08:25:09.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.113+0000 7f681a7fc700 1 -- 172.21.15.84:0/2783333905 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f681c053fc0 con 0x7f68241619d0 2023-09-13T08:25:09.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.114+0000 7f8de78a2700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8de0159a50 0x7f8de00b1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:09.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.114+0000 7f8de78a2700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f8de00b1580 0x7f8de015d520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:09.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.114+0000 7f8de78a2700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8de015da60 0x7f8de00cb020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:09.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.115+0000 7f8de78a2700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8de0159e30 con 0x7f8de0159a50 2023-09-13T08:25:09.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.115+0000 7f8de78a2700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8de015e090 con 0x7f8de00b1580 2023-09-13T08:25:09.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.115+0000 7f8de78a2700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8de00b0560 con 0x7f8de015da60 2023-09-13T08:25:09.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.115+0000 7f8de5e3f700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8de015da60 0x7f8de00cb020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:09.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.115+0000 7f8de5e3f700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8de015da60 0x7f8de00cb020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.84:53868/0 (socket says 172.21.15.84:53868) 2023-09-13T08:25:09.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.115+0000 7f8de5e3f700 1 -- 172.21.15.84:0/1716747645 learned_addr learned my addr 172.21.15.84:0/1716747645 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:09.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.115+0000 7f8de563e700 1 --2- 172.21.15.84:0/1716747645 >> v2:172.21.15.84:3300/0 conn(0x7f8de0159a50 0x7f8de00b1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:09.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.115+0000 7f8de5e3f700 1 -- 172.21.15.84:0/1716747645 >> v2:172.21.15.161:3300/0 conn(0x7f8de00b1580 msgr2=0x7f8de015d520 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-13T08:25:09.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.115+0000 7f8de5e3f700 1 --2- 172.21.15.84:0/1716747645 >> v2:172.21.15.161:3300/0 conn(0x7f8de00b1580 0x7f8de015d520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:09.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.115+0000 7f8de5e3f700 1 -- 172.21.15.84:0/1716747645 >> v2:172.21.15.84:3300/0 conn(0x7f8de0159a50 msgr2=0x7f8de00b1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:09.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.115+0000 7f8de5e3f700 1 --2- 172.21.15.84:0/1716747645 >> v2:172.21.15.84:3300/0 conn(0x7f8de0159a50 0x7f8de00b1040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:09.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.115+0000 7f8de5e3f700 1 -- 172.21.15.84:0/1716747645 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8de00b0840 con 0x7f8de015da60 2023-09-13T08:25:09.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.116+0000 7f138f7fe700 1 -- 172.21.15.84:0/3520586814 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f13a80c6ed0 con 0x7f13a806d360 2023-09-13T08:25:09.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.117+0000 7f8de5e3f700 1 --2- 172.21.15.84:0/1716747645 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8de015da60 0x7f8de00cb020 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8de0072350 tx=0x7f8dd8014ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f3a7a9df3a7b3f3 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:09.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.117+0000 7f8dd7fff700 1 -- 172.21.15.84:0/1716747645 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dd8013af0 con 0x7f8de015da60 2023-09-13T08:25:09.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.117+0000 7f8dd7fff700 1 -- 172.21.15.84:0/1716747645 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dd8013c50 con 0x7f8de015da60 2023-09-13T08:25:09.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.117+0000 7f8dd7fff700 1 -- 172.21.15.84:0/1716747645 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dd8014000 con 0x7f8de015da60 2023-09-13T08:25:09.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.118+0000 7f8de78a2700 1 -- 172.21.15.84:0/1716747645 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8de015da60 msgr2=0x7f8de00cb020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:09.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.118+0000 7f8de78a2700 1 --2- 172.21.15.84:0/1716747645 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8de015da60 0x7f8de00cb020 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8de0072350 tx=0x7f8dd8014ce0 comp rx=0 tx=0).stop 2023-09-13T08:25:09.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.118+0000 7f8de78a2700 1 -- 172.21.15.84:0/1716747645 shutdown_connections 2023-09-13T08:25:09.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.118+0000 7f8de78a2700 1 --2- 172.21.15.84:0/1716747645 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8de015da60 0x7f8de00cb020 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:09.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.118+0000 7f8de78a2700 1 --2- 172.21.15.84:0/1716747645 >> v2:172.21.15.84:3300/0 conn(0x7f8de0159a50 0x7f8de00b1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:09.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.118+0000 7f8de78a2700 1 --2- 172.21.15.84:0/1716747645 >> v2:172.21.15.161:3300/0 conn(0x7f8de00b1580 0x7f8de015d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:09.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.118+0000 7f8de78a2700 1 -- 172.21.15.84:0/1716747645 >> 172.21.15.84:0/1716747645 conn(0x7f8de00cc230 msgr2=0x7f8de00cc640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:09.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.127+0000 7f8de78a2700 1 -- 172.21.15.84:0/1716747645 shutdown_connections 2023-09-13T08:25:09.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.127+0000 7f8de78a2700 1 -- 172.21.15.84:0/1716747645 wait complete. 2023-09-13T08:25:09.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.129+0000 7f8de78a2700 1 Processor -- start 2023-09-13T08:25:09.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.130+0000 7f8de78a2700 1 -- start start 2023-09-13T08:25:09.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.131+0000 7f8de78a2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8de0159a50 0x7f8de00c5f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:09.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.131+0000 7f8de78a2700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8de015da60 0x7f8de00b4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:09.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.131+0000 7f8de78a2700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8de01e8830 0x7f8de0202730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:09.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.131+0000 7f8de78a2700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8de00b4770 con 0x7f8de0159a50 2023-09-13T08:25:09.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.131+0000 7f8de78a2700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8de00b50d0 con 0x7f8de015da60 2023-09-13T08:25:09.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.131+0000 7f8de78a2700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8de00b3af0 con 0x7f8de01e8830 2023-09-13T08:25:09.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.132+0000 7f8de563e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8de0159a50 0x7f8de00c5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:09.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.132+0000 7f8de563e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8de0159a50 0x7f8de00c5f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44010/0 (socket says 172.21.15.84:44010) 2023-09-13T08:25:09.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.132+0000 7f8de563e700 1 -- 172.21.15.84:0/4067672461 learned_addr learned my addr 172.21.15.84:0/4067672461 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:09.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.132+0000 7f8de563e700 1 -- 172.21.15.84:0/4067672461 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8de01e8830 msgr2=0x7f8de0202730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:09.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.132+0000 7f8de563e700 1 --2- 172.21.15.84:0/4067672461 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8de01e8830 0x7f8de0202730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:09.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.132+0000 7f8de563e700 1 -- 172.21.15.84:0/4067672461 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8de015da60 msgr2=0x7f8de00b4b90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-09-13T08:25:09.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.132+0000 7f8de563e700 1 --2- 172.21.15.84:0/4067672461 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8de015da60 0x7f8de00b4b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:09.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.132+0000 7f8de563e700 1 -- 172.21.15.84:0/4067672461 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dd8014660 con 0x7f8de0159a50 2023-09-13T08:25:09.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.133+0000 7f8de563e700 1 --2- 172.21.15.84:0/4067672461 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8de0159a50 0x7f8de00c5f50 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8dd000e810 tx=0x7f8dd000ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:09.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.143+0000 7f8dd5ffb700 1 -- 172.21.15.84:0/4067672461 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dd0013610 con 0x7f8de0159a50 2023-09-13T08:25:09.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.143+0000 7f8dd5ffb700 1 -- 172.21.15.84:0/4067672461 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dd0013770 con 0x7f8de0159a50 2023-09-13T08:25:09.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.143+0000 7f8dd5ffb700 1 -- 172.21.15.84:0/4067672461 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dd0013b00 con 0x7f8de0159a50 2023-09-13T08:25:09.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.143+0000 7f8de78a2700 1 -- 172.21.15.84:0/4067672461 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8de00b3dd0 con 0x7f8de0159a50 2023-09-13T08:25:09.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.143+0000 7f8de78a2700 1 -- 172.21.15.84:0/4067672461 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8de00b4390 con 0x7f8de0159a50 2023-09-13T08:25:09.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.147+0000 7f8dd5ffb700 1 -- 172.21.15.84:0/4067672461 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f8dd0013c60 con 0x7f8de0159a50 2023-09-13T08:25:09.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.148+0000 7f8dd5ffb700 1 --2- 172.21.15.84:0/4067672461 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f8dcc06a7b0 0x7f8dcc06cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:09.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.148+0000 7f8dd5ffb700 1 -- 172.21.15.84:0/4067672461 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8dd0088970 con 0x7f8de0159a50 2023-09-13T08:25:09.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.149+0000 7f8de4e3d700 1 --2- 172.21.15.84:0/4067672461 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f8dcc06a7b0 0x7f8dcc06cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:09.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.149+0000 7f8de78a2700 1 -- 172.21.15.84:0/4067672461 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dc00052f0 con 0x7f8de0159a50 2023-09-13T08:25:09.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.149+0000 7f8de4e3d700 1 --2- 172.21.15.84:0/4067672461 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f8dcc06a7b0 0x7f8dcc06cc70 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8de00cc200 tx=0x7f8ddc006c80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:09.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.159+0000 7f8dd5ffb700 1 -- 172.21.15.84:0/4067672461 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f8dd0053bf0 con 0x7f8de0159a50 2023-09-13T08:25:09.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.486+0000 7f2312452700 1 -- 172.21.15.84:0/3693315336 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f230c072390 con 0x7f230c15d590 2023-09-13T08:25:09.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.486+0000 7f2308ff9700 1 -- 172.21.15.84:0/3693315336 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f22fc021090 con 0x7f230c15d590 2023-09-13T08:25:09.489 INFO:teuthology.orchestra.run.smithi084.stdout:55834574857 2023-09-13T08:25:09.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.490+0000 7f2312452700 1 -- 172.21.15.84:0/3693315336 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f22f806a580 msgr2=0x7f22f806ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:09.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.490+0000 7f2312452700 1 --2- 172.21.15.84:0/3693315336 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f22f806a580 0x7f22f806ca40 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2300000c00 tx=0x7f2300010000 comp rx=0 tx=0).stop 2023-09-13T08:25:09.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.490+0000 7f2312452700 1 -- 172.21.15.84:0/3693315336 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f230c15d590 msgr2=0x7f230c0b3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:09.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.490+0000 7f2312452700 1 --2- 172.21.15.84:0/3693315336 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f230c15d590 0x7f230c0b3710 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f22fc00e870 tx=0x7f22fc00eb80 comp rx=0 tx=0).stop 2023-09-13T08:25:09.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.490+0000 7f2312452700 1 -- 172.21.15.84:0/3693315336 shutdown_connections 2023-09-13T08:25:09.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.490+0000 7f2312452700 1 --2- 172.21.15.84:0/3693315336 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f230c161190 0x7f230c0b3c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:09.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.490+0000 7f2312452700 1 --2- 172.21.15.84:0/3693315336 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f230c0cb8e0 0x7f230c1ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:09.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.490+0000 7f2312452700 1 --2- 172.21.15.84:0/3693315336 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f22f806a580 0x7f22f806ca40 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:09.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.490+0000 7f2312452700 1 --2- 172.21.15.84:0/3693315336 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f230c15d590 0x7f230c0b3710 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:09.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.490+0000 7f2312452700 1 -- 172.21.15.84:0/3693315336 >> 172.21.15.84:0/3693315336 conn(0x7f230c0b0a20 msgr2=0x7f230c0cf1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:09.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.491+0000 7f2312452700 1 -- 172.21.15.84:0/3693315336 shutdown_connections 2023-09-13T08:25:09.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.491+0000 7f2312452700 1 -- 172.21.15.84:0/3693315336 wait complete. 2023-09-13T08:25:09.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.493+0000 7f3c607fb700 1 -- 172.21.15.84:0/731429875 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f3c58149dd0 con 0x7f3c58071c80 2023-09-13T08:25:09.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.493+0000 7f53d7405700 1 -- 172.21.15.84:0/2015150998 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f53d00c6520 con 0x7f53d00b6650 2023-09-13T08:25:09.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.494+0000 7f3c4effd700 1 -- 172.21.15.84:0/731429875 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3c4807adf0 con 0x7f3c58071c80 2023-09-13T08:25:09.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.494+0000 7f53c5ffb700 1 -- 172.21.15.84:0/2015150998 <== mon.2 v2:172.21.15.161:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f53c0057ba0 con 0x7f53d00b6650 2023-09-13T08:25:09.495 INFO:teuthology.orchestra.run.smithi084.stdout:55834574859 2023-09-13T08:25:09.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.497+0000 7f3c607fb700 1 -- 172.21.15.84:0/731429875 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f3c3c06a580 msgr2=0x7f3c3c06ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:09.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.497+0000 7f3c607fb700 1 --2- 172.21.15.84:0/731429875 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f3c3c06a580 0x7f3c3c06ca40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3c5806c780 tx=0x7f3c5000b040 comp rx=0 tx=0).stop 2023-09-13T08:25:09.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.497+0000 7f3c607fb700 1 -- 172.21.15.84:0/731429875 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3c58071c80 msgr2=0x7f3c5815c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:09.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.497+0000 7f3c607fb700 1 --2- 172.21.15.84:0/731429875 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3c58071c80 0x7f3c5815c750 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3c48039040 tx=0x7f3c48004750 comp rx=0 tx=0).stop 2023-09-13T08:25:09.498 INFO:teuthology.orchestra.run.smithi084.stdout:55834574858 2023-09-13T08:25:09.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.501+0000 7f3c607fb700 1 -- 172.21.15.84:0/731429875 shutdown_connections 2023-09-13T08:25:09.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.501+0000 7f3c607fb700 1 --2- 172.21.15.84:0/731429875 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3c581595e0 0x7f3c581419f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:09.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.501+0000 7f3c607fb700 1 --2- 172.21.15.84:0/731429875 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f3c3c06a580 0x7f3c3c06ca40 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:09.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.501+0000 7f3c607fb700 1 --2- 172.21.15.84:0/731429875 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3c58071c80 0x7f3c5815c750 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:09.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.501+0000 7f3c607fb700 1 --2- 172.21.15.84:0/731429875 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c580721d0 0x7f3c580b4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:09.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.501+0000 7f3c607fb700 1 -- 172.21.15.84:0/731429875 >> 172.21.15.84:0/731429875 conn(0x7f3c580b0a20 msgr2=0x7f3c580ceea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:09.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.501+0000 7f53d7405700 1 -- 172.21.15.84:0/2015150998 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f53b406a620 msgr2=0x7f53b406cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:09.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.501+0000 7f53d7405700 1 --2- 172.21.15.84:0/2015150998 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f53b406a620 0x7f53b406cae0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f53cc007920 tx=0x7f53cc008040 comp rx=0 tx=0).stop 2023-09-13T08:25:09.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.501+0000 7f53d7405700 1 -- 172.21.15.84:0/2015150998 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f53d00b6650 msgr2=0x7f53d01fa490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:09.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.501+0000 7f53d7405700 1 --2- 172.21.15.84:0/2015150998 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f53d00b6650 0x7f53d01fa490 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f53c000b470 tx=0x7f53c000b780 comp rx=0 tx=0).stop 2023-09-13T08:25:09.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.502+0000 7f53d7405700 1 -- 172.21.15.84:0/2015150998 shutdown_connections 2023-09-13T08:25:09.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.502+0000 7f53d7405700 1 --2- 172.21.15.84:0/2015150998 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f53b406a620 0x7f53b406cae0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:09.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.502+0000 7f53d7405700 1 --2- 172.21.15.84:0/2015150998 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f53d01619d0 0x7f53d00ce540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:09.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.502+0000 7f53d7405700 1 --2- 172.21.15.84:0/2015150998 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f53d00b26a0 0x7f53d00c7d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:09.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.502+0000 7f53d7405700 1 --2- 172.21.15.84:0/2015150998 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f53d00b6650 0x7f53d01fa490 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:09.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.502+0000 7f53d7405700 1 -- 172.21.15.84:0/2015150998 >> 172.21.15.84:0/2015150998 conn(0x7f53d00d32c0 msgr2=0x7f53d0162f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:09.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.502+0000 7f3c607fb700 1 -- 172.21.15.84:0/731429875 shutdown_connections 2023-09-13T08:25:09.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.502+0000 7f3c607fb700 1 -- 172.21.15.84:0/731429875 wait complete. 2023-09-13T08:25:09.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.502+0000 7f53d7405700 1 -- 172.21.15.84:0/2015150998 shutdown_connections 2023-09-13T08:25:09.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.503+0000 7f53d7405700 1 -- 172.21.15.84:0/2015150998 wait complete. 2023-09-13T08:25:09.511 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574857 for osd.4 2023-09-13T08:25:09.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.514+0000 7f5e1be20700 1 -- 172.21.15.84:0/3066569012 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f5e1414f600 con 0x7f5e140c9770 2023-09-13T08:25:09.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.515+0000 7f5e0a7fc700 1 -- 172.21.15.84:0/3066569012 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5e10021020 con 0x7f5e140c9770 2023-09-13T08:25:09.515 INFO:teuthology.orchestra.run.smithi084.stdout:55834574859 2023-09-13T08:25:09.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.516+0000 7f3e58797700 1 -- 172.21.15.84:0/990028513 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f3e500b0810 con 0x7f3e501595e0 2023-09-13T08:25:09.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.516+0000 7f13ad58e700 1 -- 172.21.15.84:0/3520586814 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f13a804e9b0 con 0x7f13a806d360 2023-09-13T08:25:09.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.516+0000 7f3e46ffd700 1 -- 172.21.15.84:0/990028513 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3e40032020 con 0x7f3e501595e0 2023-09-13T08:25:09.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.516+0000 7f682bc11700 1 -- 172.21.15.84:0/2783333905 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f68240d2b10 con 0x7f68241619d0 2023-09-13T08:25:09.517 INFO:teuthology.orchestra.run.smithi084.stdout:55834574857 2023-09-13T08:25:09.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.517+0000 7f138f7fe700 1 -- 172.21.15.84:0/3520586814 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1398015090 con 0x7f13a806d360 2023-09-13T08:25:09.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.517+0000 7f681a7fc700 1 -- 172.21.15.84:0/2783333905 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f681c0575e0 con 0x7f68241619d0 2023-09-13T08:25:09.519 INFO:teuthology.orchestra.run.smithi084.stdout:55834574858 2023-09-13T08:25:09.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.518+0000 7f5e1be20700 1 -- 172.21.15.84:0/3066569012 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f5df806a580 msgr2=0x7f5df806ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:09.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.518+0000 7f5e1be20700 1 --2- 172.21.15.84:0/3066569012 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f5df806a580 0x7f5df806ca40 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5e04000c00 tx=0x7f5e04008030 comp rx=0 tx=0).stop 2023-09-13T08:25:09.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.518+0000 7f5e1be20700 1 -- 172.21.15.84:0/3066569012 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5e140c9770 msgr2=0x7f5e140aefc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:09.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.518+0000 7f5e1be20700 1 --2- 172.21.15.84:0/3066569012 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5e140c9770 0x7f5e140aefc0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5e1000f980 tx=0x7f5e1000fc90 comp rx=0 tx=0).stop 2023-09-13T08:25:09.520 INFO:teuthology.orchestra.run.smithi084.stdout:55834574857 2023-09-13T08:25:09.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.520+0000 7f3e58797700 1 -- 172.21.15.84:0/990028513 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f3e3406a580 msgr2=0x7f3e3406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:09.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.520+0000 7f3e58797700 1 --2- 172.21.15.84:0/990028513 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f3e3406a580 0x7f3e3406ca40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3e48007fd0 tx=0x7f3e48007da0 comp rx=0 tx=0).stop 2023-09-13T08:25:09.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.520+0000 7f3e58797700 1 -- 172.21.15.84:0/990028513 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3e501595e0 msgr2=0x7f3e500b1ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:09.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.520+0000 7f3e58797700 1 --2- 172.21.15.84:0/990028513 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3e501595e0 0x7f3e500b1ad0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3e500678f0 tx=0x7f3e40004750 comp rx=0 tx=0).stop 2023-09-13T08:25:09.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.521+0000 7f3e58797700 1 -- 172.21.15.84:0/990028513 shutdown_connections 2023-09-13T08:25:09.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.521+0000 7f3e58797700 1 --2- 172.21.15.84:0/990028513 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f3e3406a580 0x7f3e3406ca40 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:09.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.521+0000 7f3e58797700 1 --2- 172.21.15.84:0/990028513 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3e501595e0 0x7f3e500b1ad0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:09.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.521+0000 7f3e58797700 1 --2- 172.21.15.84:0/990028513 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e500c9770 0x7f3e5014ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:09.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.521+0000 7f3e58797700 1 --2- 172.21.15.84:0/990028513 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3e500cb860 0x7f3e500b31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:09.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.521+0000 7f3e58797700 1 -- 172.21.15.84:0/990028513 >> 172.21.15.84:0/990028513 conn(0x7f3e500b0a20 msgr2=0x7f3e500aeea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:09.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.521+0000 7f5e1be20700 1 -- 172.21.15.84:0/3066569012 shutdown_connections 2023-09-13T08:25:09.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.521+0000 7f5e1be20700 1 --2- 172.21.15.84:0/3066569012 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e141595e0 0x7f5e140af500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:09.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.521+0000 7f5e1be20700 1 --2- 172.21.15.84:0/3066569012 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5e14070840 0x7f5e1414f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:09.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.521+0000 7f5e1be20700 1 --2- 172.21.15.84:0/3066569012 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f5df806a580 0x7f5df806ca40 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:09.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.521+0000 7f5e1be20700 1 --2- 172.21.15.84:0/3066569012 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5e140c9770 0x7f5e140aefc0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:09.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.521+0000 7f5e1be20700 1 -- 172.21.15.84:0/3066569012 >> 172.21.15.84:0/3066569012 conn(0x7f5e140b0a20 msgr2=0x7f5e14151010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:09.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.522+0000 7f5e1be20700 1 -- 172.21.15.84:0/3066569012 shutdown_connections 2023-09-13T08:25:09.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.522+0000 7f5e1be20700 1 -- 172.21.15.84:0/3066569012 wait complete. 2023-09-13T08:25:09.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.522+0000 7f682bc11700 1 -- 172.21.15.84:0/2783333905 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f680806a580 msgr2=0x7f680806ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:09.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.522+0000 7f682bc11700 1 --2- 172.21.15.84:0/2783333905 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f680806a580 0x7f680806ca40 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6820007fd0 tx=0x7f6820007980 comp rx=0 tx=0).stop 2023-09-13T08:25:09.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.522+0000 7f682bc11700 1 -- 172.21.15.84:0/2783333905 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68241619d0 msgr2=0x7f68240d1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:09.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.522+0000 7f682bc11700 1 --2- 172.21.15.84:0/2783333905 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68241619d0 0x7f68240d1710 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f681c00cb50 tx=0x7f681c00ce60 comp rx=0 tx=0).stop 2023-09-13T08:25:09.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.523+0000 7f682bc11700 1 -- 172.21.15.84:0/2783333905 shutdown_connections 2023-09-13T08:25:09.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.523+0000 7f682bc11700 1 --2- 172.21.15.84:0/2783333905 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68241619d0 0x7f68240d1710 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:09.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.523+0000 7f682bc11700 1 --2- 172.21.15.84:0/2783333905 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f680806a580 0x7f680806ca40 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:09.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.523+0000 7f682bc11700 1 --2- 172.21.15.84:0/2783333905 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68240b24d0 0x7f68240ca390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:09.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.523+0000 7f682bc11700 1 --2- 172.21.15.84:0/2783333905 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f68240b6820 0x7f6824158ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:09.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.523+0000 7f682bc11700 1 -- 172.21.15.84:0/2783333905 >> 172.21.15.84:0/2783333905 conn(0x7f68240d32c0 msgr2=0x7f68240b2c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:09.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.523+0000 7f682bc11700 1 -- 172.21.15.84:0/2783333905 shutdown_connections 2023-09-13T08:25:09.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.523+0000 7f682bc11700 1 -- 172.21.15.84:0/2783333905 wait complete. 2023-09-13T08:25:09.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.523+0000 7f3e58797700 1 -- 172.21.15.84:0/990028513 shutdown_connections 2023-09-13T08:25:09.529 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574861 got 55834574859 for osd.6 2023-09-13T08:25:09.530 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574858 for osd.2 2023-09-13T08:25:09.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.525+0000 7f3e58797700 1 -- 172.21.15.84:0/990028513 wait complete. 2023-09-13T08:25:09.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.527+0000 7f13ad58e700 1 -- 172.21.15.84:0/3520586814 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f139406a5d0 msgr2=0x7f139406ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:09.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.527+0000 7f13ad58e700 1 --2- 172.21.15.84:0/3520586814 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f139406a5d0 0x7f139406ca90 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f13a81511d0 tx=0x7f139c007db0 comp rx=0 tx=0).stop 2023-09-13T08:25:09.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.527+0000 7f13ad58e700 1 -- 172.21.15.84:0/3520586814 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f13a806d360 msgr2=0x7f13a80c92f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:09.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.527+0000 7f13ad58e700 1 --2- 172.21.15.84:0/3520586814 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f13a806d360 0x7f13a80c92f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f13980090b0 tx=0x7f1398004750 comp rx=0 tx=0).stop 2023-09-13T08:25:09.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.529+0000 7f13ad58e700 1 -- 172.21.15.84:0/3520586814 shutdown_connections 2023-09-13T08:25:09.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.529+0000 7f13ad58e700 1 --2- 172.21.15.84:0/3520586814 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13a815b420 0x7f13a814d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:09.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.529+0000 7f13ad58e700 1 --2- 172.21.15.84:0/3520586814 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f139406a5d0 0x7f139406ca90 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:09.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.529+0000 7f13ad58e700 1 --2- 172.21.15.84:0/3520586814 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f13a806d360 0x7f13a80c92f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:09.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.529+0000 7f13ad58e700 1 --2- 172.21.15.84:0/3520586814 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f13a80aec10 0x7f13a815d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:09.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.529+0000 7f13ad58e700 1 -- 172.21.15.84:0/3520586814 >> 172.21.15.84:0/3520586814 conn(0x7f13a80cc230 msgr2=0x7f13a80ca180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:09.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.529+0000 7f13ad58e700 1 -- 172.21.15.84:0/3520586814 shutdown_connections 2023-09-13T08:25:09.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.529+0000 7f13ad58e700 1 -- 172.21.15.84:0/3520586814 wait complete. 2023-09-13T08:25:09.538 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574861 got 55834574859 for osd.5 2023-09-13T08:25:09.539 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574857 for osd.1 2023-09-13T08:25:09.544 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574858 for osd.0 2023-09-13T08:25:09.547 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574857 for osd.7 2023-09-13T08:25:09.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.549+0000 7f8de78a2700 1 -- 172.21.15.84:0/4067672461 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8dc00055a0 con 0x7f8de0159a50 2023-09-13T08:25:09.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.550+0000 7f8dd5ffb700 1 -- 172.21.15.84:0/4067672461 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8dd0021090 con 0x7f8de0159a50 2023-09-13T08:25:09.550 INFO:teuthology.orchestra.run.smithi084.stdout:55834574857 2023-09-13T08:25:09.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.552+0000 7f8de78a2700 1 -- 172.21.15.84:0/4067672461 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f8dcc06a7b0 msgr2=0x7f8dcc06cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:09.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.552+0000 7f8de78a2700 1 --2- 172.21.15.84:0/4067672461 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f8dcc06a7b0 0x7f8dcc06cc70 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8de00cc200 tx=0x7f8ddc006c80 comp rx=0 tx=0).stop 2023-09-13T08:25:09.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.552+0000 7f8de78a2700 1 -- 172.21.15.84:0/4067672461 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8de0159a50 msgr2=0x7f8de00c5f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:09.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.552+0000 7f8de78a2700 1 --2- 172.21.15.84:0/4067672461 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8de0159a50 0x7f8de00c5f50 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8dd000e810 tx=0x7f8dd000ebd0 comp rx=0 tx=0).stop 2023-09-13T08:25:09.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.552+0000 7f8de78a2700 1 -- 172.21.15.84:0/4067672461 shutdown_connections 2023-09-13T08:25:09.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.552+0000 7f8de78a2700 1 --2- 172.21.15.84:0/4067672461 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8de01e8830 0x7f8de0202730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:09.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.552+0000 7f8de78a2700 1 --2- 172.21.15.84:0/4067672461 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8de0159a50 0x7f8de00c5f50 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:09.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.552+0000 7f8de78a2700 1 --2- 172.21.15.84:0/4067672461 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f8dcc06a7b0 0x7f8dcc06cc70 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:09.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.552+0000 7f8de78a2700 1 --2- 172.21.15.84:0/4067672461 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8de015da60 0x7f8de00b4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:09.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.552+0000 7f8de78a2700 1 -- 172.21.15.84:0/4067672461 >> 172.21.15.84:0/4067672461 conn(0x7f8de00cc230 msgr2=0x7f8de00ce350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:09.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.552+0000 7f8de78a2700 1 -- 172.21.15.84:0/4067672461 shutdown_connections 2023-09-13T08:25:09.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:09.552+0000 7f8de78a2700 1 -- 172.21.15.84:0/4067672461 wait complete. 2023-09-13T08:25:09.564 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574857 for osd.3 2023-09-13T08:25:10.512 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-09-13T08:25:10.531 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-09-13T08:25:10.532 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-13T08:25:10.539 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-09-13T08:25:10.540 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-13T08:25:10.546 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-13T08:25:10.548 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-09-13T08:25:10.567 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-13T08:25:10.694 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:25:10.711 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:25:10.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.727+0000 7f091227a700 1 Processor -- start 2023-09-13T08:25:10.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.727+0000 7f091227a700 1 -- start start 2023-09-13T08:25:10.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.728+0000 7f091227a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f090c1619d0 0x7f090c0cbdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:10.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.728+0000 7f091227a700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f090c0c9a00 0x7f090c0cce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:10.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.728+0000 7f091227a700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f090c1665f0 con 0x7f090c0b13c0 2023-09-13T08:25:10.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.728+0000 7f091227a700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f090c165700 con 0x7f090c1619d0 2023-09-13T08:25:10.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.728+0000 7f091227a700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f090c1659e0 con 0x7f090c0c9a00 2023-09-13T08:25:10.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.729+0000 7f0910a77700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f090c0b13c0 0x7f090c0c92f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:46662/0 (socket says 172.21.15.84:46662) 2023-09-13T08:25:10.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.729+0000 7f0910a77700 1 -- 172.21.15.84:0/4166041872 learned_addr learned my addr 172.21.15.84:0/4166041872 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:25:10.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.730+0000 7f0911278700 1 --2- 172.21.15.84:0/4166041872 >> v2:172.21.15.84:3300/0 conn(0x7f090c1619d0 0x7f090c0cbdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:10.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.730+0000 7f0911278700 1 -- 172.21.15.84:0/4166041872 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f090c0c9a00 msgr2=0x7f090c0cce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:10.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.730+0000 7f0911278700 1 --2- 172.21.15.84:0/4166041872 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f090c0c9a00 0x7f090c0cce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:10.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.730+0000 7f0911278700 1 -- 172.21.15.84:0/4166041872 >> v1:172.21.15.84:6789/0 conn(0x7f090c0b13c0 legacy=0x7f090c0c92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:10.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.730+0000 7f0911278700 1 -- 172.21.15.84:0/4166041872 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f090c165cc0 con 0x7f090c1619d0 2023-09-13T08:25:10.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.731+0000 7f0911278700 1 --2- 172.21.15.84:0/4166041872 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f090c1619d0 0x7f090c0cbdf0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f08fc009840 tx=0x7f08fc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4f6f4834e85117 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:10.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.735+0000 7f0903fff700 1 -- 172.21.15.84:0/4166041872 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08fc011830 con 0x7f090c1619d0 2023-09-13T08:25:10.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.735+0000 7f0903fff700 1 -- 172.21.15.84:0/4166041872 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08fc011990 con 0x7f090c1619d0 2023-09-13T08:25:10.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.735+0000 7f0903fff700 1 -- 172.21.15.84:0/4166041872 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08fc011d20 con 0x7f090c1619d0 2023-09-13T08:25:10.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.736+0000 7f091227a700 1 -- 172.21.15.84:0/4166041872 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f090c1619d0 msgr2=0x7f090c0cbdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:10.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.736+0000 7f091227a700 1 --2- 172.21.15.84:0/4166041872 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f090c1619d0 0x7f090c0cbdf0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f08fc009840 tx=0x7f08fc009b50 comp rx=0 tx=0).stop 2023-09-13T08:25:10.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.739+0000 7f091227a700 1 -- 172.21.15.84:0/4166041872 shutdown_connections 2023-09-13T08:25:10.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.739+0000 7f091227a700 1 --2- 172.21.15.84:0/4166041872 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f090c0c9a00 0x7f090c0cce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:10.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.739+0000 7f091227a700 1 --2- 172.21.15.84:0/4166041872 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f090c1619d0 0x7f090c0cbdf0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:10.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.739+0000 7f091227a700 1 -- 172.21.15.84:0/4166041872 >> 172.21.15.84:0/4166041872 conn(0x7f090c0b07f0 msgr2=0x7f090c0b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:10.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.744+0000 7f091227a700 1 -- 172.21.15.84:0/4166041872 shutdown_connections 2023-09-13T08:25:10.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.745+0000 7f091227a700 1 -- 172.21.15.84:0/4166041872 wait complete. 2023-09-13T08:25:10.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.746+0000 7fe102afd700 1 Processor -- start 2023-09-13T08:25:10.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.746+0000 7f091227a700 1 Processor -- start 2023-09-13T08:25:10.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.746+0000 7fe102afd700 1 -- start start 2023-09-13T08:25:10.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.747+0000 7f091227a700 1 -- start start 2023-09-13T08:25:10.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.748+0000 7fe102afd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe0fc0c9770 0x7fe0fc159370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:10.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.748+0000 7fe102afd700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe0fc1598b0 0x7fe0fc070300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:10.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.748+0000 7fe102afd700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0fc0cd070 con 0x7fe0fc0b1540 2023-09-13T08:25:10.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.748+0000 7fe102afd700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0fc0c9d30 con 0x7fe0fc0c9770 2023-09-13T08:25:10.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.748+0000 7fe102afd700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0fc0ca010 con 0x7fe0fc1598b0 2023-09-13T08:25:10.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.748+0000 7f091227a700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f090c0b13c0 0x7f090c14e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:10.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.748+0000 7f091227a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f090c0c9a00 0x7f090c0af600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:10.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.748+0000 7f091227a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f090c1619d0 0x7f090c13f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:10.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.748+0000 7f091227a700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f090c14e820 con 0x7f090c0c9a00 2023-09-13T08:25:10.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.748+0000 7f091227a700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f090c14ea10 con 0x7f090c1619d0 2023-09-13T08:25:10.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.748+0000 7f091227a700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f090c162300 con 0x7f090c0b13c0 2023-09-13T08:25:10.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.748+0000 7fe10109a700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe0fc1598b0 0x7fe0fc070300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:10.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.748+0000 7fe10109a700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe0fc1598b0 0x7fe0fc070300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.84:39796/0 (socket says 172.21.15.84:39796) 2023-09-13T08:25:10.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.748+0000 7fe10109a700 1 -- 172.21.15.84:0/3337085056 learned_addr learned my addr 172.21.15.84:0/3337085056 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:10.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.748+0000 7fe0fbfff700 1 --2- 172.21.15.84:0/3337085056 >> v2:172.21.15.84:3300/0 conn(0x7fe0fc0c9770 0x7fe0fc159370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:10.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.749+0000 7f0911a79700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f090c1619d0 0x7f090c13f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:10.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.749+0000 7f0910a77700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f090c0c9a00 0x7f090c0af600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:10.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.749+0000 7f0910a77700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f090c0c9a00 0x7f090c0af600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44030/0 (socket says 172.21.15.84:44030) 2023-09-13T08:25:10.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.749+0000 7f0910a77700 1 -- 172.21.15.84:0/1212439421 learned_addr learned my addr 172.21.15.84:0/1212439421 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:10.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.749+0000 7fe0fbfff700 1 -- 172.21.15.84:0/3337085056 >> v2:172.21.15.161:3300/0 conn(0x7fe0fc1598b0 msgr2=0x7fe0fc070300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:10.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.749+0000 7fe0fbfff700 1 --2- 172.21.15.84:0/3337085056 >> v2:172.21.15.161:3300/0 conn(0x7fe0fc1598b0 0x7fe0fc070300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:10.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.749+0000 7fe0fbfff700 1 -- 172.21.15.84:0/3337085056 >> v1:172.21.15.161:6789/0 conn(0x7fe0fc0b1540 legacy=0x7fe0fc06cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:10.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.749+0000 7fe0fbfff700 1 -- 172.21.15.84:0/3337085056 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0fc0ca2f0 con 0x7fe0fc0c9770 2023-09-13T08:25:10.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.749+0000 7fe0fbfff700 1 --2- 172.21.15.84:0/3337085056 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0fc0c9770 0x7fe0fc159370 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc0cb700 tx=0x7fe0ec009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4680fecce3ad9b87 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:10.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.750+0000 7fe0fb7fe700 1 -- 172.21.15.84:0/3337085056 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0ec004230 con 0x7fe0fc0c9770 2023-09-13T08:25:10.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.750+0000 7fe0fb7fe700 1 -- 172.21.15.84:0/3337085056 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0ec004390 con 0x7fe0fc0c9770 2023-09-13T08:25:10.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.750+0000 7fe0fb7fe700 1 -- 172.21.15.84:0/3337085056 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0ec0036a0 con 0x7fe0fc0c9770 2023-09-13T08:25:10.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.750+0000 7f0911a79700 1 -- 172.21.15.84:0/1212439421 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f090c0b13c0 msgr2=0x7f090c14e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:10.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.750+0000 7f0911a79700 1 --2- 172.21.15.84:0/1212439421 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f090c0b13c0 0x7f090c14e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:10.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.750+0000 7f0911a79700 1 -- 172.21.15.84:0/1212439421 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f090c0c9a00 msgr2=0x7f090c0af600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:10.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.750+0000 7f0911a79700 1 --2- 172.21.15.84:0/1212439421 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f090c0c9a00 0x7f090c0af600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:10.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.750+0000 7f0911a79700 1 -- 172.21.15.84:0/1212439421 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08fc0094a0 con 0x7f090c1619d0 2023-09-13T08:25:10.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.754+0000 7f0911a79700 1 --2- 172.21.15.84:0/1212439421 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f090c1619d0 0x7f090c13f760 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f090c0cc920 tx=0x7f090800b750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:10.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.754+0000 7f0901ffb700 1 -- 172.21.15.84:0/1212439421 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0908011830 con 0x7f090c1619d0 2023-09-13T08:25:10.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.755+0000 7f0901ffb700 1 -- 172.21.15.84:0/1212439421 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0908011990 con 0x7f090c1619d0 2023-09-13T08:25:10.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.755+0000 7f091227a700 1 -- 172.21.15.84:0/1212439421 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f090c1625e0 con 0x7f090c1619d0 2023-09-13T08:25:10.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.755+0000 7f0901ffb700 1 -- 172.21.15.84:0/1212439421 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0908011d40 con 0x7f090c1619d0 2023-09-13T08:25:10.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.755+0000 7f091227a700 1 -- 172.21.15.84:0/1212439421 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f090c14f470 con 0x7f090c1619d0 2023-09-13T08:25:10.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.755+0000 7fe102afd700 1 -- 172.21.15.84:0/3337085056 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0fc0c9770 msgr2=0x7fe0fc159370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:10.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.755+0000 7fe102afd700 1 --2- 172.21.15.84:0/3337085056 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0fc0c9770 0x7fe0fc159370 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc0cb700 tx=0x7fe0ec009b20 comp rx=0 tx=0).stop 2023-09-13T08:25:10.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.755+0000 7fe102afd700 1 -- 172.21.15.84:0/3337085056 shutdown_connections 2023-09-13T08:25:10.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.755+0000 7fe102afd700 1 --2- 172.21.15.84:0/3337085056 >> v2:172.21.15.161:3300/0 conn(0x7fe0fc1598b0 0x7fe0fc070300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:10.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.755+0000 7fe102afd700 1 --2- 172.21.15.84:0/3337085056 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0fc0c9770 0x7fe0fc159370 secure :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc0cb700 tx=0x7fe0ec009b20 comp rx=0 tx=0).stop 2023-09-13T08:25:10.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.755+0000 7fe102afd700 1 -- 172.21.15.84:0/3337085056 >> 172.21.15.84:0/3337085056 conn(0x7fe0fc0b0a20 msgr2=0x7fe0fc0b0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:10.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.757+0000 7f0901ffb700 1 -- 172.21.15.84:0/1212439421 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f090801a400 con 0x7f090c1619d0 2023-09-13T08:25:10.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.757+0000 7fe102afd700 1 -- 172.21.15.84:0/3337085056 shutdown_connections 2023-09-13T08:25:10.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.757+0000 7fe102afd700 1 -- 172.21.15.84:0/3337085056 wait complete. 2023-09-13T08:25:10.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.757+0000 7f0901ffb700 1 --2- 172.21.15.84:0/1212439421 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f08f006a580 0x7f08f006ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:10.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.757+0000 7f091227a700 1 -- 172.21.15.84:0/1212439421 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f090c14f2d0 con 0x7f090c1619d0 2023-09-13T08:25:10.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.758+0000 7f0901ffb700 1 -- 172.21.15.84:0/1212439421 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0908057570 con 0x7f090c1619d0 2023-09-13T08:25:10.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.759+0000 7fe102afd700 1 Processor -- start 2023-09-13T08:25:10.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.759+0000 7fe102afd700 1 -- start start 2023-09-13T08:25:10.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.760+0000 7fe102afd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe0fc0b1540 0x7fe0fc0c7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:10.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.760+0000 7fe102afd700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe0fc1598b0 0x7fe0fc0c8220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:10.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.760+0000 7fe102afd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0fc14c2d0 0x7fe0fc0c8760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:10.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.760+0000 7fe102afd700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0fc0c8ca0 con 0x7fe0fc14c2d0 2023-09-13T08:25:10.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.760+0000 7fe102afd700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0fc14c790 con 0x7fe0fc0b1540 2023-09-13T08:25:10.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.760+0000 7fe102afd700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0fc0b50b0 con 0x7fe0fc1598b0 2023-09-13T08:25:10.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.761+0000 7fe10109a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0fc14c2d0 0x7fe0fc0c8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:10.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.761+0000 7fe10109a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0fc14c2d0 0x7fe0fc0c8760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44040/0 (socket says 172.21.15.84:44040) 2023-09-13T08:25:10.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.761+0000 7fe10109a700 1 -- 172.21.15.84:0/3525895946 learned_addr learned my addr 172.21.15.84:0/3525895946 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:10.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.761+0000 7fe0fbfff700 1 --2- 172.21.15.84:0/3525895946 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe0fc1598b0 0x7fe0fc0c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:10.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.761+0000 7fe10109a700 1 -- 172.21.15.84:0/3525895946 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe0fc1598b0 msgr2=0x7fe0fc0c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:10.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.761+0000 7fe10109a700 1 --2- 172.21.15.84:0/3525895946 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe0fc1598b0 0x7fe0fc0c8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:10.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.761+0000 7fe10109a700 1 -- 172.21.15.84:0/3525895946 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe0fc0b1540 msgr2=0x7fe0fc0c7ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-09-13T08:25:10.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.761+0000 7fe10109a700 1 --2- 172.21.15.84:0/3525895946 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe0fc0b1540 0x7fe0fc0c7ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:10.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.761+0000 7fe10109a700 1 -- 172.21.15.84:0/3525895946 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0ec0094a0 con 0x7fe0fc14c2d0 2023-09-13T08:25:10.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.761+0000 7fe0fbfff700 1 --2- 172.21.15.84:0/3525895946 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe0fc1598b0 0x7fe0fc0c8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T08:25:10.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.762+0000 7fe10109a700 1 --2- 172.21.15.84:0/3525895946 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0fc14c2d0 0x7fe0fc0c8760 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe0f4007b20 tx=0x7fe0f4007ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:10.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.762+0000 7fe0f97fa700 1 -- 172.21.15.84:0/3525895946 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f4017070 con 0x7fe0fc14c2d0 2023-09-13T08:25:10.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.762+0000 7fe0f97fa700 1 -- 172.21.15.84:0/3525895946 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0f400f040 con 0x7fe0fc14c2d0 2023-09-13T08:25:10.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.762+0000 7fe0f97fa700 1 -- 172.21.15.84:0/3525895946 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f4003c40 con 0x7fe0fc14c2d0 2023-09-13T08:25:10.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.762+0000 7fe102afd700 1 -- 172.21.15.84:0/3525895946 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0fc0c5fe0 con 0x7fe0fc14c2d0 2023-09-13T08:25:10.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.762+0000 7fe102afd700 1 -- 172.21.15.84:0/3525895946 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0fc146ba0 con 0x7fe0fc14c2d0 2023-09-13T08:25:10.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.765+0000 7fe102afd700 1 -- 172.21.15.84:0/3525895946 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0e8005320 con 0x7fe0fc14c2d0 2023-09-13T08:25:10.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.763+0000 7f0911278700 1 --2- 172.21.15.84:0/1212439421 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f08f006a580 0x7f08f006ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:10.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.763+0000 7f0911278700 1 --2- 172.21.15.84:0/1212439421 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f08f006a580 0x7f08f006ca40 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f08fc0090b0 tx=0x7f08fc010000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:10.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.766+0000 7f0901ffb700 1 -- 172.21.15.84:0/1212439421 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f090c14f2d0 con 0x7f090c1619d0 2023-09-13T08:25:10.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.768+0000 7f4115890700 1 Processor -- start 2023-09-13T08:25:10.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.768+0000 7f4115890700 1 -- start start 2023-09-13T08:25:10.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.769+0000 7f4115890700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f411015b2b0 0x7f41100cc0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:10.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.769+0000 7f4115890700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f41100709d0 0x7f41100b1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:10.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.770+0000 7f4115890700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41100ca260 con 0x7f41100cc630 2023-09-13T08:25:10.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.770+0000 7f4115890700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41100c9690 con 0x7f411015b2b0 2023-09-13T08:25:10.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.770+0000 7f4115890700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f411015b690 con 0x7f41100709d0 2023-09-13T08:25:10.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.770+0000 7f410f7fe700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f41100709d0 0x7f41100b1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:10.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.770+0000 7f410f7fe700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f41100709d0 0x7f41100b1d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.84:53908/0 (socket says 172.21.15.84:53908) 2023-09-13T08:25:10.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.770+0000 7f410f7fe700 1 -- 172.21.15.84:0/3239749445 learned_addr learned my addr 172.21.15.84:0/3239749445 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:10.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.770+0000 7f410f7fe700 1 -- 172.21.15.84:0/3239749445 >> v2:172.21.15.161:3300/0 conn(0x7f411015b2b0 msgr2=0x7f41100cc0f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-13T08:25:10.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.770+0000 7f410f7fe700 1 --2- 172.21.15.84:0/3239749445 >> v2:172.21.15.161:3300/0 conn(0x7f411015b2b0 0x7f41100cc0f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:10.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.770+0000 7f410f7fe700 1 -- 172.21.15.84:0/3239749445 >> v1:172.21.15.161:6789/0 conn(0x7f41100cc630 legacy=0x7f41100702c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-13T08:25:10.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.770+0000 7f410f7fe700 1 -- 172.21.15.84:0/3239749445 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41100c9930 con 0x7f41100709d0 2023-09-13T08:25:10.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.771+0000 7f410f7fe700 1 --2- 172.21.15.84:0/3239749445 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f41100709d0 0x7f41100b1d60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4108009e50 tx=0x7f410800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb58b15eea6aa601 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:10.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.771+0000 7f410dffb700 1 -- 172.21.15.84:0/3239749445 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f410800e070 con 0x7f41100709d0 2023-09-13T08:25:10.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.771+0000 7f410dffb700 1 -- 172.21.15.84:0/3239749445 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4108003a20 con 0x7f41100709d0 2023-09-13T08:25:10.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.771+0000 7f410dffb700 1 -- 172.21.15.84:0/3239749445 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4108003dd0 con 0x7f41100709d0 2023-09-13T08:25:10.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.772+0000 7f4115890700 1 -- 172.21.15.84:0/3239749445 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f41100709d0 msgr2=0x7f41100b1d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:10.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.772+0000 7f4115890700 1 --2- 172.21.15.84:0/3239749445 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f41100709d0 0x7f41100b1d60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4108009e50 tx=0x7f410800b330 comp rx=0 tx=0).stop 2023-09-13T08:25:10.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.774+0000 7f4115890700 1 -- 172.21.15.84:0/3239749445 shutdown_connections 2023-09-13T08:25:10.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.774+0000 7f4115890700 1 --2- 172.21.15.84:0/3239749445 >> v2:172.21.15.161:3300/0 conn(0x7f411015b2b0 0x7f41100cc0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:10.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.774+0000 7f4115890700 1 --2- 172.21.15.84:0/3239749445 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f41100709d0 0x7f41100b1d60 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:10.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.774+0000 7f4115890700 1 -- 172.21.15.84:0/3239749445 >> 172.21.15.84:0/3239749445 conn(0x7f41100b0a20 msgr2=0x7f41100b0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:10.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.774+0000 7f4115890700 1 -- 172.21.15.84:0/3239749445 shutdown_connections 2023-09-13T08:25:10.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.766+0000 7fe0f97fa700 1 -- 172.21.15.84:0/3525895946 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fe0f400d8f0 con 0x7fe0fc14c2d0 2023-09-13T08:25:10.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.767+0000 7fe0f97fa700 1 --2- 172.21.15.84:0/3525895946 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fe0e406a7b0 0x7fe0e406cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:10.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.767+0000 7fe0f97fa700 1 -- 172.21.15.84:0/3525895946 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe0f40888a0 con 0x7fe0fc14c2d0 2023-09-13T08:25:10.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.773+0000 7fe100899700 1 --2- 172.21.15.84:0/3525895946 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fe0e406a7b0 0x7fe0e406cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:10.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.773+0000 7fe100899700 1 --2- 172.21.15.84:0/3525895946 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fe0e406a7b0 0x7fe0e406cc70 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc15dfe0 tx=0x7fe0f0007a40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:10.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.775+0000 7fe0f97fa700 1 -- 172.21.15.84:0/3525895946 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fe0f4053b10 con 0x7fe0fc14c2d0 2023-09-13T08:25:10.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.774+0000 7f4115890700 1 -- 172.21.15.84:0/3239749445 wait complete. 2023-09-13T08:25:10.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.776+0000 7f4115890700 1 Processor -- start 2023-09-13T08:25:10.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.776+0000 7f4115890700 1 -- start start 2023-09-13T08:25:10.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.777+0000 7f4115890700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f41100709d0 0x7f41100ce480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:10.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.777+0000 7f4115890700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41100cc630 0x7f41100c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:10.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.777+0000 7f4115890700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f411015b2b0 0x7f41100cf1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:10.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.777+0000 7f4115890700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4110149540 con 0x7f411015b2b0 2023-09-13T08:25:10.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.777+0000 7f4115890700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41100c6ae0 con 0x7f41100cc630 2023-09-13T08:25:10.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.777+0000 7f4115890700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41101497e0 con 0x7f41100709d0 2023-09-13T08:25:10.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.777+0000 7f410e7fc700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41100cc630 0x7f41100c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:10.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.777+0000 7f410e7fc700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41100cc630 0x7f41100c65a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.84:39824/0 (socket says 172.21.15.84:39824) 2023-09-13T08:25:10.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.777+0000 7f410e7fc700 1 -- 172.21.15.84:0/4099001975 learned_addr learned my addr 172.21.15.84:0/4099001975 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:10.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.777+0000 7f410f7fe700 1 --2- 172.21.15.84:0/4099001975 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f411015b2b0 0x7f41100cf1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:10.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.778+0000 7f410f7fe700 1 -- 172.21.15.84:0/4099001975 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f41100709d0 msgr2=0x7f41100ce480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:10.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.778+0000 7f410f7fe700 1 --2- 172.21.15.84:0/4099001975 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f41100709d0 0x7f41100ce480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:10.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.778+0000 7f410f7fe700 1 -- 172.21.15.84:0/4099001975 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41100cc630 msgr2=0x7f41100c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:10.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.778+0000 7f410f7fe700 1 --2- 172.21.15.84:0/4099001975 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41100cc630 0x7f41100c65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:10.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.778+0000 7f410f7fe700 1 -- 172.21.15.84:0/4099001975 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4108009b30 con 0x7f411015b2b0 2023-09-13T08:25:10.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.778+0000 7f410e7fc700 1 --2- 172.21.15.84:0/4099001975 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41100cc630 0x7f41100c65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T08:25:10.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.778+0000 7f410f7fe700 1 --2- 172.21.15.84:0/4099001975 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f411015b2b0 0x7f41100cf1d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4108014000 tx=0x7f4108004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:10.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.780+0000 7f40fffff700 1 -- 172.21.15.84:0/4099001975 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4108004440 con 0x7f411015b2b0 2023-09-13T08:25:10.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.780+0000 7f40fffff700 1 -- 172.21.15.84:0/4099001975 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41080045a0 con 0x7f411015b2b0 2023-09-13T08:25:10.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.780+0000 7f40fffff700 1 -- 172.21.15.84:0/4099001975 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4108004910 con 0x7f411015b2b0 2023-09-13T08:25:10.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.780+0000 7f4115890700 1 -- 172.21.15.84:0/4099001975 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4110149ac0 con 0x7f411015b2b0 2023-09-13T08:25:10.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.780+0000 7f4115890700 1 -- 172.21.15.84:0/4099001975 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41100cea60 con 0x7f411015b2b0 2023-09-13T08:25:10.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.782+0000 7f5255f23700 1 Processor -- start 2023-09-13T08:25:10.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.782+0000 7f40fffff700 1 -- 172.21.15.84:0/4099001975 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f4108012430 con 0x7f411015b2b0 2023-09-13T08:25:10.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.783+0000 7f40fffff700 1 --2- 172.21.15.84:0/4099001975 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f40f406a620 0x7f40f406cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:10.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.783+0000 7f40fffff700 1 -- 172.21.15.84:0/4099001975 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f410808a2b0 con 0x7f411015b2b0 2023-09-13T08:25:10.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.783+0000 7f410effd700 1 --2- 172.21.15.84:0/4099001975 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f40f406a620 0x7f40f406cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:10.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.782+0000 7f5255f23700 1 -- start start 2023-09-13T08:25:10.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.784+0000 7f5255f23700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f52500c9770 0x7f5250070300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:10.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.784+0000 7f5255f23700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52500cd070 con 0x7f52501595e0 2023-09-13T08:25:10.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.784+0000 7f5255f23700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52500ccd40 con 0x7f5250070840 2023-09-13T08:25:10.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.784+0000 7f5255f23700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52500c9d30 con 0x7f52500c9770 2023-09-13T08:25:10.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.784+0000 7f524f7fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f52501595e0 0x7f525006cf70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:46704/0 (socket says 172.21.15.84:46704) 2023-09-13T08:25:10.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.784+0000 7f524f7fe700 1 -- 172.21.15.84:0/3742427827 learned_addr learned my addr 172.21.15.84:0/3742427827 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:25:10.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.784+0000 7f524effd700 1 --2- 172.21.15.84:0/3742427827 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f52500c9770 0x7f5250070300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:10.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.784+0000 7f410effd700 1 --2- 172.21.15.84:0/4099001975 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f40f406a620 0x7f40f406cae0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f411015acc0 tx=0x7f4104006c30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:10.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.785+0000 7f524effd700 1 -- 172.21.15.84:0/3742427827 >> v1:172.21.15.161:6789/0 conn(0x7f5250070840 legacy=0x7f52500cb860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:10.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.785+0000 7f524effd700 1 -- 172.21.15.84:0/3742427827 >> v1:172.21.15.84:6789/0 conn(0x7f52501595e0 legacy=0x7f525006cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:10.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.785+0000 7f524effd700 1 -- 172.21.15.84:0/3742427827 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52500ca010 con 0x7f52500c9770 2023-09-13T08:25:10.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.785+0000 7f524effd700 1 --2- 172.21.15.84:0/3742427827 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f52500c9770 0x7f5250070300 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f524800bec0 tx=0x7f524800d330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ba627f7e47cc9e2 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:10.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.784+0000 7f0d0da32700 1 Processor -- start 2023-09-13T08:25:10.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.784+0000 7f0d0da32700 1 -- start start 2023-09-13T08:25:10.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.785+0000 7f0d0da32700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f0d0816a2e0 0x7f0d080702c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:10.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.785+0000 7f0d0da32700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0d0816dcf0 0x7f0d080cb8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:10.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.785+0000 7f0d0da32700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d080ca110 con 0x7f0d08169f00 2023-09-13T08:25:10.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.785+0000 7f0d0da32700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d0816e0d0 con 0x7f0d0816a2e0 2023-09-13T08:25:10.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.785+0000 7f0d0da32700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0816e2b0 con 0x7f0d0816dcf0 2023-09-13T08:25:10.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.786+0000 7f0d067fc700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f0d0816a2e0 0x7f0d080702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:10.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.786+0000 7f4115890700 1 -- 172.21.15.84:0/4099001975 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40ec0052f0 con 0x7f411015b2b0 2023-09-13T08:25:10.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.786+0000 7f0d067fc700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f0d0816a2e0 0x7f0d080702c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.84:39836/0 (socket says 172.21.15.84:39836) 2023-09-13T08:25:10.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.786+0000 7f0d067fc700 1 -- 172.21.15.84:0/2482751059 learned_addr learned my addr 172.21.15.84:0/2482751059 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:10.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.786+0000 7f0d077fe700 1 --2- 172.21.15.84:0/2482751059 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0d0816dcf0 0x7f0d080cb8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:10.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.786+0000 7f0d067fc700 1 -- 172.21.15.84:0/2482751059 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0d0816dcf0 msgr2=0x7f0d080cb8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:10.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.786+0000 7f0d067fc700 1 --2- 172.21.15.84:0/2482751059 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0d0816dcf0 0x7f0d080cb8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:10.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.786+0000 7f0d067fc700 1 -- 172.21.15.84:0/2482751059 >> v1:172.21.15.161:6789/0 conn(0x7f0d08169f00 legacy=0x7f0d080ce7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:10.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.786+0000 7f0d067fc700 1 -- 172.21.15.84:0/2482751059 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d0816e590 con 0x7f0d0816a2e0 2023-09-13T08:25:10.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.786+0000 7f524e7fc700 1 -- 172.21.15.84:0/3742427827 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5248010070 con 0x7f52500c9770 2023-09-13T08:25:10.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.786+0000 7f524e7fc700 1 -- 172.21.15.84:0/3742427827 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5248003a20 con 0x7f52500c9770 2023-09-13T08:25:10.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.786+0000 7f524e7fc700 1 -- 172.21.15.84:0/3742427827 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5248003dd0 con 0x7f52500c9770 2023-09-13T08:25:10.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.786+0000 7f0d067fc700 1 --2- 172.21.15.84:0/2482751059 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d0816a2e0 0x7f0d080702c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0d00005ea0 tx=0x7f0d0000c390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=630a97878c9bd181 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:10.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.787+0000 7f0d05ffb700 1 -- 172.21.15.84:0/2482751059 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d00011810 con 0x7f0d0816a2e0 2023-09-13T08:25:10.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.787+0000 7f0d05ffb700 1 -- 172.21.15.84:0/2482751059 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d00011970 con 0x7f0d0816a2e0 2023-09-13T08:25:10.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.787+0000 7f0d05ffb700 1 -- 172.21.15.84:0/2482751059 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d00011d00 con 0x7f0d0816a2e0 2023-09-13T08:25:10.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.787+0000 7f5255f23700 1 -- 172.21.15.84:0/3742427827 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f52500c9770 msgr2=0x7f5250070300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:10.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.787+0000 7f5255f23700 1 --2- 172.21.15.84:0/3742427827 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f52500c9770 0x7f5250070300 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f524800bec0 tx=0x7f524800d330 comp rx=0 tx=0).stop 2023-09-13T08:25:10.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.787+0000 7f5255f23700 1 -- 172.21.15.84:0/3742427827 shutdown_connections 2023-09-13T08:25:10.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.787+0000 7f5255f23700 1 --2- 172.21.15.84:0/3742427827 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f52500c9770 0x7f5250070300 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:10.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.787+0000 7f5255f23700 1 -- 172.21.15.84:0/3742427827 >> 172.21.15.84:0/3742427827 conn(0x7f52500b0a20 msgr2=0x7f52500b0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:10.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.787+0000 7f5255f23700 1 -- 172.21.15.84:0/3742427827 shutdown_connections 2023-09-13T08:25:10.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.787+0000 7f5255f23700 1 -- 172.21.15.84:0/3742427827 wait complete. 2023-09-13T08:25:10.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.788+0000 7f0d0da32700 1 -- 172.21.15.84:0/2482751059 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d0816a2e0 msgr2=0x7f0d080702c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:10.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.788+0000 7f0d0da32700 1 --2- 172.21.15.84:0/2482751059 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d0816a2e0 0x7f0d080702c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0d00005ea0 tx=0x7f0d0000c390 comp rx=0 tx=0).stop 2023-09-13T08:25:10.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.788+0000 7f0d0da32700 1 -- 172.21.15.84:0/2482751059 shutdown_connections 2023-09-13T08:25:10.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.788+0000 7f0d0da32700 1 --2- 172.21.15.84:0/2482751059 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0d0816dcf0 0x7f0d080cb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:10.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.788+0000 7f0d0da32700 1 --2- 172.21.15.84:0/2482751059 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d0816a2e0 0x7f0d080702c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:10.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.788+0000 7f0d0da32700 1 -- 172.21.15.84:0/2482751059 >> 172.21.15.84:0/2482751059 conn(0x7f0d080b0a20 msgr2=0x7f0d080b0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:10.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.788+0000 7f0d0da32700 1 -- 172.21.15.84:0/2482751059 shutdown_connections 2023-09-13T08:25:10.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.788+0000 7f0d0da32700 1 -- 172.21.15.84:0/2482751059 wait complete. 2023-09-13T08:25:10.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.789+0000 7f0d0da32700 1 Processor -- start 2023-09-13T08:25:10.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.790+0000 7f0d0da32700 1 -- start start 2023-09-13T08:25:10.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.789+0000 7f5255f23700 1 Processor -- start 2023-09-13T08:25:10.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.790+0000 7f5255f23700 1 -- start start 2023-09-13T08:25:10.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.791+0000 7f5255f23700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5250070840 0x7f52500b3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:10.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.791+0000 7f5255f23700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52500c9770 0x7f52501e6a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:10.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.791+0000 7f5255f23700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52501595e0 0x7f52501e5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:10.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.791+0000 7f5255f23700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52501e56c0 con 0x7f52501595e0 2023-09-13T08:25:10.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.791+0000 7f5255f23700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52501e5990 con 0x7f52500c9770 2023-09-13T08:25:10.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.791+0000 7f5255f23700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52501e5c70 con 0x7f5250070840 2023-09-13T08:25:10.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.791+0000 7f524f7fe700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5250070840 0x7f52500b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:10.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.791+0000 7f524f7fe700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5250070840 0x7f52500b3750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.84:53934/0 (socket says 172.21.15.84:53934) 2023-09-13T08:25:10.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.791+0000 7f524f7fe700 1 -- 172.21.15.84:0/3699589956 learned_addr learned my addr 172.21.15.84:0/3699589956 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:10.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.791+0000 7f524effd700 1 --2- 172.21.15.84:0/3699589956 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52500c9770 0x7f52501e6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:10.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.791+0000 7f524ffff700 1 --2- 172.21.15.84:0/3699589956 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52501595e0 0x7f52501e5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:10.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.791+0000 7f0d0da32700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d08169f00 0x7f0d080c8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:10.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.791+0000 7f0d0da32700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0d0816a2e0 0x7f0d0816c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:10.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.791+0000 7f0d0da32700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d0816dcf0 0x7f0d0816a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:10.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.791+0000 7f0d0da32700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d080c7320 con 0x7f0d0816dcf0 2023-09-13T08:25:10.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.791+0000 7f0d0da32700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d080c86d0 con 0x7f0d08169f00 2023-09-13T08:25:10.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.791+0000 7f0d0da32700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d080c69f0 con 0x7f0d0816a2e0 2023-09-13T08:25:10.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.792+0000 7f524f7fe700 1 -- 172.21.15.84:0/3699589956 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52500c9770 msgr2=0x7f52501e6a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:10.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.792+0000 7f524f7fe700 1 --2- 172.21.15.84:0/3699589956 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52500c9770 0x7f52501e6a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:10.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.792+0000 7f524f7fe700 1 -- 172.21.15.84:0/3699589956 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52501595e0 msgr2=0x7f52501e5180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:10.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.792+0000 7f524f7fe700 1 --2- 172.21.15.84:0/3699589956 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52501595e0 0x7f52501e5180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:10.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.792+0000 7f524f7fe700 1 -- 172.21.15.84:0/3699589956 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f524800bb70 con 0x7f5250070840 2023-09-13T08:25:10.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.792+0000 7f524f7fe700 1 --2- 172.21.15.84:0/3699589956 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5250070840 0x7f52500b3750 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f524402de00 tx=0x7f524402bf70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:10.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.793+0000 7f5237fff700 1 -- 172.21.15.84:0/3699589956 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f524402ec10 con 0x7f5250070840 2023-09-13T08:25:10.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.793+0000 7f5237fff700 1 -- 172.21.15.84:0/3699589956 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f524402ed70 con 0x7f5250070840 2023-09-13T08:25:10.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.793+0000 7f5237fff700 1 -- 172.21.15.84:0/3699589956 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5244037690 con 0x7f5250070840 2023-09-13T08:25:10.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.793+0000 7f5255f23700 1 -- 172.21.15.84:0/3699589956 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52501e5f50 con 0x7f5250070840 2023-09-13T08:25:10.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.793+0000 7f5255f23700 1 -- 172.21.15.84:0/3699589956 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52501e6510 con 0x7f5250070840 2023-09-13T08:25:10.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.792+0000 7f0d06ffd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d08169f00 0x7f0d080c8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:10.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.792+0000 7f0d077fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d0816dcf0 0x7f0d0816a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:10.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.792+0000 7f0d077fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d0816dcf0 0x7f0d0816a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44078/0 (socket says 172.21.15.84:44078) 2023-09-13T08:25:10.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.792+0000 7f0d077fe700 1 -- 172.21.15.84:0/616930050 learned_addr learned my addr 172.21.15.84:0/616930050 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:10.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.792+0000 7f0d067fc700 1 --2- 172.21.15.84:0/616930050 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0d0816a2e0 0x7f0d0816c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:10.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.793+0000 7f0d077fe700 1 -- 172.21.15.84:0/616930050 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0d0816a2e0 msgr2=0x7f0d0816c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:10.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.793+0000 7f0d077fe700 1 --2- 172.21.15.84:0/616930050 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0d0816a2e0 0x7f0d0816c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:10.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.793+0000 7f0d077fe700 1 -- 172.21.15.84:0/616930050 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d08169f00 msgr2=0x7f0d080c8b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:10.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.793+0000 7f0d077fe700 1 --2- 172.21.15.84:0/616930050 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d08169f00 0x7f0d080c8b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:10.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.793+0000 7f0d077fe700 1 -- 172.21.15.84:0/616930050 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d00007d50 con 0x7f0d0816dcf0 2023-09-13T08:25:10.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.794+0000 7f0d077fe700 1 --2- 172.21.15.84:0/616930050 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d0816dcf0 0x7f0d0816a7f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0cf800b7a0 tx=0x7f0cf800bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:10.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.796+0000 7f5237fff700 1 -- 172.21.15.84:0/3699589956 <== mon.2 v2:172.21.15.161:3301/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f5244034070 con 0x7f5250070840 2023-09-13T08:25:10.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.797+0000 7f5237fff700 1 --2- 172.21.15.84:0/3699589956 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f523c06a650 0x7f523c06cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:10.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.797+0000 7f5237fff700 1 -- 172.21.15.84:0/3699589956 <== mon.2 v2:172.21.15.161:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f52440aad80 con 0x7f5250070840 2023-09-13T08:25:10.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.798+0000 7f40fffff700 1 -- 172.21.15.84:0/4099001975 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f4108059040 con 0x7f411015b2b0 2023-09-13T08:25:10.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.798+0000 7f0ceffff700 1 -- 172.21.15.84:0/616930050 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf8010070 con 0x7f0d0816dcf0 2023-09-13T08:25:10.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.798+0000 7f0ceffff700 1 -- 172.21.15.84:0/616930050 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cf800a7e0 con 0x7f0d0816dcf0 2023-09-13T08:25:10.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.799+0000 7f0d0da32700 1 -- 172.21.15.84:0/616930050 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d080c6cd0 con 0x7f0d0816dcf0 2023-09-13T08:25:10.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.799+0000 7f0d0da32700 1 -- 172.21.15.84:0/616930050 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d0808a300 con 0x7f0d0816dcf0 2023-09-13T08:25:10.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.799+0000 7f0ceffff700 1 -- 172.21.15.84:0/616930050 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf800ab70 con 0x7f0d0816dcf0 2023-09-13T08:25:10.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.801+0000 7f0ceffff700 1 -- 172.21.15.84:0/616930050 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f0cf800acd0 con 0x7f0d0816dcf0 2023-09-13T08:25:10.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.801+0000 7f0d0da32700 1 -- 172.21.15.84:0/616930050 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d0804e9b0 con 0x7f0d0816dcf0 2023-09-13T08:25:10.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.801+0000 7f0ceffff700 1 --2- 172.21.15.84:0/616930050 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f0cf006a6e0 0x7f0cf006cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:10.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.801+0000 7f0ceffff700 1 -- 172.21.15.84:0/616930050 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0cf8088210 con 0x7f0d0816dcf0 2023-09-13T08:25:10.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.801+0000 7f0d06ffd700 1 --2- 172.21.15.84:0/616930050 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f0cf006a6e0 0x7f0cf006cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:10.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.802+0000 7f0d06ffd700 1 --2- 172.21.15.84:0/616930050 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f0cf006a6e0 0x7f0cf006cba0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0d0816d860 tx=0x7f0cfc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:10.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.803+0000 7eff15b84700 1 Processor -- start 2023-09-13T08:25:10.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.803+0000 7eff15b84700 1 -- start start 2023-09-13T08:25:10.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.804+0000 7eff15b84700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7eff100702c0 0x7eff10070740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:10.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.804+0000 7eff15b84700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7eff100b1d60 0x7eff100b21f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:10.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.804+0000 7eff15b84700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff100ca260 con 0x7eff1015b2b0 2023-09-13T08:25:10.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.804+0000 7eff15b84700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff10070c80 con 0x7eff100702c0 2023-09-13T08:25:10.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.804+0000 7eff15b84700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff100c9690 con 0x7eff100b1d60 2023-09-13T08:25:10.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.805+0000 7eff0effd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7eff100702c0 0x7eff10070740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:10.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.805+0000 7eff0effd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7eff100702c0 0x7eff10070740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44088/0 (socket says 172.21.15.84:44088) 2023-09-13T08:25:10.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.805+0000 7eff0effd700 1 -- 172.21.15.84:0/1497549096 learned_addr learned my addr 172.21.15.84:0/1497549096 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:10.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.805+0000 7eff0effd700 1 -- 172.21.15.84:0/1497549096 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7eff100b1d60 msgr2=0x7eff100b21f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-13T08:25:10.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.805+0000 7eff0effd700 1 --2- 172.21.15.84:0/1497549096 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7eff100b1d60 0x7eff100b21f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:10.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.805+0000 7eff0effd700 1 -- 172.21.15.84:0/1497549096 >> v1:172.21.15.161:6789/0 conn(0x7eff1015b2b0 legacy=0x7eff100cc0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:10.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.805+0000 7eff0effd700 1 -- 172.21.15.84:0/1497549096 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff1015b690 con 0x7eff100702c0 2023-09-13T08:25:10.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.805+0000 7eff0effd700 1 --2- 172.21.15.84:0/1497549096 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff100702c0 0x7eff10070740 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7eff040098f0 tx=0x7eff04009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14e6387a59735a00 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:10.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.806+0000 7f524effd700 1 --2- 172.21.15.84:0/3699589956 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f523c06a650 0x7f523c06cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:10.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.806+0000 7f524effd700 1 --2- 172.21.15.84:0/3699589956 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f523c06a650 0x7f523c06cb10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f524800be90 tx=0x7f5248012000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:10.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.808+0000 7eff0e7fc700 1 -- 172.21.15.84:0/1497549096 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0400b8a0 con 0x7eff100702c0 2023-09-13T08:25:10.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.808+0000 7eff0e7fc700 1 -- 172.21.15.84:0/1497549096 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff0400ba00 con 0x7eff100702c0 2023-09-13T08:25:10.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.808+0000 7eff0e7fc700 1 -- 172.21.15.84:0/1497549096 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0400bd90 con 0x7eff100702c0 2023-09-13T08:25:10.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.808+0000 7f0ceffff700 1 -- 172.21.15.84:0/616930050 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f0cf804e9b0 con 0x7f0d0816dcf0 2023-09-13T08:25:10.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.809+0000 7eff15b84700 1 -- 172.21.15.84:0/1497549096 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff100702c0 msgr2=0x7eff10070740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:10.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.809+0000 7eff15b84700 1 --2- 172.21.15.84:0/1497549096 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff100702c0 0x7eff10070740 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7eff040098f0 tx=0x7eff04009c00 comp rx=0 tx=0).stop 2023-09-13T08:25:10.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.809+0000 7f5255f23700 1 -- 172.21.15.84:0/3699589956 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52300052f0 con 0x7f5250070840 2023-09-13T08:25:10.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.811+0000 7eff15b84700 1 -- 172.21.15.84:0/1497549096 shutdown_connections 2023-09-13T08:25:10.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.811+0000 7eff15b84700 1 --2- 172.21.15.84:0/1497549096 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7eff100b1d60 0x7eff100b21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:10.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.811+0000 7eff15b84700 1 --2- 172.21.15.84:0/1497549096 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff100702c0 0x7eff10070740 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:10.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.811+0000 7eff15b84700 1 -- 172.21.15.84:0/1497549096 >> 172.21.15.84:0/1497549096 conn(0x7eff100b0a20 msgr2=0x7eff100b0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:10.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.811+0000 7f51cdb7e700 1 Processor -- start 2023-09-13T08:25:10.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.811+0000 7f51cdb7e700 1 -- start start 2023-09-13T08:25:10.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.812+0000 7f51cdb7e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f51c806cc50 0x7f51c806d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:10.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.812+0000 7f51cdb7e700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f51c815d6b0 0x7f51c80ca830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:10.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.812+0000 7f51cdb7e700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51c80cb560 con 0x7f51c806b510 2023-09-13T08:25:10.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.812+0000 7f51cdb7e700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51c806d570 con 0x7f51c806cc50 2023-09-13T08:25:10.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.812+0000 7f51cdb7e700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51c806a750 con 0x7f51c815d6b0 2023-09-13T08:25:10.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.812+0000 7f51c77fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f51c806cc50 0x7f51c806d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:10.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.812+0000 7f51c77fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f51c806cc50 0x7f51c806d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44090/0 (socket says 172.21.15.84:44090) 2023-09-13T08:25:10.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.812+0000 7f51c77fe700 1 -- 172.21.15.84:0/2364088765 learned_addr learned my addr 172.21.15.84:0/2364088765 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:10.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.812+0000 7eff15b84700 1 -- 172.21.15.84:0/1497549096 shutdown_connections 2023-09-13T08:25:10.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.812+0000 7eff15b84700 1 -- 172.21.15.84:0/1497549096 wait complete. 2023-09-13T08:25:10.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.812+0000 7f51c6ffd700 1 --2- 172.21.15.84:0/2364088765 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f51c815d6b0 0x7f51c80ca830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:10.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.812+0000 7f51c67fc700 1 -- 172.21.15.84:0/2364088765 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3966364179 0 0) 0x7f51c80cb560 con 0x7f51c806b510 2023-09-13T08:25:10.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.812+0000 7f51c67fc700 1 -- 172.21.15.84:0/2364088765 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51b00035b0 con 0x7f51c806b510 2023-09-13T08:25:10.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.813+0000 7f51c67fc700 1 -- 172.21.15.84:0/2364088765 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3707024733 0 0) 0x7f51b00035b0 con 0x7f51c806b510 2023-09-13T08:25:10.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.813+0000 7f51c67fc700 1 -- 172.21.15.84:0/2364088765 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f51c815d6b0 msgr2=0x7f51c80ca830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:10.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.813+0000 7f51c67fc700 1 --2- 172.21.15.84:0/2364088765 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f51c815d6b0 0x7f51c80ca830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:10.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.813+0000 7f51c67fc700 1 -- 172.21.15.84:0/2364088765 >> v2:172.21.15.84:3300/0 conn(0x7f51c806cc50 msgr2=0x7f51c806d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:10.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.813+0000 7f51c67fc700 1 --2- 172.21.15.84:0/2364088765 >> v2:172.21.15.84:3300/0 conn(0x7f51c806cc50 0x7f51c806d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:10.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.813+0000 7f51c67fc700 1 -- 172.21.15.84:0/2364088765 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51c806aa30 con 0x7f51c806b510 2023-09-13T08:25:10.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.813+0000 7f51c67fc700 1 -- 172.21.15.84:0/2364088765 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2302733408 0 0) 0x7f51c00019f0 con 0x7f51c806b510 2023-09-13T08:25:10.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.813+0000 7f51c67fc700 1 -- 172.21.15.84:0/2364088765 >> v1:172.21.15.84:6789/0 conn(0x7f51c806b510 legacy=0x7f51c80cad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:10.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.813+0000 7f51c67fc700 1 --2- 172.21.15.84:0/2364088765 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51b0003a00 0x7f51b0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:10.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.813+0000 7f51c67fc700 1 --2- 172.21.15.84:0/2364088765 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f51b00043f0 0x7f51b00048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:10.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.813+0000 7f51c67fc700 1 --2- 172.21.15.84:0/2364088765 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f51b0005040 0x7f51b000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:10.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.813+0000 7f51c67fc700 1 -- 172.21.15.84:0/2364088765 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51c806d570 con 0x7f51b0003a00 2023-09-13T08:25:10.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.813+0000 7f51c67fc700 1 -- 172.21.15.84:0/2364088765 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51c806a750 con 0x7f51b0005040 2023-09-13T08:25:10.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.813+0000 7f51c67fc700 1 -- 172.21.15.84:0/2364088765 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51b000bfd0 con 0x7f51b00043f0 2023-09-13T08:25:10.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.813+0000 7f51c7fff700 1 --2- 172.21.15.84:0/2364088765 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f51b0005040 0x7f51b000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:10.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.813+0000 7f51c77fe700 1 --2- 172.21.15.84:0/2364088765 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51b0003a00 0x7f51b0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:10.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.813+0000 7f51c77fe700 1 -- 172.21.15.84:0/2364088765 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f51b00043f0 msgr2=0x7f51b00048d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-13T08:25:10.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.813+0000 7f51c77fe700 1 --2- 172.21.15.84:0/2364088765 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f51b00043f0 0x7f51b00048d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:10.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.813+0000 7f51c77fe700 1 -- 172.21.15.84:0/2364088765 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f51b0005040 msgr2=0x7f51b000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:10.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.813+0000 7f51c77fe700 1 --2- 172.21.15.84:0/2364088765 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f51b0005040 0x7f51b000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:10.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.814+0000 7f51c77fe700 1 -- 172.21.15.84:0/2364088765 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51c806aa30 con 0x7f51b0003a00 2023-09-13T08:25:10.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.814+0000 7f5237fff700 1 -- 172.21.15.84:0/3699589956 <== mon.2 v2:172.21.15.161:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f5244076080 con 0x7f5250070840 2023-09-13T08:25:10.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.814+0000 7f51c77fe700 1 --2- 172.21.15.84:0/2364088765 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51b0003a00 0x7f51b0003e20 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f51b8009bf0 tx=0x7f51b0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=812321154e179f13 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:10.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.814+0000 7f51c67fc700 1 -- 172.21.15.84:0/2364088765 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b8004020 con 0x7f51b0003a00 2023-09-13T08:25:10.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.814+0000 7f51c67fc700 1 -- 172.21.15.84:0/2364088765 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51b8004180 con 0x7f51b0003a00 2023-09-13T08:25:10.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.814+0000 7f51c67fc700 1 -- 172.21.15.84:0/2364088765 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b8004510 con 0x7f51b0003a00 2023-09-13T08:25:10.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.815+0000 7eff15b84700 1 Processor -- start 2023-09-13T08:25:10.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.816+0000 7eff15b84700 1 -- start start 2023-09-13T08:25:10.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.815+0000 7f51cdb7e700 1 -- 172.21.15.84:0/2364088765 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51b0003a00 msgr2=0x7f51b0003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:10.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.815+0000 7f51cdb7e700 1 --2- 172.21.15.84:0/2364088765 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51b0003a00 0x7f51b0003e20 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f51b8009bf0 tx=0x7f51b0005880 comp rx=0 tx=0).stop 2023-09-13T08:25:10.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.815+0000 7f51c7fff700 1 -- 172.21.15.84:0/2364088765 reap_dead start 2023-09-13T08:25:10.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.817+0000 7eff15b84700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7eff100702c0 0x7eff100a84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:10.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.817+0000 7eff15b84700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff100b1d60 0x7eff100c5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:10.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.817+0000 7eff15b84700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff1015b2b0 0x7eff10148340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:10.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.817+0000 7eff15b84700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff100c5780 con 0x7eff100b1d60 2023-09-13T08:25:10.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.817+0000 7eff15b84700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff10148880 con 0x7eff1015b2b0 2023-09-13T08:25:10.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.817+0000 7eff15b84700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff100a8bd0 con 0x7eff100702c0 2023-09-13T08:25:10.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.817+0000 7f51cdb7e700 1 -- 172.21.15.84:0/2364088765 shutdown_connections 2023-09-13T08:25:10.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.817+0000 7f51cdb7e700 1 -- 172.21.15.84:0/2364088765 >> 172.21.15.84:0/2364088765 conn(0x7f51c80cc230 msgr2=0x7f51c80cc640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:10.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.817+0000 7eff0f7fe700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7eff100702c0 0x7eff100a84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:10.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.817+0000 7eff0ffff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff1015b2b0 0x7eff10148340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:10.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.817+0000 7eff0f7fe700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7eff100702c0 0x7eff100a84d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.84:53964/0 (socket says 172.21.15.84:53964) 2023-09-13T08:25:10.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.818+0000 7eff0f7fe700 1 -- 172.21.15.84:0/1449014817 learned_addr learned my addr 172.21.15.84:0/1449014817 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:10.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.818+0000 7eff0f7fe700 1 -- 172.21.15.84:0/1449014817 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff1015b2b0 msgr2=0x7eff10148340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:10.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.818+0000 7eff0f7fe700 1 --2- 172.21.15.84:0/1449014817 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff1015b2b0 0x7eff10148340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:10.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.818+0000 7eff0f7fe700 1 -- 172.21.15.84:0/1449014817 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff100b1d60 msgr2=0x7eff100c5240 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-13T08:25:10.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.818+0000 7eff0f7fe700 1 --2- 172.21.15.84:0/1449014817 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff100b1d60 0x7eff100c5240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:10.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.818+0000 7eff0f7fe700 1 -- 172.21.15.84:0/1449014817 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff04009550 con 0x7eff100702c0 2023-09-13T08:25:10.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.818+0000 7eff0ffff700 1 --2- 172.21.15.84:0/1449014817 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff1015b2b0 0x7eff10148340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T08:25:10.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.818+0000 7eff0f7fe700 1 --2- 172.21.15.84:0/1449014817 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7eff100702c0 0x7eff100a84d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7eff0800cc00 tx=0x7eff0800cf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:10.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.818+0000 7efef7fff700 1 -- 172.21.15.84:0/1449014817 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff08003c00 con 0x7eff100702c0 2023-09-13T08:25:10.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.818+0000 7efef7fff700 1 -- 172.21.15.84:0/1449014817 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff08003d60 con 0x7eff100702c0 2023-09-13T08:25:10.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.818+0000 7efef7fff700 1 -- 172.21.15.84:0/1449014817 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0800ab30 con 0x7eff100702c0 2023-09-13T08:25:10.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.818+0000 7eff15b84700 1 -- 172.21.15.84:0/1449014817 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff100a8eb0 con 0x7eff100702c0 2023-09-13T08:25:10.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.818+0000 7eff15b84700 1 -- 172.21.15.84:0/1449014817 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff100a9470 con 0x7eff100702c0 2023-09-13T08:25:10.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.820+0000 7efef7fff700 1 -- 172.21.15.84:0/1449014817 <== mon.2 v2:172.21.15.161:3301/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7eff0800ac90 con 0x7eff100702c0 2023-09-13T08:25:10.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.821+0000 7efef7fff700 1 --2- 172.21.15.84:0/1449014817 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7efefc06a580 0x7efefc06ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:10.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.821+0000 7efef7fff700 1 -- 172.21.15.84:0/1449014817 <== mon.2 v2:172.21.15.161:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7eff08088d80 con 0x7eff100702c0 2023-09-13T08:25:10.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.824+0000 7eff0effd700 1 --2- 172.21.15.84:0/1449014817 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7efefc06a580 0x7efefc06ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:10.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.824+0000 7eff0effd700 1 --2- 172.21.15.84:0/1449014817 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7efefc06a580 0x7efefc06ca40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7eff100c91c0 tx=0x7eff04008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:10.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.825+0000 7f51cdb7e700 1 -- 172.21.15.84:0/2364088765 shutdown_connections 2023-09-13T08:25:10.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.826+0000 7eff15b84700 1 -- 172.21.15.84:0/1449014817 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff100abc30 con 0x7eff100702c0 2023-09-13T08:25:10.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.831+0000 7efef7fff700 1 -- 172.21.15.84:0/1449014817 <== mon.2 v2:172.21.15.161:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7eff08054000 con 0x7eff100702c0 2023-09-13T08:25:10.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.830+0000 7f51cdb7e700 1 -- 172.21.15.84:0/2364088765 wait complete. 2023-09-13T08:25:10.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.832+0000 7f51cdb7e700 1 Processor -- start 2023-09-13T08:25:10.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.833+0000 7f51cdb7e700 1 -- start start 2023-09-13T08:25:10.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.834+0000 7f51cdb7e700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f51b0003a00 0x7f51c80b1240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:10.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.834+0000 7f51cdb7e700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f51c80c4140 0x7f51c80c5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:10.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.834+0000 7f51cdb7e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51c815e200 0x7f51c815bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:10.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.834+0000 7f51cdb7e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51c80c5e80 con 0x7f51c815e200 2023-09-13T08:25:10.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.834+0000 7f51cdb7e700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51c80c6150 con 0x7f51c80c4140 2023-09-13T08:25:10.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.834+0000 7f51cdb7e700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51c80c3380 con 0x7f51b0003a00 2023-09-13T08:25:10.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.834+0000 7f51c77fe700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f51b0003a00 0x7f51c80b1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:10.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.834+0000 7f51c77fe700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f51b0003a00 0x7f51c80b1240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.84:53970/0 (socket says 172.21.15.84:53970) 2023-09-13T08:25:10.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.834+0000 7f51c77fe700 1 -- 172.21.15.84:0/3144501361 learned_addr learned my addr 172.21.15.84:0/3144501361 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:10.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.834+0000 7f51c6ffd700 1 --2- 172.21.15.84:0/3144501361 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f51c80c4140 0x7f51c80c5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:10.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.834+0000 7f51c6ffd700 1 -- 172.21.15.84:0/3144501361 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f51b0003a00 msgr2=0x7f51c80b1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:10.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.834+0000 7f51c6ffd700 1 --2- 172.21.15.84:0/3144501361 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f51b0003a00 0x7f51c80b1240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:10.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.834+0000 7f51c6ffd700 1 -- 172.21.15.84:0/3144501361 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51c815e200 msgr2=0x7f51c815bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:10.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.834+0000 7f51c6ffd700 1 --2- 172.21.15.84:0/3144501361 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51c815e200 0x7f51c815bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:10.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.834+0000 7f51c6ffd700 1 -- 172.21.15.84:0/3144501361 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51c80c3660 con 0x7f51c80c4140 2023-09-13T08:25:10.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.835+0000 7f51c6ffd700 1 --2- 172.21.15.84:0/3144501361 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f51c80c4140 0x7f51c80c5940 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f51b00047d0 tx=0x7f51bc00e8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:10.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.839+0000 7f51affff700 1 -- 172.21.15.84:0/3144501361 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51bc00c070 con 0x7f51c80c4140 2023-09-13T08:25:10.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.839+0000 7f51affff700 1 -- 172.21.15.84:0/3144501361 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51bc0136d0 con 0x7f51c80c4140 2023-09-13T08:25:10.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.839+0000 7f51affff700 1 -- 172.21.15.84:0/3144501361 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51bc013a80 con 0x7f51c80c4140 2023-09-13T08:25:10.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.839+0000 7f51cdb7e700 1 -- 172.21.15.84:0/3144501361 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51c80c3940 con 0x7f51c80c4140 2023-09-13T08:25:10.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.839+0000 7f51cdb7e700 1 -- 172.21.15.84:0/3144501361 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51c80c45c0 con 0x7f51c80c4140 2023-09-13T08:25:10.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.841+0000 7f51affff700 1 -- 172.21.15.84:0/3144501361 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f51bc013be0 con 0x7f51c80c4140 2023-09-13T08:25:10.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.841+0000 7f51affff700 1 --2- 172.21.15.84:0/3144501361 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f51b406a5d0 0x7f51b406ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:10.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.842+0000 7f51affff700 1 -- 172.21.15.84:0/3144501361 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f51bc088860 con 0x7f51c80c4140 2023-09-13T08:25:10.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.843+0000 7f51cdb7e700 1 -- 172.21.15.84:0/3144501361 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51a80052f0 con 0x7f51c80c4140 2023-09-13T08:25:10.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.847+0000 7f51c77fe700 1 --2- 172.21.15.84:0/3144501361 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f51b406a5d0 0x7f51b406ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:10.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.848+0000 7f51affff700 1 -- 172.21.15.84:0/3144501361 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f51bc053c10 con 0x7f51c80c4140 2023-09-13T08:25:10.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.848+0000 7f51c77fe700 1 --2- 172.21.15.84:0/3144501361 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f51b406a5d0 0x7f51b406ca90 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f51b8009130 tx=0x7f51b801d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:10.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.867+0000 7fdb52f17700 1 Processor -- start 2023-09-13T08:25:10.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.867+0000 7fdb52f17700 1 -- start start 2023-09-13T08:25:10.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.868+0000 7fdb52f17700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdb4c0c9770 0x7fdb4c070300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:10.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.868+0000 7fdb52f17700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fdb4c070840 0x7fdb4c0cb860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:10.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.868+0000 7fdb52f17700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb4c0cd070 con 0x7fdb4c1595e0 2023-09-13T08:25:10.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.868+0000 7fdb52f17700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb4c0ccd40 con 0x7fdb4c070840 2023-09-13T08:25:10.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.868+0000 7fdb52f17700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4c0c9d30 con 0x7fdb4c0c9770 2023-09-13T08:25:10.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.869+0000 7fdb514b4700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fdb4c070840 0x7fdb4c0cb860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:10.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.869+0000 7fdb514b4700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fdb4c070840 0x7fdb4c0cb860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44114/0 (socket says 172.21.15.84:44114) 2023-09-13T08:25:10.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.869+0000 7fdb514b4700 1 -- 172.21.15.84:0/3916601589 learned_addr learned my addr 172.21.15.84:0/3916601589 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:10.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.869+0000 7fdb4bfff700 1 --2- 172.21.15.84:0/3916601589 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdb4c0c9770 0x7fdb4c070300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:10.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.869+0000 7fdb514b4700 1 -- 172.21.15.84:0/3916601589 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdb4c0c9770 msgr2=0x7fdb4c070300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:10.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.869+0000 7fdb514b4700 1 --2- 172.21.15.84:0/3916601589 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdb4c0c9770 0x7fdb4c070300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:10.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.869+0000 7fdb514b4700 1 -- 172.21.15.84:0/3916601589 >> v1:172.21.15.84:6789/0 conn(0x7fdb4c1595e0 legacy=0x7fdb4c06cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:10.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.869+0000 7fdb514b4700 1 -- 172.21.15.84:0/3916601589 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb4c0ca010 con 0x7fdb4c070840 2023-09-13T08:25:10.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.870+0000 7fdb514b4700 1 --2- 172.21.15.84:0/3916601589 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdb4c070840 0x7fdb4c0cb860 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fdb4400d370 tx=0x7fdb4400d680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3ac2c478a7028a8 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:10.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.877+0000 7fdb4b7fe700 1 -- 172.21.15.84:0/3916601589 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb44010070 con 0x7fdb4c070840 2023-09-13T08:25:10.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.877+0000 7fdb4b7fe700 1 -- 172.21.15.84:0/3916601589 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb4400dc20 con 0x7fdb4c070840 2023-09-13T08:25:10.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.877+0000 7fdb4b7fe700 1 -- 172.21.15.84:0/3916601589 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb44007b30 con 0x7fdb4c070840 2023-09-13T08:25:10.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.878+0000 7fdb52f17700 1 -- 172.21.15.84:0/3916601589 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdb4c070840 msgr2=0x7fdb4c0cb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:10.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.878+0000 7fdb52f17700 1 --2- 172.21.15.84:0/3916601589 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdb4c070840 0x7fdb4c0cb860 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fdb4400d370 tx=0x7fdb4400d680 comp rx=0 tx=0).stop 2023-09-13T08:25:10.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.878+0000 7fdb52f17700 1 -- 172.21.15.84:0/3916601589 shutdown_connections 2023-09-13T08:25:10.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.878+0000 7fdb52f17700 1 --2- 172.21.15.84:0/3916601589 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdb4c070840 0x7fdb4c0cb860 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:10.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.878+0000 7fdb52f17700 1 --2- 172.21.15.84:0/3916601589 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdb4c0c9770 0x7fdb4c070300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:10.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.878+0000 7fdb52f17700 1 -- 172.21.15.84:0/3916601589 >> 172.21.15.84:0/3916601589 conn(0x7fdb4c0b0a20 msgr2=0x7fdb4c0b0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:10.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.879+0000 7fdb52f17700 1 -- 172.21.15.84:0/3916601589 shutdown_connections 2023-09-13T08:25:10.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.879+0000 7fdb52f17700 1 -- 172.21.15.84:0/3916601589 wait complete. 2023-09-13T08:25:10.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.880+0000 7fdb52f17700 1 Processor -- start 2023-09-13T08:25:10.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.881+0000 7fdb52f17700 1 -- start start 2023-09-13T08:25:10.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.882+0000 7fdb52f17700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdb4c070840 0x7fdb4c0b1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:10.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.882+0000 7fdb52f17700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdb4c0c9770 0x7fdb4c1e56c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:10.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.882+0000 7fdb52f17700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdb4c1595e0 0x7fdb4c0b2f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:10.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.882+0000 7fdb52f17700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4c1f7520 con 0x7fdb4c0c9770 2023-09-13T08:25:10.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.882+0000 7fdb52f17700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4c1f80b0 con 0x7fdb4c1595e0 2023-09-13T08:25:10.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.882+0000 7fdb52f17700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4c1e5230 con 0x7fdb4c070840 2023-09-13T08:25:10.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.883+0000 7fdb514b4700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdb4c1595e0 0x7fdb4c0b2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:10.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.883+0000 7fdb514b4700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdb4c1595e0 0x7fdb4c0b2f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.84:39894/0 (socket says 172.21.15.84:39894) 2023-09-13T08:25:10.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.883+0000 7fdb514b4700 1 -- 172.21.15.84:0/1040613171 learned_addr learned my addr 172.21.15.84:0/1040613171 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:10.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.883+0000 7fdb4bfff700 1 --2- 172.21.15.84:0/1040613171 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdb4c0c9770 0x7fdb4c1e56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:10.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.883+0000 7fdb514b4700 1 -- 172.21.15.84:0/1040613171 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdb4c070840 msgr2=0x7fdb4c0b1d40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-09-13T08:25:10.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.883+0000 7fdb514b4700 1 --2- 172.21.15.84:0/1040613171 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdb4c070840 0x7fdb4c0b1d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:10.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.883+0000 7fdb514b4700 1 -- 172.21.15.84:0/1040613171 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdb4c0c9770 msgr2=0x7fdb4c1e56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:10.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.883+0000 7fdb514b4700 1 --2- 172.21.15.84:0/1040613171 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdb4c0c9770 0x7fdb4c1e56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:10.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.883+0000 7fdb514b4700 1 -- 172.21.15.84:0/1040613171 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb4400d050 con 0x7fdb4c1595e0 2023-09-13T08:25:10.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.883+0000 7fdb4bfff700 1 --2- 172.21.15.84:0/1040613171 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdb4c0c9770 0x7fdb4c1e56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T08:25:10.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.884+0000 7fdb514b4700 1 --2- 172.21.15.84:0/1040613171 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdb4c1595e0 0x7fdb4c0b2f80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdb44008000 tx=0x7fdb44004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:10.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.885+0000 7fdb497fa700 1 -- 172.21.15.84:0/1040613171 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb440045a0 con 0x7fdb4c1595e0 2023-09-13T08:25:10.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.885+0000 7fdb497fa700 1 -- 172.21.15.84:0/1040613171 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb44004720 con 0x7fdb4c1595e0 2023-09-13T08:25:10.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.885+0000 7fdb497fa700 1 -- 172.21.15.84:0/1040613171 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb44008030 con 0x7fdb4c1595e0 2023-09-13T08:25:10.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.885+0000 7fdb52f17700 1 -- 172.21.15.84:0/1040613171 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb4c1e3c90 con 0x7fdb4c1595e0 2023-09-13T08:25:10.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.885+0000 7fdb52f17700 1 -- 172.21.15.84:0/1040613171 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb4c1e4be0 con 0x7fdb4c1595e0 2023-09-13T08:25:10.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.887+0000 7fdb52f17700 1 -- 172.21.15.84:0/1040613171 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb2c0052f0 con 0x7fdb4c1595e0 2023-09-13T08:25:10.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.888+0000 7fdb497fa700 1 -- 172.21.15.84:0/1040613171 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fdb44008190 con 0x7fdb4c1595e0 2023-09-13T08:25:10.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.889+0000 7fdb497fa700 1 --2- 172.21.15.84:0/1040613171 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fdb3806a650 0x7fdb3806cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:10.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.889+0000 7fdb497fa700 1 -- 172.21.15.84:0/1040613171 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fdb4408b790 con 0x7fdb4c1595e0 2023-09-13T08:25:10.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.890+0000 7fdb50cb3700 1 --2- 172.21.15.84:0/1040613171 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fdb3806a650 0x7fdb3806cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:10.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.890+0000 7fdb50cb3700 1 --2- 172.21.15.84:0/1040613171 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fdb3806a650 0x7fdb3806cb10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c0c2150 tx=0x7fdb40006be0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:10.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:10.895+0000 7fdb497fa700 1 -- 172.21.15.84:0/1040613171 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fdb44056a00 con 0x7fdb4c1595e0 2023-09-13T08:25:11.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.155+0000 7f091227a700 1 -- 172.21.15.84:0/1212439421 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f090c14f2d0 con 0x7f090c1619d0 2023-09-13T08:25:11.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.156+0000 7f0901ffb700 1 -- 172.21.15.84:0/1212439421 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f090c14f2d0 con 0x7f090c1619d0 2023-09-13T08:25:11.160 INFO:teuthology.orchestra.run.smithi084.stdout:55834574859 2023-09-13T08:25:11.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.162+0000 7fe102afd700 1 -- 172.21.15.84:0/3525895946 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fe0e80055d0 con 0x7fe0fc14c2d0 2023-09-13T08:25:11.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.162+0000 7f091227a700 1 -- 172.21.15.84:0/1212439421 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f08f006a580 msgr2=0x7f08f006ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:11.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.162+0000 7f091227a700 1 --2- 172.21.15.84:0/1212439421 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f08f006a580 0x7f08f006ca40 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f08fc0090b0 tx=0x7f08fc010000 comp rx=0 tx=0).stop 2023-09-13T08:25:11.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.162+0000 7f091227a700 1 -- 172.21.15.84:0/1212439421 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f090c1619d0 msgr2=0x7f090c13f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:11.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.162+0000 7f091227a700 1 --2- 172.21.15.84:0/1212439421 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f090c1619d0 0x7f090c13f760 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f090c0cc920 tx=0x7f090800b750 comp rx=0 tx=0).stop 2023-09-13T08:25:11.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.163+0000 7fe0f97fa700 1 -- 172.21.15.84:0/3525895946 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe0f4057130 con 0x7fe0fc14c2d0 2023-09-13T08:25:11.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.163+0000 7f091227a700 1 -- 172.21.15.84:0/1212439421 shutdown_connections 2023-09-13T08:25:11.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.163+0000 7f091227a700 1 --2- 172.21.15.84:0/1212439421 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f08f006a580 0x7f08f006ca40 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:11.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.163+0000 7f091227a700 1 --2- 172.21.15.84:0/1212439421 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f090c1619d0 0x7f090c13f760 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:11.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.163+0000 7f091227a700 1 --2- 172.21.15.84:0/1212439421 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f090c0b13c0 0x7f090c14e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:11.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.163+0000 7f091227a700 1 --2- 172.21.15.84:0/1212439421 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f090c0c9a00 0x7f090c0af600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:11.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.163+0000 7f091227a700 1 -- 172.21.15.84:0/1212439421 >> 172.21.15.84:0/1212439421 conn(0x7f090c0b07f0 msgr2=0x7f090c0ae710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:11.167 INFO:teuthology.orchestra.run.smithi084.stdout:55834574861 2023-09-13T08:25:11.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.169+0000 7f091227a700 1 -- 172.21.15.84:0/1212439421 shutdown_connections 2023-09-13T08:25:11.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.171+0000 7f091227a700 1 -- 172.21.15.84:0/1212439421 wait complete. 2023-09-13T08:25:11.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.171+0000 7fe102afd700 1 -- 172.21.15.84:0/3525895946 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fe0e406a7b0 msgr2=0x7fe0e406cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:11.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.171+0000 7fe102afd700 1 --2- 172.21.15.84:0/3525895946 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fe0e406a7b0 0x7fe0e406cc70 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc15dfe0 tx=0x7fe0f0007a40 comp rx=0 tx=0).stop 2023-09-13T08:25:11.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.171+0000 7fe102afd700 1 -- 172.21.15.84:0/3525895946 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0fc14c2d0 msgr2=0x7fe0fc0c8760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:11.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.171+0000 7fe102afd700 1 --2- 172.21.15.84:0/3525895946 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0fc14c2d0 0x7fe0fc0c8760 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe0f4007b20 tx=0x7fe0f4007ee0 comp rx=0 tx=0).stop 2023-09-13T08:25:11.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.172+0000 7fe102afd700 1 -- 172.21.15.84:0/3525895946 shutdown_connections 2023-09-13T08:25:11.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.172+0000 7fe102afd700 1 --2- 172.21.15.84:0/3525895946 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0fc14c2d0 0x7fe0fc0c8760 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:11.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.172+0000 7fe102afd700 1 --2- 172.21.15.84:0/3525895946 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fe0e406a7b0 0x7fe0e406cc70 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:11.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.172+0000 7fe102afd700 1 --2- 172.21.15.84:0/3525895946 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe0fc0b1540 0x7fe0fc0c7ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:11.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.172+0000 7fe102afd700 1 --2- 172.21.15.84:0/3525895946 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe0fc1598b0 0x7fe0fc0c8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:11.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.172+0000 7fe102afd700 1 -- 172.21.15.84:0/3525895946 >> 172.21.15.84:0/3525895946 conn(0x7fe0fc0b0a20 msgr2=0x7fe0fc0c2a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:11.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.180+0000 7fe102afd700 1 -- 172.21.15.84:0/3525895946 shutdown_connections 2023-09-13T08:25:11.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.180+0000 7fe102afd700 1 -- 172.21.15.84:0/3525895946 wait complete. 2023-09-13T08:25:11.195 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.4 2023-09-13T08:25:11.195 DEBUG:teuthology.parallel:result is None 2023-09-13T08:25:11.199 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574861 got 55834574861 for osd.5 2023-09-13T08:25:11.199 DEBUG:teuthology.parallel:result is None 2023-09-13T08:25:11.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.205+0000 7f0d0da32700 1 -- 172.21.15.84:0/616930050 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0d08070890 con 0x7f0d0816dcf0 2023-09-13T08:25:11.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.205+0000 7f4115890700 1 -- 172.21.15.84:0/4099001975 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f40ec0055a0 con 0x7f411015b2b0 2023-09-13T08:25:11.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.205+0000 7f0ceffff700 1 -- 172.21.15.84:0/616930050 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0cf8053630 con 0x7f0d0816dcf0 2023-09-13T08:25:11.206 INFO:teuthology.orchestra.run.smithi084.stdout:55834574859 2023-09-13T08:25:11.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.205+0000 7f40fffff700 1 -- 172.21.15.84:0/4099001975 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4108017090 con 0x7f411015b2b0 2023-09-13T08:25:11.207 INFO:teuthology.orchestra.run.smithi084.stdout:55834574860 2023-09-13T08:25:11.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.206+0000 7eff15b84700 1 -- 172.21.15.84:0/1449014817 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7eff1004e9b0 con 0x7eff100702c0 2023-09-13T08:25:11.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.207+0000 7efef7fff700 1 -- 172.21.15.84:0/1449014817 <== mon.2 v2:172.21.15.161:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7eff08057620 con 0x7eff100702c0 2023-09-13T08:25:11.208 INFO:teuthology.orchestra.run.smithi084.stdout:55834574860 2023-09-13T08:25:11.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.209+0000 7f0d0da32700 1 -- 172.21.15.84:0/616930050 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f0cf006a6e0 msgr2=0x7f0cf006cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:11.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.209+0000 7f0d0da32700 1 --2- 172.21.15.84:0/616930050 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f0cf006a6e0 0x7f0cf006cba0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0d0816d860 tx=0x7f0cfc009040 comp rx=0 tx=0).stop 2023-09-13T08:25:11.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.209+0000 7f0d0da32700 1 -- 172.21.15.84:0/616930050 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d0816dcf0 msgr2=0x7f0d0816a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:11.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.209+0000 7f0d0da32700 1 --2- 172.21.15.84:0/616930050 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d0816dcf0 0x7f0d0816a7f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0cf800b7a0 tx=0x7f0cf800bab0 comp rx=0 tx=0).stop 2023-09-13T08:25:11.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.209+0000 7f0d0da32700 1 -- 172.21.15.84:0/616930050 shutdown_connections 2023-09-13T08:25:11.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.209+0000 7f0d0da32700 1 --2- 172.21.15.84:0/616930050 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d0816dcf0 0x7f0d0816a7f0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:11.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.209+0000 7f0d0da32700 1 --2- 172.21.15.84:0/616930050 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f0cf006a6e0 0x7f0cf006cba0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:11.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.209+0000 7f0d0da32700 1 --2- 172.21.15.84:0/616930050 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d08169f00 0x7f0d080c8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:11.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.209+0000 7f0d0da32700 1 --2- 172.21.15.84:0/616930050 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0d0816a2e0 0x7f0d0816c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:11.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.209+0000 7f0d0da32700 1 -- 172.21.15.84:0/616930050 >> 172.21.15.84:0/616930050 conn(0x7f0d080b0a20 msgr2=0x7f0d080b3710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:11.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.210+0000 7f4115890700 1 -- 172.21.15.84:0/4099001975 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f40f406a620 msgr2=0x7f40f406cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:11.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.210+0000 7f4115890700 1 --2- 172.21.15.84:0/4099001975 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f40f406a620 0x7f40f406cae0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f411015acc0 tx=0x7f4104006c30 comp rx=0 tx=0).stop 2023-09-13T08:25:11.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.210+0000 7f4115890700 1 -- 172.21.15.84:0/4099001975 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f411015b2b0 msgr2=0x7f41100cf1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:11.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.210+0000 7f4115890700 1 --2- 172.21.15.84:0/4099001975 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f411015b2b0 0x7f41100cf1d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4108014000 tx=0x7f4108004ad0 comp rx=0 tx=0).stop 2023-09-13T08:25:11.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.210+0000 7f4115890700 1 -- 172.21.15.84:0/4099001975 shutdown_connections 2023-09-13T08:25:11.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.210+0000 7f4115890700 1 --2- 172.21.15.84:0/4099001975 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f411015b2b0 0x7f41100cf1d0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:11.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.210+0000 7f4115890700 1 --2- 172.21.15.84:0/4099001975 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f41100709d0 0x7f41100ce480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:11.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.210+0000 7f4115890700 1 --2- 172.21.15.84:0/4099001975 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f40f406a620 0x7f40f406cae0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:11.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.210+0000 7f4115890700 1 --2- 172.21.15.84:0/4099001975 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41100cc630 0x7f41100c65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:11.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.210+0000 7f4115890700 1 -- 172.21.15.84:0/4099001975 >> 172.21.15.84:0/4099001975 conn(0x7f41100b0a20 msgr2=0x7f41100cd580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:11.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.210+0000 7f0d0da32700 1 -- 172.21.15.84:0/616930050 shutdown_connections 2023-09-13T08:25:11.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.210+0000 7f4115890700 1 -- 172.21.15.84:0/4099001975 shutdown_connections 2023-09-13T08:25:11.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.210+0000 7f0d0da32700 1 -- 172.21.15.84:0/616930050 wait complete. 2023-09-13T08:25:11.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.210+0000 7f4115890700 1 -- 172.21.15.84:0/4099001975 wait complete. 2023-09-13T08:25:11.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.213+0000 7eff15b84700 1 -- 172.21.15.84:0/1449014817 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7efefc06a580 msgr2=0x7efefc06ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:11.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.213+0000 7eff15b84700 1 --2- 172.21.15.84:0/1449014817 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7efefc06a580 0x7efefc06ca40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7eff100c91c0 tx=0x7eff04008030 comp rx=0 tx=0).stop 2023-09-13T08:25:11.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.213+0000 7eff15b84700 1 -- 172.21.15.84:0/1449014817 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7eff100702c0 msgr2=0x7eff100a84d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:11.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.213+0000 7eff15b84700 1 --2- 172.21.15.84:0/1449014817 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7eff100702c0 0x7eff100a84d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7eff0800cc00 tx=0x7eff0800cf10 comp rx=0 tx=0).stop 2023-09-13T08:25:11.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.218+0000 7eff15b84700 1 -- 172.21.15.84:0/1449014817 shutdown_connections 2023-09-13T08:25:11.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.218+0000 7eff15b84700 1 --2- 172.21.15.84:0/1449014817 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7efefc06a580 0x7efefc06ca40 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:11.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.218+0000 7eff15b84700 1 --2- 172.21.15.84:0/1449014817 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff1015b2b0 0x7eff10148340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:11.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.218+0000 7eff15b84700 1 --2- 172.21.15.84:0/1449014817 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7eff100702c0 0x7eff100a84d0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:11.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.218+0000 7eff15b84700 1 --2- 172.21.15.84:0/1449014817 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff100b1d60 0x7eff100c5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:11.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.218+0000 7eff15b84700 1 -- 172.21.15.84:0/1449014817 >> 172.21.15.84:0/1449014817 conn(0x7eff100b0a20 msgr2=0x7eff1006ca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:11.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.218+0000 7eff15b84700 1 -- 172.21.15.84:0/1449014817 shutdown_connections 2023-09-13T08:25:11.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.218+0000 7eff15b84700 1 -- 172.21.15.84:0/1449014817 wait complete. 2023-09-13T08:25:11.226 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574860 for osd.2 2023-09-13T08:25:11.227 DEBUG:teuthology.parallel:result is None 2023-09-13T08:25:11.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.229+0000 7f5255f23700 1 -- 172.21.15.84:0/3699589956 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f52300055a0 con 0x7f5250070840 2023-09-13T08:25:11.230 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.1 2023-09-13T08:25:11.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.230+0000 7f5237fff700 1 -- 172.21.15.84:0/3699589956 <== mon.2 v2:172.21.15.161:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f52440796a0 con 0x7f5250070840 2023-09-13T08:25:11.232 INFO:teuthology.orchestra.run.smithi084.stdout:55834574861 2023-09-13T08:25:11.232 DEBUG:teuthology.parallel:result is None 2023-09-13T08:25:11.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.232+0000 7f5255f23700 1 -- 172.21.15.84:0/3699589956 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f523c06a650 msgr2=0x7f523c06cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:11.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.232+0000 7f5255f23700 1 --2- 172.21.15.84:0/3699589956 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f523c06a650 0x7f523c06cb10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f524800be90 tx=0x7f5248012000 comp rx=0 tx=0).stop 2023-09-13T08:25:11.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.232+0000 7f5255f23700 1 -- 172.21.15.84:0/3699589956 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5250070840 msgr2=0x7f52500b3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:11.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.232+0000 7f5255f23700 1 --2- 172.21.15.84:0/3699589956 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5250070840 0x7f52500b3750 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f524402de00 tx=0x7f524402bf70 comp rx=0 tx=0).stop 2023-09-13T08:25:11.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.232+0000 7f5255f23700 1 -- 172.21.15.84:0/3699589956 shutdown_connections 2023-09-13T08:25:11.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.232+0000 7f5255f23700 1 --2- 172.21.15.84:0/3699589956 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52501595e0 0x7f52501e5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:11.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.232+0000 7f5255f23700 1 --2- 172.21.15.84:0/3699589956 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5250070840 0x7f52500b3750 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:11.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.232+0000 7f5255f23700 1 --2- 172.21.15.84:0/3699589956 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f523c06a650 0x7f523c06cb10 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:11.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.232+0000 7f5255f23700 1 --2- 172.21.15.84:0/3699589956 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52500c9770 0x7f52501e6a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:11.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.232+0000 7f5255f23700 1 -- 172.21.15.84:0/3699589956 >> 172.21.15.84:0/3699589956 conn(0x7f52500b0a20 msgr2=0x7f52500cb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:11.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.232+0000 7f5255f23700 1 -- 172.21.15.84:0/3699589956 shutdown_connections 2023-09-13T08:25:11.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.232+0000 7f5255f23700 1 -- 172.21.15.84:0/3699589956 wait complete. 2023-09-13T08:25:11.239 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574860 for osd.0 2023-09-13T08:25:11.239 DEBUG:teuthology.parallel:result is None 2023-09-13T08:25:11.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.242+0000 7f51cdb7e700 1 -- 172.21.15.84:0/3144501361 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f51a8005870 con 0x7f51c80c4140 2023-09-13T08:25:11.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.242+0000 7f51affff700 1 -- 172.21.15.84:0/3144501361 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f51bc017090 con 0x7f51c80c4140 2023-09-13T08:25:11.242 INFO:teuthology.orchestra.run.smithi084.stdout:55834574859 2023-09-13T08:25:11.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.244+0000 7f51cdb7e700 1 -- 172.21.15.84:0/3144501361 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f51b406a5d0 msgr2=0x7f51b406ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:11.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.244+0000 7f51cdb7e700 1 --2- 172.21.15.84:0/3144501361 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f51b406a5d0 0x7f51b406ca90 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f51b8009130 tx=0x7f51b801d040 comp rx=0 tx=0).stop 2023-09-13T08:25:11.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.244+0000 7f51cdb7e700 1 -- 172.21.15.84:0/3144501361 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f51c80c4140 msgr2=0x7f51c80c5940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:11.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.244+0000 7f51cdb7e700 1 --2- 172.21.15.84:0/3144501361 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f51c80c4140 0x7f51c80c5940 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f51b00047d0 tx=0x7f51bc00e8f0 comp rx=0 tx=0).stop 2023-09-13T08:25:11.246 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574861 got 55834574861 for osd.6 2023-09-13T08:25:11.247 DEBUG:teuthology.parallel:result is None 2023-09-13T08:25:11.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.245+0000 7f51cdb7e700 1 -- 172.21.15.84:0/3144501361 shutdown_connections 2023-09-13T08:25:11.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.245+0000 7f51cdb7e700 1 --2- 172.21.15.84:0/3144501361 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51c815e200 0x7f51c815bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:11.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.245+0000 7f51cdb7e700 1 --2- 172.21.15.84:0/3144501361 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f51b0003a00 0x7f51c80b1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:11.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.245+0000 7f51cdb7e700 1 --2- 172.21.15.84:0/3144501361 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f51b406a5d0 0x7f51b406ca90 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:11.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.245+0000 7f51cdb7e700 1 --2- 172.21.15.84:0/3144501361 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f51c80c4140 0x7f51c80c5940 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:11.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.245+0000 7f51cdb7e700 1 -- 172.21.15.84:0/3144501361 >> 172.21.15.84:0/3144501361 conn(0x7f51c80cc230 msgr2=0x7f51c81e7ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:11.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.245+0000 7f51cdb7e700 1 -- 172.21.15.84:0/3144501361 shutdown_connections 2023-09-13T08:25:11.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.245+0000 7f51cdb7e700 1 -- 172.21.15.84:0/3144501361 wait complete. 2023-09-13T08:25:11.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.249+0000 7fdb52f17700 1 -- 172.21.15.84:0/1040613171 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fdb2c005870 con 0x7fdb4c1595e0 2023-09-13T08:25:11.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.249+0000 7fdb497fa700 1 -- 172.21.15.84:0/1040613171 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdb4405a020 con 0x7fdb4c1595e0 2023-09-13T08:25:11.250 INFO:teuthology.orchestra.run.smithi084.stdout:55834574859 2023-09-13T08:25:11.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.252+0000 7fdb52f17700 1 -- 172.21.15.84:0/1040613171 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fdb3806a650 msgr2=0x7fdb3806cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:11.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.252+0000 7fdb52f17700 1 --2- 172.21.15.84:0/1040613171 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fdb3806a650 0x7fdb3806cb10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c0c2150 tx=0x7fdb40006be0 comp rx=0 tx=0).stop 2023-09-13T08:25:11.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.252+0000 7fdb52f17700 1 -- 172.21.15.84:0/1040613171 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdb4c1595e0 msgr2=0x7fdb4c0b2f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:11.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.252+0000 7fdb52f17700 1 --2- 172.21.15.84:0/1040613171 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdb4c1595e0 0x7fdb4c0b2f80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdb44008000 tx=0x7fdb44004ad0 comp rx=0 tx=0).stop 2023-09-13T08:25:11.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.252+0000 7fdb52f17700 1 -- 172.21.15.84:0/1040613171 shutdown_connections 2023-09-13T08:25:11.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.252+0000 7fdb52f17700 1 --2- 172.21.15.84:0/1040613171 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fdb3806a650 0x7fdb3806cb10 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:11.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.252+0000 7fdb52f17700 1 --2- 172.21.15.84:0/1040613171 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdb4c1595e0 0x7fdb4c0b2f80 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:11.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.252+0000 7fdb52f17700 1 --2- 172.21.15.84:0/1040613171 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdb4c070840 0x7fdb4c0b1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:11.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.252+0000 7fdb52f17700 1 --2- 172.21.15.84:0/1040613171 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdb4c0c9770 0x7fdb4c1e56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:11.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.252+0000 7fdb52f17700 1 -- 172.21.15.84:0/1040613171 >> 172.21.15.84:0/1040613171 conn(0x7fdb4c0b0a20 msgr2=0x7fdb4c0cb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:11.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.252+0000 7fdb52f17700 1 -- 172.21.15.84:0/1040613171 shutdown_connections 2023-09-13T08:25:11.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.252+0000 7fdb52f17700 1 -- 172.21.15.84:0/1040613171 wait complete. 2023-09-13T08:25:11.258 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.7 2023-09-13T08:25:11.258 DEBUG:teuthology.parallel:result is None 2023-09-13T08:25:11.264 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.3 2023-09-13T08:25:11.264 DEBUG:teuthology.parallel:result is None 2023-09-13T08:25:11.265 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-09-13T08:25:11.265 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-13T08:25:11.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.424+0000 7f18c0544700 1 Processor -- start 2023-09-13T08:25:11.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.424+0000 7f18c0544700 1 -- start start 2023-09-13T08:25:11.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.425+0000 7f18c0544700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f18b81543b0 0x7f18b8154790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:11.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.425+0000 7f18c0544700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18b806bf90 con 0x7f18b80cbc80 2023-09-13T08:25:11.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.425+0000 7f18c0544700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18b815a8c0 con 0x7f18b80af1f0 2023-09-13T08:25:11.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.425+0000 7f18c0544700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18b815a6d0 con 0x7f18b81543b0 2023-09-13T08:25:11.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.425+0000 7f18beae1700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f18b80cbc80 0x7f18b80ae530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:46776/0 (socket says 172.21.15.84:46776) 2023-09-13T08:25:11.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.425+0000 7f18beae1700 1 -- 172.21.15.84:0/1278018108 learned_addr learned my addr 172.21.15.84:0/1278018108 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:25:11.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.425+0000 7f18be2e0700 1 --2- 172.21.15.84:0/1278018108 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f18b81543b0 0x7f18b8154790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:11.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.425+0000 7f18bd2de700 1 -- 172.21.15.84:0/1278018108 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3298295281 0 0) 0x7f18b806bf90 con 0x7f18b80cbc80 2023-09-13T08:25:11.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.425+0000 7f18bd2de700 1 -- 172.21.15.84:0/1278018108 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18a40035b0 con 0x7f18b80cbc80 2023-09-13T08:25:11.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.426+0000 7f18bd2de700 1 -- 172.21.15.84:0/1278018108 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2114993581 0 0) 0x7f18a40035b0 con 0x7f18b80cbc80 2023-09-13T08:25:11.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.426+0000 7f18bd2de700 1 -- 172.21.15.84:0/1278018108 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f18b81543b0 msgr2=0x7f18b8154790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:11.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.426+0000 7f18bd2de700 1 --2- 172.21.15.84:0/1278018108 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f18b81543b0 0x7f18b8154790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:11.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.426+0000 7f18bd2de700 1 -- 172.21.15.84:0/1278018108 >> v1:172.21.15.161:6789/0 conn(0x7f18b80af1f0 legacy=0x7f18b80cb570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:11.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.426+0000 7f18bd2de700 1 -- 172.21.15.84:0/1278018108 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18b815ab80 con 0x7f18b80cbc80 2023-09-13T08:25:11.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.426+0000 7f18bd2de700 1 -- 172.21.15.84:0/1278018108 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2302733408 0 0) 0x7f18b00019f0 con 0x7f18b80cbc80 2023-09-13T08:25:11.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.426+0000 7f18bd2de700 1 -- 172.21.15.84:0/1278018108 >> v1:172.21.15.84:6789/0 conn(0x7f18b80cbc80 legacy=0x7f18b80ae530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:11.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.426+0000 7f18bd2de700 1 --2- 172.21.15.84:0/1278018108 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f18b81543b0 0x7f18a4003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:11.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.426+0000 7f18bd2de700 1 --2- 172.21.15.84:0/1278018108 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18a4003fb0 0x7f18a4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:11.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.426+0000 7f18bd2de700 1 --2- 172.21.15.84:0/1278018108 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18a4004d90 0x7f18a4005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:11.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.426+0000 7f18bd2de700 1 -- 172.21.15.84:0/1278018108 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a400bac0 con 0x7f18a4004d90 2023-09-13T08:25:11.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.426+0000 7f18bd2de700 1 -- 172.21.15.84:0/1278018108 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a400bc30 con 0x7f18a4003fb0 2023-09-13T08:25:11.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.426+0000 7f18bd2de700 1 -- 172.21.15.84:0/1278018108 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18a400e000 con 0x7f18b81543b0 2023-09-13T08:25:11.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.426+0000 7f18beae1700 1 --2- 172.21.15.84:0/1278018108 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18a4004d90 0x7f18a4005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:11.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.426+0000 7f18be2e0700 1 --2- 172.21.15.84:0/1278018108 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f18b81543b0 0x7f18a4003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:11.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.426+0000 7f18bdadf700 1 --2- 172.21.15.84:0/1278018108 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18a4003fb0 0x7f18a4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:11.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.426+0000 7f18beae1700 1 -- 172.21.15.84:0/1278018108 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f18b81543b0 msgr2=0x7f18a4003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:11.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.426+0000 7f18beae1700 1 --2- 172.21.15.84:0/1278018108 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f18b81543b0 0x7f18a4003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:11.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.426+0000 7f18beae1700 1 -- 172.21.15.84:0/1278018108 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18a4003fb0 msgr2=0x7f18a4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:11.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.426+0000 7f18beae1700 1 --2- 172.21.15.84:0/1278018108 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18a4003fb0 0x7f18a4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:11.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.426+0000 7f18beae1700 1 -- 172.21.15.84:0/1278018108 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18a40035b0 con 0x7f18a4004d90 2023-09-13T08:25:11.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.426+0000 7f18beae1700 1 --2- 172.21.15.84:0/1278018108 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18a4004d90 0x7f18a4005210 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f18b000a830 tx=0x7f18a4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e4163bff5136b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:11.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.426+0000 7f18bd2de700 1 -- 172.21.15.84:0/1278018108 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b000a2f0 con 0x7f18a4004d90 2023-09-13T08:25:11.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.426+0000 7f18bd2de700 1 -- 172.21.15.84:0/1278018108 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18b0012620 con 0x7f18a4004d90 2023-09-13T08:25:11.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.426+0000 7f18bd2de700 1 -- 172.21.15.84:0/1278018108 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b00129d0 con 0x7f18a4004d90 2023-09-13T08:25:11.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.427+0000 7f18c0544700 1 -- 172.21.15.84:0/1278018108 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18a4004d90 msgr2=0x7f18a4005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:11.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.427+0000 7f18c0544700 1 --2- 172.21.15.84:0/1278018108 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18a4004d90 0x7f18a4005210 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f18b000a830 tx=0x7f18a4005880 comp rx=0 tx=0).stop 2023-09-13T08:25:11.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.427+0000 7f18beae1700 1 -- 172.21.15.84:0/1278018108 reap_dead start 2023-09-13T08:25:11.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.427+0000 7f18c0544700 1 -- 172.21.15.84:0/1278018108 shutdown_connections 2023-09-13T08:25:11.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.427+0000 7f18c0544700 1 -- 172.21.15.84:0/1278018108 >> 172.21.15.84:0/1278018108 conn(0x7f18b80cc230 msgr2=0x7f18b80cc640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:11.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.427+0000 7f18c0544700 1 -- 172.21.15.84:0/1278018108 shutdown_connections 2023-09-13T08:25:11.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.427+0000 7f18c0544700 1 -- 172.21.15.84:0/1278018108 wait complete. 2023-09-13T08:25:11.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.428+0000 7f18c0544700 1 Processor -- start 2023-09-13T08:25:11.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.428+0000 7f18c0544700 1 -- start start 2023-09-13T08:25:11.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.429+0000 7f18c0544700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f18a4004d90 0x7f18b8154a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:11.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.429+0000 7f18c0544700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18b8156780 0x7f18b8156c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:11.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.429+0000 7f18c0544700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18b814fde0 0x7f18b8150270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:11.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.429+0000 7f18c0544700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b81507b0 con 0x7f18b814fde0 2023-09-13T08:25:11.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.429+0000 7f18c0544700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b80c9c80 con 0x7f18b8156780 2023-09-13T08:25:11.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.429+0000 7f18c0544700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18b80c9f60 con 0x7f18a4004d90 2023-09-13T08:25:11.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.429+0000 7f18beae1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18b814fde0 0x7f18b8150270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:11.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.429+0000 7f18beae1700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18b814fde0 0x7f18b8150270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44142/0 (socket says 172.21.15.84:44142) 2023-09-13T08:25:11.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.429+0000 7f18beae1700 1 -- 172.21.15.84:0/3853538448 learned_addr learned my addr 172.21.15.84:0/3853538448 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:11.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.429+0000 7f18bdadf700 1 --2- 172.21.15.84:0/3853538448 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18b8156780 0x7f18b8156c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:11.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.429+0000 7f18beae1700 1 -- 172.21.15.84:0/3853538448 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f18a4004d90 msgr2=0x7f18b8154a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:11.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.429+0000 7f18be2e0700 1 --2- 172.21.15.84:0/3853538448 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f18a4004d90 0x7f18b8154a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:11.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.429+0000 7f18beae1700 1 --2- 172.21.15.84:0/3853538448 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f18a4004d90 0x7f18b8154a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:11.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.429+0000 7f18beae1700 1 -- 172.21.15.84:0/3853538448 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18b8156780 msgr2=0x7f18b8156c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:11.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.429+0000 7f18beae1700 1 --2- 172.21.15.84:0/3853538448 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18b8156780 0x7f18b8156c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:11.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.429+0000 7f18beae1700 1 -- 172.21.15.84:0/3853538448 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18b80ca240 con 0x7f18b814fde0 2023-09-13T08:25:11.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.429+0000 7f18bdadf700 1 --2- 172.21.15.84:0/3853538448 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18b8156780 0x7f18b8156c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T08:25:11.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.429+0000 7f18be2e0700 1 --2- 172.21.15.84:0/3853538448 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f18a4004d90 0x7f18b8154a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T08:25:11.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.430+0000 7f18beae1700 1 --2- 172.21.15.84:0/3853538448 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18b814fde0 0x7f18b8150270 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f18b000b010 tx=0x7f18b0001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:11.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.430+0000 7f18aeffd700 1 -- 172.21.15.84:0/3853538448 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b00017f0 con 0x7f18b814fde0 2023-09-13T08:25:11.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.430+0000 7f18aeffd700 1 -- 172.21.15.84:0/3853538448 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18b0001950 con 0x7f18b814fde0 2023-09-13T08:25:11.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.430+0000 7f18aeffd700 1 -- 172.21.15.84:0/3853538448 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b001e650 con 0x7f18b814fde0 2023-09-13T08:25:11.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.430+0000 7f18c0544700 1 -- 172.21.15.84:0/3853538448 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18b80ca520 con 0x7f18b814fde0 2023-09-13T08:25:11.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.430+0000 7f18c0544700 1 -- 172.21.15.84:0/3853538448 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18b8154f40 con 0x7f18b814fde0 2023-09-13T08:25:11.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.431+0000 7f18c0544700 1 -- 172.21.15.84:0/3853538448 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18b80caa40 con 0x7f18b814fde0 2023-09-13T08:25:11.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.431+0000 7f18aeffd700 1 -- 172.21.15.84:0/3853538448 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f18b001e7b0 con 0x7f18b814fde0 2023-09-13T08:25:11.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.431+0000 7f18aeffd700 1 --2- 172.21.15.84:0/3853538448 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f189c06a580 0x7f189c06ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:11.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.431+0000 7f18aeffd700 1 -- 172.21.15.84:0/3853538448 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f18b008acd0 con 0x7f18b814fde0 2023-09-13T08:25:11.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.431+0000 7f18be2e0700 1 --2- 172.21.15.84:0/3853538448 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f189c06a580 0x7f189c06ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:11.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.432+0000 7f18be2e0700 1 --2- 172.21.15.84:0/3853538448 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f189c06a580 0x7f189c06ca40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f18a8009b50 tx=0x7f18a8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:11.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.436+0000 7f18aeffd700 1 -- 172.21.15.84:0/3853538448 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f18b80caa40 con 0x7f18b814fde0 2023-09-13T08:25:11.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.623+0000 7f18c0544700 1 -- 172.21.15.84:0/3853538448 --> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f18b815b140 con 0x7f189c06a580 2023-09-13T08:25:11.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.632+0000 7f18aeffd700 1 -- 172.21.15.84:0/3853538448 <== mgr.4104 v2:172.21.15.84:6832/3568908055 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345199 (secure 0 0 0) 0x7f18a8004030 con 0x7f189c06a580 2023-09-13T08:25:11.638 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:25:11.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.635+0000 7f18c0544700 1 -- 172.21.15.84:0/3853538448 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f189c06a580 msgr2=0x7f189c06ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:11.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.635+0000 7f18c0544700 1 --2- 172.21.15.84:0/3853538448 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f189c06a580 0x7f189c06ca40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f18a8009b50 tx=0x7f18a8008040 comp rx=0 tx=0).stop 2023-09-13T08:25:11.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.635+0000 7f18c0544700 1 -- 172.21.15.84:0/3853538448 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18b814fde0 msgr2=0x7f18b8150270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:11.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.635+0000 7f18c0544700 1 --2- 172.21.15.84:0/3853538448 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18b814fde0 0x7f18b8150270 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f18b000b010 tx=0x7f18b0001d80 comp rx=0 tx=0).stop 2023-09-13T08:25:11.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.635+0000 7f18c0544700 1 -- 172.21.15.84:0/3853538448 shutdown_connections 2023-09-13T08:25:11.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.635+0000 7f18c0544700 1 --2- 172.21.15.84:0/3853538448 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18b814fde0 0x7f18b8150270 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:11.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.635+0000 7f18c0544700 1 --2- 172.21.15.84:0/3853538448 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f18a4004d90 0x7f18b8154a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:11.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.635+0000 7f18c0544700 1 --2- 172.21.15.84:0/3853538448 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f189c06a580 0x7f189c06ca40 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:11.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.635+0000 7f18c0544700 1 --2- 172.21.15.84:0/3853538448 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18b8156780 0x7f18b8156c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:11.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.635+0000 7f18c0544700 1 -- 172.21.15.84:0/3853538448 >> 172.21.15.84:0/3853538448 conn(0x7f18b80cc230 msgr2=0x7f18b815d920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:11.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.635+0000 7f18c0544700 1 -- 172.21.15.84:0/3853538448 shutdown_connections 2023-09-13T08:25:11.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.635+0000 7f18c0544700 1 -- 172.21.15.84:0/3853538448 wait complete. 2023-09-13T08:25:11.643 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-09-13T08:25:11.648 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2023-09-13T08:25:10.549820+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219368,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755352,"statfs":{"total":773094113280,"available":772869480448,"internally_reserved":0,"allocated":3284992,"data_stored":1988256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005597"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.774842+0000","last_change":"2023-09-13T08:24:42.765440+0000","last_active":"2023-09-13T08:24:46.774842+0000","last_peered":"2023-09-13T08:24:46.774842+0000","last_clean":"2023-09-13T08:24:46.774842+0000","last_became_active":"2023-09-13T08:24:42.764929+0000","last_became_peered":"2023-09-13T08:24:42.764929+0000","last_unstale":"2023-09-13T08:24:46.774842+0000","last_undegraded":"2023-09-13T08:24:46.774842+0000","last_fullsized":"2023-09-13T08:24:46.774842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:14:26.147276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.778909+0000","last_change":"2023-09-13T08:24:42.755837+0000","last_active":"2023-09-13T08:24:46.778909+0000","last_peered":"2023-09-13T08:24:46.778909+0000","last_clean":"2023-09-13T08:24:46.778909+0000","last_became_active":"2023-09-13T08:24:42.755520+0000","last_became_peered":"2023-09-13T08:24:42.755520+0000","last_unstale":"2023-09-13T08:24:46.778909+0000","last_undegraded":"2023-09-13T08:24:46.778909+0000","last_fullsized":"2023-09-13T08:24:46.778909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:01:14.370463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.778319+0000","last_change":"2023-09-13T08:24:42.751148+0000","last_active":"2023-09-13T08:24:46.778319+0000","last_peered":"2023-09-13T08:24:46.778319+0000","last_clean":"2023-09-13T08:24:46.778319+0000","last_became_active":"2023-09-13T08:24:42.750784+0000","last_became_peered":"2023-09-13T08:24:42.750784+0000","last_unstale":"2023-09-13T08:24:46.778319+0000","last_undegraded":"2023-09-13T08:24:46.778319+0000","last_fullsized":"2023-09-13T08:24:46.778319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:01:15.582567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.775884+0000","last_change":"2023-09-13T08:24:42.766616+0000","last_active":"2023-09-13T08:24:46.775884+0000","last_peered":"2023-09-13T08:24:46.775884+0000","last_clean":"2023-09-13T08:24:46.775884+0000","last_became_active":"2023-09-13T08:24:42.766318+0000","last_became_peered":"2023-09-13T08:24:42.766318+0000","last_unstale":"2023-09-13T08:24:46.775884+0000","last_undegraded":"2023-09-13T08:24:46.775884+0000","last_fullsized":"2023-09-13T08:24:46.775884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:29:11.602118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.773834+0000","last_change":"2023-09-13T08:24:42.760772+0000","last_active":"2023-09-13T08:24:46.773834+0000","last_peered":"2023-09-13T08:24:46.773834+0000","last_clean":"2023-09-13T08:24:46.773834+0000","last_became_active":"2023-09-13T08:24:42.760319+0000","last_became_peered":"2023-09-13T08:24:42.760319+0000","last_unstale":"2023-09-13T08:24:46.773834+0000","last_undegraded":"2023-09-13T08:24:46.773834+0000","last_fullsized":"2023-09-13T08:24:46.773834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:17:32.912375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.774449+0000","last_change":"2023-09-13T08:24:42.765841+0000","last_active":"2023-09-13T08:24:46.774449+0000","last_peered":"2023-09-13T08:24:46.774449+0000","last_clean":"2023-09-13T08:24:46.774449+0000","last_became_active":"2023-09-13T08:24:42.764312+0000","last_became_peered":"2023-09-13T08:24:42.764312+0000","last_unstale":"2023-09-13T08:24:46.774449+0000","last_undegraded":"2023-09-13T08:24:46.774449+0000","last_fullsized":"2023-09-13T08:24:46.774449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:31:23.082234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.773749+0000","last_change":"2023-09-13T08:24:42.753624+0000","last_active":"2023-09-13T08:24:46.773749+0000","last_peered":"2023-09-13T08:24:46.773749+0000","last_clean":"2023-09-13T08:24:46.773749+0000","last_became_active":"2023-09-13T08:24:42.753354+0000","last_became_peered":"2023-09-13T08:24:42.753354+0000","last_unstale":"2023-09-13T08:24:46.773749+0000","last_undegraded":"2023-09-13T08:24:46.773749+0000","last_fullsized":"2023-09-13T08:24:46.773749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:31:23.082234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.772638+0000","last_change":"2023-09-13T08:24:42.770839+0000","last_active":"2023-09-13T08:24:46.772638+0000","last_peered":"2023-09-13T08:24:46.772638+0000","last_clean":"2023-09-13T08:24:46.772638+0000","last_became_active":"2023-09-13T08:24:42.770596+0000","last_became_peered":"2023-09-13T08:24:42.770596+0000","last_unstale":"2023-09-13T08:24:46.772638+0000","last_undegraded":"2023-09-13T08:24:46.772638+0000","last_fullsized":"2023-09-13T08:24:46.772638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:38:04.836936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.774754+0000","last_change":"2023-09-13T08:24:42.768552+0000","last_active":"2023-09-13T08:24:46.774754+0000","last_peered":"2023-09-13T08:24:46.774754+0000","last_clean":"2023-09-13T08:24:46.774754+0000","last_became_active":"2023-09-13T08:24:42.768084+0000","last_became_peered":"2023-09-13T08:24:42.768084+0000","last_unstale":"2023-09-13T08:24:46.774754+0000","last_undegraded":"2023-09-13T08:24:46.774754+0000","last_fullsized":"2023-09-13T08:24:46.774754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T19:01:29.959464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.786411+0000","last_change":"2023-09-13T08:24:42.765506+0000","last_active":"2023-09-13T08:24:46.786411+0000","last_peered":"2023-09-13T08:24:46.786411+0000","last_clean":"2023-09-13T08:24:46.786411+0000","last_became_active":"2023-09-13T08:24:42.765119+0000","last_became_peered":"2023-09-13T08:24:42.765119+0000","last_unstale":"2023-09-13T08:24:46.786411+0000","last_undegraded":"2023-09-13T08:24:46.786411+0000","last_fullsized":"2023-09-13T08:24:46.786411+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:17:32.912375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.786113+0000","last_change":"2023-09-13T08:24:42.768066+0000","last_active":"2023-09-13T08:24:46.786113+0000","last_peered":"2023-09-13T08:24:46.786113+0000","last_clean":"2023-09-13T08:24:46.786113+0000","last_became_active":"2023-09-13T08:24:42.767857+0000","last_became_peered":"2023-09-13T08:24:42.767857+0000","last_unstale":"2023-09-13T08:24:46.786113+0000","last_undegraded":"2023-09-13T08:24:46.786113+0000","last_fullsized":"2023-09-13T08:24:46.786113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:01:14.370463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.781776+0000","last_change":"2023-09-13T08:24:42.750028+0000","last_active":"2023-09-13T08:24:46.781776+0000","last_peered":"2023-09-13T08:24:46.781776+0000","last_clean":"2023-09-13T08:24:46.781776+0000","last_became_active":"2023-09-13T08:24:42.749472+0000","last_became_peered":"2023-09-13T08:24:42.749472+0000","last_unstale":"2023-09-13T08:24:46.781776+0000","last_undegraded":"2023-09-13T08:24:46.781776+0000","last_fullsized":"2023-09-13T08:24:46.781776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:16:34.157802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.772598+0000","last_change":"2023-09-13T08:24:42.756966+0000","last_active":"2023-09-13T08:24:46.772598+0000","last_peered":"2023-09-13T08:24:46.772598+0000","last_clean":"2023-09-13T08:24:46.772598+0000","last_became_active":"2023-09-13T08:24:42.756694+0000","last_became_peered":"2023-09-13T08:24:42.756694+0000","last_unstale":"2023-09-13T08:24:46.772598+0000","last_undegraded":"2023-09-13T08:24:46.772598+0000","last_fullsized":"2023-09-13T08:24:46.772598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:22:05.554377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.779252+0000","last_change":"2023-09-13T08:24:42.761359+0000","last_active":"2023-09-13T08:24:46.779252+0000","last_peered":"2023-09-13T08:24:46.779252+0000","last_clean":"2023-09-13T08:24:46.779252+0000","last_became_active":"2023-09-13T08:24:42.761113+0000","last_became_peered":"2023-09-13T08:24:42.761113+0000","last_unstale":"2023-09-13T08:24:46.779252+0000","last_undegraded":"2023-09-13T08:24:46.779252+0000","last_fullsized":"2023-09-13T08:24:46.779252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:38:04.836936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.778710+0000","last_change":"2023-09-13T08:24:42.756240+0000","last_active":"2023-09-13T08:24:46.778710+0000","last_peered":"2023-09-13T08:24:46.778710+0000","last_clean":"2023-09-13T08:24:46.778710+0000","last_became_active":"2023-09-13T08:24:42.755563+0000","last_became_peered":"2023-09-13T08:24:42.755563+0000","last_unstale":"2023-09-13T08:24:46.778710+0000","last_undegraded":"2023-09-13T08:24:46.778710+0000","last_fullsized":"2023-09-13T08:24:46.778710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:07:53.062826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.774724+0000","last_change":"2023-09-13T08:24:42.762083+0000","last_active":"2023-09-13T08:24:46.774724+0000","last_peered":"2023-09-13T08:24:46.774724+0000","last_clean":"2023-09-13T08:24:46.774724+0000","last_became_active":"2023-09-13T08:24:42.761624+0000","last_became_peered":"2023-09-13T08:24:42.761624+0000","last_unstale":"2023-09-13T08:24:46.774724+0000","last_undegraded":"2023-09-13T08:24:46.774724+0000","last_fullsized":"2023-09-13T08:24:46.774724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:01:14.370463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.774482+0000","last_change":"2023-09-13T08:24:42.771083+0000","last_active":"2023-09-13T08:24:46.774482+0000","last_peered":"2023-09-13T08:24:46.774482+0000","last_clean":"2023-09-13T08:24:46.774482+0000","last_became_active":"2023-09-13T08:24:42.770750+0000","last_became_peered":"2023-09-13T08:24:42.770750+0000","last_unstale":"2023-09-13T08:24:46.774482+0000","last_undegraded":"2023-09-13T08:24:46.774482+0000","last_fullsized":"2023-09-13T08:24:46.774482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:41:08.160337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.784024+0000","last_change":"2023-09-13T08:24:42.756007+0000","last_active":"2023-09-13T08:24:46.784024+0000","last_peered":"2023-09-13T08:24:46.784024+0000","last_clean":"2023-09-13T08:24:46.784024+0000","last_became_active":"2023-09-13T08:24:42.755730+0000","last_became_peered":"2023-09-13T08:24:42.755730+0000","last_unstale":"2023-09-13T08:24:46.784024+0000","last_undegraded":"2023-09-13T08:24:46.784024+0000","last_fullsized":"2023-09-13T08:24:46.784024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:16:34.157802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.774987+0000","last_change":"2023-09-13T08:24:42.758637+0000","last_active":"2023-09-13T08:24:46.774987+0000","last_peered":"2023-09-13T08:24:46.774987+0000","last_clean":"2023-09-13T08:24:46.774987+0000","last_became_active":"2023-09-13T08:24:42.758355+0000","last_became_peered":"2023-09-13T08:24:42.758355+0000","last_unstale":"2023-09-13T08:24:46.774987+0000","last_undegraded":"2023-09-13T08:24:46.774987+0000","last_fullsized":"2023-09-13T08:24:46.774987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:30:17.103018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.535787+0000","last_change":"2023-09-13T08:24:46.786296+0000","last_active":"2023-09-13T08:24:48.535787+0000","last_peered":"2023-09-13T08:24:48.535787+0000","last_clean":"2023-09-13T08:24:48.535787+0000","last_became_active":"2023-09-13T08:24:46.785911+0000","last_became_peered":"2023-09-13T08:24:46.785911+0000","last_unstale":"2023-09-13T08:24:48.535787+0000","last_undegraded":"2023-09-13T08:24:48.535787+0000","last_fullsized":"2023-09-13T08:24:48.535787+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:28:08.064402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.779981+0000","last_change":"2023-09-13T08:24:41.751910+0000","last_active":"2023-09-13T08:24:46.779981+0000","last_peered":"2023-09-13T08:24:46.779981+0000","last_clean":"2023-09-13T08:24:46.779981+0000","last_became_active":"2023-09-13T08:24:41.751643+0000","last_became_peered":"2023-09-13T08:24:41.751643+0000","last_unstale":"2023-09-13T08:24:46.779981+0000","last_undegraded":"2023-09-13T08:24:46.779981+0000","last_fullsized":"2023-09-13T08:24:46.779981+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:10:08.445556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.772648+0000","last_change":"2023-09-13T08:24:42.756649+0000","last_active":"2023-09-13T08:24:46.772648+0000","last_peered":"2023-09-13T08:24:46.772648+0000","last_clean":"2023-09-13T08:24:46.772648+0000","last_became_active":"2023-09-13T08:24:42.756308+0000","last_became_peered":"2023-09-13T08:24:42.756308+0000","last_unstale":"2023-09-13T08:24:46.772648+0000","last_undegraded":"2023-09-13T08:24:46.772648+0000","last_fullsized":"2023-09-13T08:24:46.772648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:17:32.912375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.535050+0000","last_change":"2023-09-13T08:24:46.798301+0000","last_active":"2023-09-13T08:24:48.535050+0000","last_peered":"2023-09-13T08:24:48.535050+0000","last_clean":"2023-09-13T08:24:48.535050+0000","last_became_active":"2023-09-13T08:24:46.797920+0000","last_became_peered":"2023-09-13T08:24:46.797920+0000","last_unstale":"2023-09-13T08:24:48.535050+0000","last_undegraded":"2023-09-13T08:24:48.535050+0000","last_fullsized":"2023-09-13T08:24:48.535050+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:41:12.187804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.772744+0000","last_change":"2023-09-13T08:24:41.762678+0000","last_active":"2023-09-13T08:24:46.772744+0000","last_peered":"2023-09-13T08:24:46.772744+0000","last_clean":"2023-09-13T08:24:46.772744+0000","last_became_active":"2023-09-13T08:24:41.762309+0000","last_became_peered":"2023-09-13T08:24:41.762309+0000","last_unstale":"2023-09-13T08:24:46.772744+0000","last_undegraded":"2023-09-13T08:24:46.772744+0000","last_fullsized":"2023-09-13T08:24:46.772744+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:40:49.395433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.779483+0000","last_change":"2023-09-13T08:24:42.764572+0000","last_active":"2023-09-13T08:24:46.779483+0000","last_peered":"2023-09-13T08:24:46.779483+0000","last_clean":"2023-09-13T08:24:46.779483+0000","last_became_active":"2023-09-13T08:24:42.764305+0000","last_became_peered":"2023-09-13T08:24:42.764305+0000","last_unstale":"2023-09-13T08:24:46.779483+0000","last_undegraded":"2023-09-13T08:24:46.779483+0000","last_fullsized":"2023-09-13T08:24:46.779483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:47:39.312215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.535234+0000","last_change":"2023-09-13T08:24:46.799685+0000","last_active":"2023-09-13T08:24:48.535234+0000","last_peered":"2023-09-13T08:24:48.535234+0000","last_clean":"2023-09-13T08:24:48.535234+0000","last_became_active":"2023-09-13T08:24:46.798723+0000","last_became_peered":"2023-09-13T08:24:46.798723+0000","last_unstale":"2023-09-13T08:24:48.535234+0000","last_undegraded":"2023-09-13T08:24:48.535234+0000","last_fullsized":"2023-09-13T08:24:48.535234+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:19:00.119006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.774765+0000","last_change":"2023-09-13T08:24:41.755988+0000","last_active":"2023-09-13T08:24:46.774765+0000","last_peered":"2023-09-13T08:24:46.774765+0000","last_clean":"2023-09-13T08:24:46.774765+0000","last_became_active":"2023-09-13T08:24:41.755711+0000","last_became_peered":"2023-09-13T08:24:41.755711+0000","last_unstale":"2023-09-13T08:24:46.774765+0000","last_undegraded":"2023-09-13T08:24:46.774765+0000","last_fullsized":"2023-09-13T08:24:46.774765+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:01:14.575510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.775792+0000","last_change":"2023-09-13T08:24:42.771141+0000","last_active":"2023-09-13T08:24:46.775792+0000","last_peered":"2023-09-13T08:24:46.775792+0000","last_clean":"2023-09-13T08:24:46.775792+0000","last_became_active":"2023-09-13T08:24:42.770716+0000","last_became_peered":"2023-09-13T08:24:42.770716+0000","last_unstale":"2023-09-13T08:24:46.775792+0000","last_undegraded":"2023-09-13T08:24:46.775792+0000","last_fullsized":"2023-09-13T08:24:46.775792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:17:32.912375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.535125+0000","last_change":"2023-09-13T08:24:46.797683+0000","last_active":"2023-09-13T08:24:48.535125+0000","last_peered":"2023-09-13T08:24:48.535125+0000","last_clean":"2023-09-13T08:24:48.535125+0000","last_became_active":"2023-09-13T08:24:46.797283+0000","last_became_peered":"2023-09-13T08:24:46.797283+0000","last_unstale":"2023-09-13T08:24:48.535125+0000","last_undegraded":"2023-09-13T08:24:48.535125+0000","last_fullsized":"2023-09-13T08:24:48.535125+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T19:57:23.132436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.773940+0000","last_change":"2023-09-13T08:24:41.757989+0000","last_active":"2023-09-13T08:24:46.773940+0000","last_peered":"2023-09-13T08:24:46.773940+0000","last_clean":"2023-09-13T08:24:46.773940+0000","last_became_active":"2023-09-13T08:24:41.757638+0000","last_became_peered":"2023-09-13T08:24:41.757638+0000","last_unstale":"2023-09-13T08:24:46.773940+0000","last_undegraded":"2023-09-13T08:24:46.773940+0000","last_fullsized":"2023-09-13T08:24:46.773940+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:28:07.813946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.776641+0000","last_change":"2023-09-13T08:24:42.771168+0000","last_active":"2023-09-13T08:24:46.776641+0000","last_peered":"2023-09-13T08:24:46.776641+0000","last_clean":"2023-09-13T08:24:46.776641+0000","last_became_active":"2023-09-13T08:24:42.770666+0000","last_became_peered":"2023-09-13T08:24:42.770666+0000","last_unstale":"2023-09-13T08:24:46.776641+0000","last_undegraded":"2023-09-13T08:24:46.776641+0000","last_fullsized":"2023-09-13T08:24:46.776641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:14:26.147276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.537048+0000","last_change":"2023-09-13T08:24:46.796942+0000","last_active":"2023-09-13T08:24:48.537048+0000","last_peered":"2023-09-13T08:24:48.537048+0000","last_clean":"2023-09-13T08:24:48.537048+0000","last_became_active":"2023-09-13T08:24:46.796351+0000","last_became_peered":"2023-09-13T08:24:46.796351+0000","last_unstale":"2023-09-13T08:24:48.537048+0000","last_undegraded":"2023-09-13T08:24:48.537048+0000","last_fullsized":"2023-09-13T08:24:48.537048+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:56:23.838830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.772437+0000","last_change":"2023-09-13T08:24:41.751550+0000","last_active":"2023-09-13T08:24:46.772437+0000","last_peered":"2023-09-13T08:24:46.772437+0000","last_clean":"2023-09-13T08:24:46.772437+0000","last_became_active":"2023-09-13T08:24:41.751239+0000","last_became_peered":"2023-09-13T08:24:41.751239+0000","last_unstale":"2023-09-13T08:24:46.772437+0000","last_undegraded":"2023-09-13T08:24:46.772437+0000","last_fullsized":"2023-09-13T08:24:46.772437+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:14:24.302634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.780775+0000","last_change":"2023-09-13T08:24:42.761870+0000","last_active":"2023-09-13T08:24:46.780775+0000","last_peered":"2023-09-13T08:24:46.780775+0000","last_clean":"2023-09-13T08:24:46.780775+0000","last_became_active":"2023-09-13T08:24:42.761353+0000","last_became_peered":"2023-09-13T08:24:42.761353+0000","last_unstale":"2023-09-13T08:24:46.780775+0000","last_undegraded":"2023-09-13T08:24:46.780775+0000","last_fullsized":"2023-09-13T08:24:46.780775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:04:13.077626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:47.773917+0000","last_change":"2023-09-13T08:24:46.790855+0000","last_active":"2023-09-13T08:24:47.773917+0000","last_peered":"2023-09-13T08:24:47.773917+0000","last_clean":"2023-09-13T08:24:47.773917+0000","last_became_active":"2023-09-13T08:24:46.790308+0000","last_became_peered":"2023-09-13T08:24:46.790308+0000","last_unstale":"2023-09-13T08:24:47.773917+0000","last_undegraded":"2023-09-13T08:24:47.773917+0000","last_fullsized":"2023-09-13T08:24:47.773917+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:39:01.027758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.785858+0000","last_change":"2023-09-13T08:24:41.750115+0000","last_active":"2023-09-13T08:24:46.785858+0000","last_peered":"2023-09-13T08:24:46.785858+0000","last_clean":"2023-09-13T08:24:46.785858+0000","last_became_active":"2023-09-13T08:24:41.749327+0000","last_became_peered":"2023-09-13T08:24:41.749327+0000","last_unstale":"2023-09-13T08:24:46.785858+0000","last_undegraded":"2023-09-13T08:24:46.785858+0000","last_fullsized":"2023-09-13T08:24:46.785858+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:51:59.235749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.777583+0000","last_change":"2023-09-13T08:24:42.746631+0000","last_active":"2023-09-13T08:24:46.777583+0000","last_peered":"2023-09-13T08:24:46.777583+0000","last_clean":"2023-09-13T08:24:46.777583+0000","last_became_active":"2023-09-13T08:24:42.745778+0000","last_became_peered":"2023-09-13T08:24:42.745778+0000","last_unstale":"2023-09-13T08:24:46.777583+0000","last_undegraded":"2023-09-13T08:24:46.777583+0000","last_fullsized":"2023-09-13T08:24:46.777583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:22:05.554377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:47.775957+0000","last_change":"2023-09-13T08:24:46.801666+0000","last_active":"2023-09-13T08:24:47.775957+0000","last_peered":"2023-09-13T08:24:47.775957+0000","last_clean":"2023-09-13T08:24:47.775957+0000","last_became_active":"2023-09-13T08:24:46.801323+0000","last_became_peered":"2023-09-13T08:24:46.801323+0000","last_unstale":"2023-09-13T08:24:47.775957+0000","last_undegraded":"2023-09-13T08:24:47.775957+0000","last_fullsized":"2023-09-13T08:24:47.775957+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:19:00.119006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.772047+0000","last_change":"2023-09-13T08:24:41.755264+0000","last_active":"2023-09-13T08:24:46.772047+0000","last_peered":"2023-09-13T08:24:46.772047+0000","last_clean":"2023-09-13T08:24:46.772047+0000","last_became_active":"2023-09-13T08:24:41.754961+0000","last_became_peered":"2023-09-13T08:24:41.754961+0000","last_unstale":"2023-09-13T08:24:46.772047+0000","last_undegraded":"2023-09-13T08:24:46.772047+0000","last_fullsized":"2023-09-13T08:24:46.772047+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:28:07.813946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.771919+0000","last_change":"2023-09-13T08:24:42.752899+0000","last_active":"2023-09-13T08:24:46.771919+0000","last_peered":"2023-09-13T08:24:46.771919+0000","last_clean":"2023-09-13T08:24:46.771919+0000","last_became_active":"2023-09-13T08:24:42.752583+0000","last_became_peered":"2023-09-13T08:24:42.752583+0000","last_unstale":"2023-09-13T08:24:46.771919+0000","last_undegraded":"2023-09-13T08:24:46.771919+0000","last_fullsized":"2023-09-13T08:24:46.771919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:01:15.582567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.534731+0000","last_change":"2023-09-13T08:24:46.795800+0000","last_active":"2023-09-13T08:24:48.534731+0000","last_peered":"2023-09-13T08:24:48.534731+0000","last_clean":"2023-09-13T08:24:48.534731+0000","last_became_active":"2023-09-13T08:24:46.794871+0000","last_became_peered":"2023-09-13T08:24:46.794871+0000","last_unstale":"2023-09-13T08:24:48.534731+0000","last_undegraded":"2023-09-13T08:24:48.534731+0000","last_fullsized":"2023-09-13T08:24:48.534731+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:35:08.086286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.774790+0000","last_change":"2023-09-13T08:24:41.749261+0000","last_active":"2023-09-13T08:24:46.774790+0000","last_peered":"2023-09-13T08:24:46.774790+0000","last_clean":"2023-09-13T08:24:46.774790+0000","last_became_active":"2023-09-13T08:24:41.748976+0000","last_became_peered":"2023-09-13T08:24:41.748976+0000","last_unstale":"2023-09-13T08:24:46.774790+0000","last_undegraded":"2023-09-13T08:24:46.774790+0000","last_fullsized":"2023-09-13T08:24:46.774790+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:04:12.070569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.778887+0000","last_change":"2023-09-13T08:24:42.756665+0000","last_active":"2023-09-13T08:24:46.778887+0000","last_peered":"2023-09-13T08:24:46.778887+0000","last_clean":"2023-09-13T08:24:46.778887+0000","last_became_active":"2023-09-13T08:24:42.756225+0000","last_became_peered":"2023-09-13T08:24:42.756225+0000","last_unstale":"2023-09-13T08:24:46.778887+0000","last_undegraded":"2023-09-13T08:24:46.778887+0000","last_fullsized":"2023-09-13T08:24:46.778887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:22:05.554377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.535610+0000","last_change":"2023-09-13T08:24:46.794973+0000","last_active":"2023-09-13T08:24:48.535610+0000","last_peered":"2023-09-13T08:24:48.535610+0000","last_clean":"2023-09-13T08:24:48.535610+0000","last_became_active":"2023-09-13T08:24:46.794625+0000","last_became_peered":"2023-09-13T08:24:46.794625+0000","last_unstale":"2023-09-13T08:24:48.535610+0000","last_undegraded":"2023-09-13T08:24:48.535610+0000","last_fullsized":"2023-09-13T08:24:48.535610+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:24:40.971505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.786879+0000","last_change":"2023-09-13T08:24:41.752295+0000","last_active":"2023-09-13T08:24:46.786879+0000","last_peered":"2023-09-13T08:24:46.786879+0000","last_clean":"2023-09-13T08:24:46.786879+0000","last_became_active":"2023-09-13T08:24:41.751730+0000","last_became_peered":"2023-09-13T08:24:41.751730+0000","last_unstale":"2023-09-13T08:24:46.786879+0000","last_undegraded":"2023-09-13T08:24:46.786879+0000","last_fullsized":"2023-09-13T08:24:46.786879+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:14:24.302634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.775290+0000","last_change":"2023-09-13T08:24:42.761292+0000","last_active":"2023-09-13T08:24:46.775290+0000","last_peered":"2023-09-13T08:24:46.775290+0000","last_clean":"2023-09-13T08:24:46.775290+0000","last_became_active":"2023-09-13T08:24:42.761004+0000","last_became_peered":"2023-09-13T08:24:42.761004+0000","last_unstale":"2023-09-13T08:24:46.775290+0000","last_undegraded":"2023-09-13T08:24:46.775290+0000","last_fullsized":"2023-09-13T08:24:46.775290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:32:01.643446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.535622+0000","last_change":"2023-09-13T08:24:46.799231+0000","last_active":"2023-09-13T08:24:48.535622+0000","last_peered":"2023-09-13T08:24:48.535622+0000","last_clean":"2023-09-13T08:24:48.535622+0000","last_became_active":"2023-09-13T08:24:46.798813+0000","last_became_peered":"2023-09-13T08:24:46.798813+0000","last_unstale":"2023-09-13T08:24:48.535622+0000","last_undegraded":"2023-09-13T08:24:48.535622+0000","last_fullsized":"2023-09-13T08:24:48.535622+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:14:40.142972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.775333+0000","last_change":"2023-09-13T08:24:41.757732+0000","last_active":"2023-09-13T08:24:46.775333+0000","last_peered":"2023-09-13T08:24:46.775333+0000","last_clean":"2023-09-13T08:24:46.775333+0000","last_became_active":"2023-09-13T08:24:41.757452+0000","last_became_peered":"2023-09-13T08:24:41.757452+0000","last_unstale":"2023-09-13T08:24:46.775333+0000","last_undegraded":"2023-09-13T08:24:46.775333+0000","last_fullsized":"2023-09-13T08:24:46.775333+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:12:03.105088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.779874+0000","last_change":"2023-09-13T08:24:42.764641+0000","last_active":"2023-09-13T08:24:46.779874+0000","last_peered":"2023-09-13T08:24:46.779874+0000","last_clean":"2023-09-13T08:24:46.779874+0000","last_became_active":"2023-09-13T08:24:42.764368+0000","last_became_peered":"2023-09-13T08:24:42.764368+0000","last_unstale":"2023-09-13T08:24:46.779874+0000","last_undegraded":"2023-09-13T08:24:46.779874+0000","last_fullsized":"2023-09-13T08:24:46.779874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:01:14.370463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.535743+0000","last_change":"2023-09-13T08:24:46.794114+0000","last_active":"2023-09-13T08:24:48.535743+0000","last_peered":"2023-09-13T08:24:48.535743+0000","last_clean":"2023-09-13T08:24:48.535743+0000","last_became_active":"2023-09-13T08:24:46.793129+0000","last_became_peered":"2023-09-13T08:24:46.793129+0000","last_unstale":"2023-09-13T08:24:48.535743+0000","last_undegraded":"2023-09-13T08:24:48.535743+0000","last_fullsized":"2023-09-13T08:24:48.535743+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:35:08.086286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.779227+0000","last_change":"2023-09-13T08:24:41.755450+0000","last_active":"2023-09-13T08:24:46.779227+0000","last_peered":"2023-09-13T08:24:46.779227+0000","last_clean":"2023-09-13T08:24:46.779227+0000","last_became_active":"2023-09-13T08:24:41.755168+0000","last_became_peered":"2023-09-13T08:24:41.755168+0000","last_unstale":"2023-09-13T08:24:46.779227+0000","last_undegraded":"2023-09-13T08:24:46.779227+0000","last_fullsized":"2023-09-13T08:24:46.779227+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:28:07.813946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.781645+0000","last_change":"2023-09-13T08:24:42.756700+0000","last_active":"2023-09-13T08:24:46.781645+0000","last_peered":"2023-09-13T08:24:46.781645+0000","last_clean":"2023-09-13T08:24:46.781645+0000","last_became_active":"2023-09-13T08:24:42.756408+0000","last_became_peered":"2023-09-13T08:24:42.756408+0000","last_unstale":"2023-09-13T08:24:46.781645+0000","last_undegraded":"2023-09-13T08:24:46.781645+0000","last_fullsized":"2023-09-13T08:24:46.781645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:28:08.821003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.535262+0000","last_change":"2023-09-13T08:24:46.793849+0000","last_active":"2023-09-13T08:24:48.535262+0000","last_peered":"2023-09-13T08:24:48.535262+0000","last_clean":"2023-09-13T08:24:48.535262+0000","last_became_active":"2023-09-13T08:24:46.793486+0000","last_became_peered":"2023-09-13T08:24:46.793486+0000","last_unstale":"2023-09-13T08:24:48.535262+0000","last_undegraded":"2023-09-13T08:24:48.535262+0000","last_fullsized":"2023-09-13T08:24:48.535262+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:49:40.361758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:52.674989+0000","last_change":"2023-09-13T08:24:41.755123+0000","last_active":"2023-09-13T08:24:52.674989+0000","last_peered":"2023-09-13T08:24:52.674989+0000","last_clean":"2023-09-13T08:24:52.674989+0000","last_became_active":"2023-09-13T08:24:41.754872+0000","last_became_peered":"2023-09-13T08:24:41.754872+0000","last_unstale":"2023-09-13T08:24:52.674989+0000","last_undegraded":"2023-09-13T08:24:52.674989+0000","last_fullsized":"2023-09-13T08:24:52.674989+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:28:07.813946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.774928+0000","last_change":"2023-09-13T08:24:42.756478+0000","last_active":"2023-09-13T08:24:46.774928+0000","last_peered":"2023-09-13T08:24:46.774928+0000","last_clean":"2023-09-13T08:24:46.774928+0000","last_became_active":"2023-09-13T08:24:42.755725+0000","last_became_peered":"2023-09-13T08:24:42.755725+0000","last_unstale":"2023-09-13T08:24:46.774928+0000","last_undegraded":"2023-09-13T08:24:46.774928+0000","last_fullsized":"2023-09-13T08:24:46.774928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:29:11.602118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:47.810994+0000","last_change":"2023-09-13T08:24:46.791174+0000","last_active":"2023-09-13T08:24:47.810994+0000","last_peered":"2023-09-13T08:24:47.810994+0000","last_clean":"2023-09-13T08:24:47.810994+0000","last_became_active":"2023-09-13T08:24:46.790577+0000","last_became_peered":"2023-09-13T08:24:46.790577+0000","last_unstale":"2023-09-13T08:24:47.810994+0000","last_undegraded":"2023-09-13T08:24:47.810994+0000","last_fullsized":"2023-09-13T08:24:47.810994+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:06:40.257204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.777835+0000","last_change":"2023-09-13T08:24:41.748341+0000","last_active":"2023-09-13T08:24:46.777835+0000","last_peered":"2023-09-13T08:24:46.777835+0000","last_clean":"2023-09-13T08:24:46.777835+0000","last_became_active":"2023-09-13T08:24:41.748090+0000","last_became_peered":"2023-09-13T08:24:41.748090+0000","last_unstale":"2023-09-13T08:24:46.777835+0000","last_undegraded":"2023-09-13T08:24:46.777835+0000","last_fullsized":"2023-09-13T08:24:46.777835+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:04:12.070569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.779335+0000","last_change":"2023-09-13T08:24:42.748471+0000","last_active":"2023-09-13T08:24:46.779335+0000","last_peered":"2023-09-13T08:24:46.779335+0000","last_clean":"2023-09-13T08:24:46.779335+0000","last_became_active":"2023-09-13T08:24:42.748243+0000","last_became_peered":"2023-09-13T08:24:42.748243+0000","last_unstale":"2023-09-13T08:24:46.779335+0000","last_undegraded":"2023-09-13T08:24:46.779335+0000","last_fullsized":"2023-09-13T08:24:46.779335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:14:25.309691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.537111+0000","last_change":"2023-09-13T08:24:46.795104+0000","last_active":"2023-09-13T08:24:48.537111+0000","last_peered":"2023-09-13T08:24:48.537111+0000","last_clean":"2023-09-13T08:24:48.537111+0000","last_became_active":"2023-09-13T08:24:46.794725+0000","last_became_peered":"2023-09-13T08:24:46.794725+0000","last_unstale":"2023-09-13T08:24:48.537111+0000","last_undegraded":"2023-09-13T08:24:48.537111+0000","last_fullsized":"2023-09-13T08:24:48.537111+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:55:26.579142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.774235+0000","last_change":"2023-09-13T08:24:41.756881+0000","last_active":"2023-09-13T08:24:46.774235+0000","last_peered":"2023-09-13T08:24:46.774235+0000","last_clean":"2023-09-13T08:24:46.774235+0000","last_became_active":"2023-09-13T08:24:41.756567+0000","last_became_peered":"2023-09-13T08:24:41.756567+0000","last_unstale":"2023-09-13T08:24:46.774235+0000","last_undegraded":"2023-09-13T08:24:46.774235+0000","last_fullsized":"2023-09-13T08:24:46.774235+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:14:24.302634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.774321+0000","last_change":"2023-09-13T08:24:42.764196+0000","last_active":"2023-09-13T08:24:46.774321+0000","last_peered":"2023-09-13T08:24:46.774321+0000","last_clean":"2023-09-13T08:24:46.774321+0000","last_became_active":"2023-09-13T08:24:42.760048+0000","last_became_peered":"2023-09-13T08:24:42.760048+0000","last_unstale":"2023-09-13T08:24:46.774321+0000","last_undegraded":"2023-09-13T08:24:46.774321+0000","last_fullsized":"2023-09-13T08:24:46.774321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:20:47.395388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.537009+0000","last_change":"2023-09-13T08:24:46.795864+0000","last_active":"2023-09-13T08:24:48.537009+0000","last_peered":"2023-09-13T08:24:48.537009+0000","last_clean":"2023-09-13T08:24:48.537009+0000","last_became_active":"2023-09-13T08:24:46.795486+0000","last_became_peered":"2023-09-13T08:24:46.795486+0000","last_unstale":"2023-09-13T08:24:48.537009+0000","last_undegraded":"2023-09-13T08:24:48.537009+0000","last_fullsized":"2023-09-13T08:24:48.537009+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:06:32.572669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.785872+0000","last_change":"2023-09-13T08:24:41.749723+0000","last_active":"2023-09-13T08:24:46.785872+0000","last_peered":"2023-09-13T08:24:46.785872+0000","last_clean":"2023-09-13T08:24:46.785872+0000","last_became_active":"2023-09-13T08:24:41.749372+0000","last_became_peered":"2023-09-13T08:24:41.749372+0000","last_unstale":"2023-09-13T08:24:46.785872+0000","last_undegraded":"2023-09-13T08:24:46.785872+0000","last_fullsized":"2023-09-13T08:24:46.785872+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:56:12.891967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.785750+0000","last_change":"2023-09-13T08:24:42.752492+0000","last_active":"2023-09-13T08:24:46.785750+0000","last_peered":"2023-09-13T08:24:46.785750+0000","last_clean":"2023-09-13T08:24:46.785750+0000","last_became_active":"2023-09-13T08:24:42.752171+0000","last_became_peered":"2023-09-13T08:24:42.752171+0000","last_unstale":"2023-09-13T08:24:46.785750+0000","last_undegraded":"2023-09-13T08:24:46.785750+0000","last_fullsized":"2023-09-13T08:24:46.785750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:38:57.000291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.534401+0000","last_change":"2023-09-13T08:24:46.796118+0000","last_active":"2023-09-13T08:24:48.534401+0000","last_peered":"2023-09-13T08:24:48.534401+0000","last_clean":"2023-09-13T08:24:48.534401+0000","last_became_active":"2023-09-13T08:24:46.795725+0000","last_became_peered":"2023-09-13T08:24:46.795725+0000","last_unstale":"2023-09-13T08:24:48.534401+0000","last_undegraded":"2023-09-13T08:24:48.534401+0000","last_fullsized":"2023-09-13T08:24:48.534401+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:19:00.119006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.778226+0000","last_change":"2023-09-13T08:24:41.749035+0000","last_active":"2023-09-13T08:24:46.778226+0000","last_peered":"2023-09-13T08:24:46.778226+0000","last_clean":"2023-09-13T08:24:46.778226+0000","last_became_active":"2023-09-13T08:24:41.748750+0000","last_became_peered":"2023-09-13T08:24:41.748750+0000","last_unstale":"2023-09-13T08:24:46.778226+0000","last_undegraded":"2023-09-13T08:24:46.778226+0000","last_fullsized":"2023-09-13T08:24:46.778226+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:10:08.445556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.775239+0000","last_change":"2023-09-13T08:24:42.756878+0000","last_active":"2023-09-13T08:24:46.775239+0000","last_peered":"2023-09-13T08:24:46.775239+0000","last_clean":"2023-09-13T08:24:46.775239+0000","last_became_active":"2023-09-13T08:24:42.756564+0000","last_became_peered":"2023-09-13T08:24:42.756564+0000","last_unstale":"2023-09-13T08:24:46.775239+0000","last_undegraded":"2023-09-13T08:24:46.775239+0000","last_fullsized":"2023-09-13T08:24:46.775239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:23:57.161158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.534913+0000","last_change":"2023-09-13T08:24:46.799955+0000","last_active":"2023-09-13T08:24:48.534913+0000","last_peered":"2023-09-13T08:24:48.534913+0000","last_clean":"2023-09-13T08:24:48.534913+0000","last_became_active":"2023-09-13T08:24:46.799140+0000","last_became_peered":"2023-09-13T08:24:46.799140+0000","last_unstale":"2023-09-13T08:24:48.534913+0000","last_undegraded":"2023-09-13T08:24:48.534913+0000","last_fullsized":"2023-09-13T08:24:48.534913+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T19:01:33.986931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.781644+0000","last_change":"2023-09-13T08:24:41.748494+0000","last_active":"2023-09-13T08:24:46.781644+0000","last_peered":"2023-09-13T08:24:46.781644+0000","last_clean":"2023-09-13T08:24:46.781644+0000","last_became_active":"2023-09-13T08:24:41.748204+0000","last_became_peered":"2023-09-13T08:24:41.748204+0000","last_unstale":"2023-09-13T08:24:46.781644+0000","last_undegraded":"2023-09-13T08:24:46.781644+0000","last_fullsized":"2023-09-13T08:24:46.781644+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:40:49.395433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.775174+0000","last_change":"2023-09-13T08:24:42.757274+0000","last_active":"2023-09-13T08:24:46.775174+0000","last_peered":"2023-09-13T08:24:46.775174+0000","last_clean":"2023-09-13T08:24:46.775174+0000","last_became_active":"2023-09-13T08:24:42.756521+0000","last_became_peered":"2023-09-13T08:24:42.756521+0000","last_unstale":"2023-09-13T08:24:46.775174+0000","last_undegraded":"2023-09-13T08:24:46.775174+0000","last_fullsized":"2023-09-13T08:24:46.775174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:41:08.160337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.535146+0000","last_change":"2023-09-13T08:24:46.792835+0000","last_active":"2023-09-13T08:24:48.535146+0000","last_peered":"2023-09-13T08:24:48.535146+0000","last_clean":"2023-09-13T08:24:48.535146+0000","last_became_active":"2023-09-13T08:24:46.792432+0000","last_became_peered":"2023-09-13T08:24:46.792432+0000","last_unstale":"2023-09-13T08:24:48.535146+0000","last_undegraded":"2023-09-13T08:24:48.535146+0000","last_fullsized":"2023-09-13T08:24:48.535146+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:19:00.119006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.779060+0000","last_change":"2023-09-13T08:24:41.747562+0000","last_active":"2023-09-13T08:24:46.779060+0000","last_peered":"2023-09-13T08:24:46.779060+0000","last_clean":"2023-09-13T08:24:46.779060+0000","last_became_active":"2023-09-13T08:24:41.747309+0000","last_became_peered":"2023-09-13T08:24:41.747309+0000","last_unstale":"2023-09-13T08:24:46.779060+0000","last_undegraded":"2023-09-13T08:24:46.779060+0000","last_fullsized":"2023-09-13T08:24:46.779060+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:16:33.150745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.776806+0000","last_change":"2023-09-13T08:24:42.771356+0000","last_active":"2023-09-13T08:24:46.776806+0000","last_peered":"2023-09-13T08:24:46.776806+0000","last_clean":"2023-09-13T08:24:46.776806+0000","last_became_active":"2023-09-13T08:24:42.768326+0000","last_became_peered":"2023-09-13T08:24:42.768326+0000","last_unstale":"2023-09-13T08:24:46.776806+0000","last_undegraded":"2023-09-13T08:24:46.776806+0000","last_fullsized":"2023-09-13T08:24:46.776806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T19:01:29.959464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.535284+0000","last_change":"2023-09-13T08:24:46.794707+0000","last_active":"2023-09-13T08:24:48.535284+0000","last_peered":"2023-09-13T08:24:48.535284+0000","last_clean":"2023-09-13T08:24:48.535284+0000","last_became_active":"2023-09-13T08:24:46.794482+0000","last_became_peered":"2023-09-13T08:24:46.794482+0000","last_unstale":"2023-09-13T08:24:48.535284+0000","last_undegraded":"2023-09-13T08:24:48.535284+0000","last_fullsized":"2023-09-13T08:24:48.535284+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:44:45.516475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.774129+0000","last_change":"2023-09-13T08:24:41.754944+0000","last_active":"2023-09-13T08:24:46.774129+0000","last_peered":"2023-09-13T08:24:46.774129+0000","last_clean":"2023-09-13T08:24:46.774129+0000","last_became_active":"2023-09-13T08:24:41.754643+0000","last_became_peered":"2023-09-13T08:24:41.754643+0000","last_unstale":"2023-09-13T08:24:46.774129+0000","last_undegraded":"2023-09-13T08:24:46.774129+0000","last_fullsized":"2023-09-13T08:24:46.774129+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:16:33.150745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.781175+0000","last_change":"2023-09-13T08:24:42.746767+0000","last_active":"2023-09-13T08:24:46.781175+0000","last_peered":"2023-09-13T08:24:46.781175+0000","last_clean":"2023-09-13T08:24:46.781175+0000","last_became_active":"2023-09-13T08:24:42.746431+0000","last_became_peered":"2023-09-13T08:24:42.746431+0000","last_unstale":"2023-09-13T08:24:46.781175+0000","last_undegraded":"2023-09-13T08:24:46.781175+0000","last_fullsized":"2023-09-13T08:24:46.781175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:14:25.309691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.536899+0000","last_change":"2023-09-13T08:24:46.791183+0000","last_active":"2023-09-13T08:24:48.536899+0000","last_peered":"2023-09-13T08:24:48.536899+0000","last_clean":"2023-09-13T08:24:48.536899+0000","last_became_active":"2023-09-13T08:24:46.790665+0000","last_became_peered":"2023-09-13T08:24:46.790665+0000","last_unstale":"2023-09-13T08:24:48.536899+0000","last_undegraded":"2023-09-13T08:24:48.536899+0000","last_fullsized":"2023-09-13T08:24:48.536899+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:35:08.793411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.779259+0000","last_change":"2023-09-13T08:24:42.763692+0000","last_active":"2023-09-13T08:24:46.779259+0000","last_peered":"2023-09-13T08:24:46.779259+0000","last_clean":"2023-09-13T08:24:46.779259+0000","last_became_active":"2023-09-13T08:24:42.763348+0000","last_became_peered":"2023-09-13T08:24:42.763348+0000","last_unstale":"2023-09-13T08:24:46.779259+0000","last_undegraded":"2023-09-13T08:24:46.779259+0000","last_fullsized":"2023-09-13T08:24:46.779259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:01:15.582567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.778942+0000","last_change":"2023-09-13T08:24:41.750528+0000","last_active":"2023-09-13T08:24:46.778942+0000","last_peered":"2023-09-13T08:24:46.778942+0000","last_clean":"2023-09-13T08:24:46.778942+0000","last_became_active":"2023-09-13T08:24:41.750238+0000","last_became_peered":"2023-09-13T08:24:41.750238+0000","last_unstale":"2023-09-13T08:24:46.778942+0000","last_undegraded":"2023-09-13T08:24:46.778942+0000","last_fullsized":"2023-09-13T08:24:46.778942+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:40:49.395433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:47.775614+0000","last_change":"2023-09-13T08:24:46.798991+0000","last_active":"2023-09-13T08:24:47.775614+0000","last_peered":"2023-09-13T08:24:47.775614+0000","last_clean":"2023-09-13T08:24:47.775614+0000","last_became_active":"2023-09-13T08:24:46.798610+0000","last_became_peered":"2023-09-13T08:24:46.798610+0000","last_unstale":"2023-09-13T08:24:47.775614+0000","last_undegraded":"2023-09-13T08:24:47.775614+0000","last_fullsized":"2023-09-13T08:24:47.775614+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T19:57:23.132436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.772327+0000","last_change":"2023-09-13T08:24:42.768328+0000","last_active":"2023-09-13T08:24:46.772327+0000","last_peered":"2023-09-13T08:24:46.772327+0000","last_clean":"2023-09-13T08:24:46.772327+0000","last_became_active":"2023-09-13T08:24:42.768076+0000","last_became_peered":"2023-09-13T08:24:42.768076+0000","last_unstale":"2023-09-13T08:24:46.772327+0000","last_undegraded":"2023-09-13T08:24:46.772327+0000","last_fullsized":"2023-09-13T08:24:46.772327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:38:57.000291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.775019+0000","last_change":"2023-09-13T08:24:41.756796+0000","last_active":"2023-09-13T08:24:46.775019+0000","last_peered":"2023-09-13T08:24:46.775019+0000","last_clean":"2023-09-13T08:24:46.775019+0000","last_became_active":"2023-09-13T08:24:41.756485+0000","last_became_peered":"2023-09-13T08:24:41.756485+0000","last_unstale":"2023-09-13T08:24:46.775019+0000","last_undegraded":"2023-09-13T08:24:46.775019+0000","last_fullsized":"2023-09-13T08:24:46.775019+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:20:29.866513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":169,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.775432+0000","last_change":"2023-09-13T08:24:30.608284+0000","last_active":"2023-09-13T08:24:46.775432+0000","last_peered":"2023-09-13T08:24:46.775432+0000","last_clean":"2023-09-13T08:24:46.775432+0000","last_became_active":"2023-09-13T08:24:30.607240+0000","last_became_peered":"2023-09-13T08:24:30.607240+0000","last_unstale":"2023-09-13T08:24:46.775432+0000","last_undegraded":"2023-09-13T08:24:46.775432+0000","last_fullsized":"2023-09-13T08:24:46.775432+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:29.424755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:29.424755+0000","last_clean_scrub_stamp":"2023-09-13T08:24:29.424755+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:57:43.427279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.534536+0000","last_change":"2023-09-13T08:24:46.796073+0000","last_active":"2023-09-13T08:24:48.534536+0000","last_peered":"2023-09-13T08:24:48.534536+0000","last_clean":"2023-09-13T08:24:48.534536+0000","last_became_active":"2023-09-13T08:24:46.795401+0000","last_became_peered":"2023-09-13T08:24:46.795401+0000","last_unstale":"2023-09-13T08:24:48.534536+0000","last_undegraded":"2023-09-13T08:24:48.534536+0000","last_fullsized":"2023-09-13T08:24:48.534536+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:49:40.361758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.778869+0000","last_change":"2023-09-13T08:24:42.742114+0000","last_active":"2023-09-13T08:24:46.778869+0000","last_peered":"2023-09-13T08:24:46.778869+0000","last_clean":"2023-09-13T08:24:46.778869+0000","last_became_active":"2023-09-13T08:24:42.741800+0000","last_became_peered":"2023-09-13T08:24:42.741800+0000","last_unstale":"2023-09-13T08:24:46.778869+0000","last_undegraded":"2023-09-13T08:24:46.778869+0000","last_fullsized":"2023-09-13T08:24:46.778869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:52:00.242806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.774235+0000","last_change":"2023-09-13T08:24:41.749496+0000","last_active":"2023-09-13T08:24:46.774235+0000","last_peered":"2023-09-13T08:24:46.774235+0000","last_clean":"2023-09-13T08:24:46.774235+0000","last_became_active":"2023-09-13T08:24:41.749111+0000","last_became_peered":"2023-09-13T08:24:41.749111+0000","last_unstale":"2023-09-13T08:24:46.774235+0000","last_undegraded":"2023-09-13T08:24:46.774235+0000","last_fullsized":"2023-09-13T08:24:46.774235+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:12:03.105088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.534661+0000","last_change":"2023-09-13T08:24:46.794473+0000","last_active":"2023-09-13T08:24:48.534661+0000","last_peered":"2023-09-13T08:24:48.534661+0000","last_clean":"2023-09-13T08:24:48.534661+0000","last_became_active":"2023-09-13T08:24:46.794060+0000","last_became_peered":"2023-09-13T08:24:46.794060+0000","last_unstale":"2023-09-13T08:24:48.534661+0000","last_undegraded":"2023-09-13T08:24:48.534661+0000","last_fullsized":"2023-09-13T08:24:48.534661+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:35:08.793411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.774664+0000","last_change":"2023-09-13T08:24:41.762626+0000","last_active":"2023-09-13T08:24:46.774664+0000","last_peered":"2023-09-13T08:24:46.774664+0000","last_clean":"2023-09-13T08:24:46.774664+0000","last_became_active":"2023-09-13T08:24:41.762370+0000","last_became_peered":"2023-09-13T08:24:41.762370+0000","last_unstale":"2023-09-13T08:24:46.774664+0000","last_undegraded":"2023-09-13T08:24:46.774664+0000","last_fullsized":"2023-09-13T08:24:46.774664+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:47:38.305158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.779166+0000","last_change":"2023-09-13T08:24:42.756318+0000","last_active":"2023-09-13T08:24:46.779166+0000","last_peered":"2023-09-13T08:24:46.779166+0000","last_clean":"2023-09-13T08:24:46.779166+0000","last_became_active":"2023-09-13T08:24:42.755533+0000","last_became_peered":"2023-09-13T08:24:42.755533+0000","last_unstale":"2023-09-13T08:24:46.779166+0000","last_undegraded":"2023-09-13T08:24:46.779166+0000","last_fullsized":"2023-09-13T08:24:46.779166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:38:57.000291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.535633+0000","last_change":"2023-09-13T08:24:46.792676+0000","last_active":"2023-09-13T08:24:48.535633+0000","last_peered":"2023-09-13T08:24:48.535633+0000","last_clean":"2023-09-13T08:24:48.535633+0000","last_became_active":"2023-09-13T08:24:46.792303+0000","last_became_peered":"2023-09-13T08:24:46.792303+0000","last_unstale":"2023-09-13T08:24:48.535633+0000","last_undegraded":"2023-09-13T08:24:48.535633+0000","last_fullsized":"2023-09-13T08:24:48.535633+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:06:40.257204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.778749+0000","last_change":"2023-09-13T08:24:41.755753+0000","last_active":"2023-09-13T08:24:46.778749+0000","last_peered":"2023-09-13T08:24:46.778749+0000","last_clean":"2023-09-13T08:24:46.778749+0000","last_became_active":"2023-09-13T08:24:41.755494+0000","last_became_peered":"2023-09-13T08:24:41.755494+0000","last_unstale":"2023-09-13T08:24:46.778749+0000","last_undegraded":"2023-09-13T08:24:46.778749+0000","last_fullsized":"2023-09-13T08:24:46.778749+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:14:24.302634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.772761+0000","last_change":"2023-09-13T08:24:42.766497+0000","last_active":"2023-09-13T08:24:46.772761+0000","last_peered":"2023-09-13T08:24:46.772761+0000","last_clean":"2023-09-13T08:24:46.772761+0000","last_became_active":"2023-09-13T08:24:42.766157+0000","last_became_peered":"2023-09-13T08:24:42.766157+0000","last_unstale":"2023-09-13T08:24:46.772761+0000","last_undegraded":"2023-09-13T08:24:46.772761+0000","last_fullsized":"2023-09-13T08:24:46.772761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:31:23.082234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.535011+0000","last_change":"2023-09-13T08:24:46.794008+0000","last_active":"2023-09-13T08:24:48.535011+0000","last_peered":"2023-09-13T08:24:48.535011+0000","last_clean":"2023-09-13T08:24:48.535011+0000","last_became_active":"2023-09-13T08:24:46.792056+0000","last_became_peered":"2023-09-13T08:24:46.792056+0000","last_unstale":"2023-09-13T08:24:48.535011+0000","last_undegraded":"2023-09-13T08:24:48.535011+0000","last_fullsized":"2023-09-13T08:24:48.535011+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:32:05.670913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.786789+0000","last_change":"2023-09-13T08:24:41.752446+0000","last_active":"2023-09-13T08:24:46.786789+0000","last_peered":"2023-09-13T08:24:46.786789+0000","last_clean":"2023-09-13T08:24:46.786789+0000","last_became_active":"2023-09-13T08:24:41.752048+0000","last_became_peered":"2023-09-13T08:24:41.752048+0000","last_unstale":"2023-09-13T08:24:46.786789+0000","last_undegraded":"2023-09-13T08:24:46.786789+0000","last_fullsized":"2023-09-13T08:24:46.786789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:16:33.150745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.777913+0000","last_change":"2023-09-13T08:24:42.761656+0000","last_active":"2023-09-13T08:24:46.777913+0000","last_peered":"2023-09-13T08:24:46.777913+0000","last_clean":"2023-09-13T08:24:46.777913+0000","last_became_active":"2023-09-13T08:24:42.761413+0000","last_became_peered":"2023-09-13T08:24:42.761413+0000","last_unstale":"2023-09-13T08:24:46.777913+0000","last_undegraded":"2023-09-13T08:24:46.777913+0000","last_fullsized":"2023-09-13T08:24:46.777913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:38:57.000291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.535562+0000","last_change":"2023-09-13T08:24:46.799414+0000","last_active":"2023-09-13T08:24:48.535562+0000","last_peered":"2023-09-13T08:24:48.535562+0000","last_clean":"2023-09-13T08:24:48.535562+0000","last_became_active":"2023-09-13T08:24:46.796678+0000","last_became_peered":"2023-09-13T08:24:46.796678+0000","last_unstale":"2023-09-13T08:24:48.535562+0000","last_undegraded":"2023-09-13T08:24:48.535562+0000","last_fullsized":"2023-09-13T08:24:48.535562+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:44:45.516475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.773672+0000","last_change":"2023-09-13T08:24:41.762705+0000","last_active":"2023-09-13T08:24:46.773672+0000","last_peered":"2023-09-13T08:24:46.773672+0000","last_clean":"2023-09-13T08:24:46.773672+0000","last_became_active":"2023-09-13T08:24:41.762433+0000","last_became_peered":"2023-09-13T08:24:41.762433+0000","last_unstale":"2023-09-13T08:24:46.773672+0000","last_undegraded":"2023-09-13T08:24:46.773672+0000","last_fullsized":"2023-09-13T08:24:46.773672+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:33:08.894982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.780733+0000","last_change":"2023-09-13T08:24:42.756676+0000","last_active":"2023-09-13T08:24:46.780733+0000","last_peered":"2023-09-13T08:24:46.780733+0000","last_clean":"2023-09-13T08:24:46.780733+0000","last_became_active":"2023-09-13T08:24:42.756186+0000","last_became_peered":"2023-09-13T08:24:42.756186+0000","last_unstale":"2023-09-13T08:24:46.780733+0000","last_undegraded":"2023-09-13T08:24:46.780733+0000","last_fullsized":"2023-09-13T08:24:46.780733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:56:13.899024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.537160+0000","last_change":"2023-09-13T08:24:46.792798+0000","last_active":"2023-09-13T08:24:48.537160+0000","last_peered":"2023-09-13T08:24:48.537160+0000","last_clean":"2023-09-13T08:24:48.537160+0000","last_became_active":"2023-09-13T08:24:46.792514+0000","last_became_peered":"2023-09-13T08:24:46.792514+0000","last_unstale":"2023-09-13T08:24:48.537160+0000","last_undegraded":"2023-09-13T08:24:48.537160+0000","last_fullsized":"2023-09-13T08:24:48.537160+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:35:08.086286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.778802+0000","last_change":"2023-09-13T08:24:41.748432+0000","last_active":"2023-09-13T08:24:46.778802+0000","last_peered":"2023-09-13T08:24:46.778802+0000","last_clean":"2023-09-13T08:24:46.778802+0000","last_became_active":"2023-09-13T08:24:41.747775+0000","last_became_peered":"2023-09-13T08:24:41.747775+0000","last_unstale":"2023-09-13T08:24:46.778802+0000","last_undegraded":"2023-09-13T08:24:46.778802+0000","last_fullsized":"2023-09-13T08:24:46.778802+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:04:12.070569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.772017+0000","last_change":"2023-09-13T08:24:42.764490+0000","last_active":"2023-09-13T08:24:46.772017+0000","last_peered":"2023-09-13T08:24:46.772017+0000","last_clean":"2023-09-13T08:24:46.772017+0000","last_became_active":"2023-09-13T08:24:42.764250+0000","last_became_peered":"2023-09-13T08:24:42.764250+0000","last_unstale":"2023-09-13T08:24:46.772017+0000","last_undegraded":"2023-09-13T08:24:46.772017+0000","last_fullsized":"2023-09-13T08:24:46.772017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:47:39.312215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.535444+0000","last_change":"2023-09-13T08:24:46.798308+0000","last_active":"2023-09-13T08:24:48.535444+0000","last_peered":"2023-09-13T08:24:48.535444+0000","last_clean":"2023-09-13T08:24:48.535444+0000","last_became_active":"2023-09-13T08:24:46.797901+0000","last_became_peered":"2023-09-13T08:24:46.797901+0000","last_unstale":"2023-09-13T08:24:48.535444+0000","last_undegraded":"2023-09-13T08:24:48.535444+0000","last_fullsized":"2023-09-13T08:24:48.535444+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:49:40.361758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.778922+0000","last_change":"2023-09-13T08:24:41.752252+0000","last_active":"2023-09-13T08:24:46.778922+0000","last_peered":"2023-09-13T08:24:46.778922+0000","last_clean":"2023-09-13T08:24:46.778922+0000","last_became_active":"2023-09-13T08:24:41.751926+0000","last_became_peered":"2023-09-13T08:24:41.751926+0000","last_unstale":"2023-09-13T08:24:46.778922+0000","last_undegraded":"2023-09-13T08:24:46.778922+0000","last_fullsized":"2023-09-13T08:24:46.778922+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:51:59.235749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.772536+0000","last_change":"2023-09-13T08:24:42.753686+0000","last_active":"2023-09-13T08:24:46.772536+0000","last_peered":"2023-09-13T08:24:46.772536+0000","last_clean":"2023-09-13T08:24:46.772536+0000","last_became_active":"2023-09-13T08:24:42.753298+0000","last_became_peered":"2023-09-13T08:24:42.753298+0000","last_unstale":"2023-09-13T08:24:46.772536+0000","last_undegraded":"2023-09-13T08:24:46.772536+0000","last_fullsized":"2023-09-13T08:24:46.772536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:23:57.161158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.535678+0000","last_change":"2023-09-13T08:24:46.791776+0000","last_active":"2023-09-13T08:24:48.535678+0000","last_peered":"2023-09-13T08:24:48.535678+0000","last_clean":"2023-09-13T08:24:48.535678+0000","last_became_active":"2023-09-13T08:24:46.791304+0000","last_became_peered":"2023-09-13T08:24:46.791304+0000","last_unstale":"2023-09-13T08:24:48.535678+0000","last_undegraded":"2023-09-13T08:24:48.535678+0000","last_fullsized":"2023-09-13T08:24:48.535678+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:35:08.793411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.773971+0000","last_change":"2023-09-13T08:24:41.748551+0000","last_active":"2023-09-13T08:24:46.773971+0000","last_peered":"2023-09-13T08:24:46.773971+0000","last_clean":"2023-09-13T08:24:46.773971+0000","last_became_active":"2023-09-13T08:24:41.748281+0000","last_became_peered":"2023-09-13T08:24:41.748281+0000","last_unstale":"2023-09-13T08:24:46.773971+0000","last_undegraded":"2023-09-13T08:24:46.773971+0000","last_fullsized":"2023-09-13T08:24:46.773971+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:07:52.055769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.785938+0000","last_change":"2023-09-13T08:24:42.755845+0000","last_active":"2023-09-13T08:24:46.785938+0000","last_peered":"2023-09-13T08:24:46.785938+0000","last_clean":"2023-09-13T08:24:46.785938+0000","last_became_active":"2023-09-13T08:24:42.755374+0000","last_became_peered":"2023-09-13T08:24:42.755374+0000","last_unstale":"2023-09-13T08:24:46.785938+0000","last_undegraded":"2023-09-13T08:24:46.785938+0000","last_fullsized":"2023-09-13T08:24:46.785938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:22:05.554377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:47.776274+0000","last_change":"2023-09-13T08:24:46.799284+0000","last_active":"2023-09-13T08:24:47.776274+0000","last_peered":"2023-09-13T08:24:47.776274+0000","last_clean":"2023-09-13T08:24:47.776274+0000","last_became_active":"2023-09-13T08:24:46.798883+0000","last_became_peered":"2023-09-13T08:24:46.798883+0000","last_unstale":"2023-09-13T08:24:47.776274+0000","last_undegraded":"2023-09-13T08:24:47.776274+0000","last_fullsized":"2023-09-13T08:24:47.776274+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:49:40.361758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.781243+0000","last_change":"2023-09-13T08:24:41.752612+0000","last_active":"2023-09-13T08:24:46.781243+0000","last_peered":"2023-09-13T08:24:46.781243+0000","last_clean":"2023-09-13T08:24:46.781243+0000","last_became_active":"2023-09-13T08:24:41.752348+0000","last_became_peered":"2023-09-13T08:24:41.752348+0000","last_unstale":"2023-09-13T08:24:46.781243+0000","last_undegraded":"2023-09-13T08:24:46.781243+0000","last_fullsized":"2023-09-13T08:24:46.781243+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:04:36.176078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.774859+0000","last_change":"2023-09-13T08:24:42.767304+0000","last_active":"2023-09-13T08:24:46.774859+0000","last_peered":"2023-09-13T08:24:46.774859+0000","last_clean":"2023-09-13T08:24:46.774859+0000","last_became_active":"2023-09-13T08:24:42.767041+0000","last_became_peered":"2023-09-13T08:24:42.767041+0000","last_unstale":"2023-09-13T08:24:46.774859+0000","last_undegraded":"2023-09-13T08:24:46.774859+0000","last_fullsized":"2023-09-13T08:24:46.774859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:03:06.113162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.534554+0000","last_change":"2023-09-13T08:24:46.791835+0000","last_active":"2023-09-13T08:24:48.534554+0000","last_peered":"2023-09-13T08:24:48.534554+0000","last_clean":"2023-09-13T08:24:48.534554+0000","last_became_active":"2023-09-13T08:24:46.791288+0000","last_became_peered":"2023-09-13T08:24:46.791288+0000","last_unstale":"2023-09-13T08:24:48.534554+0000","last_undegraded":"2023-09-13T08:24:48.534554+0000","last_fullsized":"2023-09-13T08:24:48.534554+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:44:45.516475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.779134+0000","last_change":"2023-09-13T08:24:41.747559+0000","last_active":"2023-09-13T08:24:46.779134+0000","last_peered":"2023-09-13T08:24:46.779134+0000","last_clean":"2023-09-13T08:24:46.779134+0000","last_became_active":"2023-09-13T08:24:41.747102+0000","last_became_peered":"2023-09-13T08:24:41.747102+0000","last_unstale":"2023-09-13T08:24:46.779134+0000","last_undegraded":"2023-09-13T08:24:46.779134+0000","last_fullsized":"2023-09-13T08:24:46.779134+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:56:12.891967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.776345+0000","last_change":"2023-09-13T08:24:42.770958+0000","last_active":"2023-09-13T08:24:46.776345+0000","last_peered":"2023-09-13T08:24:46.776345+0000","last_clean":"2023-09-13T08:24:46.776345+0000","last_became_active":"2023-09-13T08:24:42.769963+0000","last_became_peered":"2023-09-13T08:24:42.769963+0000","last_unstale":"2023-09-13T08:24:46.776345+0000","last_undegraded":"2023-09-13T08:24:46.776345+0000","last_fullsized":"2023-09-13T08:24:46.776345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:30:17.103018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:47.810704+0000","last_change":"2023-09-13T08:24:46.792537+0000","last_active":"2023-09-13T08:24:47.810704+0000","last_peered":"2023-09-13T08:24:47.810704+0000","last_clean":"2023-09-13T08:24:47.810704+0000","last_became_active":"2023-09-13T08:24:46.791931+0000","last_became_peered":"2023-09-13T08:24:46.791931+0000","last_unstale":"2023-09-13T08:24:47.810704+0000","last_undegraded":"2023-09-13T08:24:47.810704+0000","last_fullsized":"2023-09-13T08:24:47.810704+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:14:40.142972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.783932+0000","last_change":"2023-09-13T08:24:41.750664+0000","last_active":"2023-09-13T08:24:46.783932+0000","last_peered":"2023-09-13T08:24:46.783932+0000","last_clean":"2023-09-13T08:24:46.783932+0000","last_became_active":"2023-09-13T08:24:41.750331+0000","last_became_peered":"2023-09-13T08:24:41.750331+0000","last_unstale":"2023-09-13T08:24:46.783932+0000","last_undegraded":"2023-09-13T08:24:46.783932+0000","last_fullsized":"2023-09-13T08:24:46.783932+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:04:12.070569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.774929+0000","last_change":"2023-09-13T08:24:42.765570+0000","last_active":"2023-09-13T08:24:46.774929+0000","last_peered":"2023-09-13T08:24:46.774929+0000","last_clean":"2023-09-13T08:24:46.774929+0000","last_became_active":"2023-09-13T08:24:42.765232+0000","last_became_peered":"2023-09-13T08:24:42.765232+0000","last_unstale":"2023-09-13T08:24:46.774929+0000","last_undegraded":"2023-09-13T08:24:46.774929+0000","last_fullsized":"2023-09-13T08:24:46.774929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:32:01.643446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.785784+0000","last_change":"2023-09-13T08:24:42.759999+0000","last_active":"2023-09-13T08:24:46.785784+0000","last_peered":"2023-09-13T08:24:46.785784+0000","last_clean":"2023-09-13T08:24:46.785784+0000","last_became_active":"2023-09-13T08:24:42.759710+0000","last_became_peered":"2023-09-13T08:24:42.759710+0000","last_unstale":"2023-09-13T08:24:46.785784+0000","last_undegraded":"2023-09-13T08:24:46.785784+0000","last_fullsized":"2023-09-13T08:24:46.785784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:07:53.062826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.779042+0000","last_change":"2023-09-13T08:24:42.763001+0000","last_active":"2023-09-13T08:24:46.779042+0000","last_peered":"2023-09-13T08:24:46.779042+0000","last_clean":"2023-09-13T08:24:46.779042+0000","last_became_active":"2023-09-13T08:24:42.762686+0000","last_became_peered":"2023-09-13T08:24:42.762686+0000","last_unstale":"2023-09-13T08:24:46.779042+0000","last_undegraded":"2023-09-13T08:24:46.779042+0000","last_fullsized":"2023-09-13T08:24:46.779042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:28:08.821003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.774332+0000","last_change":"2023-09-13T08:24:42.762039+0000","last_active":"2023-09-13T08:24:46.774332+0000","last_peered":"2023-09-13T08:24:46.774332+0000","last_clean":"2023-09-13T08:24:46.774332+0000","last_became_active":"2023-09-13T08:24:42.761685+0000","last_became_peered":"2023-09-13T08:24:42.761685+0000","last_unstale":"2023-09-13T08:24:46.774332+0000","last_undegraded":"2023-09-13T08:24:46.774332+0000","last_fullsized":"2023-09-13T08:24:46.774332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:03:06.113162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.777670+0000","last_change":"2023-09-13T08:24:42.751302+0000","last_active":"2023-09-13T08:24:46.777670+0000","last_peered":"2023-09-13T08:24:46.777670+0000","last_clean":"2023-09-13T08:24:46.777670+0000","last_became_active":"2023-09-13T08:24:42.751016+0000","last_became_peered":"2023-09-13T08:24:42.751016+0000","last_unstale":"2023-09-13T08:24:46.777670+0000","last_undegraded":"2023-09-13T08:24:46.777670+0000","last_fullsized":"2023-09-13T08:24:46.777670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:07:53.062826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.772384+0000","last_change":"2023-09-13T08:24:42.752520+0000","last_active":"2023-09-13T08:24:46.772384+0000","last_peered":"2023-09-13T08:24:46.772384+0000","last_clean":"2023-09-13T08:24:46.772384+0000","last_became_active":"2023-09-13T08:24:42.752216+0000","last_became_peered":"2023-09-13T08:24:42.752216+0000","last_unstale":"2023-09-13T08:24:46.772384+0000","last_undegraded":"2023-09-13T08:24:46.772384+0000","last_fullsized":"2023-09-13T08:24:46.772384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:30:17.103018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.779033+0000","last_change":"2023-09-13T08:24:42.758492+0000","last_active":"2023-09-13T08:24:46.779033+0000","last_peered":"2023-09-13T08:24:46.779033+0000","last_clean":"2023-09-13T08:24:46.779033+0000","last_became_active":"2023-09-13T08:24:42.758226+0000","last_became_peered":"2023-09-13T08:24:42.758226+0000","last_unstale":"2023-09-13T08:24:46.779033+0000","last_undegraded":"2023-09-13T08:24:46.779033+0000","last_fullsized":"2023-09-13T08:24:46.779033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:31:23.082234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.786631+0000","last_change":"2023-09-13T08:24:42.765380+0000","last_active":"2023-09-13T08:24:46.786631+0000","last_peered":"2023-09-13T08:24:46.786631+0000","last_clean":"2023-09-13T08:24:46.786631+0000","last_became_active":"2023-09-13T08:24:42.764743+0000","last_became_peered":"2023-09-13T08:24:42.764743+0000","last_unstale":"2023-09-13T08:24:46.786631+0000","last_undegraded":"2023-09-13T08:24:46.786631+0000","last_fullsized":"2023-09-13T08:24:46.786631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:23:57.161158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.772975+0000","last_change":"2023-09-13T08:24:42.752773+0000","last_active":"2023-09-13T08:24:46.772975+0000","last_peered":"2023-09-13T08:24:46.772975+0000","last_clean":"2023-09-13T08:24:46.772975+0000","last_became_active":"2023-09-13T08:24:42.752417+0000","last_became_peered":"2023-09-13T08:24:42.752417+0000","last_unstale":"2023-09-13T08:24:46.772975+0000","last_undegraded":"2023-09-13T08:24:46.772975+0000","last_fullsized":"2023-09-13T08:24:46.772975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:01:14.370463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.774852+0000","last_change":"2023-09-13T08:24:42.761893+0000","last_active":"2023-09-13T08:24:46.774852+0000","last_peered":"2023-09-13T08:24:46.774852+0000","last_clean":"2023-09-13T08:24:46.774852+0000","last_became_active":"2023-09-13T08:24:42.761302+0000","last_became_peered":"2023-09-13T08:24:42.761302+0000","last_unstale":"2023-09-13T08:24:46.774852+0000","last_undegraded":"2023-09-13T08:24:46.774852+0000","last_fullsized":"2023-09-13T08:24:46.774852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:20:47.395388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.772142+0000","last_change":"2023-09-13T08:24:42.752632+0000","last_active":"2023-09-13T08:24:46.772142+0000","last_peered":"2023-09-13T08:24:46.772142+0000","last_clean":"2023-09-13T08:24:46.772142+0000","last_became_active":"2023-09-13T08:24:42.752332+0000","last_became_peered":"2023-09-13T08:24:42.752332+0000","last_unstale":"2023-09-13T08:24:46.772142+0000","last_undegraded":"2023-09-13T08:24:46.772142+0000","last_fullsized":"2023-09-13T08:24:46.772142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:07:53.062826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.774683+0000","last_change":"2023-09-13T08:24:42.764523+0000","last_active":"2023-09-13T08:24:46.774683+0000","last_peered":"2023-09-13T08:24:46.774683+0000","last_clean":"2023-09-13T08:24:46.774683+0000","last_became_active":"2023-09-13T08:24:42.764276+0000","last_became_peered":"2023-09-13T08:24:42.764276+0000","last_unstale":"2023-09-13T08:24:46.774683+0000","last_undegraded":"2023-09-13T08:24:46.774683+0000","last_fullsized":"2023-09-13T08:24:46.774683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:23:57.161158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.777757+0000","last_change":"2023-09-13T08:24:42.750926+0000","last_active":"2023-09-13T08:24:46.777757+0000","last_peered":"2023-09-13T08:24:46.777757+0000","last_clean":"2023-09-13T08:24:46.777757+0000","last_became_active":"2023-09-13T08:24:42.750569+0000","last_became_peered":"2023-09-13T08:24:42.750569+0000","last_unstale":"2023-09-13T08:24:46.777757+0000","last_undegraded":"2023-09-13T08:24:46.777757+0000","last_fullsized":"2023-09-13T08:24:46.777757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:31:23.082234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.786084+0000","last_change":"2023-09-13T08:24:42.752653+0000","last_active":"2023-09-13T08:24:46.786084+0000","last_peered":"2023-09-13T08:24:46.786084+0000","last_clean":"2023-09-13T08:24:46.786084+0000","last_became_active":"2023-09-13T08:24:42.752390+0000","last_became_peered":"2023-09-13T08:24:42.752390+0000","last_unstale":"2023-09-13T08:24:46.786084+0000","last_undegraded":"2023-09-13T08:24:46.786084+0000","last_fullsized":"2023-09-13T08:24:46.786084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:31:23.082234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":851968,"data_stored":690730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574861,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":99940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574860,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":860160,"data_stored":690786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574860,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":253952,"data_stored":99780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.249}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]}]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.0359999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":25.963999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":15.307}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":10.952}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":15.243}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":10.994999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.1150000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":99906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]}]},{"osd":5,"up_from":13,"seq":55834574861,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":99870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-13T08:25:11.655 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-13T08:25:11.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.809+0000 7fe666cb2700 1 Processor -- start 2023-09-13T08:25:11.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.809+0000 7fe666cb2700 1 -- start start 2023-09-13T08:25:11.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.809+0000 7fe666cb2700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe66006c750 0x7fe6601682c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:11.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.809+0000 7fe666cb2700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6600b1d80 con 0x7fe660160e30 2023-09-13T08:25:11.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.809+0000 7fe666cb2700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6600b2060 con 0x7fe66006bad0 2023-09-13T08:25:11.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.809+0000 7fe666cb2700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6600b2340 con 0x7fe66006c750 2023-09-13T08:25:11.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.809+0000 7fe66524f700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe66006c750 0x7fe6601682c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:11.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.810+0000 7fe66524f700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe66006c750 0x7fe6601682c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44150/0 (socket says 172.21.15.84:44150) 2023-09-13T08:25:11.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.810+0000 7fe664a4e700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fe660160e30 0x7fe6600b1530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:46792/0 (socket says 172.21.15.84:46792) 2023-09-13T08:25:11.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.810+0000 7fe66524f700 1 -- 172.21.15.84:0/2681569329 learned_addr learned my addr 172.21.15.84:0/2681569329 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:11.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.810+0000 7fe66524f700 1 -- 172.21.15.84:0/2681569329 >> v1:172.21.15.161:6789/0 conn(0x7fe66006bad0 legacy=0x7fe66006c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:11.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.810+0000 7fe66524f700 1 -- 172.21.15.84:0/2681569329 >> v1:172.21.15.84:6789/0 conn(0x7fe660160e30 legacy=0x7fe6600b1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:11.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.810+0000 7fe66524f700 1 -- 172.21.15.84:0/2681569329 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6600b2620 con 0x7fe66006c750 2023-09-13T08:25:11.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.810+0000 7fe65f7fe700 1 -- 172.21.15.84:0/2681569329 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1597669842 0 0) 0x7fe6600b1d80 con 0x7fe660160e30 2023-09-13T08:25:11.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.810+0000 7fe66524f700 1 --2- 172.21.15.84:0/2681569329 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe66006c750 0x7fe6601682c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe658009e50 tx=0x7fe65800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d2fa81312ca58cb server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:11.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.810+0000 7fe65f7fe700 1 -- 172.21.15.84:0/2681569329 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe65800e070 con 0x7fe66006c750 2023-09-13T08:25:11.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.810+0000 7fe65f7fe700 1 -- 172.21.15.84:0/2681569329 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe658003a20 con 0x7fe66006c750 2023-09-13T08:25:11.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.810+0000 7fe65f7fe700 1 -- 172.21.15.84:0/2681569329 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe658003dd0 con 0x7fe66006c750 2023-09-13T08:25:11.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.811+0000 7fe666cb2700 1 -- 172.21.15.84:0/2681569329 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe66006c750 msgr2=0x7fe6601682c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:11.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.811+0000 7fe666cb2700 1 --2- 172.21.15.84:0/2681569329 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe66006c750 0x7fe6601682c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe658009e50 tx=0x7fe65800b330 comp rx=0 tx=0).stop 2023-09-13T08:25:11.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.811+0000 7fe666cb2700 1 -- 172.21.15.84:0/2681569329 shutdown_connections 2023-09-13T08:25:11.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.811+0000 7fe666cb2700 1 --2- 172.21.15.84:0/2681569329 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe66006c750 0x7fe6601682c0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:11.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.811+0000 7fe666cb2700 1 -- 172.21.15.84:0/2681569329 >> 172.21.15.84:0/2681569329 conn(0x7fe6600d11c0 msgr2=0x7fe6600d15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:11.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.811+0000 7fe666cb2700 1 -- 172.21.15.84:0/2681569329 shutdown_connections 2023-09-13T08:25:11.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.811+0000 7fe666cb2700 1 -- 172.21.15.84:0/2681569329 wait complete. 2023-09-13T08:25:11.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.812+0000 7fe666cb2700 1 Processor -- start 2023-09-13T08:25:11.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.812+0000 7fe666cb2700 1 -- start start 2023-09-13T08:25:11.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.813+0000 7fe666cb2700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe66006bad0 0x7fe6601f39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:11.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.813+0000 7fe666cb2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe66006c750 0x7fe6600b1070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:11.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.813+0000 7fe666cb2700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe660160e30 0x7fe6600b15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:11.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.813+0000 7fe666cb2700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6601563c0 con 0x7fe66006c750 2023-09-13T08:25:11.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.813+0000 7fe666cb2700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6601f3ef0 con 0x7fe660160e30 2023-09-13T08:25:11.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.813+0000 7fe666cb2700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe660155510 con 0x7fe66006bad0 2023-09-13T08:25:11.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.813+0000 7fe65ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe66006c750 0x7fe6600b1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:11.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.813+0000 7fe65ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe66006c750 0x7fe6600b1070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44154/0 (socket says 172.21.15.84:44154) 2023-09-13T08:25:11.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.813+0000 7fe65ffff700 1 -- 172.21.15.84:0/534486243 learned_addr learned my addr 172.21.15.84:0/534486243 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:11.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.813+0000 7fe66524f700 1 --2- 172.21.15.84:0/534486243 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe660160e30 0x7fe6600b15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:11.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.813+0000 7fe664a4e700 1 --2- 172.21.15.84:0/534486243 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe66006bad0 0x7fe6601f39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:11.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.813+0000 7fe65ffff700 1 -- 172.21.15.84:0/534486243 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe66006bad0 msgr2=0x7fe6601f39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:11.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.813+0000 7fe65ffff700 1 --2- 172.21.15.84:0/534486243 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe66006bad0 0x7fe6601f39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:11.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.813+0000 7fe65ffff700 1 -- 172.21.15.84:0/534486243 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe660160e30 msgr2=0x7fe6600b15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:11.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.813+0000 7fe65ffff700 1 --2- 172.21.15.84:0/534486243 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe660160e30 0x7fe6600b15b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:11.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.813+0000 7fe65ffff700 1 -- 172.21.15.84:0/534486243 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe658009b30 con 0x7fe66006c750 2023-09-13T08:25:11.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.813+0000 7fe65ffff700 1 --2- 172.21.15.84:0/534486243 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe66006c750 0x7fe6600b1070 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe64c00b4a0 tx=0x7fe64c00b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:11.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.813+0000 7fe65d7fa700 1 -- 172.21.15.84:0/534486243 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe64c011830 con 0x7fe66006c750 2023-09-13T08:25:11.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.813+0000 7fe65d7fa700 1 -- 172.21.15.84:0/534486243 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe64c011990 con 0x7fe66006c750 2023-09-13T08:25:11.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.813+0000 7fe666cb2700 1 -- 172.21.15.84:0/534486243 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6601557b0 con 0x7fe66006c750 2023-09-13T08:25:11.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.814+0000 7fe65d7fa700 1 -- 172.21.15.84:0/534486243 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe64c011d40 con 0x7fe66006c750 2023-09-13T08:25:11.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.814+0000 7fe666cb2700 1 -- 172.21.15.84:0/534486243 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe660155d70 con 0x7fe66006c750 2023-09-13T08:25:11.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.814+0000 7fe666cb2700 1 -- 172.21.15.84:0/534486243 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe660156530 con 0x7fe66006c750 2023-09-13T08:25:11.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.815+0000 7fe65d7fa700 1 -- 172.21.15.84:0/534486243 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fe64c01a400 con 0x7fe66006c750 2023-09-13T08:25:11.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.815+0000 7fe65d7fa700 1 --2- 172.21.15.84:0/534486243 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fe64406a580 0x7fe64406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:11.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.815+0000 7fe65d7fa700 1 -- 172.21.15.84:0/534486243 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe64c088970 con 0x7fe66006c750 2023-09-13T08:25:11.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.815+0000 7fe664a4e700 1 --2- 172.21.15.84:0/534486243 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fe64406a580 0x7fe64406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:11.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.816+0000 7fe664a4e700 1 --2- 172.21.15.84:0/534486243 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fe64406a580 0x7fe64406ca40 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe654007fd0 tx=0x7fe654007de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:11.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:11.820+0000 7fe65d7fa700 1 -- 172.21.15.84:0/534486243 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fe64c053c00 con 0x7fe66006c750 2023-09-13T08:25:12.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.007+0000 7fe666cb2700 1 -- 172.21.15.84:0/534486243 --> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe6600b2900 con 0x7fe64406a580 2023-09-13T08:25:12.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.016+0000 7fe65d7fa700 1 -- 172.21.15.84:0/534486243 <== mgr.4104 v2:172.21.15.84:6832/3568908055 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345199 (secure 0 0 0) 0x7fe654001370 con 0x7fe64406a580 2023-09-13T08:25:12.022 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:25:12.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.019+0000 7fe666cb2700 1 -- 172.21.15.84:0/534486243 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fe64406a580 msgr2=0x7fe64406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:12.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.019+0000 7fe666cb2700 1 --2- 172.21.15.84:0/534486243 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fe64406a580 0x7fe64406ca40 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe654007fd0 tx=0x7fe654007de0 comp rx=0 tx=0).stop 2023-09-13T08:25:12.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.019+0000 7fe666cb2700 1 -- 172.21.15.84:0/534486243 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe66006c750 msgr2=0x7fe6600b1070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:12.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.019+0000 7fe666cb2700 1 --2- 172.21.15.84:0/534486243 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe66006c750 0x7fe6600b1070 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe64c00b4a0 tx=0x7fe64c00b7b0 comp rx=0 tx=0).stop 2023-09-13T08:25:12.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.019+0000 7fe666cb2700 1 -- 172.21.15.84:0/534486243 shutdown_connections 2023-09-13T08:25:12.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.019+0000 7fe666cb2700 1 --2- 172.21.15.84:0/534486243 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fe64406a580 0x7fe64406ca40 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:12.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.019+0000 7fe666cb2700 1 --2- 172.21.15.84:0/534486243 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe660160e30 0x7fe6600b15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:12.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.019+0000 7fe666cb2700 1 --2- 172.21.15.84:0/534486243 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe66006bad0 0x7fe6601f39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:12.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.019+0000 7fe666cb2700 1 --2- 172.21.15.84:0/534486243 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe66006c750 0x7fe6600b1070 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:12.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.019+0000 7fe666cb2700 1 -- 172.21.15.84:0/534486243 >> 172.21.15.84:0/534486243 conn(0x7fe6600d11c0 msgr2=0x7fe66015fe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:12.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.019+0000 7fe666cb2700 1 -- 172.21.15.84:0/534486243 shutdown_connections 2023-09-13T08:25:12.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.019+0000 7fe666cb2700 1 -- 172.21.15.84:0/534486243 wait complete. 2023-09-13T08:25:12.030 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-09-13T08:25:12.032 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2023-09-13T08:25:10.549820+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219368,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755352,"statfs":{"total":773094113280,"available":772869480448,"internally_reserved":0,"allocated":3284992,"data_stored":1988256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005597"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.774842+0000","last_change":"2023-09-13T08:24:42.765440+0000","last_active":"2023-09-13T08:24:46.774842+0000","last_peered":"2023-09-13T08:24:46.774842+0000","last_clean":"2023-09-13T08:24:46.774842+0000","last_became_active":"2023-09-13T08:24:42.764929+0000","last_became_peered":"2023-09-13T08:24:42.764929+0000","last_unstale":"2023-09-13T08:24:46.774842+0000","last_undegraded":"2023-09-13T08:24:46.774842+0000","last_fullsized":"2023-09-13T08:24:46.774842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:14:26.147276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.778909+0000","last_change":"2023-09-13T08:24:42.755837+0000","last_active":"2023-09-13T08:24:46.778909+0000","last_peered":"2023-09-13T08:24:46.778909+0000","last_clean":"2023-09-13T08:24:46.778909+0000","last_became_active":"2023-09-13T08:24:42.755520+0000","last_became_peered":"2023-09-13T08:24:42.755520+0000","last_unstale":"2023-09-13T08:24:46.778909+0000","last_undegraded":"2023-09-13T08:24:46.778909+0000","last_fullsized":"2023-09-13T08:24:46.778909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:01:14.370463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.778319+0000","last_change":"2023-09-13T08:24:42.751148+0000","last_active":"2023-09-13T08:24:46.778319+0000","last_peered":"2023-09-13T08:24:46.778319+0000","last_clean":"2023-09-13T08:24:46.778319+0000","last_became_active":"2023-09-13T08:24:42.750784+0000","last_became_peered":"2023-09-13T08:24:42.750784+0000","last_unstale":"2023-09-13T08:24:46.778319+0000","last_undegraded":"2023-09-13T08:24:46.778319+0000","last_fullsized":"2023-09-13T08:24:46.778319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:01:15.582567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.775884+0000","last_change":"2023-09-13T08:24:42.766616+0000","last_active":"2023-09-13T08:24:46.775884+0000","last_peered":"2023-09-13T08:24:46.775884+0000","last_clean":"2023-09-13T08:24:46.775884+0000","last_became_active":"2023-09-13T08:24:42.766318+0000","last_became_peered":"2023-09-13T08:24:42.766318+0000","last_unstale":"2023-09-13T08:24:46.775884+0000","last_undegraded":"2023-09-13T08:24:46.775884+0000","last_fullsized":"2023-09-13T08:24:46.775884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:29:11.602118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.773834+0000","last_change":"2023-09-13T08:24:42.760772+0000","last_active":"2023-09-13T08:24:46.773834+0000","last_peered":"2023-09-13T08:24:46.773834+0000","last_clean":"2023-09-13T08:24:46.773834+0000","last_became_active":"2023-09-13T08:24:42.760319+0000","last_became_peered":"2023-09-13T08:24:42.760319+0000","last_unstale":"2023-09-13T08:24:46.773834+0000","last_undegraded":"2023-09-13T08:24:46.773834+0000","last_fullsized":"2023-09-13T08:24:46.773834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:17:32.912375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.774449+0000","last_change":"2023-09-13T08:24:42.765841+0000","last_active":"2023-09-13T08:24:46.774449+0000","last_peered":"2023-09-13T08:24:46.774449+0000","last_clean":"2023-09-13T08:24:46.774449+0000","last_became_active":"2023-09-13T08:24:42.764312+0000","last_became_peered":"2023-09-13T08:24:42.764312+0000","last_unstale":"2023-09-13T08:24:46.774449+0000","last_undegraded":"2023-09-13T08:24:46.774449+0000","last_fullsized":"2023-09-13T08:24:46.774449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:31:23.082234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.773749+0000","last_change":"2023-09-13T08:24:42.753624+0000","last_active":"2023-09-13T08:24:46.773749+0000","last_peered":"2023-09-13T08:24:46.773749+0000","last_clean":"2023-09-13T08:24:46.773749+0000","last_became_active":"2023-09-13T08:24:42.753354+0000","last_became_peered":"2023-09-13T08:24:42.753354+0000","last_unstale":"2023-09-13T08:24:46.773749+0000","last_undegraded":"2023-09-13T08:24:46.773749+0000","last_fullsized":"2023-09-13T08:24:46.773749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:31:23.082234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.772638+0000","last_change":"2023-09-13T08:24:42.770839+0000","last_active":"2023-09-13T08:24:46.772638+0000","last_peered":"2023-09-13T08:24:46.772638+0000","last_clean":"2023-09-13T08:24:46.772638+0000","last_became_active":"2023-09-13T08:24:42.770596+0000","last_became_peered":"2023-09-13T08:24:42.770596+0000","last_unstale":"2023-09-13T08:24:46.772638+0000","last_undegraded":"2023-09-13T08:24:46.772638+0000","last_fullsized":"2023-09-13T08:24:46.772638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:38:04.836936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.774754+0000","last_change":"2023-09-13T08:24:42.768552+0000","last_active":"2023-09-13T08:24:46.774754+0000","last_peered":"2023-09-13T08:24:46.774754+0000","last_clean":"2023-09-13T08:24:46.774754+0000","last_became_active":"2023-09-13T08:24:42.768084+0000","last_became_peered":"2023-09-13T08:24:42.768084+0000","last_unstale":"2023-09-13T08:24:46.774754+0000","last_undegraded":"2023-09-13T08:24:46.774754+0000","last_fullsized":"2023-09-13T08:24:46.774754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T19:01:29.959464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.786411+0000","last_change":"2023-09-13T08:24:42.765506+0000","last_active":"2023-09-13T08:24:46.786411+0000","last_peered":"2023-09-13T08:24:46.786411+0000","last_clean":"2023-09-13T08:24:46.786411+0000","last_became_active":"2023-09-13T08:24:42.765119+0000","last_became_peered":"2023-09-13T08:24:42.765119+0000","last_unstale":"2023-09-13T08:24:46.786411+0000","last_undegraded":"2023-09-13T08:24:46.786411+0000","last_fullsized":"2023-09-13T08:24:46.786411+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:17:32.912375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.786113+0000","last_change":"2023-09-13T08:24:42.768066+0000","last_active":"2023-09-13T08:24:46.786113+0000","last_peered":"2023-09-13T08:24:46.786113+0000","last_clean":"2023-09-13T08:24:46.786113+0000","last_became_active":"2023-09-13T08:24:42.767857+0000","last_became_peered":"2023-09-13T08:24:42.767857+0000","last_unstale":"2023-09-13T08:24:46.786113+0000","last_undegraded":"2023-09-13T08:24:46.786113+0000","last_fullsized":"2023-09-13T08:24:46.786113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:01:14.370463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.781776+0000","last_change":"2023-09-13T08:24:42.750028+0000","last_active":"2023-09-13T08:24:46.781776+0000","last_peered":"2023-09-13T08:24:46.781776+0000","last_clean":"2023-09-13T08:24:46.781776+0000","last_became_active":"2023-09-13T08:24:42.749472+0000","last_became_peered":"2023-09-13T08:24:42.749472+0000","last_unstale":"2023-09-13T08:24:46.781776+0000","last_undegraded":"2023-09-13T08:24:46.781776+0000","last_fullsized":"2023-09-13T08:24:46.781776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:16:34.157802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.772598+0000","last_change":"2023-09-13T08:24:42.756966+0000","last_active":"2023-09-13T08:24:46.772598+0000","last_peered":"2023-09-13T08:24:46.772598+0000","last_clean":"2023-09-13T08:24:46.772598+0000","last_became_active":"2023-09-13T08:24:42.756694+0000","last_became_peered":"2023-09-13T08:24:42.756694+0000","last_unstale":"2023-09-13T08:24:46.772598+0000","last_undegraded":"2023-09-13T08:24:46.772598+0000","last_fullsized":"2023-09-13T08:24:46.772598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:22:05.554377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.779252+0000","last_change":"2023-09-13T08:24:42.761359+0000","last_active":"2023-09-13T08:24:46.779252+0000","last_peered":"2023-09-13T08:24:46.779252+0000","last_clean":"2023-09-13T08:24:46.779252+0000","last_became_active":"2023-09-13T08:24:42.761113+0000","last_became_peered":"2023-09-13T08:24:42.761113+0000","last_unstale":"2023-09-13T08:24:46.779252+0000","last_undegraded":"2023-09-13T08:24:46.779252+0000","last_fullsized":"2023-09-13T08:24:46.779252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:38:04.836936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.778710+0000","last_change":"2023-09-13T08:24:42.756240+0000","last_active":"2023-09-13T08:24:46.778710+0000","last_peered":"2023-09-13T08:24:46.778710+0000","last_clean":"2023-09-13T08:24:46.778710+0000","last_became_active":"2023-09-13T08:24:42.755563+0000","last_became_peered":"2023-09-13T08:24:42.755563+0000","last_unstale":"2023-09-13T08:24:46.778710+0000","last_undegraded":"2023-09-13T08:24:46.778710+0000","last_fullsized":"2023-09-13T08:24:46.778710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:07:53.062826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.774724+0000","last_change":"2023-09-13T08:24:42.762083+0000","last_active":"2023-09-13T08:24:46.774724+0000","last_peered":"2023-09-13T08:24:46.774724+0000","last_clean":"2023-09-13T08:24:46.774724+0000","last_became_active":"2023-09-13T08:24:42.761624+0000","last_became_peered":"2023-09-13T08:24:42.761624+0000","last_unstale":"2023-09-13T08:24:46.774724+0000","last_undegraded":"2023-09-13T08:24:46.774724+0000","last_fullsized":"2023-09-13T08:24:46.774724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:01:14.370463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.774482+0000","last_change":"2023-09-13T08:24:42.771083+0000","last_active":"2023-09-13T08:24:46.774482+0000","last_peered":"2023-09-13T08:24:46.774482+0000","last_clean":"2023-09-13T08:24:46.774482+0000","last_became_active":"2023-09-13T08:24:42.770750+0000","last_became_peered":"2023-09-13T08:24:42.770750+0000","last_unstale":"2023-09-13T08:24:46.774482+0000","last_undegraded":"2023-09-13T08:24:46.774482+0000","last_fullsized":"2023-09-13T08:24:46.774482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:41:08.160337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.784024+0000","last_change":"2023-09-13T08:24:42.756007+0000","last_active":"2023-09-13T08:24:46.784024+0000","last_peered":"2023-09-13T08:24:46.784024+0000","last_clean":"2023-09-13T08:24:46.784024+0000","last_became_active":"2023-09-13T08:24:42.755730+0000","last_became_peered":"2023-09-13T08:24:42.755730+0000","last_unstale":"2023-09-13T08:24:46.784024+0000","last_undegraded":"2023-09-13T08:24:46.784024+0000","last_fullsized":"2023-09-13T08:24:46.784024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:16:34.157802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.774987+0000","last_change":"2023-09-13T08:24:42.758637+0000","last_active":"2023-09-13T08:24:46.774987+0000","last_peered":"2023-09-13T08:24:46.774987+0000","last_clean":"2023-09-13T08:24:46.774987+0000","last_became_active":"2023-09-13T08:24:42.758355+0000","last_became_peered":"2023-09-13T08:24:42.758355+0000","last_unstale":"2023-09-13T08:24:46.774987+0000","last_undegraded":"2023-09-13T08:24:46.774987+0000","last_fullsized":"2023-09-13T08:24:46.774987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:30:17.103018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.535787+0000","last_change":"2023-09-13T08:24:46.786296+0000","last_active":"2023-09-13T08:24:48.535787+0000","last_peered":"2023-09-13T08:24:48.535787+0000","last_clean":"2023-09-13T08:24:48.535787+0000","last_became_active":"2023-09-13T08:24:46.785911+0000","last_became_peered":"2023-09-13T08:24:46.785911+0000","last_unstale":"2023-09-13T08:24:48.535787+0000","last_undegraded":"2023-09-13T08:24:48.535787+0000","last_fullsized":"2023-09-13T08:24:48.535787+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:28:08.064402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.779981+0000","last_change":"2023-09-13T08:24:41.751910+0000","last_active":"2023-09-13T08:24:46.779981+0000","last_peered":"2023-09-13T08:24:46.779981+0000","last_clean":"2023-09-13T08:24:46.779981+0000","last_became_active":"2023-09-13T08:24:41.751643+0000","last_became_peered":"2023-09-13T08:24:41.751643+0000","last_unstale":"2023-09-13T08:24:46.779981+0000","last_undegraded":"2023-09-13T08:24:46.779981+0000","last_fullsized":"2023-09-13T08:24:46.779981+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:10:08.445556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.772648+0000","last_change":"2023-09-13T08:24:42.756649+0000","last_active":"2023-09-13T08:24:46.772648+0000","last_peered":"2023-09-13T08:24:46.772648+0000","last_clean":"2023-09-13T08:24:46.772648+0000","last_became_active":"2023-09-13T08:24:42.756308+0000","last_became_peered":"2023-09-13T08:24:42.756308+0000","last_unstale":"2023-09-13T08:24:46.772648+0000","last_undegraded":"2023-09-13T08:24:46.772648+0000","last_fullsized":"2023-09-13T08:24:46.772648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:17:32.912375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.535050+0000","last_change":"2023-09-13T08:24:46.798301+0000","last_active":"2023-09-13T08:24:48.535050+0000","last_peered":"2023-09-13T08:24:48.535050+0000","last_clean":"2023-09-13T08:24:48.535050+0000","last_became_active":"2023-09-13T08:24:46.797920+0000","last_became_peered":"2023-09-13T08:24:46.797920+0000","last_unstale":"2023-09-13T08:24:48.535050+0000","last_undegraded":"2023-09-13T08:24:48.535050+0000","last_fullsized":"2023-09-13T08:24:48.535050+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:41:12.187804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.772744+0000","last_change":"2023-09-13T08:24:41.762678+0000","last_active":"2023-09-13T08:24:46.772744+0000","last_peered":"2023-09-13T08:24:46.772744+0000","last_clean":"2023-09-13T08:24:46.772744+0000","last_became_active":"2023-09-13T08:24:41.762309+0000","last_became_peered":"2023-09-13T08:24:41.762309+0000","last_unstale":"2023-09-13T08:24:46.772744+0000","last_undegraded":"2023-09-13T08:24:46.772744+0000","last_fullsized":"2023-09-13T08:24:46.772744+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:40:49.395433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.779483+0000","last_change":"2023-09-13T08:24:42.764572+0000","last_active":"2023-09-13T08:24:46.779483+0000","last_peered":"2023-09-13T08:24:46.779483+0000","last_clean":"2023-09-13T08:24:46.779483+0000","last_became_active":"2023-09-13T08:24:42.764305+0000","last_became_peered":"2023-09-13T08:24:42.764305+0000","last_unstale":"2023-09-13T08:24:46.779483+0000","last_undegraded":"2023-09-13T08:24:46.779483+0000","last_fullsized":"2023-09-13T08:24:46.779483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:47:39.312215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.535234+0000","last_change":"2023-09-13T08:24:46.799685+0000","last_active":"2023-09-13T08:24:48.535234+0000","last_peered":"2023-09-13T08:24:48.535234+0000","last_clean":"2023-09-13T08:24:48.535234+0000","last_became_active":"2023-09-13T08:24:46.798723+0000","last_became_peered":"2023-09-13T08:24:46.798723+0000","last_unstale":"2023-09-13T08:24:48.535234+0000","last_undegraded":"2023-09-13T08:24:48.535234+0000","last_fullsized":"2023-09-13T08:24:48.535234+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:19:00.119006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.774765+0000","last_change":"2023-09-13T08:24:41.755988+0000","last_active":"2023-09-13T08:24:46.774765+0000","last_peered":"2023-09-13T08:24:46.774765+0000","last_clean":"2023-09-13T08:24:46.774765+0000","last_became_active":"2023-09-13T08:24:41.755711+0000","last_became_peered":"2023-09-13T08:24:41.755711+0000","last_unstale":"2023-09-13T08:24:46.774765+0000","last_undegraded":"2023-09-13T08:24:46.774765+0000","last_fullsized":"2023-09-13T08:24:46.774765+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:01:14.575510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.775792+0000","last_change":"2023-09-13T08:24:42.771141+0000","last_active":"2023-09-13T08:24:46.775792+0000","last_peered":"2023-09-13T08:24:46.775792+0000","last_clean":"2023-09-13T08:24:46.775792+0000","last_became_active":"2023-09-13T08:24:42.770716+0000","last_became_peered":"2023-09-13T08:24:42.770716+0000","last_unstale":"2023-09-13T08:24:46.775792+0000","last_undegraded":"2023-09-13T08:24:46.775792+0000","last_fullsized":"2023-09-13T08:24:46.775792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:17:32.912375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.535125+0000","last_change":"2023-09-13T08:24:46.797683+0000","last_active":"2023-09-13T08:24:48.535125+0000","last_peered":"2023-09-13T08:24:48.535125+0000","last_clean":"2023-09-13T08:24:48.535125+0000","last_became_active":"2023-09-13T08:24:46.797283+0000","last_became_peered":"2023-09-13T08:24:46.797283+0000","last_unstale":"2023-09-13T08:24:48.535125+0000","last_undegraded":"2023-09-13T08:24:48.535125+0000","last_fullsized":"2023-09-13T08:24:48.535125+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T19:57:23.132436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.773940+0000","last_change":"2023-09-13T08:24:41.757989+0000","last_active":"2023-09-13T08:24:46.773940+0000","last_peered":"2023-09-13T08:24:46.773940+0000","last_clean":"2023-09-13T08:24:46.773940+0000","last_became_active":"2023-09-13T08:24:41.757638+0000","last_became_peered":"2023-09-13T08:24:41.757638+0000","last_unstale":"2023-09-13T08:24:46.773940+0000","last_undegraded":"2023-09-13T08:24:46.773940+0000","last_fullsized":"2023-09-13T08:24:46.773940+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:28:07.813946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.776641+0000","last_change":"2023-09-13T08:24:42.771168+0000","last_active":"2023-09-13T08:24:46.776641+0000","last_peered":"2023-09-13T08:24:46.776641+0000","last_clean":"2023-09-13T08:24:46.776641+0000","last_became_active":"2023-09-13T08:24:42.770666+0000","last_became_peered":"2023-09-13T08:24:42.770666+0000","last_unstale":"2023-09-13T08:24:46.776641+0000","last_undegraded":"2023-09-13T08:24:46.776641+0000","last_fullsized":"2023-09-13T08:24:46.776641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:14:26.147276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.537048+0000","last_change":"2023-09-13T08:24:46.796942+0000","last_active":"2023-09-13T08:24:48.537048+0000","last_peered":"2023-09-13T08:24:48.537048+0000","last_clean":"2023-09-13T08:24:48.537048+0000","last_became_active":"2023-09-13T08:24:46.796351+0000","last_became_peered":"2023-09-13T08:24:46.796351+0000","last_unstale":"2023-09-13T08:24:48.537048+0000","last_undegraded":"2023-09-13T08:24:48.537048+0000","last_fullsized":"2023-09-13T08:24:48.537048+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:56:23.838830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.772437+0000","last_change":"2023-09-13T08:24:41.751550+0000","last_active":"2023-09-13T08:24:46.772437+0000","last_peered":"2023-09-13T08:24:46.772437+0000","last_clean":"2023-09-13T08:24:46.772437+0000","last_became_active":"2023-09-13T08:24:41.751239+0000","last_became_peered":"2023-09-13T08:24:41.751239+0000","last_unstale":"2023-09-13T08:24:46.772437+0000","last_undegraded":"2023-09-13T08:24:46.772437+0000","last_fullsized":"2023-09-13T08:24:46.772437+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:14:24.302634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.780775+0000","last_change":"2023-09-13T08:24:42.761870+0000","last_active":"2023-09-13T08:24:46.780775+0000","last_peered":"2023-09-13T08:24:46.780775+0000","last_clean":"2023-09-13T08:24:46.780775+0000","last_became_active":"2023-09-13T08:24:42.761353+0000","last_became_peered":"2023-09-13T08:24:42.761353+0000","last_unstale":"2023-09-13T08:24:46.780775+0000","last_undegraded":"2023-09-13T08:24:46.780775+0000","last_fullsized":"2023-09-13T08:24:46.780775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:04:13.077626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:47.773917+0000","last_change":"2023-09-13T08:24:46.790855+0000","last_active":"2023-09-13T08:24:47.773917+0000","last_peered":"2023-09-13T08:24:47.773917+0000","last_clean":"2023-09-13T08:24:47.773917+0000","last_became_active":"2023-09-13T08:24:46.790308+0000","last_became_peered":"2023-09-13T08:24:46.790308+0000","last_unstale":"2023-09-13T08:24:47.773917+0000","last_undegraded":"2023-09-13T08:24:47.773917+0000","last_fullsized":"2023-09-13T08:24:47.773917+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:39:01.027758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.785858+0000","last_change":"2023-09-13T08:24:41.750115+0000","last_active":"2023-09-13T08:24:46.785858+0000","last_peered":"2023-09-13T08:24:46.785858+0000","last_clean":"2023-09-13T08:24:46.785858+0000","last_became_active":"2023-09-13T08:24:41.749327+0000","last_became_peered":"2023-09-13T08:24:41.749327+0000","last_unstale":"2023-09-13T08:24:46.785858+0000","last_undegraded":"2023-09-13T08:24:46.785858+0000","last_fullsized":"2023-09-13T08:24:46.785858+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:51:59.235749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.777583+0000","last_change":"2023-09-13T08:24:42.746631+0000","last_active":"2023-09-13T08:24:46.777583+0000","last_peered":"2023-09-13T08:24:46.777583+0000","last_clean":"2023-09-13T08:24:46.777583+0000","last_became_active":"2023-09-13T08:24:42.745778+0000","last_became_peered":"2023-09-13T08:24:42.745778+0000","last_unstale":"2023-09-13T08:24:46.777583+0000","last_undegraded":"2023-09-13T08:24:46.777583+0000","last_fullsized":"2023-09-13T08:24:46.777583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:22:05.554377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:47.775957+0000","last_change":"2023-09-13T08:24:46.801666+0000","last_active":"2023-09-13T08:24:47.775957+0000","last_peered":"2023-09-13T08:24:47.775957+0000","last_clean":"2023-09-13T08:24:47.775957+0000","last_became_active":"2023-09-13T08:24:46.801323+0000","last_became_peered":"2023-09-13T08:24:46.801323+0000","last_unstale":"2023-09-13T08:24:47.775957+0000","last_undegraded":"2023-09-13T08:24:47.775957+0000","last_fullsized":"2023-09-13T08:24:47.775957+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:19:00.119006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.772047+0000","last_change":"2023-09-13T08:24:41.755264+0000","last_active":"2023-09-13T08:24:46.772047+0000","last_peered":"2023-09-13T08:24:46.772047+0000","last_clean":"2023-09-13T08:24:46.772047+0000","last_became_active":"2023-09-13T08:24:41.754961+0000","last_became_peered":"2023-09-13T08:24:41.754961+0000","last_unstale":"2023-09-13T08:24:46.772047+0000","last_undegraded":"2023-09-13T08:24:46.772047+0000","last_fullsized":"2023-09-13T08:24:46.772047+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:28:07.813946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.771919+0000","last_change":"2023-09-13T08:24:42.752899+0000","last_active":"2023-09-13T08:24:46.771919+0000","last_peered":"2023-09-13T08:24:46.771919+0000","last_clean":"2023-09-13T08:24:46.771919+0000","last_became_active":"2023-09-13T08:24:42.752583+0000","last_became_peered":"2023-09-13T08:24:42.752583+0000","last_unstale":"2023-09-13T08:24:46.771919+0000","last_undegraded":"2023-09-13T08:24:46.771919+0000","last_fullsized":"2023-09-13T08:24:46.771919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:01:15.582567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.534731+0000","last_change":"2023-09-13T08:24:46.795800+0000","last_active":"2023-09-13T08:24:48.534731+0000","last_peered":"2023-09-13T08:24:48.534731+0000","last_clean":"2023-09-13T08:24:48.534731+0000","last_became_active":"2023-09-13T08:24:46.794871+0000","last_became_peered":"2023-09-13T08:24:46.794871+0000","last_unstale":"2023-09-13T08:24:48.534731+0000","last_undegraded":"2023-09-13T08:24:48.534731+0000","last_fullsized":"2023-09-13T08:24:48.534731+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:35:08.086286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.774790+0000","last_change":"2023-09-13T08:24:41.749261+0000","last_active":"2023-09-13T08:24:46.774790+0000","last_peered":"2023-09-13T08:24:46.774790+0000","last_clean":"2023-09-13T08:24:46.774790+0000","last_became_active":"2023-09-13T08:24:41.748976+0000","last_became_peered":"2023-09-13T08:24:41.748976+0000","last_unstale":"2023-09-13T08:24:46.774790+0000","last_undegraded":"2023-09-13T08:24:46.774790+0000","last_fullsized":"2023-09-13T08:24:46.774790+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:04:12.070569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.778887+0000","last_change":"2023-09-13T08:24:42.756665+0000","last_active":"2023-09-13T08:24:46.778887+0000","last_peered":"2023-09-13T08:24:46.778887+0000","last_clean":"2023-09-13T08:24:46.778887+0000","last_became_active":"2023-09-13T08:24:42.756225+0000","last_became_peered":"2023-09-13T08:24:42.756225+0000","last_unstale":"2023-09-13T08:24:46.778887+0000","last_undegraded":"2023-09-13T08:24:46.778887+0000","last_fullsized":"2023-09-13T08:24:46.778887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:22:05.554377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.535610+0000","last_change":"2023-09-13T08:24:46.794973+0000","last_active":"2023-09-13T08:24:48.535610+0000","last_peered":"2023-09-13T08:24:48.535610+0000","last_clean":"2023-09-13T08:24:48.535610+0000","last_became_active":"2023-09-13T08:24:46.794625+0000","last_became_peered":"2023-09-13T08:24:46.794625+0000","last_unstale":"2023-09-13T08:24:48.535610+0000","last_undegraded":"2023-09-13T08:24:48.535610+0000","last_fullsized":"2023-09-13T08:24:48.535610+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:24:40.971505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.786879+0000","last_change":"2023-09-13T08:24:41.752295+0000","last_active":"2023-09-13T08:24:46.786879+0000","last_peered":"2023-09-13T08:24:46.786879+0000","last_clean":"2023-09-13T08:24:46.786879+0000","last_became_active":"2023-09-13T08:24:41.751730+0000","last_became_peered":"2023-09-13T08:24:41.751730+0000","last_unstale":"2023-09-13T08:24:46.786879+0000","last_undegraded":"2023-09-13T08:24:46.786879+0000","last_fullsized":"2023-09-13T08:24:46.786879+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:14:24.302634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.775290+0000","last_change":"2023-09-13T08:24:42.761292+0000","last_active":"2023-09-13T08:24:46.775290+0000","last_peered":"2023-09-13T08:24:46.775290+0000","last_clean":"2023-09-13T08:24:46.775290+0000","last_became_active":"2023-09-13T08:24:42.761004+0000","last_became_peered":"2023-09-13T08:24:42.761004+0000","last_unstale":"2023-09-13T08:24:46.775290+0000","last_undegraded":"2023-09-13T08:24:46.775290+0000","last_fullsized":"2023-09-13T08:24:46.775290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:32:01.643446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.535622+0000","last_change":"2023-09-13T08:24:46.799231+0000","last_active":"2023-09-13T08:24:48.535622+0000","last_peered":"2023-09-13T08:24:48.535622+0000","last_clean":"2023-09-13T08:24:48.535622+0000","last_became_active":"2023-09-13T08:24:46.798813+0000","last_became_peered":"2023-09-13T08:24:46.798813+0000","last_unstale":"2023-09-13T08:24:48.535622+0000","last_undegraded":"2023-09-13T08:24:48.535622+0000","last_fullsized":"2023-09-13T08:24:48.535622+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:14:40.142972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.775333+0000","last_change":"2023-09-13T08:24:41.757732+0000","last_active":"2023-09-13T08:24:46.775333+0000","last_peered":"2023-09-13T08:24:46.775333+0000","last_clean":"2023-09-13T08:24:46.775333+0000","last_became_active":"2023-09-13T08:24:41.757452+0000","last_became_peered":"2023-09-13T08:24:41.757452+0000","last_unstale":"2023-09-13T08:24:46.775333+0000","last_undegraded":"2023-09-13T08:24:46.775333+0000","last_fullsized":"2023-09-13T08:24:46.775333+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:12:03.105088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.779874+0000","last_change":"2023-09-13T08:24:42.764641+0000","last_active":"2023-09-13T08:24:46.779874+0000","last_peered":"2023-09-13T08:24:46.779874+0000","last_clean":"2023-09-13T08:24:46.779874+0000","last_became_active":"2023-09-13T08:24:42.764368+0000","last_became_peered":"2023-09-13T08:24:42.764368+0000","last_unstale":"2023-09-13T08:24:46.779874+0000","last_undegraded":"2023-09-13T08:24:46.779874+0000","last_fullsized":"2023-09-13T08:24:46.779874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:01:14.370463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.535743+0000","last_change":"2023-09-13T08:24:46.794114+0000","last_active":"2023-09-13T08:24:48.535743+0000","last_peered":"2023-09-13T08:24:48.535743+0000","last_clean":"2023-09-13T08:24:48.535743+0000","last_became_active":"2023-09-13T08:24:46.793129+0000","last_became_peered":"2023-09-13T08:24:46.793129+0000","last_unstale":"2023-09-13T08:24:48.535743+0000","last_undegraded":"2023-09-13T08:24:48.535743+0000","last_fullsized":"2023-09-13T08:24:48.535743+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:35:08.086286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.779227+0000","last_change":"2023-09-13T08:24:41.755450+0000","last_active":"2023-09-13T08:24:46.779227+0000","last_peered":"2023-09-13T08:24:46.779227+0000","last_clean":"2023-09-13T08:24:46.779227+0000","last_became_active":"2023-09-13T08:24:41.755168+0000","last_became_peered":"2023-09-13T08:24:41.755168+0000","last_unstale":"2023-09-13T08:24:46.779227+0000","last_undegraded":"2023-09-13T08:24:46.779227+0000","last_fullsized":"2023-09-13T08:24:46.779227+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:28:07.813946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.781645+0000","last_change":"2023-09-13T08:24:42.756700+0000","last_active":"2023-09-13T08:24:46.781645+0000","last_peered":"2023-09-13T08:24:46.781645+0000","last_clean":"2023-09-13T08:24:46.781645+0000","last_became_active":"2023-09-13T08:24:42.756408+0000","last_became_peered":"2023-09-13T08:24:42.756408+0000","last_unstale":"2023-09-13T08:24:46.781645+0000","last_undegraded":"2023-09-13T08:24:46.781645+0000","last_fullsized":"2023-09-13T08:24:46.781645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:28:08.821003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.535262+0000","last_change":"2023-09-13T08:24:46.793849+0000","last_active":"2023-09-13T08:24:48.535262+0000","last_peered":"2023-09-13T08:24:48.535262+0000","last_clean":"2023-09-13T08:24:48.535262+0000","last_became_active":"2023-09-13T08:24:46.793486+0000","last_became_peered":"2023-09-13T08:24:46.793486+0000","last_unstale":"2023-09-13T08:24:48.535262+0000","last_undegraded":"2023-09-13T08:24:48.535262+0000","last_fullsized":"2023-09-13T08:24:48.535262+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:49:40.361758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:52.674989+0000","last_change":"2023-09-13T08:24:41.755123+0000","last_active":"2023-09-13T08:24:52.674989+0000","last_peered":"2023-09-13T08:24:52.674989+0000","last_clean":"2023-09-13T08:24:52.674989+0000","last_became_active":"2023-09-13T08:24:41.754872+0000","last_became_peered":"2023-09-13T08:24:41.754872+0000","last_unstale":"2023-09-13T08:24:52.674989+0000","last_undegraded":"2023-09-13T08:24:52.674989+0000","last_fullsized":"2023-09-13T08:24:52.674989+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:28:07.813946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.774928+0000","last_change":"2023-09-13T08:24:42.756478+0000","last_active":"2023-09-13T08:24:46.774928+0000","last_peered":"2023-09-13T08:24:46.774928+0000","last_clean":"2023-09-13T08:24:46.774928+0000","last_became_active":"2023-09-13T08:24:42.755725+0000","last_became_peered":"2023-09-13T08:24:42.755725+0000","last_unstale":"2023-09-13T08:24:46.774928+0000","last_undegraded":"2023-09-13T08:24:46.774928+0000","last_fullsized":"2023-09-13T08:24:46.774928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:29:11.602118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:47.810994+0000","last_change":"2023-09-13T08:24:46.791174+0000","last_active":"2023-09-13T08:24:47.810994+0000","last_peered":"2023-09-13T08:24:47.810994+0000","last_clean":"2023-09-13T08:24:47.810994+0000","last_became_active":"2023-09-13T08:24:46.790577+0000","last_became_peered":"2023-09-13T08:24:46.790577+0000","last_unstale":"2023-09-13T08:24:47.810994+0000","last_undegraded":"2023-09-13T08:24:47.810994+0000","last_fullsized":"2023-09-13T08:24:47.810994+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:06:40.257204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.777835+0000","last_change":"2023-09-13T08:24:41.748341+0000","last_active":"2023-09-13T08:24:46.777835+0000","last_peered":"2023-09-13T08:24:46.777835+0000","last_clean":"2023-09-13T08:24:46.777835+0000","last_became_active":"2023-09-13T08:24:41.748090+0000","last_became_peered":"2023-09-13T08:24:41.748090+0000","last_unstale":"2023-09-13T08:24:46.777835+0000","last_undegraded":"2023-09-13T08:24:46.777835+0000","last_fullsized":"2023-09-13T08:24:46.777835+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:04:12.070569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.779335+0000","last_change":"2023-09-13T08:24:42.748471+0000","last_active":"2023-09-13T08:24:46.779335+0000","last_peered":"2023-09-13T08:24:46.779335+0000","last_clean":"2023-09-13T08:24:46.779335+0000","last_became_active":"2023-09-13T08:24:42.748243+0000","last_became_peered":"2023-09-13T08:24:42.748243+0000","last_unstale":"2023-09-13T08:24:46.779335+0000","last_undegraded":"2023-09-13T08:24:46.779335+0000","last_fullsized":"2023-09-13T08:24:46.779335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:14:25.309691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.537111+0000","last_change":"2023-09-13T08:24:46.795104+0000","last_active":"2023-09-13T08:24:48.537111+0000","last_peered":"2023-09-13T08:24:48.537111+0000","last_clean":"2023-09-13T08:24:48.537111+0000","last_became_active":"2023-09-13T08:24:46.794725+0000","last_became_peered":"2023-09-13T08:24:46.794725+0000","last_unstale":"2023-09-13T08:24:48.537111+0000","last_undegraded":"2023-09-13T08:24:48.537111+0000","last_fullsized":"2023-09-13T08:24:48.537111+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:55:26.579142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.774235+0000","last_change":"2023-09-13T08:24:41.756881+0000","last_active":"2023-09-13T08:24:46.774235+0000","last_peered":"2023-09-13T08:24:46.774235+0000","last_clean":"2023-09-13T08:24:46.774235+0000","last_became_active":"2023-09-13T08:24:41.756567+0000","last_became_peered":"2023-09-13T08:24:41.756567+0000","last_unstale":"2023-09-13T08:24:46.774235+0000","last_undegraded":"2023-09-13T08:24:46.774235+0000","last_fullsized":"2023-09-13T08:24:46.774235+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:14:24.302634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.774321+0000","last_change":"2023-09-13T08:24:42.764196+0000","last_active":"2023-09-13T08:24:46.774321+0000","last_peered":"2023-09-13T08:24:46.774321+0000","last_clean":"2023-09-13T08:24:46.774321+0000","last_became_active":"2023-09-13T08:24:42.760048+0000","last_became_peered":"2023-09-13T08:24:42.760048+0000","last_unstale":"2023-09-13T08:24:46.774321+0000","last_undegraded":"2023-09-13T08:24:46.774321+0000","last_fullsized":"2023-09-13T08:24:46.774321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:20:47.395388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.537009+0000","last_change":"2023-09-13T08:24:46.795864+0000","last_active":"2023-09-13T08:24:48.537009+0000","last_peered":"2023-09-13T08:24:48.537009+0000","last_clean":"2023-09-13T08:24:48.537009+0000","last_became_active":"2023-09-13T08:24:46.795486+0000","last_became_peered":"2023-09-13T08:24:46.795486+0000","last_unstale":"2023-09-13T08:24:48.537009+0000","last_undegraded":"2023-09-13T08:24:48.537009+0000","last_fullsized":"2023-09-13T08:24:48.537009+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:06:32.572669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.785872+0000","last_change":"2023-09-13T08:24:41.749723+0000","last_active":"2023-09-13T08:24:46.785872+0000","last_peered":"2023-09-13T08:24:46.785872+0000","last_clean":"2023-09-13T08:24:46.785872+0000","last_became_active":"2023-09-13T08:24:41.749372+0000","last_became_peered":"2023-09-13T08:24:41.749372+0000","last_unstale":"2023-09-13T08:24:46.785872+0000","last_undegraded":"2023-09-13T08:24:46.785872+0000","last_fullsized":"2023-09-13T08:24:46.785872+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:56:12.891967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.785750+0000","last_change":"2023-09-13T08:24:42.752492+0000","last_active":"2023-09-13T08:24:46.785750+0000","last_peered":"2023-09-13T08:24:46.785750+0000","last_clean":"2023-09-13T08:24:46.785750+0000","last_became_active":"2023-09-13T08:24:42.752171+0000","last_became_peered":"2023-09-13T08:24:42.752171+0000","last_unstale":"2023-09-13T08:24:46.785750+0000","last_undegraded":"2023-09-13T08:24:46.785750+0000","last_fullsized":"2023-09-13T08:24:46.785750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:38:57.000291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.534401+0000","last_change":"2023-09-13T08:24:46.796118+0000","last_active":"2023-09-13T08:24:48.534401+0000","last_peered":"2023-09-13T08:24:48.534401+0000","last_clean":"2023-09-13T08:24:48.534401+0000","last_became_active":"2023-09-13T08:24:46.795725+0000","last_became_peered":"2023-09-13T08:24:46.795725+0000","last_unstale":"2023-09-13T08:24:48.534401+0000","last_undegraded":"2023-09-13T08:24:48.534401+0000","last_fullsized":"2023-09-13T08:24:48.534401+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:19:00.119006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.778226+0000","last_change":"2023-09-13T08:24:41.749035+0000","last_active":"2023-09-13T08:24:46.778226+0000","last_peered":"2023-09-13T08:24:46.778226+0000","last_clean":"2023-09-13T08:24:46.778226+0000","last_became_active":"2023-09-13T08:24:41.748750+0000","last_became_peered":"2023-09-13T08:24:41.748750+0000","last_unstale":"2023-09-13T08:24:46.778226+0000","last_undegraded":"2023-09-13T08:24:46.778226+0000","last_fullsized":"2023-09-13T08:24:46.778226+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:10:08.445556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.775239+0000","last_change":"2023-09-13T08:24:42.756878+0000","last_active":"2023-09-13T08:24:46.775239+0000","last_peered":"2023-09-13T08:24:46.775239+0000","last_clean":"2023-09-13T08:24:46.775239+0000","last_became_active":"2023-09-13T08:24:42.756564+0000","last_became_peered":"2023-09-13T08:24:42.756564+0000","last_unstale":"2023-09-13T08:24:46.775239+0000","last_undegraded":"2023-09-13T08:24:46.775239+0000","last_fullsized":"2023-09-13T08:24:46.775239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:23:57.161158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.534913+0000","last_change":"2023-09-13T08:24:46.799955+0000","last_active":"2023-09-13T08:24:48.534913+0000","last_peered":"2023-09-13T08:24:48.534913+0000","last_clean":"2023-09-13T08:24:48.534913+0000","last_became_active":"2023-09-13T08:24:46.799140+0000","last_became_peered":"2023-09-13T08:24:46.799140+0000","last_unstale":"2023-09-13T08:24:48.534913+0000","last_undegraded":"2023-09-13T08:24:48.534913+0000","last_fullsized":"2023-09-13T08:24:48.534913+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T19:01:33.986931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.781644+0000","last_change":"2023-09-13T08:24:41.748494+0000","last_active":"2023-09-13T08:24:46.781644+0000","last_peered":"2023-09-13T08:24:46.781644+0000","last_clean":"2023-09-13T08:24:46.781644+0000","last_became_active":"2023-09-13T08:24:41.748204+0000","last_became_peered":"2023-09-13T08:24:41.748204+0000","last_unstale":"2023-09-13T08:24:46.781644+0000","last_undegraded":"2023-09-13T08:24:46.781644+0000","last_fullsized":"2023-09-13T08:24:46.781644+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:40:49.395433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.775174+0000","last_change":"2023-09-13T08:24:42.757274+0000","last_active":"2023-09-13T08:24:46.775174+0000","last_peered":"2023-09-13T08:24:46.775174+0000","last_clean":"2023-09-13T08:24:46.775174+0000","last_became_active":"2023-09-13T08:24:42.756521+0000","last_became_peered":"2023-09-13T08:24:42.756521+0000","last_unstale":"2023-09-13T08:24:46.775174+0000","last_undegraded":"2023-09-13T08:24:46.775174+0000","last_fullsized":"2023-09-13T08:24:46.775174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:41:08.160337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.535146+0000","last_change":"2023-09-13T08:24:46.792835+0000","last_active":"2023-09-13T08:24:48.535146+0000","last_peered":"2023-09-13T08:24:48.535146+0000","last_clean":"2023-09-13T08:24:48.535146+0000","last_became_active":"2023-09-13T08:24:46.792432+0000","last_became_peered":"2023-09-13T08:24:46.792432+0000","last_unstale":"2023-09-13T08:24:48.535146+0000","last_undegraded":"2023-09-13T08:24:48.535146+0000","last_fullsized":"2023-09-13T08:24:48.535146+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:19:00.119006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.779060+0000","last_change":"2023-09-13T08:24:41.747562+0000","last_active":"2023-09-13T08:24:46.779060+0000","last_peered":"2023-09-13T08:24:46.779060+0000","last_clean":"2023-09-13T08:24:46.779060+0000","last_became_active":"2023-09-13T08:24:41.747309+0000","last_became_peered":"2023-09-13T08:24:41.747309+0000","last_unstale":"2023-09-13T08:24:46.779060+0000","last_undegraded":"2023-09-13T08:24:46.779060+0000","last_fullsized":"2023-09-13T08:24:46.779060+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:16:33.150745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.776806+0000","last_change":"2023-09-13T08:24:42.771356+0000","last_active":"2023-09-13T08:24:46.776806+0000","last_peered":"2023-09-13T08:24:46.776806+0000","last_clean":"2023-09-13T08:24:46.776806+0000","last_became_active":"2023-09-13T08:24:42.768326+0000","last_became_peered":"2023-09-13T08:24:42.768326+0000","last_unstale":"2023-09-13T08:24:46.776806+0000","last_undegraded":"2023-09-13T08:24:46.776806+0000","last_fullsized":"2023-09-13T08:24:46.776806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T19:01:29.959464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.535284+0000","last_change":"2023-09-13T08:24:46.794707+0000","last_active":"2023-09-13T08:24:48.535284+0000","last_peered":"2023-09-13T08:24:48.535284+0000","last_clean":"2023-09-13T08:24:48.535284+0000","last_became_active":"2023-09-13T08:24:46.794482+0000","last_became_peered":"2023-09-13T08:24:46.794482+0000","last_unstale":"2023-09-13T08:24:48.535284+0000","last_undegraded":"2023-09-13T08:24:48.535284+0000","last_fullsized":"2023-09-13T08:24:48.535284+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:44:45.516475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.774129+0000","last_change":"2023-09-13T08:24:41.754944+0000","last_active":"2023-09-13T08:24:46.774129+0000","last_peered":"2023-09-13T08:24:46.774129+0000","last_clean":"2023-09-13T08:24:46.774129+0000","last_became_active":"2023-09-13T08:24:41.754643+0000","last_became_peered":"2023-09-13T08:24:41.754643+0000","last_unstale":"2023-09-13T08:24:46.774129+0000","last_undegraded":"2023-09-13T08:24:46.774129+0000","last_fullsized":"2023-09-13T08:24:46.774129+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:16:33.150745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.781175+0000","last_change":"2023-09-13T08:24:42.746767+0000","last_active":"2023-09-13T08:24:46.781175+0000","last_peered":"2023-09-13T08:24:46.781175+0000","last_clean":"2023-09-13T08:24:46.781175+0000","last_became_active":"2023-09-13T08:24:42.746431+0000","last_became_peered":"2023-09-13T08:24:42.746431+0000","last_unstale":"2023-09-13T08:24:46.781175+0000","last_undegraded":"2023-09-13T08:24:46.781175+0000","last_fullsized":"2023-09-13T08:24:46.781175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:14:25.309691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.536899+0000","last_change":"2023-09-13T08:24:46.791183+0000","last_active":"2023-09-13T08:24:48.536899+0000","last_peered":"2023-09-13T08:24:48.536899+0000","last_clean":"2023-09-13T08:24:48.536899+0000","last_became_active":"2023-09-13T08:24:46.790665+0000","last_became_peered":"2023-09-13T08:24:46.790665+0000","last_unstale":"2023-09-13T08:24:48.536899+0000","last_undegraded":"2023-09-13T08:24:48.536899+0000","last_fullsized":"2023-09-13T08:24:48.536899+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:35:08.793411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.779259+0000","last_change":"2023-09-13T08:24:42.763692+0000","last_active":"2023-09-13T08:24:46.779259+0000","last_peered":"2023-09-13T08:24:46.779259+0000","last_clean":"2023-09-13T08:24:46.779259+0000","last_became_active":"2023-09-13T08:24:42.763348+0000","last_became_peered":"2023-09-13T08:24:42.763348+0000","last_unstale":"2023-09-13T08:24:46.779259+0000","last_undegraded":"2023-09-13T08:24:46.779259+0000","last_fullsized":"2023-09-13T08:24:46.779259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:01:15.582567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.778942+0000","last_change":"2023-09-13T08:24:41.750528+0000","last_active":"2023-09-13T08:24:46.778942+0000","last_peered":"2023-09-13T08:24:46.778942+0000","last_clean":"2023-09-13T08:24:46.778942+0000","last_became_active":"2023-09-13T08:24:41.750238+0000","last_became_peered":"2023-09-13T08:24:41.750238+0000","last_unstale":"2023-09-13T08:24:46.778942+0000","last_undegraded":"2023-09-13T08:24:46.778942+0000","last_fullsized":"2023-09-13T08:24:46.778942+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:40:49.395433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:47.775614+0000","last_change":"2023-09-13T08:24:46.798991+0000","last_active":"2023-09-13T08:24:47.775614+0000","last_peered":"2023-09-13T08:24:47.775614+0000","last_clean":"2023-09-13T08:24:47.775614+0000","last_became_active":"2023-09-13T08:24:46.798610+0000","last_became_peered":"2023-09-13T08:24:46.798610+0000","last_unstale":"2023-09-13T08:24:47.775614+0000","last_undegraded":"2023-09-13T08:24:47.775614+0000","last_fullsized":"2023-09-13T08:24:47.775614+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T19:57:23.132436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.772327+0000","last_change":"2023-09-13T08:24:42.768328+0000","last_active":"2023-09-13T08:24:46.772327+0000","last_peered":"2023-09-13T08:24:46.772327+0000","last_clean":"2023-09-13T08:24:46.772327+0000","last_became_active":"2023-09-13T08:24:42.768076+0000","last_became_peered":"2023-09-13T08:24:42.768076+0000","last_unstale":"2023-09-13T08:24:46.772327+0000","last_undegraded":"2023-09-13T08:24:46.772327+0000","last_fullsized":"2023-09-13T08:24:46.772327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:38:57.000291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.775019+0000","last_change":"2023-09-13T08:24:41.756796+0000","last_active":"2023-09-13T08:24:46.775019+0000","last_peered":"2023-09-13T08:24:46.775019+0000","last_clean":"2023-09-13T08:24:46.775019+0000","last_became_active":"2023-09-13T08:24:41.756485+0000","last_became_peered":"2023-09-13T08:24:41.756485+0000","last_unstale":"2023-09-13T08:24:46.775019+0000","last_undegraded":"2023-09-13T08:24:46.775019+0000","last_fullsized":"2023-09-13T08:24:46.775019+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:20:29.866513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":169,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.775432+0000","last_change":"2023-09-13T08:24:30.608284+0000","last_active":"2023-09-13T08:24:46.775432+0000","last_peered":"2023-09-13T08:24:46.775432+0000","last_clean":"2023-09-13T08:24:46.775432+0000","last_became_active":"2023-09-13T08:24:30.607240+0000","last_became_peered":"2023-09-13T08:24:30.607240+0000","last_unstale":"2023-09-13T08:24:46.775432+0000","last_undegraded":"2023-09-13T08:24:46.775432+0000","last_fullsized":"2023-09-13T08:24:46.775432+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:29.424755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:29.424755+0000","last_clean_scrub_stamp":"2023-09-13T08:24:29.424755+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:57:43.427279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.534536+0000","last_change":"2023-09-13T08:24:46.796073+0000","last_active":"2023-09-13T08:24:48.534536+0000","last_peered":"2023-09-13T08:24:48.534536+0000","last_clean":"2023-09-13T08:24:48.534536+0000","last_became_active":"2023-09-13T08:24:46.795401+0000","last_became_peered":"2023-09-13T08:24:46.795401+0000","last_unstale":"2023-09-13T08:24:48.534536+0000","last_undegraded":"2023-09-13T08:24:48.534536+0000","last_fullsized":"2023-09-13T08:24:48.534536+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:49:40.361758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.778869+0000","last_change":"2023-09-13T08:24:42.742114+0000","last_active":"2023-09-13T08:24:46.778869+0000","last_peered":"2023-09-13T08:24:46.778869+0000","last_clean":"2023-09-13T08:24:46.778869+0000","last_became_active":"2023-09-13T08:24:42.741800+0000","last_became_peered":"2023-09-13T08:24:42.741800+0000","last_unstale":"2023-09-13T08:24:46.778869+0000","last_undegraded":"2023-09-13T08:24:46.778869+0000","last_fullsized":"2023-09-13T08:24:46.778869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:52:00.242806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.774235+0000","last_change":"2023-09-13T08:24:41.749496+0000","last_active":"2023-09-13T08:24:46.774235+0000","last_peered":"2023-09-13T08:24:46.774235+0000","last_clean":"2023-09-13T08:24:46.774235+0000","last_became_active":"2023-09-13T08:24:41.749111+0000","last_became_peered":"2023-09-13T08:24:41.749111+0000","last_unstale":"2023-09-13T08:24:46.774235+0000","last_undegraded":"2023-09-13T08:24:46.774235+0000","last_fullsized":"2023-09-13T08:24:46.774235+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:12:03.105088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.534661+0000","last_change":"2023-09-13T08:24:46.794473+0000","last_active":"2023-09-13T08:24:48.534661+0000","last_peered":"2023-09-13T08:24:48.534661+0000","last_clean":"2023-09-13T08:24:48.534661+0000","last_became_active":"2023-09-13T08:24:46.794060+0000","last_became_peered":"2023-09-13T08:24:46.794060+0000","last_unstale":"2023-09-13T08:24:48.534661+0000","last_undegraded":"2023-09-13T08:24:48.534661+0000","last_fullsized":"2023-09-13T08:24:48.534661+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:35:08.793411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.774664+0000","last_change":"2023-09-13T08:24:41.762626+0000","last_active":"2023-09-13T08:24:46.774664+0000","last_peered":"2023-09-13T08:24:46.774664+0000","last_clean":"2023-09-13T08:24:46.774664+0000","last_became_active":"2023-09-13T08:24:41.762370+0000","last_became_peered":"2023-09-13T08:24:41.762370+0000","last_unstale":"2023-09-13T08:24:46.774664+0000","last_undegraded":"2023-09-13T08:24:46.774664+0000","last_fullsized":"2023-09-13T08:24:46.774664+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:47:38.305158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.779166+0000","last_change":"2023-09-13T08:24:42.756318+0000","last_active":"2023-09-13T08:24:46.779166+0000","last_peered":"2023-09-13T08:24:46.779166+0000","last_clean":"2023-09-13T08:24:46.779166+0000","last_became_active":"2023-09-13T08:24:42.755533+0000","last_became_peered":"2023-09-13T08:24:42.755533+0000","last_unstale":"2023-09-13T08:24:46.779166+0000","last_undegraded":"2023-09-13T08:24:46.779166+0000","last_fullsized":"2023-09-13T08:24:46.779166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:38:57.000291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.535633+0000","last_change":"2023-09-13T08:24:46.792676+0000","last_active":"2023-09-13T08:24:48.535633+0000","last_peered":"2023-09-13T08:24:48.535633+0000","last_clean":"2023-09-13T08:24:48.535633+0000","last_became_active":"2023-09-13T08:24:46.792303+0000","last_became_peered":"2023-09-13T08:24:46.792303+0000","last_unstale":"2023-09-13T08:24:48.535633+0000","last_undegraded":"2023-09-13T08:24:48.535633+0000","last_fullsized":"2023-09-13T08:24:48.535633+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:06:40.257204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.778749+0000","last_change":"2023-09-13T08:24:41.755753+0000","last_active":"2023-09-13T08:24:46.778749+0000","last_peered":"2023-09-13T08:24:46.778749+0000","last_clean":"2023-09-13T08:24:46.778749+0000","last_became_active":"2023-09-13T08:24:41.755494+0000","last_became_peered":"2023-09-13T08:24:41.755494+0000","last_unstale":"2023-09-13T08:24:46.778749+0000","last_undegraded":"2023-09-13T08:24:46.778749+0000","last_fullsized":"2023-09-13T08:24:46.778749+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:14:24.302634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.772761+0000","last_change":"2023-09-13T08:24:42.766497+0000","last_active":"2023-09-13T08:24:46.772761+0000","last_peered":"2023-09-13T08:24:46.772761+0000","last_clean":"2023-09-13T08:24:46.772761+0000","last_became_active":"2023-09-13T08:24:42.766157+0000","last_became_peered":"2023-09-13T08:24:42.766157+0000","last_unstale":"2023-09-13T08:24:46.772761+0000","last_undegraded":"2023-09-13T08:24:46.772761+0000","last_fullsized":"2023-09-13T08:24:46.772761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:31:23.082234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.535011+0000","last_change":"2023-09-13T08:24:46.794008+0000","last_active":"2023-09-13T08:24:48.535011+0000","last_peered":"2023-09-13T08:24:48.535011+0000","last_clean":"2023-09-13T08:24:48.535011+0000","last_became_active":"2023-09-13T08:24:46.792056+0000","last_became_peered":"2023-09-13T08:24:46.792056+0000","last_unstale":"2023-09-13T08:24:48.535011+0000","last_undegraded":"2023-09-13T08:24:48.535011+0000","last_fullsized":"2023-09-13T08:24:48.535011+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:32:05.670913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.786789+0000","last_change":"2023-09-13T08:24:41.752446+0000","last_active":"2023-09-13T08:24:46.786789+0000","last_peered":"2023-09-13T08:24:46.786789+0000","last_clean":"2023-09-13T08:24:46.786789+0000","last_became_active":"2023-09-13T08:24:41.752048+0000","last_became_peered":"2023-09-13T08:24:41.752048+0000","last_unstale":"2023-09-13T08:24:46.786789+0000","last_undegraded":"2023-09-13T08:24:46.786789+0000","last_fullsized":"2023-09-13T08:24:46.786789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:16:33.150745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.777913+0000","last_change":"2023-09-13T08:24:42.761656+0000","last_active":"2023-09-13T08:24:46.777913+0000","last_peered":"2023-09-13T08:24:46.777913+0000","last_clean":"2023-09-13T08:24:46.777913+0000","last_became_active":"2023-09-13T08:24:42.761413+0000","last_became_peered":"2023-09-13T08:24:42.761413+0000","last_unstale":"2023-09-13T08:24:46.777913+0000","last_undegraded":"2023-09-13T08:24:46.777913+0000","last_fullsized":"2023-09-13T08:24:46.777913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:38:57.000291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.535562+0000","last_change":"2023-09-13T08:24:46.799414+0000","last_active":"2023-09-13T08:24:48.535562+0000","last_peered":"2023-09-13T08:24:48.535562+0000","last_clean":"2023-09-13T08:24:48.535562+0000","last_became_active":"2023-09-13T08:24:46.796678+0000","last_became_peered":"2023-09-13T08:24:46.796678+0000","last_unstale":"2023-09-13T08:24:48.535562+0000","last_undegraded":"2023-09-13T08:24:48.535562+0000","last_fullsized":"2023-09-13T08:24:48.535562+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:44:45.516475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.773672+0000","last_change":"2023-09-13T08:24:41.762705+0000","last_active":"2023-09-13T08:24:46.773672+0000","last_peered":"2023-09-13T08:24:46.773672+0000","last_clean":"2023-09-13T08:24:46.773672+0000","last_became_active":"2023-09-13T08:24:41.762433+0000","last_became_peered":"2023-09-13T08:24:41.762433+0000","last_unstale":"2023-09-13T08:24:46.773672+0000","last_undegraded":"2023-09-13T08:24:46.773672+0000","last_fullsized":"2023-09-13T08:24:46.773672+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:33:08.894982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.780733+0000","last_change":"2023-09-13T08:24:42.756676+0000","last_active":"2023-09-13T08:24:46.780733+0000","last_peered":"2023-09-13T08:24:46.780733+0000","last_clean":"2023-09-13T08:24:46.780733+0000","last_became_active":"2023-09-13T08:24:42.756186+0000","last_became_peered":"2023-09-13T08:24:42.756186+0000","last_unstale":"2023-09-13T08:24:46.780733+0000","last_undegraded":"2023-09-13T08:24:46.780733+0000","last_fullsized":"2023-09-13T08:24:46.780733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:56:13.899024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.537160+0000","last_change":"2023-09-13T08:24:46.792798+0000","last_active":"2023-09-13T08:24:48.537160+0000","last_peered":"2023-09-13T08:24:48.537160+0000","last_clean":"2023-09-13T08:24:48.537160+0000","last_became_active":"2023-09-13T08:24:46.792514+0000","last_became_peered":"2023-09-13T08:24:46.792514+0000","last_unstale":"2023-09-13T08:24:48.537160+0000","last_undegraded":"2023-09-13T08:24:48.537160+0000","last_fullsized":"2023-09-13T08:24:48.537160+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:35:08.086286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.778802+0000","last_change":"2023-09-13T08:24:41.748432+0000","last_active":"2023-09-13T08:24:46.778802+0000","last_peered":"2023-09-13T08:24:46.778802+0000","last_clean":"2023-09-13T08:24:46.778802+0000","last_became_active":"2023-09-13T08:24:41.747775+0000","last_became_peered":"2023-09-13T08:24:41.747775+0000","last_unstale":"2023-09-13T08:24:46.778802+0000","last_undegraded":"2023-09-13T08:24:46.778802+0000","last_fullsized":"2023-09-13T08:24:46.778802+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:04:12.070569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.772017+0000","last_change":"2023-09-13T08:24:42.764490+0000","last_active":"2023-09-13T08:24:46.772017+0000","last_peered":"2023-09-13T08:24:46.772017+0000","last_clean":"2023-09-13T08:24:46.772017+0000","last_became_active":"2023-09-13T08:24:42.764250+0000","last_became_peered":"2023-09-13T08:24:42.764250+0000","last_unstale":"2023-09-13T08:24:46.772017+0000","last_undegraded":"2023-09-13T08:24:46.772017+0000","last_fullsized":"2023-09-13T08:24:46.772017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:47:39.312215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.535444+0000","last_change":"2023-09-13T08:24:46.798308+0000","last_active":"2023-09-13T08:24:48.535444+0000","last_peered":"2023-09-13T08:24:48.535444+0000","last_clean":"2023-09-13T08:24:48.535444+0000","last_became_active":"2023-09-13T08:24:46.797901+0000","last_became_peered":"2023-09-13T08:24:46.797901+0000","last_unstale":"2023-09-13T08:24:48.535444+0000","last_undegraded":"2023-09-13T08:24:48.535444+0000","last_fullsized":"2023-09-13T08:24:48.535444+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:49:40.361758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.778922+0000","last_change":"2023-09-13T08:24:41.752252+0000","last_active":"2023-09-13T08:24:46.778922+0000","last_peered":"2023-09-13T08:24:46.778922+0000","last_clean":"2023-09-13T08:24:46.778922+0000","last_became_active":"2023-09-13T08:24:41.751926+0000","last_became_peered":"2023-09-13T08:24:41.751926+0000","last_unstale":"2023-09-13T08:24:46.778922+0000","last_undegraded":"2023-09-13T08:24:46.778922+0000","last_fullsized":"2023-09-13T08:24:46.778922+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:51:59.235749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.772536+0000","last_change":"2023-09-13T08:24:42.753686+0000","last_active":"2023-09-13T08:24:46.772536+0000","last_peered":"2023-09-13T08:24:46.772536+0000","last_clean":"2023-09-13T08:24:46.772536+0000","last_became_active":"2023-09-13T08:24:42.753298+0000","last_became_peered":"2023-09-13T08:24:42.753298+0000","last_unstale":"2023-09-13T08:24:46.772536+0000","last_undegraded":"2023-09-13T08:24:46.772536+0000","last_fullsized":"2023-09-13T08:24:46.772536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:23:57.161158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.535678+0000","last_change":"2023-09-13T08:24:46.791776+0000","last_active":"2023-09-13T08:24:48.535678+0000","last_peered":"2023-09-13T08:24:48.535678+0000","last_clean":"2023-09-13T08:24:48.535678+0000","last_became_active":"2023-09-13T08:24:46.791304+0000","last_became_peered":"2023-09-13T08:24:46.791304+0000","last_unstale":"2023-09-13T08:24:48.535678+0000","last_undegraded":"2023-09-13T08:24:48.535678+0000","last_fullsized":"2023-09-13T08:24:48.535678+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:35:08.793411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.773971+0000","last_change":"2023-09-13T08:24:41.748551+0000","last_active":"2023-09-13T08:24:46.773971+0000","last_peered":"2023-09-13T08:24:46.773971+0000","last_clean":"2023-09-13T08:24:46.773971+0000","last_became_active":"2023-09-13T08:24:41.748281+0000","last_became_peered":"2023-09-13T08:24:41.748281+0000","last_unstale":"2023-09-13T08:24:46.773971+0000","last_undegraded":"2023-09-13T08:24:46.773971+0000","last_fullsized":"2023-09-13T08:24:46.773971+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:07:52.055769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.785938+0000","last_change":"2023-09-13T08:24:42.755845+0000","last_active":"2023-09-13T08:24:46.785938+0000","last_peered":"2023-09-13T08:24:46.785938+0000","last_clean":"2023-09-13T08:24:46.785938+0000","last_became_active":"2023-09-13T08:24:42.755374+0000","last_became_peered":"2023-09-13T08:24:42.755374+0000","last_unstale":"2023-09-13T08:24:46.785938+0000","last_undegraded":"2023-09-13T08:24:46.785938+0000","last_fullsized":"2023-09-13T08:24:46.785938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:22:05.554377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:47.776274+0000","last_change":"2023-09-13T08:24:46.799284+0000","last_active":"2023-09-13T08:24:47.776274+0000","last_peered":"2023-09-13T08:24:47.776274+0000","last_clean":"2023-09-13T08:24:47.776274+0000","last_became_active":"2023-09-13T08:24:46.798883+0000","last_became_peered":"2023-09-13T08:24:46.798883+0000","last_unstale":"2023-09-13T08:24:47.776274+0000","last_undegraded":"2023-09-13T08:24:47.776274+0000","last_fullsized":"2023-09-13T08:24:47.776274+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:49:40.361758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.781243+0000","last_change":"2023-09-13T08:24:41.752612+0000","last_active":"2023-09-13T08:24:46.781243+0000","last_peered":"2023-09-13T08:24:46.781243+0000","last_clean":"2023-09-13T08:24:46.781243+0000","last_became_active":"2023-09-13T08:24:41.752348+0000","last_became_peered":"2023-09-13T08:24:41.752348+0000","last_unstale":"2023-09-13T08:24:46.781243+0000","last_undegraded":"2023-09-13T08:24:46.781243+0000","last_fullsized":"2023-09-13T08:24:46.781243+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:04:36.176078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.774859+0000","last_change":"2023-09-13T08:24:42.767304+0000","last_active":"2023-09-13T08:24:46.774859+0000","last_peered":"2023-09-13T08:24:46.774859+0000","last_clean":"2023-09-13T08:24:46.774859+0000","last_became_active":"2023-09-13T08:24:42.767041+0000","last_became_peered":"2023-09-13T08:24:42.767041+0000","last_unstale":"2023-09-13T08:24:46.774859+0000","last_undegraded":"2023-09-13T08:24:46.774859+0000","last_fullsized":"2023-09-13T08:24:46.774859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:03:06.113162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:48.534554+0000","last_change":"2023-09-13T08:24:46.791835+0000","last_active":"2023-09-13T08:24:48.534554+0000","last_peered":"2023-09-13T08:24:48.534554+0000","last_clean":"2023-09-13T08:24:48.534554+0000","last_became_active":"2023-09-13T08:24:46.791288+0000","last_became_peered":"2023-09-13T08:24:46.791288+0000","last_unstale":"2023-09-13T08:24:48.534554+0000","last_undegraded":"2023-09-13T08:24:48.534554+0000","last_fullsized":"2023-09-13T08:24:48.534554+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:44:45.516475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.779134+0000","last_change":"2023-09-13T08:24:41.747559+0000","last_active":"2023-09-13T08:24:46.779134+0000","last_peered":"2023-09-13T08:24:46.779134+0000","last_clean":"2023-09-13T08:24:46.779134+0000","last_became_active":"2023-09-13T08:24:41.747102+0000","last_became_peered":"2023-09-13T08:24:41.747102+0000","last_unstale":"2023-09-13T08:24:46.779134+0000","last_undegraded":"2023-09-13T08:24:46.779134+0000","last_fullsized":"2023-09-13T08:24:46.779134+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:56:12.891967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.776345+0000","last_change":"2023-09-13T08:24:42.770958+0000","last_active":"2023-09-13T08:24:46.776345+0000","last_peered":"2023-09-13T08:24:46.776345+0000","last_clean":"2023-09-13T08:24:46.776345+0000","last_became_active":"2023-09-13T08:24:42.769963+0000","last_became_peered":"2023-09-13T08:24:42.769963+0000","last_unstale":"2023-09-13T08:24:46.776345+0000","last_undegraded":"2023-09-13T08:24:46.776345+0000","last_fullsized":"2023-09-13T08:24:46.776345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:30:17.103018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-13T08:24:47.810704+0000","last_change":"2023-09-13T08:24:46.792537+0000","last_active":"2023-09-13T08:24:47.810704+0000","last_peered":"2023-09-13T08:24:47.810704+0000","last_clean":"2023-09-13T08:24:47.810704+0000","last_became_active":"2023-09-13T08:24:46.791931+0000","last_became_peered":"2023-09-13T08:24:46.791931+0000","last_unstale":"2023-09-13T08:24:47.810704+0000","last_undegraded":"2023-09-13T08:24:47.810704+0000","last_fullsized":"2023-09-13T08:24:47.810704+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:45.755553+0000","last_clean_scrub_stamp":"2023-09-13T08:24:45.755553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:14:40.142972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.783932+0000","last_change":"2023-09-13T08:24:41.750664+0000","last_active":"2023-09-13T08:24:46.783932+0000","last_peered":"2023-09-13T08:24:46.783932+0000","last_clean":"2023-09-13T08:24:46.783932+0000","last_became_active":"2023-09-13T08:24:41.750331+0000","last_became_peered":"2023-09-13T08:24:41.750331+0000","last_unstale":"2023-09-13T08:24:46.783932+0000","last_undegraded":"2023-09-13T08:24:46.783932+0000","last_fullsized":"2023-09-13T08:24:46.783932+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:40.721028+0000","last_clean_scrub_stamp":"2023-09-13T08:24:40.721028+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:04:12.070569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.774929+0000","last_change":"2023-09-13T08:24:42.765570+0000","last_active":"2023-09-13T08:24:46.774929+0000","last_peered":"2023-09-13T08:24:46.774929+0000","last_clean":"2023-09-13T08:24:46.774929+0000","last_became_active":"2023-09-13T08:24:42.765232+0000","last_became_peered":"2023-09-13T08:24:42.765232+0000","last_unstale":"2023-09-13T08:24:46.774929+0000","last_undegraded":"2023-09-13T08:24:46.774929+0000","last_fullsized":"2023-09-13T08:24:46.774929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:32:01.643446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.785784+0000","last_change":"2023-09-13T08:24:42.759999+0000","last_active":"2023-09-13T08:24:46.785784+0000","last_peered":"2023-09-13T08:24:46.785784+0000","last_clean":"2023-09-13T08:24:46.785784+0000","last_became_active":"2023-09-13T08:24:42.759710+0000","last_became_peered":"2023-09-13T08:24:42.759710+0000","last_unstale":"2023-09-13T08:24:46.785784+0000","last_undegraded":"2023-09-13T08:24:46.785784+0000","last_fullsized":"2023-09-13T08:24:46.785784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:07:53.062826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.779042+0000","last_change":"2023-09-13T08:24:42.763001+0000","last_active":"2023-09-13T08:24:46.779042+0000","last_peered":"2023-09-13T08:24:46.779042+0000","last_clean":"2023-09-13T08:24:46.779042+0000","last_became_active":"2023-09-13T08:24:42.762686+0000","last_became_peered":"2023-09-13T08:24:42.762686+0000","last_unstale":"2023-09-13T08:24:46.779042+0000","last_undegraded":"2023-09-13T08:24:46.779042+0000","last_fullsized":"2023-09-13T08:24:46.779042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:28:08.821003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.774332+0000","last_change":"2023-09-13T08:24:42.762039+0000","last_active":"2023-09-13T08:24:46.774332+0000","last_peered":"2023-09-13T08:24:46.774332+0000","last_clean":"2023-09-13T08:24:46.774332+0000","last_became_active":"2023-09-13T08:24:42.761685+0000","last_became_peered":"2023-09-13T08:24:42.761685+0000","last_unstale":"2023-09-13T08:24:46.774332+0000","last_undegraded":"2023-09-13T08:24:46.774332+0000","last_fullsized":"2023-09-13T08:24:46.774332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:03:06.113162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.777670+0000","last_change":"2023-09-13T08:24:42.751302+0000","last_active":"2023-09-13T08:24:46.777670+0000","last_peered":"2023-09-13T08:24:46.777670+0000","last_clean":"2023-09-13T08:24:46.777670+0000","last_became_active":"2023-09-13T08:24:42.751016+0000","last_became_peered":"2023-09-13T08:24:42.751016+0000","last_unstale":"2023-09-13T08:24:46.777670+0000","last_undegraded":"2023-09-13T08:24:46.777670+0000","last_fullsized":"2023-09-13T08:24:46.777670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:07:53.062826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.772384+0000","last_change":"2023-09-13T08:24:42.752520+0000","last_active":"2023-09-13T08:24:46.772384+0000","last_peered":"2023-09-13T08:24:46.772384+0000","last_clean":"2023-09-13T08:24:46.772384+0000","last_became_active":"2023-09-13T08:24:42.752216+0000","last_became_peered":"2023-09-13T08:24:42.752216+0000","last_unstale":"2023-09-13T08:24:46.772384+0000","last_undegraded":"2023-09-13T08:24:46.772384+0000","last_fullsized":"2023-09-13T08:24:46.772384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:30:17.103018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.779033+0000","last_change":"2023-09-13T08:24:42.758492+0000","last_active":"2023-09-13T08:24:46.779033+0000","last_peered":"2023-09-13T08:24:46.779033+0000","last_clean":"2023-09-13T08:24:46.779033+0000","last_became_active":"2023-09-13T08:24:42.758226+0000","last_became_peered":"2023-09-13T08:24:42.758226+0000","last_unstale":"2023-09-13T08:24:46.779033+0000","last_undegraded":"2023-09-13T08:24:46.779033+0000","last_fullsized":"2023-09-13T08:24:46.779033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:31:23.082234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.786631+0000","last_change":"2023-09-13T08:24:42.765380+0000","last_active":"2023-09-13T08:24:46.786631+0000","last_peered":"2023-09-13T08:24:46.786631+0000","last_clean":"2023-09-13T08:24:46.786631+0000","last_became_active":"2023-09-13T08:24:42.764743+0000","last_became_peered":"2023-09-13T08:24:42.764743+0000","last_unstale":"2023-09-13T08:24:46.786631+0000","last_undegraded":"2023-09-13T08:24:46.786631+0000","last_fullsized":"2023-09-13T08:24:46.786631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:23:57.161158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.772975+0000","last_change":"2023-09-13T08:24:42.752773+0000","last_active":"2023-09-13T08:24:46.772975+0000","last_peered":"2023-09-13T08:24:46.772975+0000","last_clean":"2023-09-13T08:24:46.772975+0000","last_became_active":"2023-09-13T08:24:42.752417+0000","last_became_peered":"2023-09-13T08:24:42.752417+0000","last_unstale":"2023-09-13T08:24:46.772975+0000","last_undegraded":"2023-09-13T08:24:46.772975+0000","last_fullsized":"2023-09-13T08:24:46.772975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:01:14.370463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.774852+0000","last_change":"2023-09-13T08:24:42.761893+0000","last_active":"2023-09-13T08:24:46.774852+0000","last_peered":"2023-09-13T08:24:46.774852+0000","last_clean":"2023-09-13T08:24:46.774852+0000","last_became_active":"2023-09-13T08:24:42.761302+0000","last_became_peered":"2023-09-13T08:24:42.761302+0000","last_unstale":"2023-09-13T08:24:46.774852+0000","last_undegraded":"2023-09-13T08:24:46.774852+0000","last_fullsized":"2023-09-13T08:24:46.774852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:20:47.395388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.772142+0000","last_change":"2023-09-13T08:24:42.752632+0000","last_active":"2023-09-13T08:24:46.772142+0000","last_peered":"2023-09-13T08:24:46.772142+0000","last_clean":"2023-09-13T08:24:46.772142+0000","last_became_active":"2023-09-13T08:24:42.752332+0000","last_became_peered":"2023-09-13T08:24:42.752332+0000","last_unstale":"2023-09-13T08:24:46.772142+0000","last_undegraded":"2023-09-13T08:24:46.772142+0000","last_fullsized":"2023-09-13T08:24:46.772142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:07:53.062826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.774683+0000","last_change":"2023-09-13T08:24:42.764523+0000","last_active":"2023-09-13T08:24:46.774683+0000","last_peered":"2023-09-13T08:24:46.774683+0000","last_clean":"2023-09-13T08:24:46.774683+0000","last_became_active":"2023-09-13T08:24:42.764276+0000","last_became_peered":"2023-09-13T08:24:42.764276+0000","last_unstale":"2023-09-13T08:24:46.774683+0000","last_undegraded":"2023-09-13T08:24:46.774683+0000","last_fullsized":"2023-09-13T08:24:46.774683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:23:57.161158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.777757+0000","last_change":"2023-09-13T08:24:42.750926+0000","last_active":"2023-09-13T08:24:46.777757+0000","last_peered":"2023-09-13T08:24:46.777757+0000","last_clean":"2023-09-13T08:24:46.777757+0000","last_became_active":"2023-09-13T08:24:42.750569+0000","last_became_peered":"2023-09-13T08:24:42.750569+0000","last_unstale":"2023-09-13T08:24:46.777757+0000","last_undegraded":"2023-09-13T08:24:46.777757+0000","last_fullsized":"2023-09-13T08:24:46.777757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:31:23.082234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-13T08:24:46.786084+0000","last_change":"2023-09-13T08:24:42.752653+0000","last_active":"2023-09-13T08:24:46.786084+0000","last_peered":"2023-09-13T08:24:46.786084+0000","last_clean":"2023-09-13T08:24:46.786084+0000","last_became_active":"2023-09-13T08:24:42.752390+0000","last_became_peered":"2023-09-13T08:24:42.752390+0000","last_unstale":"2023-09-13T08:24:46.786084+0000","last_undegraded":"2023-09-13T08:24:46.786084+0000","last_fullsized":"2023-09-13T08:24:46.786084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:41.728086+0000","last_clean_scrub_stamp":"2023-09-13T08:24:41.728086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:31:23.082234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":851968,"data_stored":690730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574861,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":99940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574860,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":860160,"data_stored":690786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574860,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":253952,"data_stored":99780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.249}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]}]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.0359999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":25.963999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":15.307}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":10.952}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":15.243}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":10.994999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.1150000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":99906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]}]},{"osd":5,"up_from":13,"seq":55834574861,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":99870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-13T08:25:12.041 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-09-13T08:25:12.182 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-09-13T08:25:12.183 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-09-13T08:25:12.183 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-13T08:25:12.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.302+0000 7fe899a7f700 1 Processor -- start 2023-09-13T08:25:12.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.302+0000 7fe899a7f700 1 -- start start 2023-09-13T08:25:12.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.303+0000 7fe899a7f700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe89415d530 0x7fe894161bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:12.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.303+0000 7fe899a7f700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8941620f0 con 0x7fe89406a620 2023-09-13T08:25:12.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.303+0000 7fe899a7f700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8940cae50 con 0x7fe8940ca920 2023-09-13T08:25:12.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.303+0000 7fe899a7f700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8940cff20 con 0x7fe89415d530 2023-09-13T08:25:12.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.303+0000 7fe893fff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fe89406a620 0x7fe8940ce490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:46810/0 (socket says 172.21.15.84:46810) 2023-09-13T08:25:12.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.303+0000 7fe893fff700 1 -- 172.21.15.84:0/2043275404 learned_addr learned my addr 172.21.15.84:0/2043275404 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:25:12.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.303+0000 7fe8937fe700 1 --2- 172.21.15.84:0/2043275404 >> v2:172.21.15.161:3300/0 conn(0x7fe89415d530 0x7fe894161bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:12.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.304+0000 7fe8927fc700 1 -- 172.21.15.84:0/2043275404 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3196197024 0 0) 0x7fe8941620f0 con 0x7fe89406a620 2023-09-13T08:25:12.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.304+0000 7fe8927fc700 1 -- 172.21.15.84:0/2043275404 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe87c0035b0 con 0x7fe89406a620 2023-09-13T08:25:12.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.304+0000 7fe8937fe700 1 -- 172.21.15.84:0/2043275404 >> v1:172.21.15.161:6789/0 conn(0x7fe8940ca920 legacy=0x7fe89406d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:12.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.304+0000 7fe8927fc700 1 -- 172.21.15.84:0/2043275404 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4202929625 0 0) 0x7fe87c0035b0 con 0x7fe89406a620 2023-09-13T08:25:12.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.304+0000 7fe8937fe700 1 -- 172.21.15.84:0/2043275404 >> v1:172.21.15.84:6789/0 conn(0x7fe89406a620 legacy=0x7fe8940ce490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:12.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.304+0000 7fe8937fe700 1 -- 172.21.15.84:0/2043275404 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8940cb130 con 0x7fe89415d530 2023-09-13T08:25:12.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.304+0000 7fe8937fe700 1 --2- 172.21.15.84:0/2043275404 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe89415d530 0x7fe894161bb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe888009840 tx=0x7fe888009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e00573e90be77447 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:12.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.304+0000 7fe8927fc700 1 -- 172.21.15.84:0/2043275404 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe88c0019f0 con 0x7fe89415d530 2023-09-13T08:25:12.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.304+0000 7fe8927fc700 1 -- 172.21.15.84:0/2043275404 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe888004030 con 0x7fe89415d530 2023-09-13T08:25:12.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.304+0000 7fe8927fc700 1 -- 172.21.15.84:0/2043275404 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8880043a0 con 0x7fe89415d530 2023-09-13T08:25:12.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.305+0000 7fe899a7f700 1 -- 172.21.15.84:0/2043275404 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe89415d530 msgr2=0x7fe894161bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:12.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.305+0000 7fe899a7f700 1 --2- 172.21.15.84:0/2043275404 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe89415d530 0x7fe894161bb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe888009840 tx=0x7fe888009b50 comp rx=0 tx=0).stop 2023-09-13T08:25:12.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.305+0000 7fe899a7f700 1 -- 172.21.15.84:0/2043275404 shutdown_connections 2023-09-13T08:25:12.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.305+0000 7fe899a7f700 1 --2- 172.21.15.84:0/2043275404 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe89415d530 0x7fe894161bb0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:12.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.305+0000 7fe899a7f700 1 -- 172.21.15.84:0/2043275404 >> 172.21.15.84:0/2043275404 conn(0x7fe8940d00c0 msgr2=0x7fe8940d04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:12.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.305+0000 7fe899a7f700 1 -- 172.21.15.84:0/2043275404 shutdown_connections 2023-09-13T08:25:12.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.305+0000 7fe899a7f700 1 -- 172.21.15.84:0/2043275404 wait complete. 2023-09-13T08:25:12.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.306+0000 7fe899a7f700 1 Processor -- start 2023-09-13T08:25:12.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.307+0000 7fe899a7f700 1 -- start start 2023-09-13T08:25:12.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.307+0000 7fe899a7f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe89406a620 0x7fe89415d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:12.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.307+0000 7fe899a7f700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe8940ca920 0x7fe8940ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:12.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.307+0000 7fe899a7f700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe89415d530 0x7fe8941572d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:12.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.307+0000 7fe899a7f700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8941f7370 con 0x7fe89406a620 2023-09-13T08:25:12.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.307+0000 7fe899a7f700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe89415e650 con 0x7fe89415d530 2023-09-13T08:25:12.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.307+0000 7fe899a7f700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe89415e930 con 0x7fe8940ca920 2023-09-13T08:25:12.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.307+0000 7fe8937fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe89406a620 0x7fe89415d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:12.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.308+0000 7fe8937fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe89406a620 0x7fe89415d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44166/0 (socket says 172.21.15.84:44166) 2023-09-13T08:25:12.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.308+0000 7fe8937fe700 1 -- 172.21.15.84:0/990840451 learned_addr learned my addr 172.21.15.84:0/990840451 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:12.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.308+0000 7fe893fff700 1 --2- 172.21.15.84:0/990840451 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe89415d530 0x7fe8941572d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:12.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.308+0000 7fe892ffd700 1 --2- 172.21.15.84:0/990840451 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe8940ca920 0x7fe8940ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:12.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.308+0000 7fe8937fe700 1 -- 172.21.15.84:0/990840451 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe8940ca920 msgr2=0x7fe8940ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:12.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.308+0000 7fe8937fe700 1 --2- 172.21.15.84:0/990840451 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe8940ca920 0x7fe8940ce7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:12.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.308+0000 7fe8937fe700 1 -- 172.21.15.84:0/990840451 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe89415d530 msgr2=0x7fe8941572d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:12.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.308+0000 7fe8937fe700 1 --2- 172.21.15.84:0/990840451 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe89415d530 0x7fe8941572d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:12.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.308+0000 7fe8937fe700 1 -- 172.21.15.84:0/990840451 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8880094a0 con 0x7fe89406a620 2023-09-13T08:25:12.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.308+0000 7fe8937fe700 1 --2- 172.21.15.84:0/990840451 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe89406a620 0x7fe89415d910 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe8880090b0 tx=0x7fe888004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:12.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.308+0000 7fe87bfff700 1 -- 172.21.15.84:0/990840451 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe888003df0 con 0x7fe89406a620 2023-09-13T08:25:12.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.308+0000 7fe87bfff700 1 -- 172.21.15.84:0/990840451 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe88801f070 con 0x7fe89406a620 2023-09-13T08:25:12.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.308+0000 7fe899a7f700 1 -- 172.21.15.84:0/990840451 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8940c7190 con 0x7fe89406a620 2023-09-13T08:25:12.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.308+0000 7fe87bfff700 1 -- 172.21.15.84:0/990840451 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe888011830 con 0x7fe89406a620 2023-09-13T08:25:12.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.308+0000 7fe899a7f700 1 -- 172.21.15.84:0/990840451 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8940c7750 con 0x7fe89406a620 2023-09-13T08:25:12.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.309+0000 7fe899a7f700 1 -- 172.21.15.84:0/990840451 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe89404e9b0 con 0x7fe89406a620 2023-09-13T08:25:12.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.309+0000 7fe87bfff700 1 -- 172.21.15.84:0/990840451 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fe888021030 con 0x7fe89406a620 2023-09-13T08:25:12.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.310+0000 7fe87bfff700 1 --2- 172.21.15.84:0/990840451 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fe88006a580 0x7fe88006ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:12.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.310+0000 7fe87bfff700 1 -- 172.21.15.84:0/990840451 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe88808a0d0 con 0x7fe89406a620 2023-09-13T08:25:12.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.310+0000 7fe892ffd700 1 --2- 172.21.15.84:0/990840451 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fe88006a580 0x7fe88006ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:12.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.310+0000 7fe892ffd700 1 --2- 172.21.15.84:0/990840451 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fe88006a580 0x7fe88006ca40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe884007fd0 tx=0x7fe884009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:12.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.314+0000 7fe87bfff700 1 -- 172.21.15.84:0/990840451 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fe888055510 con 0x7fe89406a620 2023-09-13T08:25:12.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.544+0000 7fe899a7f700 1 -- 172.21.15.84:0/990840451 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fe8940b6040 con 0x7fe89406a620 2023-09-13T08:25:12.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.545+0000 7fe87bfff700 1 -- 172.21.15.84:0/990840451 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fe888006cc0 con 0x7fe89406a620 2023-09-13T08:25:12.545 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:25:12.545 INFO:teuthology.orchestra.run.smithi084.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-09-13T08:25:12.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.547+0000 7fe899a7f700 1 -- 172.21.15.84:0/990840451 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fe88006a580 msgr2=0x7fe88006ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:12.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.547+0000 7fe899a7f700 1 --2- 172.21.15.84:0/990840451 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fe88006a580 0x7fe88006ca40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe884007fd0 tx=0x7fe884009040 comp rx=0 tx=0).stop 2023-09-13T08:25:12.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.547+0000 7fe899a7f700 1 -- 172.21.15.84:0/990840451 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe89406a620 msgr2=0x7fe89415d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:12.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.547+0000 7fe899a7f700 1 --2- 172.21.15.84:0/990840451 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe89406a620 0x7fe89415d910 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe8880090b0 tx=0x7fe888004750 comp rx=0 tx=0).stop 2023-09-13T08:25:12.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.547+0000 7fe899a7f700 1 -- 172.21.15.84:0/990840451 shutdown_connections 2023-09-13T08:25:12.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.547+0000 7fe899a7f700 1 --2- 172.21.15.84:0/990840451 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fe88006a580 0x7fe88006ca40 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:12.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.547+0000 7fe899a7f700 1 --2- 172.21.15.84:0/990840451 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe89415d530 0x7fe8941572d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:12.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.547+0000 7fe899a7f700 1 --2- 172.21.15.84:0/990840451 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe89406a620 0x7fe89415d910 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:12.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.547+0000 7fe899a7f700 1 --2- 172.21.15.84:0/990840451 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe8940ca920 0x7fe8940ce7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:12.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.547+0000 7fe899a7f700 1 -- 172.21.15.84:0/990840451 >> 172.21.15.84:0/990840451 conn(0x7fe8940d00c0 msgr2=0x7fe89406f070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:12.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.547+0000 7fe899a7f700 1 -- 172.21.15.84:0/990840451 shutdown_connections 2023-09-13T08:25:12.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.547+0000 7fe899a7f700 1 -- 172.21.15.84:0/990840451 wait complete. 2023-09-13T08:25:12.559 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-09-13T08:25:12.559 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T08:25:12.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.680+0000 7f29cd9ed700 1 Processor -- start 2023-09-13T08:25:12.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.681+0000 7f29cd9ed700 1 -- start start 2023-09-13T08:25:12.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.681+0000 7f29cd9ed700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f29c80ca920 0x7f29c806d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:12.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.681+0000 7f29cd9ed700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29c80cae50 con 0x7f29c815d530 2023-09-13T08:25:12.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.681+0000 7f29cd9ed700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29c80cb130 con 0x7f29c806a620 2023-09-13T08:25:12.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.681+0000 7f29cd9ed700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29c80cff20 con 0x7f29c80ca920 2023-09-13T08:25:12.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.681+0000 7f29c6ffd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f29c815d530 0x7f29c8161bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:46820/0 (socket says 172.21.15.84:46820) 2023-09-13T08:25:12.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.681+0000 7f29c6ffd700 1 -- 172.21.15.84:0/4248885334 learned_addr learned my addr 172.21.15.84:0/4248885334 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:25:12.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.682+0000 7f29c67fc700 1 --2- 172.21.15.84:0/4248885334 >> v2:172.21.15.161:3300/0 conn(0x7f29c80ca920 0x7f29c806d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:12.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.682+0000 7f29c5ffb700 1 -- 172.21.15.84:0/4248885334 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1086648019 0 0) 0x7f29c80cae50 con 0x7f29c815d530 2023-09-13T08:25:12.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.682+0000 7f29c5ffb700 1 -- 172.21.15.84:0/4248885334 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29b00035b0 con 0x7f29c815d530 2023-09-13T08:25:12.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.682+0000 7f29c5ffb700 1 -- 172.21.15.84:0/4248885334 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2127026662 0 0) 0x7f29c80cb130 con 0x7f29c806a620 2023-09-13T08:25:12.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.682+0000 7f29c5ffb700 1 -- 172.21.15.84:0/4248885334 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29c80cae50 con 0x7f29c806a620 2023-09-13T08:25:12.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.682+0000 7f29c5ffb700 1 -- 172.21.15.84:0/4248885334 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1745752121 0 0) 0x7f29b00035b0 con 0x7f29c815d530 2023-09-13T08:25:12.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.682+0000 7f29c5ffb700 1 -- 172.21.15.84:0/4248885334 >> v2:172.21.15.161:3300/0 conn(0x7f29c80ca920 msgr2=0x7f29c806d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:12.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.682+0000 7f29c5ffb700 1 --2- 172.21.15.84:0/4248885334 >> v2:172.21.15.161:3300/0 conn(0x7f29c80ca920 0x7f29c806d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:12.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.682+0000 7f29c5ffb700 1 -- 172.21.15.84:0/4248885334 >> v1:172.21.15.161:6789/0 conn(0x7f29c806a620 legacy=0x7f29c80ce490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:12.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.682+0000 7f29c5ffb700 1 -- 172.21.15.84:0/4248885334 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29c80cb410 con 0x7f29c815d530 2023-09-13T08:25:12.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.682+0000 7f29c5ffb700 1 -- 172.21.15.84:0/4248885334 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2302733408 0 0) 0x7f29bc001670 con 0x7f29c815d530 2023-09-13T08:25:12.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.682+0000 7f29c67fc700 1 --2- 172.21.15.84:0/4248885334 >> v2:172.21.15.161:3300/0 conn(0x7f29c80ca920 0x7f29c806d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T08:25:12.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.682+0000 7f29c5ffb700 1 -- 172.21.15.84:0/4248885334 >> v1:172.21.15.84:6789/0 conn(0x7f29c815d530 legacy=0x7f29c8161bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:12.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.682+0000 7f29c5ffb700 1 --2- 172.21.15.84:0/4248885334 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f29b0003be0 0x7f29b0003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:12.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.682+0000 7f29c5ffb700 1 --2- 172.21.15.84:0/4248885334 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29b0004850 0x7f29b0004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:12.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.682+0000 7f29c5ffb700 1 --2- 172.21.15.84:0/4248885334 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f29b0005210 0x7f29b000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:12.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.682+0000 7f29c5ffb700 1 -- 172.21.15.84:0/4248885334 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b000c0e0 con 0x7f29b0004850 2023-09-13T08:25:12.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.682+0000 7f29c5ffb700 1 -- 172.21.15.84:0/4248885334 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b000c220 con 0x7f29b0003be0 2023-09-13T08:25:12.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.682+0000 7f29c5ffb700 1 -- 172.21.15.84:0/4248885334 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29b000c3e0 con 0x7f29b0005210 2023-09-13T08:25:12.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.682+0000 7f29c67fc700 1 --2- 172.21.15.84:0/4248885334 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29b0004850 0x7f29b0004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:12.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.682+0000 7f29c6ffd700 1 --2- 172.21.15.84:0/4248885334 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f29b0003be0 0x7f29b0003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:12.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.682+0000 7f29c77fe700 1 --2- 172.21.15.84:0/4248885334 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f29b0005210 0x7f29b000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:12.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.682+0000 7f29c67fc700 1 -- 172.21.15.84:0/4248885334 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f29b0005210 msgr2=0x7f29b000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:12.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.682+0000 7f29c67fc700 1 --2- 172.21.15.84:0/4248885334 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f29b0005210 0x7f29b000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:12.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.682+0000 7f29c67fc700 1 -- 172.21.15.84:0/4248885334 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f29b0003be0 msgr2=0x7f29b0003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:12.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.682+0000 7f29c67fc700 1 --2- 172.21.15.84:0/4248885334 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f29b0003be0 0x7f29b0003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:12.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.682+0000 7f29c67fc700 1 -- 172.21.15.84:0/4248885334 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b00035b0 con 0x7f29b0004850 2023-09-13T08:25:12.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.682+0000 7f29c77fe700 1 -- 172.21.15.84:0/4248885334 reap_dead start 2023-09-13T08:25:12.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.683+0000 7f29c67fc700 1 --2- 172.21.15.84:0/4248885334 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29b0004850 0x7f29b0004cd0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f29b8009d30 tx=0x7f29b0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62c719de6fcbc1bc server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:12.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.683+0000 7f29c5ffb700 1 -- 172.21.15.84:0/4248885334 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b8009e80 con 0x7f29b0004850 2023-09-13T08:25:12.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.683+0000 7f29c5ffb700 1 -- 172.21.15.84:0/4248885334 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29b800e9a0 con 0x7f29b0004850 2023-09-13T08:25:12.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.683+0000 7f29c5ffb700 1 -- 172.21.15.84:0/4248885334 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b800ed10 con 0x7f29b0004850 2023-09-13T08:25:12.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.683+0000 7f29cd9ed700 1 -- 172.21.15.84:0/4248885334 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29b0004850 msgr2=0x7f29b0004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:12.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.683+0000 7f29cd9ed700 1 --2- 172.21.15.84:0/4248885334 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29b0004850 0x7f29b0004cd0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f29b8009d30 tx=0x7f29b0005880 comp rx=0 tx=0).stop 2023-09-13T08:25:12.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.683+0000 7f29cd9ed700 1 -- 172.21.15.84:0/4248885334 shutdown_connections 2023-09-13T08:25:12.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.683+0000 7f29cd9ed700 1 --2- 172.21.15.84:0/4248885334 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29b0004850 0x7f29b0004cd0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:12.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.683+0000 7f29cd9ed700 1 -- 172.21.15.84:0/4248885334 >> 172.21.15.84:0/4248885334 conn(0x7f29c80d00c0 msgr2=0x7f29c80d04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:12.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.683+0000 7f29cd9ed700 1 -- 172.21.15.84:0/4248885334 shutdown_connections 2023-09-13T08:25:12.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.683+0000 7f29cd9ed700 1 -- 172.21.15.84:0/4248885334 wait complete. 2023-09-13T08:25:12.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.685+0000 7f29cd9ed700 1 Processor -- start 2023-09-13T08:25:12.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.685+0000 7f29cd9ed700 1 -- start start 2023-09-13T08:25:12.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.686+0000 7f29cd9ed700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f29b0004850 0x7f29c814fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:12.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.686+0000 7f29cd9ed700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29c8160870 0x7f29c80c7660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:12.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.686+0000 7f29cd9ed700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f29c815ec60 0x7f29c815f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:12.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.686+0000 7f29cd9ed700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c81f2cf0 con 0x7f29c8160870 2023-09-13T08:25:12.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.686+0000 7f29cd9ed700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c815dec0 con 0x7f29c815ec60 2023-09-13T08:25:12.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.686+0000 7f29cd9ed700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29c8160da0 con 0x7f29b0004850 2023-09-13T08:25:12.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.686+0000 7f29c67fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29c8160870 0x7f29c80c7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:12.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.686+0000 7f29c67fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29c8160870 0x7f29c80c7660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44188/0 (socket says 172.21.15.84:44188) 2023-09-13T08:25:12.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.686+0000 7f29c67fc700 1 -- 172.21.15.84:0/3697921292 learned_addr learned my addr 172.21.15.84:0/3697921292 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:12.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.686+0000 7f29c6ffd700 1 --2- 172.21.15.84:0/3697921292 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f29b0004850 0x7f29c814fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:12.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.686+0000 7f29c77fe700 1 --2- 172.21.15.84:0/3697921292 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f29c815ec60 0x7f29c815f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:12.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.686+0000 7f29c67fc700 1 -- 172.21.15.84:0/3697921292 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f29b0004850 msgr2=0x7f29c814fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:12.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.686+0000 7f29c67fc700 1 --2- 172.21.15.84:0/3697921292 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f29b0004850 0x7f29c814fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:12.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.686+0000 7f29c67fc700 1 -- 172.21.15.84:0/3697921292 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f29c815ec60 msgr2=0x7f29c815f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:12.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.686+0000 7f29c67fc700 1 --2- 172.21.15.84:0/3697921292 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f29c815ec60 0x7f29c815f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:12.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.686+0000 7f29c67fc700 1 -- 172.21.15.84:0/3697921292 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29c815e180 con 0x7f29c8160870 2023-09-13T08:25:12.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.686+0000 7f29c6ffd700 1 --2- 172.21.15.84:0/3697921292 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f29b0004850 0x7f29c814fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T08:25:12.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.686+0000 7f29c77fe700 1 --2- 172.21.15.84:0/3697921292 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f29c815ec60 0x7f29c815f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T08:25:12.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.687+0000 7f29c67fc700 1 --2- 172.21.15.84:0/3697921292 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29c8160870 0x7f29c80c7660 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f29b00047d0 tx=0x7f29b80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:12.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.687+0000 7f29affff700 1 -- 172.21.15.84:0/3697921292 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b8003ab0 con 0x7f29c8160870 2023-09-13T08:25:12.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.687+0000 7f29affff700 1 -- 172.21.15.84:0/3697921292 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29b8003c10 con 0x7f29c8160870 2023-09-13T08:25:12.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.687+0000 7f29cd9ed700 1 -- 172.21.15.84:0/3697921292 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29c815e460 con 0x7f29c8160870 2023-09-13T08:25:12.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.687+0000 7f29affff700 1 -- 172.21.15.84:0/3697921292 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b8009e80 con 0x7f29c8160870 2023-09-13T08:25:12.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.687+0000 7f29cd9ed700 1 -- 172.21.15.84:0/3697921292 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29c8153310 con 0x7f29c8160870 2023-09-13T08:25:12.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.688+0000 7f29cd9ed700 1 -- 172.21.15.84:0/3697921292 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29c815e980 con 0x7f29c8160870 2023-09-13T08:25:12.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.688+0000 7f29affff700 1 -- 172.21.15.84:0/3697921292 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f29b8013470 con 0x7f29c8160870 2023-09-13T08:25:12.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.688+0000 7f29affff700 1 --2- 172.21.15.84:0/3697921292 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f29b406a5b0 0x7f29b406ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:12.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.688+0000 7f29affff700 1 -- 172.21.15.84:0/3697921292 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f29b808a660 con 0x7f29c8160870 2023-09-13T08:25:12.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.689+0000 7f29c6ffd700 1 --2- 172.21.15.84:0/3697921292 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f29b406a5b0 0x7f29b406ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:12.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.689+0000 7f29c6ffd700 1 --2- 172.21.15.84:0/3697921292 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f29b406a5b0 0x7f29b406ca70 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f29bc000c00 tx=0x7f29bc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:12.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.693+0000 7f29affff700 1 -- 172.21.15.84:0/3697921292 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f29c815e980 con 0x7f29c8160870 2023-09-13T08:25:12.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.887+0000 7f29cd9ed700 1 -- 172.21.15.84:0/3697921292 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f29c815e980 con 0x7f29c8160870 2023-09-13T08:25:12.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.888+0000 7f29affff700 1 -- 172.21.15.84:0/3697921292 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18322 (secure 0 0 0) 0x7f29c815e980 con 0x7f29c8160870 2023-09-13T08:25:12.889 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:25:12.889 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":24,"fsid":"0107440b-b634-42c5-a643-5d31ea826116","created":"2023-09-13T08:24:16.931917+0000","modified":"2023-09-13T08:24:47.176259+0000","last_up_change":"2023-09-13T08:24:28.422631+0000","last_in_change":"2023-09-13T08:24:19.425578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T08:24:28.583720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-13T08:24:39.862832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-13T08:24:41.145511+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-13T08:24:44.775160+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4a53ec12-1469-4356-b4e1-2b8fc9b7c0f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6817","nonce":1599532366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6819","nonce":1599532366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6823","nonce":1599532366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6821","nonce":1599532366}]},"public_addr":"172.21.15.84:6817/1599532366","cluster_addr":"172.21.15.84:6819/1599532366","heartbeat_back_addr":"172.21.15.84:6823/1599532366","heartbeat_front_addr":"172.21.15.84:6821/1599532366","state":["exists","up"]},{"osd":1,"uuid":"11e964a0-b80c-4afc-bfbf-e2067969db29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6825","nonce":461860977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6827","nonce":461860977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6831","nonce":461860977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6829","nonce":461860977}]},"public_addr":"172.21.15.84:6825/461860977","cluster_addr":"172.21.15.84:6827/461860977","heartbeat_back_addr":"172.21.15.84:6831/461860977","heartbeat_front_addr":"172.21.15.84:6829/461860977","state":["exists","up"]},{"osd":2,"uuid":"3ce74529-4dd1-44c7-9576-968f5fdc0c25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6809","nonce":1168316165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6811","nonce":1168316165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6815","nonce":1168316165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6813","nonce":1168316165}]},"public_addr":"172.21.15.84:6809/1168316165","cluster_addr":"172.21.15.84:6811/1168316165","heartbeat_back_addr":"172.21.15.84:6815/1168316165","heartbeat_front_addr":"172.21.15.84:6813/1168316165","state":["exists","up"]},{"osd":3,"uuid":"460cb5c5-590a-4d06-a4d9-5bac2fdf33b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6801","nonce":1661609810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6803","nonce":1661609810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6807","nonce":1661609810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6805","nonce":1661609810}]},"public_addr":"172.21.15.84:6801/1661609810","cluster_addr":"172.21.15.84:6803/1661609810","heartbeat_back_addr":"172.21.15.84:6807/1661609810","heartbeat_front_addr":"172.21.15.84:6805/1661609810","state":["exists","up"]},{"osd":4,"uuid":"bf237dd0-3ebd-44b5-8078-24a63e00d792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6801","nonce":1303562374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6803","nonce":1303562374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6807","nonce":1303562374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6805","nonce":1303562374}]},"public_addr":"172.21.15.161:6801/1303562374","cluster_addr":"172.21.15.161:6803/1303562374","heartbeat_back_addr":"172.21.15.161:6807/1303562374","heartbeat_front_addr":"172.21.15.161:6805/1303562374","state":["exists","up"]},{"osd":5,"uuid":"e1e538e0-5844-456b-8c6e-434d3a914af1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6818","nonce":961120854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6822","nonce":961120854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6830","nonce":961120854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6826","nonce":961120854}]},"public_addr":"172.21.15.161:6818/961120854","cluster_addr":"172.21.15.161:6822/961120854","heartbeat_back_addr":"172.21.15.161:6830/961120854","heartbeat_front_addr":"172.21.15.161:6826/961120854","state":["exists","up"]},{"osd":6,"uuid":"5cb1785e-960f-4dd4-b295-9e21b2c3f875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6809","nonce":980533466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6811","nonce":980533466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6815","nonce":980533466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6813","nonce":980533466}]},"public_addr":"172.21.15.161:6809/980533466","cluster_addr":"172.21.15.161:6811/980533466","heartbeat_back_addr":"172.21.15.161:6815/980533466","heartbeat_front_addr":"172.21.15.161:6813/980533466","state":["exists","up"]},{"osd":7,"uuid":"5acb6619-e933-4b46-b1c2-60af30acb839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6817","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6819","nonce":2479691549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6821","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6823","nonce":2479691549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6829","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6831","nonce":2479691549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6825","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6827","nonce":2479691549}]},"public_addr":"172.21.15.161:6819/2479691549","cluster_addr":"172.21.15.161:6823/2479691549","heartbeat_back_addr":"172.21.15.161:6831/2479691549","heartbeat_front_addr":"172.21.15.161:6827/2479691549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.678857+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.685341+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.613603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.634940+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.564387+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.697347+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.637437+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.619397+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T08:25:12.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.891+0000 7f29cd9ed700 1 -- 172.21.15.84:0/3697921292 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f29b406a5b0 msgr2=0x7f29b406ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:12.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.891+0000 7f29cd9ed700 1 --2- 172.21.15.84:0/3697921292 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f29b406a5b0 0x7f29b406ca70 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f29bc000c00 tx=0x7f29bc009040 comp rx=0 tx=0).stop 2023-09-13T08:25:12.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.891+0000 7f29cd9ed700 1 -- 172.21.15.84:0/3697921292 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29c8160870 msgr2=0x7f29c80c7660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:12.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.891+0000 7f29cd9ed700 1 --2- 172.21.15.84:0/3697921292 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29c8160870 0x7f29c80c7660 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f29b00047d0 tx=0x7f29b80047c0 comp rx=0 tx=0).stop 2023-09-13T08:25:12.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.891+0000 7f29cd9ed700 1 -- 172.21.15.84:0/3697921292 shutdown_connections 2023-09-13T08:25:12.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.891+0000 7f29cd9ed700 1 --2- 172.21.15.84:0/3697921292 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f29b406a5b0 0x7f29b406ca70 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:12.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.891+0000 7f29cd9ed700 1 --2- 172.21.15.84:0/3697921292 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f29c815ec60 0x7f29c815f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:12.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.891+0000 7f29cd9ed700 1 --2- 172.21.15.84:0/3697921292 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f29b0004850 0x7f29c814fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:12.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.891+0000 7f29cd9ed700 1 --2- 172.21.15.84:0/3697921292 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29c8160870 0x7f29c80c7660 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:12.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.891+0000 7f29cd9ed700 1 -- 172.21.15.84:0/3697921292 >> 172.21.15.84:0/3697921292 conn(0x7f29c80d00c0 msgr2=0x7f29c80cf080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:12.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.891+0000 7f29cd9ed700 1 -- 172.21.15.84:0/3697921292 shutdown_connections 2023-09-13T08:25:12.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:12.891+0000 7f29cd9ed700 1 -- 172.21.15.84:0/3697921292 wait complete. 2023-09-13T08:25:12.903 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T08:24:28.583720+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-13T08:24:39.862832+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-13T08:24:41.145511+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-09-13T08:24:44.775160+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-13T08:25:12.904 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T08:25:13.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.027+0000 7f4d4e753700 1 Processor -- start 2023-09-13T08:25:13.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.027+0000 7f4d4e753700 1 -- start start 2023-09-13T08:25:13.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.028+0000 7f4d4e753700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f4d481599b0 0x7f4d480cef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:13.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.028+0000 7f4d4e753700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4d4806b910 0x7f4d4806df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:13.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.028+0000 7f4d4e753700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d480cf440 con 0x7f4d4806db00 2023-09-13T08:25:13.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.028+0000 7f4d4e753700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d4806d8c0 con 0x7f4d481599b0 2023-09-13T08:25:13.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.028+0000 7f4d4e753700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4806e4c0 con 0x7f4d4806b910 2023-09-13T08:25:13.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.028+0000 7f4d477fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f4d4806db00 0x7f4d4815d370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:46840/0 (socket says 172.21.15.84:46840) 2023-09-13T08:25:13.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.028+0000 7f4d477fe700 1 -- 172.21.15.84:0/2020015712 learned_addr learned my addr 172.21.15.84:0/2020015712 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:25:13.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.029+0000 7f4d46ffd700 1 -- 172.21.15.84:0/2020015712 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3210932840 0 0) 0x7f4d480cf440 con 0x7f4d4806db00 2023-09-13T08:25:13.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.029+0000 7f4d4ccf0700 1 --2- 172.21.15.84:0/2020015712 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4d4806b910 0x7f4d4806df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:13.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.029+0000 7f4d47fff700 1 --2- 172.21.15.84:0/2020015712 >> v2:172.21.15.161:3300/0 conn(0x7f4d481599b0 0x7f4d480cef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:13.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.029+0000 7f4d46ffd700 1 -- 172.21.15.84:0/2020015712 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d340035b0 con 0x7f4d4806db00 2023-09-13T08:25:13.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.029+0000 7f4d46ffd700 1 -- 172.21.15.84:0/2020015712 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3218120147 0 0) 0x7f4d340035b0 con 0x7f4d4806db00 2023-09-13T08:25:13.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.029+0000 7f4d46ffd700 1 -- 172.21.15.84:0/2020015712 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4d4806b910 msgr2=0x7f4d4806df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:13.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.029+0000 7f4d46ffd700 1 --2- 172.21.15.84:0/2020015712 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4d4806b910 0x7f4d4806df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:13.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.029+0000 7f4d46ffd700 1 -- 172.21.15.84:0/2020015712 >> v2:172.21.15.161:3300/0 conn(0x7f4d481599b0 msgr2=0x7f4d480cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:13.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.029+0000 7f4d46ffd700 1 --2- 172.21.15.84:0/2020015712 >> v2:172.21.15.161:3300/0 conn(0x7f4d481599b0 0x7f4d480cef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:13.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.029+0000 7f4d46ffd700 1 -- 172.21.15.84:0/2020015712 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d4806d5e0 con 0x7f4d4806db00 2023-09-13T08:25:13.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.029+0000 7f4d46ffd700 1 -- 172.21.15.84:0/2020015712 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2302733408 0 0) 0x7f4d30001670 con 0x7f4d4806db00 2023-09-13T08:25:13.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.029+0000 7f4d46ffd700 1 -- 172.21.15.84:0/2020015712 >> v1:172.21.15.84:6789/0 conn(0x7f4d4806db00 legacy=0x7f4d4815d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:13.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.029+0000 7f4d46ffd700 1 --2- 172.21.15.84:0/2020015712 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4d4806b910 0x7f4d34003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:13.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.029+0000 7f4d46ffd700 1 --2- 172.21.15.84:0/2020015712 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4d34003f80 0x7f4d34004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:13.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.029+0000 7f4d46ffd700 1 --2- 172.21.15.84:0/2020015712 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d34004d90 0x7f4d34005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:13.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.029+0000 7f4d46ffd700 1 -- 172.21.15.84:0/2020015712 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4806d8c0 con 0x7f4d34004d90 2023-09-13T08:25:13.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.029+0000 7f4d46ffd700 1 -- 172.21.15.84:0/2020015712 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4806e4c0 con 0x7f4d34003f80 2023-09-13T08:25:13.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.029+0000 7f4d46ffd700 1 -- 172.21.15.84:0/2020015712 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3400ba60 con 0x7f4d4806b910 2023-09-13T08:25:13.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.029+0000 7f4d4ccf0700 1 --2- 172.21.15.84:0/2020015712 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d34004d90 0x7f4d34005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:13.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.029+0000 7f4d47fff700 1 --2- 172.21.15.84:0/2020015712 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4d4806b910 0x7f4d34003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:13.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.029+0000 7f4d477fe700 1 --2- 172.21.15.84:0/2020015712 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4d34003f80 0x7f4d34004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:13.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.029+0000 7f4d4ccf0700 1 -- 172.21.15.84:0/2020015712 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4d4806b910 msgr2=0x7f4d34003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:13.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.029+0000 7f4d4ccf0700 1 --2- 172.21.15.84:0/2020015712 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4d4806b910 0x7f4d34003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:13.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.029+0000 7f4d4ccf0700 1 -- 172.21.15.84:0/2020015712 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4d34003f80 msgr2=0x7f4d34004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:13.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.029+0000 7f4d4ccf0700 1 --2- 172.21.15.84:0/2020015712 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4d34003f80 0x7f4d34004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:13.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.029+0000 7f4d4ccf0700 1 -- 172.21.15.84:0/2020015712 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d340035b0 con 0x7f4d34004d90 2023-09-13T08:25:13.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.030+0000 7f4d4ccf0700 1 --2- 172.21.15.84:0/2020015712 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d34004d90 0x7f4d34005210 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4d4000e170 tx=0x7f4d34005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ec7e7c9316891d server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:13.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.030+0000 7f4d46ffd700 1 -- 172.21.15.84:0/2020015712 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d4000ec90 con 0x7f4d34004d90 2023-09-13T08:25:13.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.030+0000 7f4d46ffd700 1 -- 172.21.15.84:0/2020015712 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d4000f040 con 0x7f4d34004d90 2023-09-13T08:25:13.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.030+0000 7f4d46ffd700 1 -- 172.21.15.84:0/2020015712 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d40014480 con 0x7f4d34004d90 2023-09-13T08:25:13.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.030+0000 7f4d4e753700 1 -- 172.21.15.84:0/2020015712 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d34004d90 msgr2=0x7f4d34005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:13.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.030+0000 7f4d4e753700 1 --2- 172.21.15.84:0/2020015712 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d34004d90 0x7f4d34005210 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4d4000e170 tx=0x7f4d34005880 comp rx=0 tx=0).stop 2023-09-13T08:25:13.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.030+0000 7f4d4ccf0700 1 -- 172.21.15.84:0/2020015712 reap_dead start 2023-09-13T08:25:13.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.030+0000 7f4d4e753700 1 -- 172.21.15.84:0/2020015712 shutdown_connections 2023-09-13T08:25:13.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.030+0000 7f4d4e753700 1 -- 172.21.15.84:0/2020015712 >> 172.21.15.84:0/2020015712 conn(0x7f4d480cf8f0 msgr2=0x7f4d480cfd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:13.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.030+0000 7f4d4e753700 1 -- 172.21.15.84:0/2020015712 shutdown_connections 2023-09-13T08:25:13.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.030+0000 7f4d4e753700 1 -- 172.21.15.84:0/2020015712 wait complete. 2023-09-13T08:25:13.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.032+0000 7f4d4e753700 1 Processor -- start 2023-09-13T08:25:13.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.032+0000 7f4d4e753700 1 -- start start 2023-09-13T08:25:13.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.033+0000 7f4d4e753700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d48151d70 0x7f4d4814d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:13.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.033+0000 7f4d4e753700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4d4813a7e0 0x7f4d480b0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:13.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.033+0000 7f4d4e753700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4d480b0ba0 0x7f4d481534f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:13.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.033+0000 7f4d4e753700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4814b6d0 con 0x7f4d48151d70 2023-09-13T08:25:13.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.033+0000 7f4d4e753700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4814ed70 con 0x7f4d480b0ba0 2023-09-13T08:25:13.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.033+0000 7f4d4e753700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d480b1030 con 0x7f4d4813a7e0 2023-09-13T08:25:13.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.033+0000 7f4d47fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d48151d70 0x7f4d4814d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:13.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.033+0000 7f4d47fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d48151d70 0x7f4d4814d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44206/0 (socket says 172.21.15.84:44206) 2023-09-13T08:25:13.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.033+0000 7f4d47fff700 1 -- 172.21.15.84:0/3517521270 learned_addr learned my addr 172.21.15.84:0/3517521270 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:13.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.033+0000 7f4d477fe700 1 --2- 172.21.15.84:0/3517521270 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4d4813a7e0 0x7f4d480b0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:13.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.033+0000 7f4d4ccf0700 1 --2- 172.21.15.84:0/3517521270 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4d480b0ba0 0x7f4d481534f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:13.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.033+0000 7f4d47fff700 1 -- 172.21.15.84:0/3517521270 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4d4813a7e0 msgr2=0x7f4d480b0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:13.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.033+0000 7f4d47fff700 1 --2- 172.21.15.84:0/3517521270 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4d4813a7e0 0x7f4d480b0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:13.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.033+0000 7f4d47fff700 1 -- 172.21.15.84:0/3517521270 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4d480b0ba0 msgr2=0x7f4d481534f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:13.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.033+0000 7f4d47fff700 1 --2- 172.21.15.84:0/3517521270 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4d480b0ba0 0x7f4d481534f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:13.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.033+0000 7f4d47fff700 1 -- 172.21.15.84:0/3517521270 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d4814dcd0 con 0x7f4d48151d70 2023-09-13T08:25:13.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.033+0000 7f4d477fe700 1 --2- 172.21.15.84:0/3517521270 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4d4813a7e0 0x7f4d480b0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T08:25:13.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.033+0000 7f4d4ccf0700 1 --2- 172.21.15.84:0/3517521270 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4d480b0ba0 0x7f4d481534f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T08:25:13.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.034+0000 7f4d47fff700 1 --2- 172.21.15.84:0/3517521270 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d48151d70 0x7f4d4814d6a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4d38013e30 tx=0x7f4d38011490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:13.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.034+0000 7f4d44ff9700 1 -- 172.21.15.84:0/3517521270 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d38010040 con 0x7f4d48151d70 2023-09-13T08:25:13.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.034+0000 7f4d44ff9700 1 -- 172.21.15.84:0/3517521270 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d38011040 con 0x7f4d48151d70 2023-09-13T08:25:13.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.034+0000 7f4d44ff9700 1 -- 172.21.15.84:0/3517521270 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d3800bc00 con 0x7f4d48151d70 2023-09-13T08:25:13.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.034+0000 7f4d4e753700 1 -- 172.21.15.84:0/3517521270 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d4814dfb0 con 0x7f4d48151d70 2023-09-13T08:25:13.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.034+0000 7f4d4e753700 1 -- 172.21.15.84:0/3517521270 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d4814e570 con 0x7f4d48151d70 2023-09-13T08:25:13.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.035+0000 7f4d4e753700 1 -- 172.21.15.84:0/3517521270 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d4804f200 con 0x7f4d48151d70 2023-09-13T08:25:13.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.035+0000 7f4d44ff9700 1 -- 172.21.15.84:0/3517521270 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f4d38017650 con 0x7f4d48151d70 2023-09-13T08:25:13.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.035+0000 7f4d44ff9700 1 --2- 172.21.15.84:0/3517521270 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f4d2806a580 0x7f4d2806ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:13.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.036+0000 7f4d44ff9700 1 -- 172.21.15.84:0/3517521270 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4d3808baf0 con 0x7f4d48151d70 2023-09-13T08:25:13.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.036+0000 7f4d477fe700 1 --2- 172.21.15.84:0/3517521270 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f4d2806a580 0x7f4d2806ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:13.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.036+0000 7f4d477fe700 1 --2- 172.21.15.84:0/3517521270 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f4d2806a580 0x7f4d2806ca40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4d30000fb0 tx=0x7f4d30009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:13.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.040+0000 7f4d44ff9700 1 -- 172.21.15.84:0/3517521270 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f4d38056d80 con 0x7f4d48151d70 2023-09-13T08:25:13.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.225+0000 7f4d4e753700 1 -- 172.21.15.84:0/3517521270 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4d480ccb90 con 0x7f4d48151d70 2023-09-13T08:25:13.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.226+0000 7f4d44ff9700 1 -- 172.21.15.84:0/3517521270 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4d3805a3a0 con 0x7f4d48151d70 2023-09-13T08:25:13.226 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-09-13T08:25:13.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.227+0000 7f4d4e753700 1 -- 172.21.15.84:0/3517521270 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f4d2806a580 msgr2=0x7f4d2806ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:13.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.228+0000 7f4d4e753700 1 --2- 172.21.15.84:0/3517521270 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f4d2806a580 0x7f4d2806ca40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4d30000fb0 tx=0x7f4d30009040 comp rx=0 tx=0).stop 2023-09-13T08:25:13.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.228+0000 7f4d4e753700 1 -- 172.21.15.84:0/3517521270 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d48151d70 msgr2=0x7f4d4814d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:13.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.228+0000 7f4d4e753700 1 --2- 172.21.15.84:0/3517521270 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d48151d70 0x7f4d4814d6a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4d38013e30 tx=0x7f4d38011490 comp rx=0 tx=0).stop 2023-09-13T08:25:13.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.228+0000 7f4d4e753700 1 -- 172.21.15.84:0/3517521270 shutdown_connections 2023-09-13T08:25:13.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.228+0000 7f4d4e753700 1 --2- 172.21.15.84:0/3517521270 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f4d2806a580 0x7f4d2806ca40 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:13.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.228+0000 7f4d4e753700 1 --2- 172.21.15.84:0/3517521270 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4d480b0ba0 0x7f4d481534f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:13.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.228+0000 7f4d4e753700 1 --2- 172.21.15.84:0/3517521270 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d48151d70 0x7f4d4814d6a0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:13.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.228+0000 7f4d4e753700 1 --2- 172.21.15.84:0/3517521270 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4d4813a7e0 0x7f4d480b0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:13.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.228+0000 7f4d4e753700 1 -- 172.21.15.84:0/3517521270 >> 172.21.15.84:0/3517521270 conn(0x7f4d480cf8f0 msgr2=0x7f4d480b3600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:13.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.228+0000 7f4d4e753700 1 -- 172.21.15.84:0/3517521270 shutdown_connections 2023-09-13T08:25:13.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.228+0000 7f4d4e753700 1 -- 172.21.15.84:0/3517521270 wait complete. 2023-09-13T08:25:13.240 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-13T08:25:13.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.362+0000 7f6463ea2700 1 Processor -- start 2023-09-13T08:25:13.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.362+0000 7f6463ea2700 1 -- start start 2023-09-13T08:25:13.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.363+0000 7f6463ea2700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f645c0ca8e0 0x7f645c0cf570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:13.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.363+0000 7f6463ea2700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f645c15e910 0x7f645c0cacc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:13.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.363+0000 7f6463ea2700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f645c0cd590 0x7f645c161150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:13.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.363+0000 7f6463ea2700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f645c15e480 con 0x7f645c0cd590 2023-09-13T08:25:13.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.363+0000 7f6463ea2700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f645c0cb200 con 0x7f645c0ca8e0 2023-09-13T08:25:13.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.363+0000 7f6463ea2700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f645c0cfbe0 con 0x7f645c15e910 2023-09-13T08:25:13.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.363+0000 7f646243f700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f645c0cd590 0x7f645c161150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:13.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.363+0000 7f646243f700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f645c0cd590 0x7f645c161150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44218/0 (socket says 172.21.15.84:44218) 2023-09-13T08:25:13.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.363+0000 7f646243f700 1 -- 172.21.15.84:0/3299278505 learned_addr learned my addr 172.21.15.84:0/3299278505 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:13.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.363+0000 7f6461c3e700 1 --2- 172.21.15.84:0/3299278505 >> v2:172.21.15.161:3300/0 conn(0x7f645c0ca8e0 0x7f645c0cf570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:13.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.363+0000 7f646143d700 1 --2- 172.21.15.84:0/3299278505 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f645c15e910 0x7f645c0cacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:13.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.363+0000 7f646243f700 1 -- 172.21.15.84:0/3299278505 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f645c15e910 msgr2=0x7f645c0cacc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:13.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.363+0000 7f646243f700 1 --2- 172.21.15.84:0/3299278505 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f645c15e910 0x7f645c0cacc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:13.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.363+0000 7f646243f700 1 -- 172.21.15.84:0/3299278505 >> v2:172.21.15.161:3300/0 conn(0x7f645c0ca8e0 msgr2=0x7f645c0cf570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:13.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.363+0000 7f646243f700 1 --2- 172.21.15.84:0/3299278505 >> v2:172.21.15.161:3300/0 conn(0x7f645c0ca8e0 0x7f645c0cf570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:13.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.363+0000 7f646243f700 1 -- 172.21.15.84:0/3299278505 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f645c15de30 con 0x7f645c0cd590 2023-09-13T08:25:13.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.363+0000 7f646143d700 1 --2- 172.21.15.84:0/3299278505 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f645c15e910 0x7f645c0cacc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T08:25:13.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.363+0000 7f6461c3e700 1 --2- 172.21.15.84:0/3299278505 >> v2:172.21.15.161:3300/0 conn(0x7f645c0ca8e0 0x7f645c0cf570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T08:25:13.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.363+0000 7f646243f700 1 --2- 172.21.15.84:0/3299278505 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f645c0cd590 0x7f645c161150 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f645c069150 tx=0x7f645400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c3ea574d8c76381 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:13.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.364+0000 7f6460c3c700 1 -- 172.21.15.84:0/3299278505 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645400e070 con 0x7f645c0cd590 2023-09-13T08:25:13.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.364+0000 7f6460c3c700 1 -- 172.21.15.84:0/3299278505 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f645400b9c0 con 0x7f645c0cd590 2023-09-13T08:25:13.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.364+0000 7f6460c3c700 1 -- 172.21.15.84:0/3299278505 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645400bd70 con 0x7f645c0cd590 2023-09-13T08:25:13.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.364+0000 7f6463ea2700 1 -- 172.21.15.84:0/3299278505 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f645c0cd590 msgr2=0x7f645c161150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:13.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.364+0000 7f6463ea2700 1 --2- 172.21.15.84:0/3299278505 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f645c0cd590 0x7f645c161150 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f645c069150 tx=0x7f645400b330 comp rx=0 tx=0).stop 2023-09-13T08:25:13.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.364+0000 7f6463ea2700 1 -- 172.21.15.84:0/3299278505 shutdown_connections 2023-09-13T08:25:13.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.364+0000 7f6463ea2700 1 --2- 172.21.15.84:0/3299278505 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f645c0cd590 0x7f645c161150 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:13.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.364+0000 7f6463ea2700 1 --2- 172.21.15.84:0/3299278505 >> v2:172.21.15.161:3300/0 conn(0x7f645c0ca8e0 0x7f645c0cf570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:13.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.364+0000 7f6463ea2700 1 --2- 172.21.15.84:0/3299278505 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f645c15e910 0x7f645c0cacc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:13.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.364+0000 7f6463ea2700 1 -- 172.21.15.84:0/3299278505 >> 172.21.15.84:0/3299278505 conn(0x7f645c0cca70 msgr2=0x7f645c0cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:13.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.364+0000 7f6463ea2700 1 -- 172.21.15.84:0/3299278505 shutdown_connections 2023-09-13T08:25:13.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.364+0000 7f6463ea2700 1 -- 172.21.15.84:0/3299278505 wait complete. 2023-09-13T08:25:13.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.365+0000 7f6463ea2700 1 Processor -- start 2023-09-13T08:25:13.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.365+0000 7f6463ea2700 1 -- start start 2023-09-13T08:25:13.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.366+0000 7f6463ea2700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f645c0ca8e0 0x7f645c156680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:13.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.366+0000 7f6463ea2700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f645c0cd590 0x7f645c15b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:13.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.366+0000 7f6463ea2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f645c15e910 0x7f645c15b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:13.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.366+0000 7f6463ea2700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f645c0ad340 con 0x7f645c15e910 2023-09-13T08:25:13.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.366+0000 7f6463ea2700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f645c1f3dc0 con 0x7f645c0cd590 2023-09-13T08:25:13.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.366+0000 7f6463ea2700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f645c0aca10 con 0x7f645c0ca8e0 2023-09-13T08:25:13.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.366+0000 7f646243f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f645c15e910 0x7f645c15b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:13.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.366+0000 7f646243f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f645c15e910 0x7f645c15b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44224/0 (socket says 172.21.15.84:44224) 2023-09-13T08:25:13.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.366+0000 7f646243f700 1 -- 172.21.15.84:0/580812513 learned_addr learned my addr 172.21.15.84:0/580812513 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:13.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.366+0000 7f6461c3e700 1 --2- 172.21.15.84:0/580812513 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f645c0ca8e0 0x7f645c156680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:13.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.366+0000 7f646143d700 1 --2- 172.21.15.84:0/580812513 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f645c0cd590 0x7f645c15b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:13.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.366+0000 7f646243f700 1 -- 172.21.15.84:0/580812513 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f645c0ca8e0 msgr2=0x7f645c156680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:13.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.366+0000 7f646243f700 1 --2- 172.21.15.84:0/580812513 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f645c0ca8e0 0x7f645c156680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:13.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.366+0000 7f646243f700 1 -- 172.21.15.84:0/580812513 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f645c0cd590 msgr2=0x7f645c15b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:13.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.366+0000 7f646243f700 1 --2- 172.21.15.84:0/580812513 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f645c0cd590 0x7f645c15b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:13.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.366+0000 7f646243f700 1 -- 172.21.15.84:0/580812513 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6454009b30 con 0x7f645c15e910 2023-09-13T08:25:13.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.366+0000 7f646143d700 1 --2- 172.21.15.84:0/580812513 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f645c0cd590 0x7f645c15b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T08:25:13.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.367+0000 7f646243f700 1 --2- 172.21.15.84:0/580812513 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f645c15e910 0x7f645c15b940 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f645400b370 tx=0x7f6454004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:13.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.367+0000 7f64527fc700 1 -- 172.21.15.84:0/580812513 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6454004310 con 0x7f645c15e910 2023-09-13T08:25:13.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.367+0000 7f64527fc700 1 -- 172.21.15.84:0/580812513 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6454004470 con 0x7f645c15e910 2023-09-13T08:25:13.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.367+0000 7f6463ea2700 1 -- 172.21.15.84:0/580812513 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f645c0accf0 con 0x7f645c15e910 2023-09-13T08:25:13.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.367+0000 7f64527fc700 1 -- 172.21.15.84:0/580812513 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6454004820 con 0x7f645c15e910 2023-09-13T08:25:13.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.367+0000 7f6463ea2700 1 -- 172.21.15.84:0/580812513 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f645c156bc0 con 0x7f645c15e910 2023-09-13T08:25:13.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.368+0000 7f6463ea2700 1 -- 172.21.15.84:0/580812513 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f645c04f200 con 0x7f645c15e910 2023-09-13T08:25:13.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.368+0000 7f64527fc700 1 -- 172.21.15.84:0/580812513 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f645401c440 con 0x7f645c15e910 2023-09-13T08:25:13.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.369+0000 7f64527fc700 1 --2- 172.21.15.84:0/580812513 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f644006a580 0x7f644006ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:13.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.369+0000 7f64527fc700 1 -- 172.21.15.84:0/580812513 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f645408a320 con 0x7f645c15e910 2023-09-13T08:25:13.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.369+0000 7f6461c3e700 1 --2- 172.21.15.84:0/580812513 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f644006a580 0x7f644006ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:13.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.369+0000 7f6461c3e700 1 --2- 172.21.15.84:0/580812513 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f644006a580 0x7f644006ca40 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f644c006ba0 tx=0x7f644c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:13.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.373+0000 7f64527fc700 1 -- 172.21.15.84:0/580812513 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f64540555c0 con 0x7f645c15e910 2023-09-13T08:25:13.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.564+0000 7f6463ea2700 1 -- 172.21.15.84:0/580812513 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f645c15e0e0 con 0x7f645c15e910 2023-09-13T08:25:13.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.564+0000 7f64527fc700 1 -- 172.21.15.84:0/580812513 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6454058be0 con 0x7f645c15e910 2023-09-13T08:25:13.564 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-09-13T08:25:13.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.566+0000 7f6463ea2700 1 -- 172.21.15.84:0/580812513 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f644006a580 msgr2=0x7f644006ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:13.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.566+0000 7f6463ea2700 1 --2- 172.21.15.84:0/580812513 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f644006a580 0x7f644006ca40 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f644c006ba0 tx=0x7f644c008040 comp rx=0 tx=0).stop 2023-09-13T08:25:13.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.566+0000 7f6463ea2700 1 -- 172.21.15.84:0/580812513 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f645c15e910 msgr2=0x7f645c15b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:13.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.566+0000 7f6463ea2700 1 --2- 172.21.15.84:0/580812513 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f645c15e910 0x7f645c15b940 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f645400b370 tx=0x7f6454004ad0 comp rx=0 tx=0).stop 2023-09-13T08:25:13.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.566+0000 7f6463ea2700 1 -- 172.21.15.84:0/580812513 shutdown_connections 2023-09-13T08:25:13.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.566+0000 7f6463ea2700 1 --2- 172.21.15.84:0/580812513 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f645c15e910 0x7f645c15b940 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:13.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.566+0000 7f6463ea2700 1 --2- 172.21.15.84:0/580812513 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f645c0ca8e0 0x7f645c156680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:13.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.566+0000 7f6463ea2700 1 --2- 172.21.15.84:0/580812513 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f644006a580 0x7f644006ca40 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:13.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.566+0000 7f6463ea2700 1 --2- 172.21.15.84:0/580812513 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f645c0cd590 0x7f645c15b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:13.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.566+0000 7f6463ea2700 1 -- 172.21.15.84:0/580812513 >> 172.21.15.84:0/580812513 conn(0x7f645c0cca70 msgr2=0x7f645c06e530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:13.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.566+0000 7f6463ea2700 1 -- 172.21.15.84:0/580812513 shutdown_connections 2023-09-13T08:25:13.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.566+0000 7f6463ea2700 1 -- 172.21.15.84:0/580812513 wait complete. 2023-09-13T08:25:13.579 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-13T08:25:13.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.701+0000 7f266b153700 1 Processor -- start 2023-09-13T08:25:13.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.701+0000 7f266b153700 1 -- start start 2023-09-13T08:25:13.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.702+0000 7f266b153700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f266415b4b0 0x7f26640ca640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:13.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.702+0000 7f266b153700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f266406a620 0x7f266406aab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:13.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.702+0000 7f266b153700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26640cc460 con 0x7f266406f700 2023-09-13T08:25:13.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.702+0000 7f266b153700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f266406fb80 con 0x7f266406a620 2023-09-13T08:25:13.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.702+0000 7f266b153700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f266406aff0 con 0x7f266415b4b0 2023-09-13T08:25:13.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.702+0000 7f2668eef700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f266415b4b0 0x7f26640ca640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:13.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.702+0000 7f26696f0700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f266406a620 0x7f266406aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:13.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.702+0000 7f2663fff700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f266406f700 0x7f26640cbd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.84:33044/0 (socket says 172.21.15.84:33044) 2023-09-13T08:25:13.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.702+0000 7f2663fff700 1 -- 172.21.15.84:0/4290873921 learned_addr learned my addr 172.21.15.84:0/4290873921 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:25:13.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.702+0000 7f26696f0700 1 --2- 172.21.15.84:0/4290873921 >> v2:172.21.15.161:3300/0 conn(0x7f266406a620 0x7f266406aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.84:40004/0 (socket says 172.21.15.84:40004) 2023-09-13T08:25:13.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.703+0000 7f26637fe700 1 -- 172.21.15.84:0/4290873921 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 588724018 0 0) 0x7f26640cc460 con 0x7f266406f700 2023-09-13T08:25:13.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.703+0000 7f26637fe700 1 -- 172.21.15.84:0/4290873921 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26540035b0 con 0x7f266406f700 2023-09-13T08:25:13.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.703+0000 7f2668eef700 1 -- 172.21.15.84:0/4290873921 >> v2:172.21.15.161:3300/0 conn(0x7f266406a620 msgr2=0x7f266406aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:13.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.703+0000 7f2668eef700 1 --2- 172.21.15.84:0/4290873921 >> v2:172.21.15.161:3300/0 conn(0x7f266406a620 0x7f266406aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:13.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.703+0000 7f2668eef700 1 -- 172.21.15.84:0/4290873921 >> v1:172.21.15.161:6789/0 conn(0x7f266406f700 legacy=0x7f26640cbd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:13.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.703+0000 7f2668eef700 1 -- 172.21.15.84:0/4290873921 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26640cacb0 con 0x7f266415b4b0 2023-09-13T08:25:13.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.703+0000 7f2668eef700 1 --2- 172.21.15.84:0/4290873921 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f266415b4b0 0x7f26640ca640 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2658009840 tx=0x7f2658009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=96388defdcfd3d02 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:13.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.703+0000 7f26637fe700 1 -- 172.21.15.84:0/4290873921 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2658011830 con 0x7f266415b4b0 2023-09-13T08:25:13.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.703+0000 7f26637fe700 1 -- 172.21.15.84:0/4290873921 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2658011990 con 0x7f266415b4b0 2023-09-13T08:25:13.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.703+0000 7f26637fe700 1 -- 172.21.15.84:0/4290873921 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2658011d20 con 0x7f266415b4b0 2023-09-13T08:25:13.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.704+0000 7f266b153700 1 -- 172.21.15.84:0/4290873921 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f266415b4b0 msgr2=0x7f26640ca640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:13.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.704+0000 7f266b153700 1 --2- 172.21.15.84:0/4290873921 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f266415b4b0 0x7f26640ca640 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2658009840 tx=0x7f2658009b50 comp rx=0 tx=0).stop 2023-09-13T08:25:13.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.704+0000 7f266b153700 1 -- 172.21.15.84:0/4290873921 shutdown_connections 2023-09-13T08:25:13.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.704+0000 7f266b153700 1 --2- 172.21.15.84:0/4290873921 >> v2:172.21.15.161:3300/0 conn(0x7f266406a620 0x7f266406aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:13.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.704+0000 7f266b153700 1 --2- 172.21.15.84:0/4290873921 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f266415b4b0 0x7f26640ca640 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:13.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.704+0000 7f266b153700 1 -- 172.21.15.84:0/4290873921 >> 172.21.15.84:0/4290873921 conn(0x7f26640cca70 msgr2=0x7f26640cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:13.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.704+0000 7f266b153700 1 -- 172.21.15.84:0/4290873921 shutdown_connections 2023-09-13T08:25:13.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.704+0000 7f266b153700 1 -- 172.21.15.84:0/4290873921 wait complete. 2023-09-13T08:25:13.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.705+0000 7f266b153700 1 Processor -- start 2023-09-13T08:25:13.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.705+0000 7f266b153700 1 -- start start 2023-09-13T08:25:13.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.706+0000 7f266b153700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f266406a620 0x7f266414f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:13.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.706+0000 7f266b153700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f266406f700 0x7f2664154da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:13.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.706+0000 7f266b153700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f266415b4b0 0x7f26640c7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:13.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.706+0000 7f266b153700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26641f0970 con 0x7f266415b4b0 2023-09-13T08:25:13.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.706+0000 7f266b153700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2664151430 con 0x7f266406a620 2023-09-13T08:25:13.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.706+0000 7f266b153700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2664152290 con 0x7f266406f700 2023-09-13T08:25:13.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.706+0000 7f26696f0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f266415b4b0 0x7f26640c7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:13.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.706+0000 7f26696f0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f266415b4b0 0x7f26640c7bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44234/0 (socket says 172.21.15.84:44234) 2023-09-13T08:25:13.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.706+0000 7f26696f0700 1 -- 172.21.15.84:0/3335147902 learned_addr learned my addr 172.21.15.84:0/3335147902 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:13.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.706+0000 7f2668eef700 1 --2- 172.21.15.84:0/3335147902 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f266406a620 0x7f266414f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:13.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.706+0000 7f2663fff700 1 --2- 172.21.15.84:0/3335147902 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f266406f700 0x7f2664154da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:13.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.706+0000 7f26696f0700 1 -- 172.21.15.84:0/3335147902 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f266406f700 msgr2=0x7f2664154da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:13.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.706+0000 7f26696f0700 1 --2- 172.21.15.84:0/3335147902 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f266406f700 0x7f2664154da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:13.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.706+0000 7f26696f0700 1 -- 172.21.15.84:0/3335147902 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f266406a620 msgr2=0x7f266414f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:13.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.706+0000 7f26696f0700 1 --2- 172.21.15.84:0/3335147902 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f266406a620 0x7f266414f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:13.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.706+0000 7f26696f0700 1 -- 172.21.15.84:0/3335147902 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26580094a0 con 0x7f266415b4b0 2023-09-13T08:25:13.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.706+0000 7f2668eef700 1 --2- 172.21.15.84:0/3335147902 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f266406a620 0x7f266414f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T08:25:13.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.706+0000 7f26696f0700 1 --2- 172.21.15.84:0/3335147902 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f266415b4b0 0x7f26640c7bd0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f265c00efc0 tx=0x7f265c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:13.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.707+0000 7f26617fa700 1 -- 172.21.15.84:0/3335147902 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f265c00cce0 con 0x7f266415b4b0 2023-09-13T08:25:13.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.707+0000 7f26617fa700 1 -- 172.21.15.84:0/3335147902 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f265c00f040 con 0x7f266415b4b0 2023-09-13T08:25:13.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.707+0000 7f266b153700 1 -- 172.21.15.84:0/3335147902 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2664152720 con 0x7f266415b4b0 2023-09-13T08:25:13.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.707+0000 7f26617fa700 1 -- 172.21.15.84:0/3335147902 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f265c014480 con 0x7f266415b4b0 2023-09-13T08:25:13.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.707+0000 7f266b153700 1 -- 172.21.15.84:0/3335147902 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2664151960 con 0x7f266415b4b0 2023-09-13T08:25:13.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.708+0000 7f266b153700 1 -- 172.21.15.84:0/3335147902 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f266404f200 con 0x7f266415b4b0 2023-09-13T08:25:13.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.708+0000 7f26617fa700 1 -- 172.21.15.84:0/3335147902 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f265c0145e0 con 0x7f266415b4b0 2023-09-13T08:25:13.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.708+0000 7f26617fa700 1 --2- 172.21.15.84:0/3335147902 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f264806a580 0x7f264806ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:13.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.709+0000 7f26617fa700 1 -- 172.21.15.84:0/3335147902 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f265c089920 con 0x7f266415b4b0 2023-09-13T08:25:13.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.709+0000 7f2668eef700 1 --2- 172.21.15.84:0/3335147902 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f264806a580 0x7f264806ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:13.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.709+0000 7f2668eef700 1 --2- 172.21.15.84:0/3335147902 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f264806a580 0x7f264806ca40 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2658000c00 tx=0x7f2658008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:13.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.713+0000 7f26617fa700 1 -- 172.21.15.84:0/3335147902 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f265c054c40 con 0x7f266415b4b0 2023-09-13T08:25:13.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.904+0000 7f266b153700 1 -- 172.21.15.84:0/3335147902 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f26641523d0 con 0x7f266415b4b0 2023-09-13T08:25:13.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.905+0000 7f26617fa700 1 -- 172.21.15.84:0/3335147902 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f265c0180a0 con 0x7f266415b4b0 2023-09-13T08:25:13.905 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-09-13T08:25:13.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.907+0000 7f266b153700 1 -- 172.21.15.84:0/3335147902 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f264806a580 msgr2=0x7f264806ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:13.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.907+0000 7f266b153700 1 --2- 172.21.15.84:0/3335147902 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f264806a580 0x7f264806ca40 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2658000c00 tx=0x7f2658008030 comp rx=0 tx=0).stop 2023-09-13T08:25:13.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.907+0000 7f266b153700 1 -- 172.21.15.84:0/3335147902 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f266415b4b0 msgr2=0x7f26640c7bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:13.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.907+0000 7f266b153700 1 --2- 172.21.15.84:0/3335147902 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f266415b4b0 0x7f26640c7bd0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f265c00efc0 tx=0x7f265c00c3a0 comp rx=0 tx=0).stop 2023-09-13T08:25:13.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.907+0000 7f266b153700 1 -- 172.21.15.84:0/3335147902 shutdown_connections 2023-09-13T08:25:13.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.907+0000 7f266b153700 1 --2- 172.21.15.84:0/3335147902 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f266415b4b0 0x7f26640c7bd0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:13.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.907+0000 7f266b153700 1 --2- 172.21.15.84:0/3335147902 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f264806a580 0x7f264806ca40 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:13.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.907+0000 7f266b153700 1 --2- 172.21.15.84:0/3335147902 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f266406a620 0x7f266414f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:13.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.907+0000 7f266b153700 1 --2- 172.21.15.84:0/3335147902 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f266406f700 0x7f2664154da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:13.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.907+0000 7f266b153700 1 -- 172.21.15.84:0/3335147902 >> 172.21.15.84:0/3335147902 conn(0x7f26640cca70 msgr2=0x7f266406e0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:13.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.907+0000 7f266b153700 1 -- 172.21.15.84:0/3335147902 shutdown_connections 2023-09-13T08:25:13.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:13.907+0000 7f266b153700 1 -- 172.21.15.84:0/3335147902 wait complete. 2023-09-13T08:25:13.919 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-09-13T08:25:14.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.042+0000 7f9bbd53e700 1 Processor -- start 2023-09-13T08:25:14.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.042+0000 7f9bbd53e700 1 -- start start 2023-09-13T08:25:14.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.043+0000 7f9bbd53e700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9bb815d570 0x7f9bb80b8d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:14.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.043+0000 7f9bbd53e700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bb815d950 con 0x7f9bb8160ff0 2023-09-13T08:25:14.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.043+0000 7f9bbd53e700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bb8161480 con 0x7f9bb80d0340 2023-09-13T08:25:14.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.043+0000 7f9bbd53e700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bb81616f0 con 0x7f9bb815d570 2023-09-13T08:25:14.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.043+0000 7f9bb67fc700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f9bb8160ff0 0x7f9bb80cfc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:46888/0 (socket says 172.21.15.84:46888) 2023-09-13T08:25:14.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.043+0000 7f9bb67fc700 1 -- 172.21.15.84:0/1616256982 learned_addr learned my addr 172.21.15.84:0/1616256982 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:25:14.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.043+0000 7f9bb6ffd700 1 --2- 172.21.15.84:0/1616256982 >> v2:172.21.15.161:3300/0 conn(0x7f9bb815d570 0x7f9bb80b8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:14.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.043+0000 7f9bb5ffb700 1 -- 172.21.15.84:0/1616256982 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1341968180 0 0) 0x7f9ba8001110 con 0x7f9bb8160ff0 2023-09-13T08:25:14.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.043+0000 7f9bb5ffb700 1 -- 172.21.15.84:0/1616256982 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ba00035b0 con 0x7f9bb8160ff0 2023-09-13T08:25:14.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.044+0000 7f9bb5ffb700 1 -- 172.21.15.84:0/1616256982 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 811403657 0 0) 0x7f9bb8161480 con 0x7f9bb80d0340 2023-09-13T08:25:14.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.044+0000 7f9bb5ffb700 1 -- 172.21.15.84:0/1616256982 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ba8001110 con 0x7f9bb80d0340 2023-09-13T08:25:14.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.044+0000 7f9bb5ffb700 1 -- 172.21.15.84:0/1616256982 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 720344136 0 0) 0x7f9ba00035b0 con 0x7f9bb8160ff0 2023-09-13T08:25:14.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.044+0000 7f9bb5ffb700 1 -- 172.21.15.84:0/1616256982 >> v2:172.21.15.161:3300/0 conn(0x7f9bb815d570 msgr2=0x7f9bb80b8d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:14.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.044+0000 7f9bb5ffb700 1 --2- 172.21.15.84:0/1616256982 >> v2:172.21.15.161:3300/0 conn(0x7f9bb815d570 0x7f9bb80b8d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:14.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.044+0000 7f9bb5ffb700 1 -- 172.21.15.84:0/1616256982 >> v1:172.21.15.161:6789/0 conn(0x7f9bb80d0340 legacy=0x7f9bb80d1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:14.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.044+0000 7f9bb5ffb700 1 -- 172.21.15.84:0/1616256982 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bb81619d0 con 0x7f9bb8160ff0 2023-09-13T08:25:14.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.044+0000 7f9bb5ffb700 1 -- 172.21.15.84:0/1616256982 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2302733408 0 0) 0x7f9ba8001800 con 0x7f9bb8160ff0 2023-09-13T08:25:14.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.044+0000 7f9bb5ffb700 1 -- 172.21.15.84:0/1616256982 >> v1:172.21.15.84:6789/0 conn(0x7f9bb8160ff0 legacy=0x7f9bb80cfc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:14.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.044+0000 7f9bb5ffb700 1 --2- 172.21.15.84:0/1616256982 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ba0003b90 0x7f9ba0003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:14.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.044+0000 7f9bb5ffb700 1 --2- 172.21.15.84:0/1616256982 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9ba0004850 0x7f9ba0004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:14.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.044+0000 7f9bb5ffb700 1 --2- 172.21.15.84:0/1616256982 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9ba0005210 0x7f9ba000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:14.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.044+0000 7f9bb5ffb700 1 -- 172.21.15.84:0/1616256982 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb81616f0 con 0x7f9ba0003b90 2023-09-13T08:25:14.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.044+0000 7f9bb5ffb700 1 -- 172.21.15.84:0/1616256982 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba000c090 con 0x7f9ba0005210 2023-09-13T08:25:14.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.044+0000 7f9bb5ffb700 1 -- 172.21.15.84:0/1616256982 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba000c250 con 0x7f9ba0004850 2023-09-13T08:25:14.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.044+0000 7f9bb6ffd700 1 --2- 172.21.15.84:0/1616256982 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ba0003b90 0x7f9ba0003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:14.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.044+0000 7f9bb67fc700 1 --2- 172.21.15.84:0/1616256982 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9ba0004850 0x7f9ba0004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:14.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.044+0000 7f9bb77fe700 1 --2- 172.21.15.84:0/1616256982 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9ba0005210 0x7f9ba000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:14.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.044+0000 7f9bb6ffd700 1 -- 172.21.15.84:0/1616256982 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9ba0004850 msgr2=0x7f9ba0004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:14.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.044+0000 7f9bb6ffd700 1 --2- 172.21.15.84:0/1616256982 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9ba0004850 0x7f9ba0004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:14.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.044+0000 7f9bb6ffd700 1 -- 172.21.15.84:0/1616256982 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9ba0005210 msgr2=0x7f9ba000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:14.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.044+0000 7f9bb6ffd700 1 --2- 172.21.15.84:0/1616256982 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9ba0005210 0x7f9ba000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:14.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.044+0000 7f9bb77fe700 1 -- 172.21.15.84:0/1616256982 reap_dead start 2023-09-13T08:25:14.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.044+0000 7f9bb6ffd700 1 -- 172.21.15.84:0/1616256982 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ba00035b0 con 0x7f9ba0003b90 2023-09-13T08:25:14.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.044+0000 7f9bb67fc700 1 --2- 172.21.15.84:0/1616256982 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9ba0004850 0x7f9ba0004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T08:25:14.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.044+0000 7f9bb6ffd700 1 --2- 172.21.15.84:0/1616256982 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ba0003b90 0x7f9ba0003f90 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f9bac009b60 tx=0x7f9ba0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b931eddd1529a409 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:14.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.044+0000 7f9bb5ffb700 1 -- 172.21.15.84:0/1616256982 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bac00e6c0 con 0x7f9ba0003b90 2023-09-13T08:25:14.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.044+0000 7f9bb5ffb700 1 -- 172.21.15.84:0/1616256982 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bac00e820 con 0x7f9ba0003b90 2023-09-13T08:25:14.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.044+0000 7f9bb5ffb700 1 -- 172.21.15.84:0/1616256982 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bac00eb90 con 0x7f9ba0003b90 2023-09-13T08:25:14.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.045+0000 7f9bbd53e700 1 -- 172.21.15.84:0/1616256982 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ba0003b90 msgr2=0x7f9ba0003f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:14.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.045+0000 7f9bbd53e700 1 --2- 172.21.15.84:0/1616256982 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ba0003b90 0x7f9ba0003f90 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f9bac009b60 tx=0x7f9ba0005880 comp rx=0 tx=0).stop 2023-09-13T08:25:14.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.045+0000 7f9bbd53e700 1 -- 172.21.15.84:0/1616256982 shutdown_connections 2023-09-13T08:25:14.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.045+0000 7f9bbd53e700 1 --2- 172.21.15.84:0/1616256982 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ba0003b90 0x7f9ba0003f90 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:14.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.045+0000 7f9bbd53e700 1 -- 172.21.15.84:0/1616256982 >> 172.21.15.84:0/1616256982 conn(0x7f9bb806b0d0 msgr2=0x7f9bb806b4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:14.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.045+0000 7f9bbd53e700 1 -- 172.21.15.84:0/1616256982 shutdown_connections 2023-09-13T08:25:14.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.045+0000 7f9bbd53e700 1 -- 172.21.15.84:0/1616256982 wait complete. 2023-09-13T08:25:14.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.046+0000 7f9bbd53e700 1 Processor -- start 2023-09-13T08:25:14.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.046+0000 7f9bbd53e700 1 -- start start 2023-09-13T08:25:14.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.047+0000 7f9bbd53e700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9ba0003b90 0x7f9bb81f2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:14.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.047+0000 7f9bbd53e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9bb815ae50 0x7f9bb815b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:14.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.047+0000 7f9bbd53e700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9bb81488e0 0x7f9bb8148d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:14.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.047+0000 7f9bbd53e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb815c470 con 0x7f9bb815ae50 2023-09-13T08:25:14.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.047+0000 7f9bbd53e700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb81f2b40 con 0x7f9bb81488e0 2023-09-13T08:25:14.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.047+0000 7f9bbd53e700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb815b8f0 con 0x7f9ba0003b90 2023-09-13T08:25:14.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.047+0000 7f9bb67fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9bb815ae50 0x7f9bb815b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:14.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.047+0000 7f9bb67fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9bb815ae50 0x7f9bb815b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44254/0 (socket says 172.21.15.84:44254) 2023-09-13T08:25:14.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.047+0000 7f9bb67fc700 1 -- 172.21.15.84:0/740548493 learned_addr learned my addr 172.21.15.84:0/740548493 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:14.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.047+0000 7f9bb6ffd700 1 --2- 172.21.15.84:0/740548493 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9ba0003b90 0x7f9bb81f2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:14.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.047+0000 7f9bb67fc700 1 -- 172.21.15.84:0/740548493 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9ba0003b90 msgr2=0x7f9bb81f2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:14.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.047+0000 7f9bb67fc700 1 --2- 172.21.15.84:0/740548493 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9ba0003b90 0x7f9bb81f2600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:14.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.047+0000 7f9bb77fe700 1 --2- 172.21.15.84:0/740548493 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9bb81488e0 0x7f9bb8148d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:14.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.047+0000 7f9bb67fc700 1 -- 172.21.15.84:0/740548493 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9bb81488e0 msgr2=0x7f9bb8148d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:14.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.047+0000 7f9bb67fc700 1 --2- 172.21.15.84:0/740548493 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9bb81488e0 0x7f9bb8148d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:14.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.047+0000 7f9bb67fc700 1 -- 172.21.15.84:0/740548493 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bb815bbd0 con 0x7f9bb815ae50 2023-09-13T08:25:14.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.048+0000 7f9bb67fc700 1 --2- 172.21.15.84:0/740548493 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9bb815ae50 0x7f9bb815b2d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f9ba8007280 tx=0x7f9ba8007640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:14.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.048+0000 7f9b9f7fe700 1 -- 172.21.15.84:0/740548493 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba800e5f0 con 0x7f9bb815ae50 2023-09-13T08:25:14.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.048+0000 7f9b9f7fe700 1 -- 172.21.15.84:0/740548493 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ba800e750 con 0x7f9bb815ae50 2023-09-13T08:25:14.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.048+0000 7f9bbd53e700 1 -- 172.21.15.84:0/740548493 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bb815beb0 con 0x7f9bb815ae50 2023-09-13T08:25:14.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.048+0000 7f9b9f7fe700 1 -- 172.21.15.84:0/740548493 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba800eae0 con 0x7f9bb815ae50 2023-09-13T08:25:14.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.048+0000 7f9bbd53e700 1 -- 172.21.15.84:0/740548493 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bb814ad10 con 0x7f9bb815ae50 2023-09-13T08:25:14.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.049+0000 7f9bbd53e700 1 -- 172.21.15.84:0/740548493 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bb804f200 con 0x7f9bb815ae50 2023-09-13T08:25:14.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.049+0000 7f9b9f7fe700 1 -- 172.21.15.84:0/740548493 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f9ba801d460 con 0x7f9bb815ae50 2023-09-13T08:25:14.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.050+0000 7f9b9f7fe700 1 --2- 172.21.15.84:0/740548493 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f9ba406a580 0x7f9ba406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:14.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.050+0000 7f9b9f7fe700 1 -- 172.21.15.84:0/740548493 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9ba8089810 con 0x7f9bb815ae50 2023-09-13T08:25:14.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.050+0000 7f9bb6ffd700 1 --2- 172.21.15.84:0/740548493 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f9ba406a580 0x7f9ba406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:14.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.050+0000 7f9bb6ffd700 1 --2- 172.21.15.84:0/740548493 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f9ba406a580 0x7f9ba406ca40 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9bb8158c10 tx=0x7f9bac008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:14.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.053+0000 7f9b9f7fe700 1 -- 172.21.15.84:0/740548493 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f9ba8054aa0 con 0x7f9bb815ae50 2023-09-13T08:25:14.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.241+0000 7f9bbd53e700 1 -- 172.21.15.84:0/740548493 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f9bb815d950 con 0x7f9bb815ae50 2023-09-13T08:25:14.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.242+0000 7f9b9f7fe700 1 -- 172.21.15.84:0/740548493 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7f9bb815d950 con 0x7f9bb815ae50 2023-09-13T08:25:14.242 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-09-13T08:25:14.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.244+0000 7f9bbd53e700 1 -- 172.21.15.84:0/740548493 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f9ba406a580 msgr2=0x7f9ba406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:14.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.244+0000 7f9bbd53e700 1 --2- 172.21.15.84:0/740548493 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f9ba406a580 0x7f9ba406ca40 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9bb8158c10 tx=0x7f9bac008030 comp rx=0 tx=0).stop 2023-09-13T08:25:14.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.244+0000 7f9bbd53e700 1 -- 172.21.15.84:0/740548493 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9bb815ae50 msgr2=0x7f9bb815b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:14.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.244+0000 7f9bbd53e700 1 --2- 172.21.15.84:0/740548493 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9bb815ae50 0x7f9bb815b2d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f9ba8007280 tx=0x7f9ba8007640 comp rx=0 tx=0).stop 2023-09-13T08:25:14.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.244+0000 7f9bbd53e700 1 -- 172.21.15.84:0/740548493 shutdown_connections 2023-09-13T08:25:14.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.244+0000 7f9bbd53e700 1 --2- 172.21.15.84:0/740548493 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f9ba406a580 0x7f9ba406ca40 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:14.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.244+0000 7f9bbd53e700 1 --2- 172.21.15.84:0/740548493 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9bb81488e0 0x7f9bb8148d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:14.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.244+0000 7f9bbd53e700 1 --2- 172.21.15.84:0/740548493 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9ba0003b90 0x7f9bb81f2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:14.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.244+0000 7f9bbd53e700 1 --2- 172.21.15.84:0/740548493 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9bb815ae50 0x7f9bb815b2d0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:14.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.244+0000 7f9bbd53e700 1 -- 172.21.15.84:0/740548493 >> 172.21.15.84:0/740548493 conn(0x7f9bb806b0d0 msgr2=0x7f9bb80b6370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:14.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.244+0000 7f9bbd53e700 1 -- 172.21.15.84:0/740548493 shutdown_connections 2023-09-13T08:25:14.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.244+0000 7f9bbd53e700 1 -- 172.21.15.84:0/740548493 wait complete. 2023-09-13T08:25:14.256 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T08:25:14.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.375+0000 7f6ecfab4700 1 Processor -- start 2023-09-13T08:25:14.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.375+0000 7f6ecfab4700 1 -- start start 2023-09-13T08:25:14.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.376+0000 7f6ecfab4700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6ec80cc340 0x7f6ec80713b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:14.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.376+0000 7f6ecfab4700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6ec80718f0 0x7f6ec815afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:14.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.376+0000 7f6ecfab4700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ec815b690 con 0x7f6ec815eb80 2023-09-13T08:25:14.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.376+0000 7f6ecfab4700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ec815b970 con 0x7f6ec80cc340 2023-09-13T08:25:14.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.376+0000 7f6ecfab4700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec8071da0 con 0x7f6ec80718f0 2023-09-13T08:25:14.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.376+0000 7f6ecd850700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6ec80cc340 0x7f6ec80713b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:14.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.376+0000 7f6ecd850700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6ec80cc340 0x7f6ec80713b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44260/0 (socket says 172.21.15.84:44260) 2023-09-13T08:25:14.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.376+0000 7f6ecd04f700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f6ec815eb80 0x7f6ec815a8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:46908/0 (socket says 172.21.15.84:46908) 2023-09-13T08:25:14.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.376+0000 7f6ecd850700 1 -- 172.21.15.84:0/3113778641 learned_addr learned my addr 172.21.15.84:0/3113778641 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:14.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.376+0000 7f6ece051700 1 --2- 172.21.15.84:0/3113778641 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6ec80718f0 0x7f6ec815afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:14.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.376+0000 7f6ecd850700 1 -- 172.21.15.84:0/3113778641 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6ec80718f0 msgr2=0x7f6ec815afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:14.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.376+0000 7f6ecd850700 1 --2- 172.21.15.84:0/3113778641 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6ec80718f0 0x7f6ec815afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:14.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.376+0000 7f6ecd850700 1 -- 172.21.15.84:0/3113778641 >> v1:172.21.15.84:6789/0 conn(0x7f6ec815eb80 legacy=0x7f6ec815a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:14.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.376+0000 7f6ecd850700 1 -- 172.21.15.84:0/3113778641 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ec815e0a0 con 0x7f6ec80cc340 2023-09-13T08:25:14.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.376+0000 7f6ecc84e700 1 -- 172.21.15.84:0/3113778641 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2036061689 0 0) 0x7f6ec815b690 con 0x7f6ec815eb80 2023-09-13T08:25:14.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.377+0000 7f6ecd850700 1 --2- 172.21.15.84:0/3113778641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ec80cc340 0x7f6ec80713b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f6eb800bbc0 tx=0x7f6eb800bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47f0c06c7e107541 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:14.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.377+0000 7f6ecc84e700 1 -- 172.21.15.84:0/3113778641 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb800dd50 con 0x7f6ec80cc340 2023-09-13T08:25:14.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.377+0000 7f6ecc84e700 1 -- 172.21.15.84:0/3113778641 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eb8010470 con 0x7f6ec80cc340 2023-09-13T08:25:14.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.377+0000 7f6ecc84e700 1 -- 172.21.15.84:0/3113778641 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb8010800 con 0x7f6ec80cc340 2023-09-13T08:25:14.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.377+0000 7f6ecfab4700 1 -- 172.21.15.84:0/3113778641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ec80cc340 msgr2=0x7f6ec80713b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:14.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.377+0000 7f6ecfab4700 1 --2- 172.21.15.84:0/3113778641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ec80cc340 0x7f6ec80713b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f6eb800bbc0 tx=0x7f6eb800bed0 comp rx=0 tx=0).stop 2023-09-13T08:25:14.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.377+0000 7f6ecfab4700 1 -- 172.21.15.84:0/3113778641 shutdown_connections 2023-09-13T08:25:14.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.377+0000 7f6ecfab4700 1 --2- 172.21.15.84:0/3113778641 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6ec80718f0 0x7f6ec815afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:14.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.377+0000 7f6ecfab4700 1 --2- 172.21.15.84:0/3113778641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ec80cc340 0x7f6ec80713b0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:14.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.377+0000 7f6ecfab4700 1 -- 172.21.15.84:0/3113778641 >> 172.21.15.84:0/3113778641 conn(0x7f6ec80d00c0 msgr2=0x7f6ec80d04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:14.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.377+0000 7f6ecfab4700 1 -- 172.21.15.84:0/3113778641 shutdown_connections 2023-09-13T08:25:14.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.377+0000 7f6ecfab4700 1 -- 172.21.15.84:0/3113778641 wait complete. 2023-09-13T08:25:14.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.379+0000 7f6ecfab4700 1 Processor -- start 2023-09-13T08:25:14.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.379+0000 7f6ecfab4700 1 -- start start 2023-09-13T08:25:14.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.379+0000 7f6ecfab4700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ec80718f0 0x7f6ec8151900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:14.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.379+0000 7f6ecfab4700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6ec80cc340 0x7f6ec80c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:14.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.379+0000 7f6ecfab4700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ec815eb80 0x7f6ec81593e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:14.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.379+0000 7f6ecfab4700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec80b3410 con 0x7f6ec80718f0 2023-09-13T08:25:14.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.379+0000 7f6ecfab4700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec8151e40 con 0x7f6ec815eb80 2023-09-13T08:25:14.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.379+0000 7f6ecfab4700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec80b5a70 con 0x7f6ec80cc340 2023-09-13T08:25:14.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.379+0000 7f6ecd850700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ec80718f0 0x7f6ec8151900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:14.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.379+0000 7f6ecd850700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ec80718f0 0x7f6ec8151900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44266/0 (socket says 172.21.15.84:44266) 2023-09-13T08:25:14.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.379+0000 7f6ecd850700 1 -- 172.21.15.84:0/2024514158 learned_addr learned my addr 172.21.15.84:0/2024514158 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:14.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.380+0000 7f6ecd850700 1 -- 172.21.15.84:0/2024514158 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6ec80cc340 msgr2=0x7f6ec80c86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:14.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.380+0000 7f6ecd850700 1 --2- 172.21.15.84:0/2024514158 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6ec80cc340 0x7f6ec80c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:14.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.380+0000 7f6ecd850700 1 -- 172.21.15.84:0/2024514158 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ec815eb80 msgr2=0x7f6ec81593e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:14.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.380+0000 7f6ecd850700 1 --2- 172.21.15.84:0/2024514158 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ec815eb80 0x7f6ec81593e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:14.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.380+0000 7f6ecd850700 1 -- 172.21.15.84:0/2024514158 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eb800b7f0 con 0x7f6ec80718f0 2023-09-13T08:25:14.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.380+0000 7f6ecd850700 1 --2- 172.21.15.84:0/2024514158 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ec80718f0 0x7f6ec8151900 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f6ec80d0de0 tx=0x7f6eb8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:14.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.380+0000 7f6ebe7fc700 1 -- 172.21.15.84:0/2024514158 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb8003bb0 con 0x7f6ec80718f0 2023-09-13T08:25:14.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.380+0000 7f6ebe7fc700 1 -- 172.21.15.84:0/2024514158 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eb8003d10 con 0x7f6ec80718f0 2023-09-13T08:25:14.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.380+0000 7f6ecfab4700 1 -- 172.21.15.84:0/2024514158 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ec80b2d50 con 0x7f6ec80718f0 2023-09-13T08:25:14.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.380+0000 7f6ebe7fc700 1 -- 172.21.15.84:0/2024514158 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb80107e0 con 0x7f6ec80718f0 2023-09-13T08:25:14.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.380+0000 7f6ecfab4700 1 -- 172.21.15.84:0/2024514158 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ec80b5d50 con 0x7f6ec80718f0 2023-09-13T08:25:14.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.381+0000 7f6ecfab4700 1 -- 172.21.15.84:0/2024514158 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ec8154e30 con 0x7f6ec80718f0 2023-09-13T08:25:14.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.381+0000 7f6ebe7fc700 1 -- 172.21.15.84:0/2024514158 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f6eb8019400 con 0x7f6ec80718f0 2023-09-13T08:25:14.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.382+0000 7f6ebe7fc700 1 --2- 172.21.15.84:0/2024514158 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f6eac06a580 0x7f6eac06ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:14.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.382+0000 7f6ebe7fc700 1 -- 172.21.15.84:0/2024514158 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6eb808a930 con 0x7f6ec80718f0 2023-09-13T08:25:14.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.382+0000 7f6ecd04f700 1 --2- 172.21.15.84:0/2024514158 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f6eac06a580 0x7f6eac06ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:14.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.382+0000 7f6ecd04f700 1 --2- 172.21.15.84:0/2024514158 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f6eac06a580 0x7f6eac06ca40 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6ec80ced40 tx=0x7f6ec40079f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:14.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.386+0000 7f6ebe7fc700 1 -- 172.21.15.84:0/2024514158 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f6ec8154e30 con 0x7f6ec80718f0 2023-09-13T08:25:14.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.617+0000 7f6ecfab4700 1 -- 172.21.15.84:0/2024514158 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6ec8154e30 con 0x7f6ec80718f0 2023-09-13T08:25:14.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.618+0000 7f6ebe7fc700 1 -- 172.21.15.84:0/2024514158 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4909 (secure 0 0 0) 0x7f6ec8154e30 con 0x7f6ec80718f0 2023-09-13T08:25:14.618 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:25:14.619 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/3581118217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6833","nonce":3581118217},{"type":"v1","addr":"172.21.15.161:6835","nonce":3581118217}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4296,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/566416855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":566416855},{"type":"v1","addr":"172.21.15.84:6835","nonce":566416855}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4299,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/482729238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":482729238},{"type":"v1","addr":"172.21.15.84:6837","nonce":482729238}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T08:24:42.132788+0000","modified":"2023-09-13T08:25:05.211766+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4314},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4314":{"gid":4314,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.161:6834/2524298549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":2524298549},{"type":"v1","addr":"172.21.15.161:6834","nonce":2524298549}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-13T08:25:14.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.620+0000 7f6ecfab4700 1 -- 172.21.15.84:0/2024514158 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f6eac06a580 msgr2=0x7f6eac06ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:14.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.620+0000 7f6ecfab4700 1 --2- 172.21.15.84:0/2024514158 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f6eac06a580 0x7f6eac06ca40 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6ec80ced40 tx=0x7f6ec40079f0 comp rx=0 tx=0).stop 2023-09-13T08:25:14.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.620+0000 7f6ecfab4700 1 -- 172.21.15.84:0/2024514158 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ec80718f0 msgr2=0x7f6ec8151900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:14.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.620+0000 7f6ecfab4700 1 --2- 172.21.15.84:0/2024514158 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ec80718f0 0x7f6ec8151900 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f6ec80d0de0 tx=0x7f6eb8004750 comp rx=0 tx=0).stop 2023-09-13T08:25:14.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.620+0000 7f6ecfab4700 1 -- 172.21.15.84:0/2024514158 shutdown_connections 2023-09-13T08:25:14.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.620+0000 7f6ecfab4700 1 --2- 172.21.15.84:0/2024514158 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f6eac06a580 0x7f6eac06ca40 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:14.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.620+0000 7f6ecfab4700 1 --2- 172.21.15.84:0/2024514158 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ec815eb80 0x7f6ec81593e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:14.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.620+0000 7f6ecfab4700 1 --2- 172.21.15.84:0/2024514158 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ec80718f0 0x7f6ec8151900 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:14.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.620+0000 7f6ecfab4700 1 --2- 172.21.15.84:0/2024514158 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6ec80cc340 0x7f6ec80c86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:14.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.620+0000 7f6ecfab4700 1 -- 172.21.15.84:0/2024514158 >> 172.21.15.84:0/2024514158 conn(0x7f6ec80d00c0 msgr2=0x7f6ec8153760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:14.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.620+0000 7f6ecfab4700 1 -- 172.21.15.84:0/2024514158 shutdown_connections 2023-09-13T08:25:14.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.620+0000 7f6ecfab4700 1 -- 172.21.15.84:0/2024514158 wait complete. 2023-09-13T08:25:14.623 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 9 2023-09-13T08:25:14.632 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T08:25:14.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.752+0000 7fabc619e700 1 Processor -- start 2023-09-13T08:25:14.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.752+0000 7fabc619e700 1 -- start start 2023-09-13T08:25:14.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.753+0000 7fabc619e700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fabc00d2ba0 0x7fabc0161a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:14.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.753+0000 7fabc619e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fabc00ce230 0x7fabc00cfa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:14.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.753+0000 7fabc619e700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fabc00cff60 0x7fabc00b84f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:14.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.753+0000 7fabc619e700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabc015e390 con 0x7fabc00ce230 2023-09-13T08:25:14.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.753+0000 7fabc619e700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabc015daa0 con 0x7fabc00d2ba0 2023-09-13T08:25:14.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.753+0000 7fabc619e700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabc015dd40 con 0x7fabc00cff60 2023-09-13T08:25:14.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.753+0000 7fabbeffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fabc00ce230 0x7fabc00cfa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:14.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.753+0000 7fabbeffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fabc00ce230 0x7fabc00cfa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44276/0 (socket says 172.21.15.84:44276) 2023-09-13T08:25:14.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.753+0000 7fabbeffd700 1 -- 172.21.15.84:0/1016728071 learned_addr learned my addr 172.21.15.84:0/1016728071 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:14.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.753+0000 7fabbffff700 1 --2- 172.21.15.84:0/1016728071 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fabc00cff60 0x7fabc00b84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:14.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.753+0000 7fabbf7fe700 1 --2- 172.21.15.84:0/1016728071 >> v2:172.21.15.161:3300/0 conn(0x7fabc00d2ba0 0x7fabc0161a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:14.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.753+0000 7fabbeffd700 1 -- 172.21.15.84:0/1016728071 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fabc00cff60 msgr2=0x7fabc00b84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:14.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.753+0000 7fabbeffd700 1 --2- 172.21.15.84:0/1016728071 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fabc00cff60 0x7fabc00b84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:14.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.753+0000 7fabbeffd700 1 -- 172.21.15.84:0/1016728071 >> v2:172.21.15.161:3300/0 conn(0x7fabc00d2ba0 msgr2=0x7fabc0161a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:14.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.753+0000 7fabbeffd700 1 --2- 172.21.15.84:0/1016728071 >> v2:172.21.15.161:3300/0 conn(0x7fabc00d2ba0 0x7fabc0161a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:14.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.753+0000 7fabbeffd700 1 -- 172.21.15.84:0/1016728071 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabc015e020 con 0x7fabc00ce230 2023-09-13T08:25:14.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.753+0000 7fabbeffd700 1 --2- 172.21.15.84:0/1016728071 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fabc00ce230 0x7fabc00cfa20 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fabc006c170 tx=0x7fabb4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36300d4440ae9e2f server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:14.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.754+0000 7fabbe7fc700 1 -- 172.21.15.84:0/1016728071 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb4011830 con 0x7fabc00ce230 2023-09-13T08:25:14.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.754+0000 7fabbe7fc700 1 -- 172.21.15.84:0/1016728071 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabb4011990 con 0x7fabc00ce230 2023-09-13T08:25:14.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.754+0000 7fabbe7fc700 1 -- 172.21.15.84:0/1016728071 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb4011d20 con 0x7fabc00ce230 2023-09-13T08:25:14.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.754+0000 7fabc619e700 1 -- 172.21.15.84:0/1016728071 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fabc00ce230 msgr2=0x7fabc00cfa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:14.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.754+0000 7fabc619e700 1 --2- 172.21.15.84:0/1016728071 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fabc00ce230 0x7fabc00cfa20 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fabc006c170 tx=0x7fabb4009bd0 comp rx=0 tx=0).stop 2023-09-13T08:25:14.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.754+0000 7fabc619e700 1 -- 172.21.15.84:0/1016728071 shutdown_connections 2023-09-13T08:25:14.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.754+0000 7fabc619e700 1 --2- 172.21.15.84:0/1016728071 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fabc00cff60 0x7fabc00b84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:14.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.754+0000 7fabc619e700 1 --2- 172.21.15.84:0/1016728071 >> v2:172.21.15.161:3300/0 conn(0x7fabc00d2ba0 0x7fabc0161a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:14.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.754+0000 7fabc619e700 1 --2- 172.21.15.84:0/1016728071 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fabc00ce230 0x7fabc00cfa20 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:14.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.754+0000 7fabc619e700 1 -- 172.21.15.84:0/1016728071 >> 172.21.15.84:0/1016728071 conn(0x7fabc006b130 msgr2=0x7fabc006b540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:14.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.754+0000 7fabc619e700 1 -- 172.21.15.84:0/1016728071 shutdown_connections 2023-09-13T08:25:14.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.754+0000 7fabc619e700 1 -- 172.21.15.84:0/1016728071 wait complete. 2023-09-13T08:25:14.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.756+0000 7fabc619e700 1 Processor -- start 2023-09-13T08:25:14.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.756+0000 7fabc619e700 1 -- start start 2023-09-13T08:25:14.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.757+0000 7fabc619e700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fabc00ce230 0x7fabc015e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:14.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.757+0000 7fabc619e700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fabc00cff60 0x7fabc00c8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:14.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.757+0000 7fabc619e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fabc00d2ba0 0x7fabc01601c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:14.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.757+0000 7fabc619e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabc015f050 con 0x7fabc00d2ba0 2023-09-13T08:25:14.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.757+0000 7fabc619e700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabc015f330 con 0x7fabc00ce230 2023-09-13T08:25:14.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.757+0000 7fabc619e700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabc015f610 con 0x7fabc00cff60 2023-09-13T08:25:14.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.757+0000 7fabbffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fabc00d2ba0 0x7fabc01601c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:14.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.757+0000 7fabbffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fabc00d2ba0 0x7fabc01601c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44284/0 (socket says 172.21.15.84:44284) 2023-09-13T08:25:14.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.757+0000 7fabbffff700 1 -- 172.21.15.84:0/2349809062 learned_addr learned my addr 172.21.15.84:0/2349809062 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:14.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.757+0000 7fabbf7fe700 1 --2- 172.21.15.84:0/2349809062 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fabc00ce230 0x7fabc015e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:14.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.757+0000 7fabbeffd700 1 --2- 172.21.15.84:0/2349809062 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fabc00cff60 0x7fabc00c8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:14.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.757+0000 7fabbffff700 1 -- 172.21.15.84:0/2349809062 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fabc00cff60 msgr2=0x7fabc00c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:14.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.757+0000 7fabbffff700 1 --2- 172.21.15.84:0/2349809062 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fabc00cff60 0x7fabc00c8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:14.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.757+0000 7fabbffff700 1 -- 172.21.15.84:0/2349809062 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fabc00ce230 msgr2=0x7fabc015e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:14.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.757+0000 7fabbffff700 1 --2- 172.21.15.84:0/2349809062 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fabc00ce230 0x7fabc015e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:14.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.757+0000 7fabbffff700 1 -- 172.21.15.84:0/2349809062 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabb4009550 con 0x7fabc00d2ba0 2023-09-13T08:25:14.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.757+0000 7fabbffff700 1 --2- 172.21.15.84:0/2349809062 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fabc00d2ba0 0x7fabc01601c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fabb800efc0 tx=0x7fabb800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:14.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.757+0000 7faba7fff700 1 -- 172.21.15.84:0/2349809062 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb8009ea0 con 0x7fabc00d2ba0 2023-09-13T08:25:14.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.757+0000 7faba7fff700 1 -- 172.21.15.84:0/2349809062 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabb800f040 con 0x7fabc00d2ba0 2023-09-13T08:25:14.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.757+0000 7fabc619e700 1 -- 172.21.15.84:0/2349809062 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabc015f8f0 con 0x7fabc00d2ba0 2023-09-13T08:25:14.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.757+0000 7faba7fff700 1 -- 172.21.15.84:0/2349809062 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb800ced0 con 0x7fabc00d2ba0 2023-09-13T08:25:14.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.757+0000 7fabc619e700 1 -- 172.21.15.84:0/2349809062 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabc015ed60 con 0x7fabc00d2ba0 2023-09-13T08:25:14.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.758+0000 7fabc619e700 1 -- 172.21.15.84:0/2349809062 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabc015fe10 con 0x7fabc00d2ba0 2023-09-13T08:25:14.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.759+0000 7faba7fff700 1 -- 172.21.15.84:0/2349809062 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fabb8014480 con 0x7fabc00d2ba0 2023-09-13T08:25:14.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.759+0000 7faba7fff700 1 --2- 172.21.15.84:0/2349809062 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fabac06a5d0 0x7fabac06ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:14.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.759+0000 7faba7fff700 1 -- 172.21.15.84:0/2349809062 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fabb80893c0 con 0x7fabc00d2ba0 2023-09-13T08:25:14.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.759+0000 7fabbf7fe700 1 --2- 172.21.15.84:0/2349809062 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fabac06a5d0 0x7fabac06ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:14.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.760+0000 7fabbf7fe700 1 --2- 172.21.15.84:0/2349809062 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fabac06a5d0 0x7fabac06ca90 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fabb0009ac0 tx=0x7fabb0009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:14.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.764+0000 7faba7fff700 1 -- 172.21.15.84:0/2349809062 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fabc015fe10 con 0x7fabc00d2ba0 2023-09-13T08:25:14.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.957+0000 7fabc619e700 1 -- 172.21.15.84:0/2349809062 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fabc015fe10 con 0x7fabc00d2ba0 2023-09-13T08:25:14.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.958+0000 7faba7fff700 1 -- 172.21.15.84:0/2349809062 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18322 (secure 0 0 0) 0x7fabc015fe10 con 0x7fabc00d2ba0 2023-09-13T08:25:14.958 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:25:14.958 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":24,"fsid":"0107440b-b634-42c5-a643-5d31ea826116","created":"2023-09-13T08:24:16.931917+0000","modified":"2023-09-13T08:24:47.176259+0000","last_up_change":"2023-09-13T08:24:28.422631+0000","last_in_change":"2023-09-13T08:24:19.425578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T08:24:28.583720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-13T08:24:39.862832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-13T08:24:41.145511+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-13T08:24:44.775160+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4a53ec12-1469-4356-b4e1-2b8fc9b7c0f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6817","nonce":1599532366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6819","nonce":1599532366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6823","nonce":1599532366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6821","nonce":1599532366}]},"public_addr":"172.21.15.84:6817/1599532366","cluster_addr":"172.21.15.84:6819/1599532366","heartbeat_back_addr":"172.21.15.84:6823/1599532366","heartbeat_front_addr":"172.21.15.84:6821/1599532366","state":["exists","up"]},{"osd":1,"uuid":"11e964a0-b80c-4afc-bfbf-e2067969db29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6825","nonce":461860977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6827","nonce":461860977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6831","nonce":461860977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6829","nonce":461860977}]},"public_addr":"172.21.15.84:6825/461860977","cluster_addr":"172.21.15.84:6827/461860977","heartbeat_back_addr":"172.21.15.84:6831/461860977","heartbeat_front_addr":"172.21.15.84:6829/461860977","state":["exists","up"]},{"osd":2,"uuid":"3ce74529-4dd1-44c7-9576-968f5fdc0c25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6809","nonce":1168316165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6811","nonce":1168316165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6815","nonce":1168316165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6813","nonce":1168316165}]},"public_addr":"172.21.15.84:6809/1168316165","cluster_addr":"172.21.15.84:6811/1168316165","heartbeat_back_addr":"172.21.15.84:6815/1168316165","heartbeat_front_addr":"172.21.15.84:6813/1168316165","state":["exists","up"]},{"osd":3,"uuid":"460cb5c5-590a-4d06-a4d9-5bac2fdf33b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6801","nonce":1661609810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6803","nonce":1661609810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6807","nonce":1661609810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6805","nonce":1661609810}]},"public_addr":"172.21.15.84:6801/1661609810","cluster_addr":"172.21.15.84:6803/1661609810","heartbeat_back_addr":"172.21.15.84:6807/1661609810","heartbeat_front_addr":"172.21.15.84:6805/1661609810","state":["exists","up"]},{"osd":4,"uuid":"bf237dd0-3ebd-44b5-8078-24a63e00d792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6801","nonce":1303562374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6803","nonce":1303562374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6807","nonce":1303562374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6805","nonce":1303562374}]},"public_addr":"172.21.15.161:6801/1303562374","cluster_addr":"172.21.15.161:6803/1303562374","heartbeat_back_addr":"172.21.15.161:6807/1303562374","heartbeat_front_addr":"172.21.15.161:6805/1303562374","state":["exists","up"]},{"osd":5,"uuid":"e1e538e0-5844-456b-8c6e-434d3a914af1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6818","nonce":961120854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6822","nonce":961120854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6830","nonce":961120854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6826","nonce":961120854}]},"public_addr":"172.21.15.161:6818/961120854","cluster_addr":"172.21.15.161:6822/961120854","heartbeat_back_addr":"172.21.15.161:6830/961120854","heartbeat_front_addr":"172.21.15.161:6826/961120854","state":["exists","up"]},{"osd":6,"uuid":"5cb1785e-960f-4dd4-b295-9e21b2c3f875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6809","nonce":980533466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6811","nonce":980533466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6815","nonce":980533466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6813","nonce":980533466}]},"public_addr":"172.21.15.161:6809/980533466","cluster_addr":"172.21.15.161:6811/980533466","heartbeat_back_addr":"172.21.15.161:6815/980533466","heartbeat_front_addr":"172.21.15.161:6813/980533466","state":["exists","up"]},{"osd":7,"uuid":"5acb6619-e933-4b46-b1c2-60af30acb839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6817","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6819","nonce":2479691549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6821","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6823","nonce":2479691549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6829","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6831","nonce":2479691549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6825","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6827","nonce":2479691549}]},"public_addr":"172.21.15.161:6819/2479691549","cluster_addr":"172.21.15.161:6823/2479691549","heartbeat_back_addr":"172.21.15.161:6831/2479691549","heartbeat_front_addr":"172.21.15.161:6827/2479691549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.678857+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.685341+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.613603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.634940+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.564387+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.697347+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.637437+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.619397+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T08:25:14.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.960+0000 7fabc619e700 1 -- 172.21.15.84:0/2349809062 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fabac06a5d0 msgr2=0x7fabac06ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:14.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.960+0000 7fabc619e700 1 --2- 172.21.15.84:0/2349809062 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fabac06a5d0 0x7fabac06ca90 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fabb0009ac0 tx=0x7fabb0009210 comp rx=0 tx=0).stop 2023-09-13T08:25:14.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.960+0000 7fabc619e700 1 -- 172.21.15.84:0/2349809062 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fabc00d2ba0 msgr2=0x7fabc01601c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:14.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.960+0000 7fabc619e700 1 --2- 172.21.15.84:0/2349809062 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fabc00d2ba0 0x7fabc01601c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fabb800efc0 tx=0x7fabb800c3a0 comp rx=0 tx=0).stop 2023-09-13T08:25:14.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.960+0000 7fabc619e700 1 -- 172.21.15.84:0/2349809062 shutdown_connections 2023-09-13T08:25:14.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.960+0000 7fabc619e700 1 --2- 172.21.15.84:0/2349809062 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fabc00d2ba0 0x7fabc01601c0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:14.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.960+0000 7fabc619e700 1 --2- 172.21.15.84:0/2349809062 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fabac06a5d0 0x7fabac06ca90 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:14.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.960+0000 7fabc619e700 1 --2- 172.21.15.84:0/2349809062 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fabc00ce230 0x7fabc015e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:14.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.960+0000 7fabc619e700 1 --2- 172.21.15.84:0/2349809062 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fabc00cff60 0x7fabc00c8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:14.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.960+0000 7fabc619e700 1 -- 172.21.15.84:0/2349809062 >> 172.21.15.84:0/2349809062 conn(0x7fabc006b130 msgr2=0x7fabc00b49f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:14.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.960+0000 7fabc619e700 1 -- 172.21.15.84:0/2349809062 shutdown_connections 2023-09-13T08:25:14.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:14.960+0000 7fabc619e700 1 -- 172.21.15.84:0/2349809062 wait complete. 2023-09-13T08:25:14.972 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T08:24:28.583720+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-13T08:24:39.862832+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-13T08:24:41.145511+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-09-13T08:24:44.775160+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-13T08:25:14.974 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T08:25:15.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.096+0000 7f87dc99d700 1 Processor -- start 2023-09-13T08:25:15.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.096+0000 7f87dc99d700 1 -- start start 2023-09-13T08:25:15.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.097+0000 7f87dc99d700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f87d80b21b0 0x7f87d80d3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:15.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.097+0000 7f87dc99d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f87d80d1780 0x7f87d80b2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:15.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.097+0000 7f87dc99d700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87d80d1f10 con 0x7f87d815d6a0 2023-09-13T08:25:15.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.097+0000 7f87dc99d700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87d815da80 con 0x7f87d80d1780 2023-09-13T08:25:15.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.097+0000 7f87dc99d700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87d80d03c0 con 0x7f87d80b21b0 2023-09-13T08:25:15.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.097+0000 7f87d7fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f87d80d1780 0x7f87d80b2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:15.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.097+0000 7f87d77fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f87d815d6a0 0x7f87d80d1070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:46934/0 (socket says 172.21.15.84:46934) 2023-09-13T08:25:15.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.097+0000 7f87d77fe700 1 -- 172.21.15.84:0/4214782931 learned_addr learned my addr 172.21.15.84:0/4214782931 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:25:15.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.097+0000 7f87d6ffd700 1 --2- 172.21.15.84:0/4214782931 >> v2:172.21.15.161:3300/0 conn(0x7f87d80b21b0 0x7f87d80d3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:15.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.098+0000 7f87d7fff700 1 -- 172.21.15.84:0/4214782931 >> v2:172.21.15.161:3300/0 conn(0x7f87d80b21b0 msgr2=0x7f87d80d3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:15.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.098+0000 7f87d7fff700 1 --2- 172.21.15.84:0/4214782931 >> v2:172.21.15.161:3300/0 conn(0x7f87d80b21b0 0x7f87d80d3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:15.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.098+0000 7f87d7fff700 1 -- 172.21.15.84:0/4214782931 >> v1:172.21.15.84:6789/0 conn(0x7f87d815d6a0 legacy=0x7f87d80d1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:15.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.098+0000 7f87d67fc700 1 -- 172.21.15.84:0/4214782931 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2556109130 0 0) 0x7f87d80d1f10 con 0x7f87d815d6a0 2023-09-13T08:25:15.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.098+0000 7f87d7fff700 1 -- 172.21.15.84:0/4214782931 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87d80d06a0 con 0x7f87d80d1780 2023-09-13T08:25:15.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.098+0000 7f87d7fff700 1 --2- 172.21.15.84:0/4214782931 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f87d80d1780 0x7f87d80b2cf0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f87d808b150 tx=0x7f87d000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a59515552709fe5 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:15.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.098+0000 7f87d67fc700 1 -- 172.21.15.84:0/4214782931 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d000e070 con 0x7f87d80d1780 2023-09-13T08:25:15.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.098+0000 7f87d67fc700 1 -- 172.21.15.84:0/4214782931 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87d000bb20 con 0x7f87d80d1780 2023-09-13T08:25:15.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.098+0000 7f87d67fc700 1 -- 172.21.15.84:0/4214782931 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d0012430 con 0x7f87d80d1780 2023-09-13T08:25:15.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.098+0000 7f87dc99d700 1 -- 172.21.15.84:0/4214782931 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f87d80d1780 msgr2=0x7f87d80b2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:15.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.098+0000 7f87dc99d700 1 --2- 172.21.15.84:0/4214782931 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f87d80d1780 0x7f87d80b2cf0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f87d808b150 tx=0x7f87d000b330 comp rx=0 tx=0).stop 2023-09-13T08:25:15.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.098+0000 7f87dc99d700 1 -- 172.21.15.84:0/4214782931 shutdown_connections 2023-09-13T08:25:15.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.098+0000 7f87dc99d700 1 --2- 172.21.15.84:0/4214782931 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f87d80d1780 0x7f87d80b2cf0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:15.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.098+0000 7f87dc99d700 1 --2- 172.21.15.84:0/4214782931 >> v2:172.21.15.161:3300/0 conn(0x7f87d80b21b0 0x7f87d80d3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:15.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.098+0000 7f87dc99d700 1 -- 172.21.15.84:0/4214782931 >> 172.21.15.84:0/4214782931 conn(0x7f87d80d3290 msgr2=0x7f87d80d36a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:15.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.098+0000 7f87dc99d700 1 -- 172.21.15.84:0/4214782931 shutdown_connections 2023-09-13T08:25:15.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.098+0000 7f87dc99d700 1 -- 172.21.15.84:0/4214782931 wait complete. 2023-09-13T08:25:15.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.100+0000 7f87dc99d700 1 Processor -- start 2023-09-13T08:25:15.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.100+0000 7f87dc99d700 1 -- start start 2023-09-13T08:25:15.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.100+0000 7f87dc99d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f87d80b21b0 0x7f87d815dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:15.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.100+0000 7f87dc99d700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f87d80d1780 0x7f87d81512c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:15.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.101+0000 7f87dc99d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f87d815d6a0 0x7f87d80cc260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:15.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.101+0000 7f87dc99d700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87d8151e80 con 0x7f87d80b21b0 2023-09-13T08:25:15.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.101+0000 7f87dc99d700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87d80cb050 con 0x7f87d815d6a0 2023-09-13T08:25:15.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.101+0000 7f87dc99d700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87d80cb330 con 0x7f87d80d1780 2023-09-13T08:25:15.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.101+0000 7f87d77fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f87d80b21b0 0x7f87d815dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:15.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.101+0000 7f87d77fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f87d80b21b0 0x7f87d815dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44294/0 (socket says 172.21.15.84:44294) 2023-09-13T08:25:15.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.101+0000 7f87d77fe700 1 -- 172.21.15.84:0/2729761479 learned_addr learned my addr 172.21.15.84:0/2729761479 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:15.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.101+0000 7f87d7fff700 1 --2- 172.21.15.84:0/2729761479 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f87d815d6a0 0x7f87d80cc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:15.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.101+0000 7f87d6ffd700 1 --2- 172.21.15.84:0/2729761479 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f87d80d1780 0x7f87d81512c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:15.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.101+0000 7f87d77fe700 1 -- 172.21.15.84:0/2729761479 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f87d80d1780 msgr2=0x7f87d81512c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:15.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.101+0000 7f87d77fe700 1 --2- 172.21.15.84:0/2729761479 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f87d80d1780 0x7f87d81512c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:15.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.101+0000 7f87d77fe700 1 -- 172.21.15.84:0/2729761479 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f87d815d6a0 msgr2=0x7f87d80cc260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:15.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.101+0000 7f87d77fe700 1 --2- 172.21.15.84:0/2729761479 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f87d815d6a0 0x7f87d80cc260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:15.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.101+0000 7f87d77fe700 1 -- 172.21.15.84:0/2729761479 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87d0009a70 con 0x7f87d80b21b0 2023-09-13T08:25:15.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.101+0000 7f87d77fe700 1 --2- 172.21.15.84:0/2729761479 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f87d80b21b0 0x7f87d815dc00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f87c000c4a0 tx=0x7f87c000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:15.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.101+0000 7f87cffff700 1 -- 172.21.15.84:0/2729761479 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c00074e0 con 0x7f87d80b21b0 2023-09-13T08:25:15.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.101+0000 7f87cffff700 1 -- 172.21.15.84:0/2729761479 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87c0007640 con 0x7f87d80b21b0 2023-09-13T08:25:15.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.101+0000 7f87dc99d700 1 -- 172.21.15.84:0/2729761479 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87d80cb610 con 0x7f87d80b21b0 2023-09-13T08:25:15.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.101+0000 7f87cffff700 1 -- 172.21.15.84:0/2729761479 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c0005a70 con 0x7f87d80b21b0 2023-09-13T08:25:15.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.101+0000 7f87dc99d700 1 -- 172.21.15.84:0/2729761479 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87d8151800 con 0x7f87d80b21b0 2023-09-13T08:25:15.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.102+0000 7f87dc99d700 1 -- 172.21.15.84:0/2729761479 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87d8151990 con 0x7f87d80b21b0 2023-09-13T08:25:15.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.103+0000 7f87cffff700 1 -- 172.21.15.84:0/2729761479 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f87c0005bd0 con 0x7f87d80b21b0 2023-09-13T08:25:15.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.103+0000 7f87cffff700 1 --2- 172.21.15.84:0/2729761479 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f87b806a580 0x7f87b806ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:15.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.103+0000 7f87cffff700 1 -- 172.21.15.84:0/2729761479 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f87c00881d0 con 0x7f87d80b21b0 2023-09-13T08:25:15.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.103+0000 7f87d6ffd700 1 --2- 172.21.15.84:0/2729761479 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f87b806a580 0x7f87b806ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:15.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.103+0000 7f87d6ffd700 1 --2- 172.21.15.84:0/2729761479 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f87b806a580 0x7f87b806ca40 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f87d80cd330 tx=0x7f87c8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:15.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.107+0000 7f87cffff700 1 -- 172.21.15.84:0/2729761479 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f87d8151990 con 0x7f87d80b21b0 2023-09-13T08:25:15.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.295+0000 7f87dc99d700 1 -- 172.21.15.84:0/2729761479 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f87d8151990 con 0x7f87d80b21b0 2023-09-13T08:25:15.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.295+0000 7f87cffff700 1 -- 172.21.15.84:0/2729761479 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f87d8151990 con 0x7f87d80b21b0 2023-09-13T08:25:15.295 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-09-13T08:25:15.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.297+0000 7f87dc99d700 1 -- 172.21.15.84:0/2729761479 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f87b806a580 msgr2=0x7f87b806ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:15.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.297+0000 7f87dc99d700 1 --2- 172.21.15.84:0/2729761479 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f87b806a580 0x7f87b806ca40 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f87d80cd330 tx=0x7f87c8008040 comp rx=0 tx=0).stop 2023-09-13T08:25:15.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.297+0000 7f87dc99d700 1 -- 172.21.15.84:0/2729761479 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f87d80b21b0 msgr2=0x7f87d815dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:15.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.297+0000 7f87dc99d700 1 --2- 172.21.15.84:0/2729761479 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f87d80b21b0 0x7f87d815dc00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f87c000c4a0 tx=0x7f87c000c860 comp rx=0 tx=0).stop 2023-09-13T08:25:15.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.297+0000 7f87dc99d700 1 -- 172.21.15.84:0/2729761479 shutdown_connections 2023-09-13T08:25:15.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.297+0000 7f87dc99d700 1 --2- 172.21.15.84:0/2729761479 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f87b806a580 0x7f87b806ca40 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:15.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.297+0000 7f87dc99d700 1 --2- 172.21.15.84:0/2729761479 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f87d815d6a0 0x7f87d80cc260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:15.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.297+0000 7f87dc99d700 1 --2- 172.21.15.84:0/2729761479 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f87d80b21b0 0x7f87d815dc00 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:15.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.297+0000 7f87dc99d700 1 --2- 172.21.15.84:0/2729761479 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f87d80d1780 0x7f87d81512c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:15.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.297+0000 7f87dc99d700 1 -- 172.21.15.84:0/2729761479 >> 172.21.15.84:0/2729761479 conn(0x7f87d80d3290 msgr2=0x7f87d815c690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:15.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.298+0000 7f87dc99d700 1 -- 172.21.15.84:0/2729761479 shutdown_connections 2023-09-13T08:25:15.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.298+0000 7f87dc99d700 1 -- 172.21.15.84:0/2729761479 wait complete. 2023-09-13T08:25:15.309 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-13T08:25:15.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.432+0000 7f1aad184700 1 Processor -- start 2023-09-13T08:25:15.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.432+0000 7f1aad184700 1 -- start start 2023-09-13T08:25:15.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.433+0000 7f1aad184700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1aa806db00 0x7f1aa806df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:15.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.433+0000 7f1aad184700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1aa806a900 0x7f1aa806ad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:15.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.433+0000 7f1aad184700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1aa806d5e0 con 0x7f1aa81599b0 2023-09-13T08:25:15.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.433+0000 7f1aad184700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1aa806d8c0 con 0x7f1aa806db00 2023-09-13T08:25:15.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.433+0000 7f1aad184700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa806e4c0 con 0x7f1aa806a900 2023-09-13T08:25:15.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.433+0000 7f1aa659c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1aa806db00 0x7f1aa806df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:15.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.433+0000 7f1aa6d9d700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f1aa81599b0 0x7f1aa80cef00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:46948/0 (socket says 172.21.15.84:46948) 2023-09-13T08:25:15.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.433+0000 7f1aa6d9d700 1 -- 172.21.15.84:0/2951349169 learned_addr learned my addr 172.21.15.84:0/2951349169 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:25:15.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.433+0000 7f1aa659c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1aa806db00 0x7f1aa806df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44304/0 (socket says 172.21.15.84:44304) 2023-09-13T08:25:15.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.433+0000 7f1aa759e700 1 --2- 172.21.15.84:0/2951349169 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1aa806a900 0x7f1aa806ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:15.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.433+0000 7f1aa659c700 1 -- 172.21.15.84:0/2951349169 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1aa806a900 msgr2=0x7f1aa806ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:15.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.433+0000 7f1aa659c700 1 --2- 172.21.15.84:0/2951349169 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1aa806a900 0x7f1aa806ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:15.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.433+0000 7f1aa5d9b700 1 -- 172.21.15.84:0/2951349169 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1348298276 0 0) 0x7f1aa806d5e0 con 0x7f1aa81599b0 2023-09-13T08:25:15.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.433+0000 7f1aa659c700 1 -- 172.21.15.84:0/2951349169 >> v1:172.21.15.84:6789/0 conn(0x7f1aa81599b0 legacy=0x7f1aa80cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:15.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.433+0000 7f1aa659c700 1 -- 172.21.15.84:0/2951349169 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aa80b45c0 con 0x7f1aa806db00 2023-09-13T08:25:15.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.433+0000 7f1aa759e700 1 --2- 172.21.15.84:0/2951349169 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1aa806a900 0x7f1aa806ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T08:25:15.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.434+0000 7f1aa659c700 1 --2- 172.21.15.84:0/2951349169 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1aa806db00 0x7f1aa806df80 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1a98009840 tx=0x7f1a98009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64637cd0eda274fc server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:15.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.434+0000 7f1aa5d9b700 1 -- 172.21.15.84:0/2951349169 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a98011830 con 0x7f1aa806db00 2023-09-13T08:25:15.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.434+0000 7f1aa5d9b700 1 -- 172.21.15.84:0/2951349169 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a98011990 con 0x7f1aa806db00 2023-09-13T08:25:15.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.434+0000 7f1aa5d9b700 1 -- 172.21.15.84:0/2951349169 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a98011d20 con 0x7f1aa806db00 2023-09-13T08:25:15.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.434+0000 7f1aad184700 1 -- 172.21.15.84:0/2951349169 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1aa806db00 msgr2=0x7f1aa806df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:15.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.434+0000 7f1aad184700 1 --2- 172.21.15.84:0/2951349169 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1aa806db00 0x7f1aa806df80 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1a98009840 tx=0x7f1a98009b50 comp rx=0 tx=0).stop 2023-09-13T08:25:15.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.434+0000 7f1aad184700 1 -- 172.21.15.84:0/2951349169 shutdown_connections 2023-09-13T08:25:15.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.434+0000 7f1aad184700 1 --2- 172.21.15.84:0/2951349169 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1aa806a900 0x7f1aa806ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:15.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.434+0000 7f1aad184700 1 --2- 172.21.15.84:0/2951349169 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1aa806db00 0x7f1aa806df80 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:15.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.434+0000 7f1aad184700 1 -- 172.21.15.84:0/2951349169 >> 172.21.15.84:0/2951349169 conn(0x7f1aa80cf8f0 msgr2=0x7f1aa80cfd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:15.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.434+0000 7f1aad184700 1 -- 172.21.15.84:0/2951349169 shutdown_connections 2023-09-13T08:25:15.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.434+0000 7f1aad184700 1 -- 172.21.15.84:0/2951349169 wait complete. 2023-09-13T08:25:15.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.436+0000 7f1aad184700 1 Processor -- start 2023-09-13T08:25:15.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.436+0000 7f1aad184700 1 -- start start 2023-09-13T08:25:15.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.437+0000 7f1aad184700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1aa806a900 0x7f1aa8151a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:15.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.437+0000 7f1aad184700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1aa806db00 0x7f1aa80b3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:15.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.437+0000 7f1aad184700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1aa81f57e0 0x7f1aa80b3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:15.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.437+0000 7f1aad184700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa80acf00 con 0x7f1aa806a900 2023-09-13T08:25:15.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.437+0000 7f1aad184700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa8153420 con 0x7f1aa81f57e0 2023-09-13T08:25:15.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.437+0000 7f1aad184700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa80ac8d0 con 0x7f1aa806db00 2023-09-13T08:25:15.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.437+0000 7f1aa6d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1aa806a900 0x7f1aa8151a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:15.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.437+0000 7f1aa6d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1aa806a900 0x7f1aa8151a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44308/0 (socket says 172.21.15.84:44308) 2023-09-13T08:25:15.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.437+0000 7f1aa6d9d700 1 -- 172.21.15.84:0/421412213 learned_addr learned my addr 172.21.15.84:0/421412213 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:15.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.437+0000 7f1aa659c700 1 --2- 172.21.15.84:0/421412213 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1aa806db00 0x7f1aa80b3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:15.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.437+0000 7f1aa759e700 1 --2- 172.21.15.84:0/421412213 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1aa81f57e0 0x7f1aa80b3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:15.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.437+0000 7f1aa6d9d700 1 -- 172.21.15.84:0/421412213 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1aa806db00 msgr2=0x7f1aa80b3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:15.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.437+0000 7f1aa6d9d700 1 --2- 172.21.15.84:0/421412213 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1aa806db00 0x7f1aa80b3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:15.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.437+0000 7f1aa6d9d700 1 -- 172.21.15.84:0/421412213 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1aa81f57e0 msgr2=0x7f1aa80b3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:15.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.437+0000 7f1aa6d9d700 1 --2- 172.21.15.84:0/421412213 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1aa81f57e0 0x7f1aa80b3b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:15.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.437+0000 7f1aa6d9d700 1 -- 172.21.15.84:0/421412213 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a980094a0 con 0x7f1aa806a900 2023-09-13T08:25:15.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.437+0000 7f1aa659c700 1 --2- 172.21.15.84:0/421412213 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1aa806db00 0x7f1aa80b3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T08:25:15.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.437+0000 7f1aa6d9d700 1 --2- 172.21.15.84:0/421412213 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1aa806a900 0x7f1aa8151a30 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c0011e0 tx=0x7f1a9c00cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:15.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.437+0000 7f1a8f7fe700 1 -- 172.21.15.84:0/421412213 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a9c004c80 con 0x7f1aa806a900 2023-09-13T08:25:15.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.437+0000 7f1a8f7fe700 1 -- 172.21.15.84:0/421412213 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a9c004e00 con 0x7f1aa806a900 2023-09-13T08:25:15.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.437+0000 7f1aad184700 1 -- 172.21.15.84:0/421412213 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1aa814ecd0 con 0x7f1aa806a900 2023-09-13T08:25:15.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.437+0000 7f1a8f7fe700 1 -- 172.21.15.84:0/421412213 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a9c007310 con 0x7f1aa806a900 2023-09-13T08:25:15.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.437+0000 7f1aad184700 1 -- 172.21.15.84:0/421412213 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1aa814f290 con 0x7f1aa806a900 2023-09-13T08:25:15.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.438+0000 7f1aad184700 1 -- 172.21.15.84:0/421412213 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1aa806cd30 con 0x7f1aa806a900 2023-09-13T08:25:15.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.439+0000 7f1a8f7fe700 1 -- 172.21.15.84:0/421412213 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f1a9c007470 con 0x7f1aa806a900 2023-09-13T08:25:15.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.439+0000 7f1a8f7fe700 1 --2- 172.21.15.84:0/421412213 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f1a9406a580 0x7f1a9406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:15.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.439+0000 7f1a8f7fe700 1 -- 172.21.15.84:0/421412213 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1a9c088ad0 con 0x7f1aa806a900 2023-09-13T08:25:15.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.439+0000 7f1aa659c700 1 --2- 172.21.15.84:0/421412213 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f1a9406a580 0x7f1a9406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:15.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.439+0000 7f1aa659c700 1 --2- 172.21.15.84:0/421412213 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f1a9406a580 0x7f1a9406ca40 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1aa8166570 tx=0x7f1a98008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:15.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.443+0000 7f1a8f7fe700 1 -- 172.21.15.84:0/421412213 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f1a9c053d60 con 0x7f1aa806a900 2023-09-13T08:25:15.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.632+0000 7f1aad184700 1 -- 172.21.15.84:0/421412213 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1aa814f450 con 0x7f1aa806a900 2023-09-13T08:25:15.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.632+0000 7f1a8f7fe700 1 -- 172.21.15.84:0/421412213 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1a9c057380 con 0x7f1aa806a900 2023-09-13T08:25:15.633 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-09-13T08:25:15.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.634+0000 7f1aad184700 1 -- 172.21.15.84:0/421412213 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f1a9406a580 msgr2=0x7f1a9406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:15.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.634+0000 7f1aad184700 1 --2- 172.21.15.84:0/421412213 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f1a9406a580 0x7f1a9406ca40 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1aa8166570 tx=0x7f1a98008030 comp rx=0 tx=0).stop 2023-09-13T08:25:15.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.634+0000 7f1aad184700 1 -- 172.21.15.84:0/421412213 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1aa806a900 msgr2=0x7f1aa8151a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:15.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.634+0000 7f1aad184700 1 --2- 172.21.15.84:0/421412213 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1aa806a900 0x7f1aa8151a30 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c0011e0 tx=0x7f1a9c00cae0 comp rx=0 tx=0).stop 2023-09-13T08:25:15.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.634+0000 7f1aad184700 1 -- 172.21.15.84:0/421412213 shutdown_connections 2023-09-13T08:25:15.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.634+0000 7f1aad184700 1 --2- 172.21.15.84:0/421412213 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f1a9406a580 0x7f1a9406ca40 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:15.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.634+0000 7f1aad184700 1 --2- 172.21.15.84:0/421412213 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1aa81f57e0 0x7f1aa80b3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:15.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.634+0000 7f1aad184700 1 --2- 172.21.15.84:0/421412213 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1aa806a900 0x7f1aa8151a30 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:15.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.634+0000 7f1aad184700 1 --2- 172.21.15.84:0/421412213 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1aa806db00 0x7f1aa80b3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:15.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.634+0000 7f1aad184700 1 -- 172.21.15.84:0/421412213 >> 172.21.15.84:0/421412213 conn(0x7f1aa80cf8f0 msgr2=0x7f1aa80cef00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:15.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.634+0000 7f1aad184700 1 -- 172.21.15.84:0/421412213 shutdown_connections 2023-09-13T08:25:15.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.634+0000 7f1aad184700 1 -- 172.21.15.84:0/421412213 wait complete. 2023-09-13T08:25:15.647 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-13T08:25:15.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.782+0000 7f944e3ce700 1 Processor -- start 2023-09-13T08:25:15.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.782+0000 7f944e3ce700 1 -- start start 2023-09-13T08:25:15.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.782+0000 7f944e3ce700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f94480cd590 0x7f94480cf570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:15.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.782+0000 7f944e3ce700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f944815e480 con 0x7f94480ca8e0 2023-09-13T08:25:15.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.782+0000 7f944e3ce700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94480cfbe0 con 0x7f944815e910 2023-09-13T08:25:15.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.782+0000 7f944e3ce700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f944815de30 con 0x7f94480cd590 2023-09-13T08:25:15.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.783+0000 7f944c96b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f94480cd590 0x7f94480cf570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:15.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.783+0000 7f9447fff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f94480ca8e0 0x7f94480cacc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:46964/0 (socket says 172.21.15.84:46964) 2023-09-13T08:25:15.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.783+0000 7f9447fff700 1 -- 172.21.15.84:0/2690824358 learned_addr learned my addr 172.21.15.84:0/2690824358 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:25:15.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.783+0000 7f944c96b700 1 -- 172.21.15.84:0/2690824358 >> v1:172.21.15.161:6789/0 conn(0x7f944815e910 legacy=0x7f94480cdbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:15.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.783+0000 7f944c96b700 1 -- 172.21.15.84:0/2690824358 >> v1:172.21.15.84:6789/0 conn(0x7f94480ca8e0 legacy=0x7f94480cacc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:15.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.783+0000 7f9446ffd700 1 -- 172.21.15.84:0/2690824358 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3310941445 0 0) 0x7f944815e480 con 0x7f94480ca8e0 2023-09-13T08:25:15.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.783+0000 7f944c96b700 1 -- 172.21.15.84:0/2690824358 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f944815e110 con 0x7f94480cd590 2023-09-13T08:25:15.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.783+0000 7f944c96b700 1 --2- 172.21.15.84:0/2690824358 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94480cd590 0x7f94480cf570 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9440009d90 tx=0x7f944000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b6b5f1e7eb7d0bf server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:15.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.783+0000 7f9446ffd700 1 -- 172.21.15.84:0/2690824358 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f944000e070 con 0x7f94480cd590 2023-09-13T08:25:15.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.783+0000 7f9446ffd700 1 -- 172.21.15.84:0/2690824358 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f944000bb90 con 0x7f94480cd590 2023-09-13T08:25:15.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.783+0000 7f9446ffd700 1 -- 172.21.15.84:0/2690824358 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9440003a20 con 0x7f94480cd590 2023-09-13T08:25:15.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.784+0000 7f944e3ce700 1 -- 172.21.15.84:0/2690824358 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94480cd590 msgr2=0x7f94480cf570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:15.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.784+0000 7f944e3ce700 1 --2- 172.21.15.84:0/2690824358 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94480cd590 0x7f94480cf570 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9440009d90 tx=0x7f944000b330 comp rx=0 tx=0).stop 2023-09-13T08:25:15.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.784+0000 7f944e3ce700 1 -- 172.21.15.84:0/2690824358 shutdown_connections 2023-09-13T08:25:15.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.784+0000 7f944e3ce700 1 --2- 172.21.15.84:0/2690824358 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94480cd590 0x7f94480cf570 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:15.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.784+0000 7f944e3ce700 1 -- 172.21.15.84:0/2690824358 >> 172.21.15.84:0/2690824358 conn(0x7f94480cca70 msgr2=0x7f94480cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:15.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.784+0000 7f944e3ce700 1 -- 172.21.15.84:0/2690824358 shutdown_connections 2023-09-13T08:25:15.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.784+0000 7f944e3ce700 1 -- 172.21.15.84:0/2690824358 wait complete. 2023-09-13T08:25:15.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.785+0000 7f944e3ce700 1 Processor -- start 2023-09-13T08:25:15.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.786+0000 7f944e3ce700 1 -- start start 2023-09-13T08:25:15.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.786+0000 7f944e3ce700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94480ca8e0 0x7f94481f2f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:15.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.786+0000 7f944e3ce700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94480cd590 0x7f94481f6f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:15.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.786+0000 7f944e3ce700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f944815e910 0x7f94480c9400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:15.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.786+0000 7f944e3ce700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94480b3bd0 con 0x7f94480ca8e0 2023-09-13T08:25:15.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.786+0000 7f944e3ce700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94480c4990 con 0x7f94480cd590 2023-09-13T08:25:15.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.786+0000 7f944e3ce700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94481f7450 con 0x7f944815e910 2023-09-13T08:25:15.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.786+0000 7f9447fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94480ca8e0 0x7f94481f2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:15.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.786+0000 7f9447fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94480ca8e0 0x7f94481f2f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44320/0 (socket says 172.21.15.84:44320) 2023-09-13T08:25:15.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.786+0000 7f9447fff700 1 -- 172.21.15.84:0/898418952 learned_addr learned my addr 172.21.15.84:0/898418952 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:15.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.787+0000 7f94477fe700 1 --2- 172.21.15.84:0/898418952 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94480cd590 0x7f94481f6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:15.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.787+0000 7f944c96b700 1 --2- 172.21.15.84:0/898418952 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f944815e910 0x7f94480c9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:15.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.787+0000 7f9447fff700 1 -- 172.21.15.84:0/898418952 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f944815e910 msgr2=0x7f94480c9400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:15.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.787+0000 7f9447fff700 1 --2- 172.21.15.84:0/898418952 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f944815e910 0x7f94480c9400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:15.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.787+0000 7f9447fff700 1 -- 172.21.15.84:0/898418952 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94480cd590 msgr2=0x7f94481f6f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:15.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.787+0000 7f9447fff700 1 --2- 172.21.15.84:0/898418952 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94480cd590 0x7f94481f6f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:15.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.787+0000 7f9447fff700 1 -- 172.21.15.84:0/898418952 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9440009a70 con 0x7f94480ca8e0 2023-09-13T08:25:15.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.787+0000 7f944c96b700 1 --2- 172.21.15.84:0/898418952 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f944815e910 0x7f94480c9400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T08:25:15.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.787+0000 7f9447fff700 1 --2- 172.21.15.84:0/898418952 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94480ca8e0 0x7f94481f2f10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f943c00c750 tx=0x7f943c00cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:15.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.787+0000 7f9444ff9700 1 -- 172.21.15.84:0/898418952 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f943c004c80 con 0x7f94480ca8e0 2023-09-13T08:25:15.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.787+0000 7f9444ff9700 1 -- 172.21.15.84:0/898418952 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f943c004e00 con 0x7f94480ca8e0 2023-09-13T08:25:15.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.787+0000 7f944e3ce700 1 -- 172.21.15.84:0/898418952 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94481f3560 con 0x7f94480ca8e0 2023-09-13T08:25:15.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.787+0000 7f9444ff9700 1 -- 172.21.15.84:0/898418952 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f943c007310 con 0x7f94480ca8e0 2023-09-13T08:25:15.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.787+0000 7f944e3ce700 1 -- 172.21.15.84:0/898418952 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94481f3b20 con 0x7f94480ca8e0 2023-09-13T08:25:15.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.788+0000 7f944e3ce700 1 -- 172.21.15.84:0/898418952 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f944804f200 con 0x7f94480ca8e0 2023-09-13T08:25:15.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.788+0000 7f9444ff9700 1 -- 172.21.15.84:0/898418952 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f943c007470 con 0x7f94480ca8e0 2023-09-13T08:25:15.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.789+0000 7f9444ff9700 1 --2- 172.21.15.84:0/898418952 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f943406a580 0x7f943406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:15.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.789+0000 7f9444ff9700 1 -- 172.21.15.84:0/898418952 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f943c088af0 con 0x7f94480ca8e0 2023-09-13T08:25:15.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.789+0000 7f94477fe700 1 --2- 172.21.15.84:0/898418952 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f943406a580 0x7f943406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:15.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.789+0000 7f94477fe700 1 --2- 172.21.15.84:0/898418952 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f943406a580 0x7f943406ca40 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f94480c6960 tx=0x7f9438008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:15.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.793+0000 7f9444ff9700 1 -- 172.21.15.84:0/898418952 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f943c053d80 con 0x7f94480ca8e0 2023-09-13T08:25:15.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.984+0000 7f944e3ce700 1 -- 172.21.15.84:0/898418952 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f944806df60 con 0x7f94480ca8e0 2023-09-13T08:25:15.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.985+0000 7f9444ff9700 1 -- 172.21.15.84:0/898418952 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f943c0573a0 con 0x7f94480ca8e0 2023-09-13T08:25:15.985 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-09-13T08:25:15.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.987+0000 7f944e3ce700 1 -- 172.21.15.84:0/898418952 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f943406a580 msgr2=0x7f943406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:15.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.987+0000 7f944e3ce700 1 --2- 172.21.15.84:0/898418952 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f943406a580 0x7f943406ca40 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f94480c6960 tx=0x7f9438008040 comp rx=0 tx=0).stop 2023-09-13T08:25:15.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.987+0000 7f944e3ce700 1 -- 172.21.15.84:0/898418952 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94480ca8e0 msgr2=0x7f94481f2f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:15.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.987+0000 7f944e3ce700 1 --2- 172.21.15.84:0/898418952 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94480ca8e0 0x7f94481f2f10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f943c00c750 tx=0x7f943c00cb10 comp rx=0 tx=0).stop 2023-09-13T08:25:15.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.987+0000 7f944e3ce700 1 -- 172.21.15.84:0/898418952 shutdown_connections 2023-09-13T08:25:15.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.987+0000 7f944e3ce700 1 --2- 172.21.15.84:0/898418952 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f944815e910 0x7f94480c9400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:15.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.987+0000 7f944e3ce700 1 --2- 172.21.15.84:0/898418952 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94480ca8e0 0x7f94481f2f10 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:15.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.987+0000 7f944e3ce700 1 --2- 172.21.15.84:0/898418952 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f943406a580 0x7f943406ca40 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:15.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.987+0000 7f944e3ce700 1 --2- 172.21.15.84:0/898418952 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94480cd590 0x7f94481f6f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:15.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.987+0000 7f944e3ce700 1 -- 172.21.15.84:0/898418952 >> 172.21.15.84:0/898418952 conn(0x7f94480cca70 msgr2=0x7f944815f0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:15.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.987+0000 7f944e3ce700 1 -- 172.21.15.84:0/898418952 shutdown_connections 2023-09-13T08:25:15.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:15.987+0000 7f944e3ce700 1 -- 172.21.15.84:0/898418952 wait complete. 2023-09-13T08:25:16.000 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-09-13T08:25:16.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.124+0000 7f8b1d1fc700 1 Processor -- start 2023-09-13T08:25:16.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.124+0000 7f8b1d1fc700 1 -- start start 2023-09-13T08:25:16.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.125+0000 7f8b1d1fc700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8b180ca8e0 0x7f8b180cf570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:16.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.125+0000 7f8b1d1fc700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8b180cd590 0x7f8b180cdbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:16.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.125+0000 7f8b1d1fc700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b1815e480 con 0x7f8b1815e910 2023-09-13T08:25:16.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.125+0000 7f8b1d1fc700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b180cfbe0 con 0x7f8b180cd590 2023-09-13T08:25:16.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.125+0000 7f8b1d1fc700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b1815de30 con 0x7f8b180ca8e0 2023-09-13T08:25:16.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.125+0000 7f8b1759e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8b180cd590 0x7f8b180cdbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:16.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.125+0000 7f8b1759e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8b180cd590 0x7f8b180cdbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44330/0 (socket says 172.21.15.84:44330) 2023-09-13T08:25:16.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.125+0000 7f8b1759e700 1 -- 172.21.15.84:0/4107107907 learned_addr learned my addr 172.21.15.84:0/4107107907 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:16.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.125+0000 7f8b16d9d700 1 --2- 172.21.15.84:0/4107107907 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8b180ca8e0 0x7f8b180cf570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:16.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.126+0000 7f8b1759e700 1 -- 172.21.15.84:0/4107107907 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8b180ca8e0 msgr2=0x7f8b180cf570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:16.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.126+0000 7f8b1759e700 1 --2- 172.21.15.84:0/4107107907 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8b180ca8e0 0x7f8b180cf570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:16.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.126+0000 7f8b1759e700 1 -- 172.21.15.84:0/4107107907 >> v1:172.21.15.161:6789/0 conn(0x7f8b1815e910 legacy=0x7f8b180cacc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:16.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.126+0000 7f8b1759e700 1 -- 172.21.15.84:0/4107107907 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b1815e110 con 0x7f8b180cd590 2023-09-13T08:25:16.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.126+0000 7f8b16d9d700 1 --2- 172.21.15.84:0/4107107907 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8b180ca8e0 0x7f8b180cf570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T08:25:16.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.126+0000 7f8b1759e700 1 --2- 172.21.15.84:0/4107107907 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b180cd590 0x7f8b180cdbc0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f8b10009e50 tx=0x7f8b1000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5989b6a9da492d95 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:16.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.126+0000 7f8b15d9b700 1 -- 172.21.15.84:0/4107107907 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1000e070 con 0x7f8b180cd590 2023-09-13T08:25:16.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.126+0000 7f8b15d9b700 1 -- 172.21.15.84:0/4107107907 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b1000b9c0 con 0x7f8b180cd590 2023-09-13T08:25:16.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.126+0000 7f8b15d9b700 1 -- 172.21.15.84:0/4107107907 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1000bd70 con 0x7f8b180cd590 2023-09-13T08:25:16.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.126+0000 7f8b1d1fc700 1 -- 172.21.15.84:0/4107107907 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b180cd590 msgr2=0x7f8b180cdbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:16.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.126+0000 7f8b1d1fc700 1 --2- 172.21.15.84:0/4107107907 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b180cd590 0x7f8b180cdbc0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f8b10009e50 tx=0x7f8b1000b330 comp rx=0 tx=0).stop 2023-09-13T08:25:16.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.126+0000 7f8b1d1fc700 1 -- 172.21.15.84:0/4107107907 shutdown_connections 2023-09-13T08:25:16.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.126+0000 7f8b1d1fc700 1 --2- 172.21.15.84:0/4107107907 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b180cd590 0x7f8b180cdbc0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:16.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.126+0000 7f8b1d1fc700 1 --2- 172.21.15.84:0/4107107907 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8b180ca8e0 0x7f8b180cf570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:16.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.126+0000 7f8b1d1fc700 1 -- 172.21.15.84:0/4107107907 >> 172.21.15.84:0/4107107907 conn(0x7f8b180cca70 msgr2=0x7f8b180cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:16.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.127+0000 7f8b1d1fc700 1 -- 172.21.15.84:0/4107107907 shutdown_connections 2023-09-13T08:25:16.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.127+0000 7f8b1d1fc700 1 -- 172.21.15.84:0/4107107907 wait complete. 2023-09-13T08:25:16.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.128+0000 7f8b1d1fc700 1 Processor -- start 2023-09-13T08:25:16.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.128+0000 7f8b1d1fc700 1 -- start start 2023-09-13T08:25:16.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.129+0000 7f8b1d1fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b180ca8e0 0x7f8b18159c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:16.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.129+0000 7f8b1d1fc700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b180cd590 0x7f8b180c7330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:16.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.129+0000 7f8b1d1fc700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8b1815e910 0x7f8b1814aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:16.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.129+0000 7f8b1d1fc700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b180c5050 con 0x7f8b180ca8e0 2023-09-13T08:25:16.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.129+0000 7f8b1d1fc700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b180ad260 con 0x7f8b180cd590 2023-09-13T08:25:16.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.129+0000 7f8b1d1fc700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b180ad540 con 0x7f8b1815e910 2023-09-13T08:25:16.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.129+0000 7f8b16d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b180ca8e0 0x7f8b18159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:16.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.129+0000 7f8b16d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b180ca8e0 0x7f8b18159c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44332/0 (socket says 172.21.15.84:44332) 2023-09-13T08:25:16.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.129+0000 7f8b16d9d700 1 -- 172.21.15.84:0/2344381265 learned_addr learned my addr 172.21.15.84:0/2344381265 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:16.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.129+0000 7f8b1759e700 1 --2- 172.21.15.84:0/2344381265 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8b1815e910 0x7f8b1814aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:16.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.129+0000 7f8b1659c700 1 --2- 172.21.15.84:0/2344381265 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b180cd590 0x7f8b180c7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:16.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.129+0000 7f8b16d9d700 1 -- 172.21.15.84:0/2344381265 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8b1815e910 msgr2=0x7f8b1814aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:16.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.129+0000 7f8b16d9d700 1 --2- 172.21.15.84:0/2344381265 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8b1815e910 0x7f8b1814aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:16.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.129+0000 7f8b16d9d700 1 -- 172.21.15.84:0/2344381265 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b180cd590 msgr2=0x7f8b180c7330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:16.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.129+0000 7f8b16d9d700 1 --2- 172.21.15.84:0/2344381265 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b180cd590 0x7f8b180c7330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:16.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.129+0000 7f8b16d9d700 1 -- 172.21.15.84:0/2344381265 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b10009b30 con 0x7f8b180ca8e0 2023-09-13T08:25:16.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.129+0000 7f8b1659c700 1 --2- 172.21.15.84:0/2344381265 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b180cd590 0x7f8b180c7330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T08:25:16.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.129+0000 7f8b16d9d700 1 --2- 172.21.15.84:0/2344381265 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b180ca8e0 0x7f8b18159c20 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c00e810 tx=0x7f8b0c00ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:16.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.129+0000 7f8aff7fe700 1 -- 172.21.15.84:0/2344381265 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b0c004230 con 0x7f8b180ca8e0 2023-09-13T08:25:16.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.129+0000 7f8aff7fe700 1 -- 172.21.15.84:0/2344381265 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b0c004390 con 0x7f8b180ca8e0 2023-09-13T08:25:16.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.129+0000 7f8aff7fe700 1 -- 172.21.15.84:0/2344381265 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b0c0036a0 con 0x7f8b180ca8e0 2023-09-13T08:25:16.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.129+0000 7f8b1d1fc700 1 -- 172.21.15.84:0/2344381265 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b180ad820 con 0x7f8b180ca8e0 2023-09-13T08:25:16.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.130+0000 7f8b1d1fc700 1 -- 172.21.15.84:0/2344381265 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b180adde0 con 0x7f8b180ca8e0 2023-09-13T08:25:16.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.130+0000 7f8b1d1fc700 1 -- 172.21.15.84:0/2344381265 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b180ae150 con 0x7f8b180ca8e0 2023-09-13T08:25:16.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.131+0000 7f8aff7fe700 1 -- 172.21.15.84:0/2344381265 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f8b0c003800 con 0x7f8b180ca8e0 2023-09-13T08:25:16.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.131+0000 7f8aff7fe700 1 --2- 172.21.15.84:0/2344381265 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f8b0406a580 0x7f8b0406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:16.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.131+0000 7f8aff7fe700 1 -- 172.21.15.84:0/2344381265 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8b0c0887f0 con 0x7f8b180ca8e0 2023-09-13T08:25:16.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.131+0000 7f8b1659c700 1 --2- 172.21.15.84:0/2344381265 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f8b0406a580 0x7f8b0406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:16.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.132+0000 7f8b1659c700 1 --2- 172.21.15.84:0/2344381265 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f8b0406a580 0x7f8b0406ca40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8b180b5d10 tx=0x7f8b08009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:16.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.136+0000 7f8aff7fe700 1 -- 172.21.15.84:0/2344381265 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f8b0c053b10 con 0x7f8b180ca8e0 2023-09-13T08:25:16.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.324+0000 7f8b1d1fc700 1 -- 172.21.15.84:0/2344381265 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f8b1804f200 con 0x7f8b180ca8e0 2023-09-13T08:25:16.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.325+0000 7f8aff7fe700 1 -- 172.21.15.84:0/2344381265 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7f8b0c020020 con 0x7f8b180ca8e0 2023-09-13T08:25:16.325 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-09-13T08:25:16.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.327+0000 7f8b1d1fc700 1 -- 172.21.15.84:0/2344381265 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f8b0406a580 msgr2=0x7f8b0406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:16.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.327+0000 7f8b1d1fc700 1 --2- 172.21.15.84:0/2344381265 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f8b0406a580 0x7f8b0406ca40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8b180b5d10 tx=0x7f8b08009040 comp rx=0 tx=0).stop 2023-09-13T08:25:16.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.327+0000 7f8b1d1fc700 1 -- 172.21.15.84:0/2344381265 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b180ca8e0 msgr2=0x7f8b18159c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:16.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.327+0000 7f8b1d1fc700 1 --2- 172.21.15.84:0/2344381265 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b180ca8e0 0x7f8b18159c20 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c00e810 tx=0x7f8b0c00ebd0 comp rx=0 tx=0).stop 2023-09-13T08:25:16.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.327+0000 7f8b1d1fc700 1 -- 172.21.15.84:0/2344381265 shutdown_connections 2023-09-13T08:25:16.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.327+0000 7f8b1d1fc700 1 --2- 172.21.15.84:0/2344381265 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8b1815e910 0x7f8b1814aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:16.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.327+0000 7f8b1d1fc700 1 --2- 172.21.15.84:0/2344381265 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b180ca8e0 0x7f8b18159c20 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:16.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.327+0000 7f8b1d1fc700 1 --2- 172.21.15.84:0/2344381265 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f8b0406a580 0x7f8b0406ca40 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:16.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.327+0000 7f8b1d1fc700 1 --2- 172.21.15.84:0/2344381265 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b180cd590 0x7f8b180c7330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:16.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.327+0000 7f8b1d1fc700 1 -- 172.21.15.84:0/2344381265 >> 172.21.15.84:0/2344381265 conn(0x7f8b180cca70 msgr2=0x7f8b180ce740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:16.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.327+0000 7f8b1d1fc700 1 -- 172.21.15.84:0/2344381265 shutdown_connections 2023-09-13T08:25:16.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.327+0000 7f8b1d1fc700 1 -- 172.21.15.84:0/2344381265 wait complete. 2023-09-13T08:25:16.339 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T08:25:16.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.459+0000 7fbfbf4cf700 1 Processor -- start 2023-09-13T08:25:16.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.459+0000 7fbfbf4cf700 1 -- start start 2023-09-13T08:25:16.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.460+0000 7fbfbf4cf700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fbfb815d530 0x7fbfb8161bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:16.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.460+0000 7fbfbf4cf700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfb81620f0 con 0x7fbfb806a620 2023-09-13T08:25:16.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.460+0000 7fbfbf4cf700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfb80cae50 con 0x7fbfb80ca920 2023-09-13T08:25:16.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.460+0000 7fbfbf4cf700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfb80cff20 con 0x7fbfb815d530 2023-09-13T08:25:16.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.460+0000 7fbfbda6c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fbfb806a620 0x7fbfb80ce490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:46990/0 (socket says 172.21.15.84:46990) 2023-09-13T08:25:16.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.460+0000 7fbfbda6c700 1 -- 172.21.15.84:0/169219641 learned_addr learned my addr 172.21.15.84:0/169219641 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:25:16.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.460+0000 7fbfbd26b700 1 --2- 172.21.15.84:0/169219641 >> v2:172.21.15.161:3300/0 conn(0x7fbfb815d530 0x7fbfb8161bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:16.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.461+0000 7fbfaffff700 1 -- 172.21.15.84:0/169219641 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4283753545 0 0) 0x7fbfb81620f0 con 0x7fbfb806a620 2023-09-13T08:25:16.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.461+0000 7fbfaffff700 1 -- 172.21.15.84:0/169219641 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbfa40035b0 con 0x7fbfb806a620 2023-09-13T08:25:16.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.461+0000 7fbfaffff700 1 -- 172.21.15.84:0/169219641 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 164595534 0 0) 0x7fbfa40035b0 con 0x7fbfb806a620 2023-09-13T08:25:16.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.461+0000 7fbfaffff700 1 -- 172.21.15.84:0/169219641 >> v2:172.21.15.161:3300/0 conn(0x7fbfb815d530 msgr2=0x7fbfb8161bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:16.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.461+0000 7fbfaffff700 1 --2- 172.21.15.84:0/169219641 >> v2:172.21.15.161:3300/0 conn(0x7fbfb815d530 0x7fbfb8161bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:16.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.461+0000 7fbfaffff700 1 -- 172.21.15.84:0/169219641 >> v1:172.21.15.161:6789/0 conn(0x7fbfb80ca920 legacy=0x7fbfb806d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:16.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.461+0000 7fbfaffff700 1 -- 172.21.15.84:0/169219641 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfb80cb130 con 0x7fbfb806a620 2023-09-13T08:25:16.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.461+0000 7fbfaffff700 1 -- 172.21.15.84:0/169219641 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2302733408 0 0) 0x7fbfb00019f0 con 0x7fbfb806a620 2023-09-13T08:25:16.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.461+0000 7fbfaffff700 1 -- 172.21.15.84:0/169219641 >> v1:172.21.15.84:6789/0 conn(0x7fbfb806a620 legacy=0x7fbfb80ce490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:16.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.461+0000 7fbfaffff700 1 --2- 172.21.15.84:0/169219641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbfa4003a00 0x7fbfa4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:16.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.461+0000 7fbfaffff700 1 --2- 172.21.15.84:0/169219641 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbfa4004850 0x7fbfa4004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:16.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.461+0000 7fbfaffff700 1 --2- 172.21.15.84:0/169219641 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbfa4005210 0x7fbfa400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:16.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.461+0000 7fbfaffff700 1 -- 172.21.15.84:0/169219641 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa400c080 con 0x7fbfa4003a00 2023-09-13T08:25:16.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.461+0000 7fbfaffff700 1 -- 172.21.15.84:0/169219641 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa400c1f0 con 0x7fbfa4005210 2023-09-13T08:25:16.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.461+0000 7fbfaffff700 1 -- 172.21.15.84:0/169219641 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa400c3b0 con 0x7fbfa4004850 2023-09-13T08:25:16.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.461+0000 7fbfbd26b700 1 --2- 172.21.15.84:0/169219641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbfa4003a00 0x7fbfa4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:16.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.461+0000 7fbfbda6c700 1 --2- 172.21.15.84:0/169219641 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbfa4005210 0x7fbfa400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:16.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.461+0000 7fbfbca6a700 1 --2- 172.21.15.84:0/169219641 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbfa4004850 0x7fbfa4004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:16.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.461+0000 7fbfbd26b700 1 -- 172.21.15.84:0/169219641 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbfa4004850 msgr2=0x7fbfa4004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:16.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.461+0000 7fbfbd26b700 1 --2- 172.21.15.84:0/169219641 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbfa4004850 0x7fbfa4004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:16.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.461+0000 7fbfbd26b700 1 -- 172.21.15.84:0/169219641 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbfa4005210 msgr2=0x7fbfa400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:16.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.461+0000 7fbfbd26b700 1 --2- 172.21.15.84:0/169219641 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbfa4005210 0x7fbfa400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:16.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.461+0000 7fbfbd26b700 1 -- 172.21.15.84:0/169219641 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfa40035b0 con 0x7fbfa4003a00 2023-09-13T08:25:16.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.461+0000 7fbfbda6c700 1 --2- 172.21.15.84:0/169219641 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbfa4005210 0x7fbfa400ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T08:25:16.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.461+0000 7fbfbda6c700 1 -- 172.21.15.84:0/169219641 reap_dead start 2023-09-13T08:25:16.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.461+0000 7fbfbd26b700 1 --2- 172.21.15.84:0/169219641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbfa4003a00 0x7fbfa4003e20 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fbfa8009b60 tx=0x7fbfa4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf5f5f1d9f40aa2a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:16.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.461+0000 7fbfaffff700 1 -- 172.21.15.84:0/169219641 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa800e6c0 con 0x7fbfa4003a00 2023-09-13T08:25:16.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.462+0000 7fbfaffff700 1 -- 172.21.15.84:0/169219641 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfa800e820 con 0x7fbfa4003a00 2023-09-13T08:25:16.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.462+0000 7fbfaffff700 1 -- 172.21.15.84:0/169219641 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa800eb90 con 0x7fbfa4003a00 2023-09-13T08:25:16.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.462+0000 7fbfbf4cf700 1 -- 172.21.15.84:0/169219641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbfa4003a00 msgr2=0x7fbfa4003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:16.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.462+0000 7fbfbf4cf700 1 --2- 172.21.15.84:0/169219641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbfa4003a00 0x7fbfa4003e20 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fbfa8009b60 tx=0x7fbfa4005880 comp rx=0 tx=0).stop 2023-09-13T08:25:16.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.462+0000 7fbfbf4cf700 1 -- 172.21.15.84:0/169219641 shutdown_connections 2023-09-13T08:25:16.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.462+0000 7fbfbf4cf700 1 --2- 172.21.15.84:0/169219641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbfa4003a00 0x7fbfa4003e20 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:16.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.462+0000 7fbfbf4cf700 1 -- 172.21.15.84:0/169219641 >> 172.21.15.84:0/169219641 conn(0x7fbfb80d00c0 msgr2=0x7fbfb80d04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:16.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.462+0000 7fbfbf4cf700 1 -- 172.21.15.84:0/169219641 shutdown_connections 2023-09-13T08:25:16.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.462+0000 7fbfbf4cf700 1 -- 172.21.15.84:0/169219641 wait complete. 2023-09-13T08:25:16.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.464+0000 7fbfbf4cf700 1 Processor -- start 2023-09-13T08:25:16.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.464+0000 7fbfbf4cf700 1 -- start start 2023-09-13T08:25:16.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.465+0000 7fbfbf4cf700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbfa4003a00 0x7fbfb81529c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:16.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.465+0000 7fbfbf4cf700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbfb80b4a60 0x7fbfb80b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:16.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.465+0000 7fbfbf4cf700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbfb81f2860 0x7fbfb81f2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:16.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.465+0000 7fbfbf4cf700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb80b5420 con 0x7fbfb81f2860 2023-09-13T08:25:16.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.465+0000 7fbfbf4cf700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb8153290 con 0x7fbfa4003a00 2023-09-13T08:25:16.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.465+0000 7fbfbf4cf700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb8152f00 con 0x7fbfb80b4a60 2023-09-13T08:25:16.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.465+0000 7fbfbda6c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbfb81f2860 0x7fbfb81f2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:16.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.465+0000 7fbfbda6c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbfb81f2860 0x7fbfb81f2ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44356/0 (socket says 172.21.15.84:44356) 2023-09-13T08:25:16.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.465+0000 7fbfbda6c700 1 -- 172.21.15.84:0/1200625804 learned_addr learned my addr 172.21.15.84:0/1200625804 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:16.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.465+0000 7fbfbd26b700 1 --2- 172.21.15.84:0/1200625804 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbfa4003a00 0x7fbfb81529c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:16.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.465+0000 7fbfbca6a700 1 --2- 172.21.15.84:0/1200625804 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbfb80b4a60 0x7fbfb80b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:16.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.465+0000 7fbfbda6c700 1 -- 172.21.15.84:0/1200625804 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbfb80b4a60 msgr2=0x7fbfb80b4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:16.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.465+0000 7fbfbda6c700 1 --2- 172.21.15.84:0/1200625804 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbfb80b4a60 0x7fbfb80b4ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:16.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.465+0000 7fbfbda6c700 1 -- 172.21.15.84:0/1200625804 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbfa4003a00 msgr2=0x7fbfb81529c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:16.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.465+0000 7fbfbda6c700 1 --2- 172.21.15.84:0/1200625804 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbfa4003a00 0x7fbfb81529c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:16.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.465+0000 7fbfbda6c700 1 -- 172.21.15.84:0/1200625804 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfb81f35e0 con 0x7fbfb81f2860 2023-09-13T08:25:16.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.465+0000 7fbfbda6c700 1 --2- 172.21.15.84:0/1200625804 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbfb81f2860 0x7fbfb81f2ce0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fbfb80d1140 tx=0x7fbfb000e440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:16.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.465+0000 7fbfadffb700 1 -- 172.21.15.84:0/1200625804 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb0017070 con 0x7fbfb81f2860 2023-09-13T08:25:16.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.465+0000 7fbfadffb700 1 -- 172.21.15.84:0/1200625804 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfb000ea80 con 0x7fbfb81f2860 2023-09-13T08:25:16.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.465+0000 7fbfbf4cf700 1 -- 172.21.15.84:0/1200625804 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfb81f38c0 con 0x7fbfb81f2860 2023-09-13T08:25:16.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.465+0000 7fbfadffb700 1 -- 172.21.15.84:0/1200625804 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb000ec30 con 0x7fbfb81f2860 2023-09-13T08:25:16.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.466+0000 7fbfbf4cf700 1 -- 172.21.15.84:0/1200625804 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfb81f3e80 con 0x7fbfb81f2860 2023-09-13T08:25:16.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.466+0000 7fbfbf4cf700 1 -- 172.21.15.84:0/1200625804 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfb8153440 con 0x7fbfb81f2860 2023-09-13T08:25:16.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.467+0000 7fbfadffb700 1 -- 172.21.15.84:0/1200625804 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fbfb000ed90 con 0x7fbfb81f2860 2023-09-13T08:25:16.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.467+0000 7fbfadffb700 1 --2- 172.21.15.84:0/1200625804 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fbf9c06a580 0x7fbf9c06ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:16.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.467+0000 7fbfadffb700 1 -- 172.21.15.84:0/1200625804 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbfb0088960 con 0x7fbfb81f2860 2023-09-13T08:25:16.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.467+0000 7fbfbd26b700 1 --2- 172.21.15.84:0/1200625804 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fbf9c06a580 0x7fbf9c06ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:16.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.468+0000 7fbfbd26b700 1 --2- 172.21.15.84:0/1200625804 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fbf9c06a580 0x7fbf9c06ca40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fbfa80090b0 tx=0x7fbfa8008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:16.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.472+0000 7fbfadffb700 1 -- 172.21.15.84:0/1200625804 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fbfb8153440 con 0x7fbfb81f2860 2023-09-13T08:25:16.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.703+0000 7fbfbf4cf700 1 -- 172.21.15.84:0/1200625804 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbfb8153440 con 0x7fbfb81f2860 2023-09-13T08:25:16.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.703+0000 7fbfadffb700 1 -- 172.21.15.84:0/1200625804 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4909 (secure 0 0 0) 0x7fbfb8153440 con 0x7fbfb81f2860 2023-09-13T08:25:16.703 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:25:16.704 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/3581118217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6833","nonce":3581118217},{"type":"v1","addr":"172.21.15.161:6835","nonce":3581118217}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4296,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/566416855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":566416855},{"type":"v1","addr":"172.21.15.84:6835","nonce":566416855}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4299,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/482729238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":482729238},{"type":"v1","addr":"172.21.15.84:6837","nonce":482729238}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T08:24:42.132788+0000","modified":"2023-09-13T08:25:05.211766+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4314},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4314":{"gid":4314,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.161:6834/2524298549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":2524298549},{"type":"v1","addr":"172.21.15.161:6834","nonce":2524298549}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-13T08:25:16.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.705+0000 7fbfbf4cf700 1 -- 172.21.15.84:0/1200625804 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fbf9c06a580 msgr2=0x7fbf9c06ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:16.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.705+0000 7fbfbf4cf700 1 --2- 172.21.15.84:0/1200625804 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fbf9c06a580 0x7fbf9c06ca40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fbfa80090b0 tx=0x7fbfa8008030 comp rx=0 tx=0).stop 2023-09-13T08:25:16.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.705+0000 7fbfbf4cf700 1 -- 172.21.15.84:0/1200625804 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbfb81f2860 msgr2=0x7fbfb81f2ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:16.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.705+0000 7fbfbf4cf700 1 --2- 172.21.15.84:0/1200625804 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbfb81f2860 0x7fbfb81f2ce0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fbfb80d1140 tx=0x7fbfb000e440 comp rx=0 tx=0).stop 2023-09-13T08:25:16.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.705+0000 7fbfbf4cf700 1 -- 172.21.15.84:0/1200625804 shutdown_connections 2023-09-13T08:25:16.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.705+0000 7fbfbf4cf700 1 --2- 172.21.15.84:0/1200625804 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbfb81f2860 0x7fbfb81f2ce0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:16.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.705+0000 7fbfbf4cf700 1 --2- 172.21.15.84:0/1200625804 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fbf9c06a580 0x7fbf9c06ca40 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:16.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.705+0000 7fbfbf4cf700 1 --2- 172.21.15.84:0/1200625804 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbfa4003a00 0x7fbfb81529c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:16.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.705+0000 7fbfbf4cf700 1 --2- 172.21.15.84:0/1200625804 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbfb80b4a60 0x7fbfb80b4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:16.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.705+0000 7fbfbf4cf700 1 -- 172.21.15.84:0/1200625804 >> 172.21.15.84:0/1200625804 conn(0x7fbfb80d00c0 msgr2=0x7fbfb815c460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:16.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.705+0000 7fbfbf4cf700 1 -- 172.21.15.84:0/1200625804 shutdown_connections 2023-09-13T08:25:16.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.705+0000 7fbfbf4cf700 1 -- 172.21.15.84:0/1200625804 wait complete. 2023-09-13T08:25:16.709 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 9 2023-09-13T08:25:16.718 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T08:25:16.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.841+0000 7fbd719cf700 1 Processor -- start 2023-09-13T08:25:16.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.841+0000 7fbd719cf700 1 -- start start 2023-09-13T08:25:16.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.841+0000 7fbd719cf700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbd6c0cdfe0 0x7fbd6c0b8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:16.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.842+0000 7fbd719cf700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd6c0d1b50 con 0x7fbd6c15d6e0 2023-09-13T08:25:16.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.842+0000 7fbd719cf700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd6c0d1e30 con 0x7fbd6c0d2bf0 2023-09-13T08:25:16.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.842+0000 7fbd719cf700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6c0d30a0 con 0x7fbd6c0cdfe0 2023-09-13T08:25:16.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.842+0000 7fbd6a7fc700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fbd6c15d6e0 0x7fbd6c0ce3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:47006/0 (socket says 172.21.15.84:47006) 2023-09-13T08:25:16.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.842+0000 7fbd6a7fc700 1 -- 172.21.15.84:0/1182162940 learned_addr learned my addr 172.21.15.84:0/1182162940 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:25:16.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.842+0000 7fbd6affd700 1 --2- 172.21.15.84:0/1182162940 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbd6c0cdfe0 0x7fbd6c0b8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:16.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.842+0000 7fbd69ffb700 1 -- 172.21.15.84:0/1182162940 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2468934540 0 0) 0x7fbd6c0d1b50 con 0x7fbd6c15d6e0 2023-09-13T08:25:16.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.842+0000 7fbd69ffb700 1 -- 172.21.15.84:0/1182162940 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd540035b0 con 0x7fbd6c15d6e0 2023-09-13T08:25:16.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.842+0000 7fbd69ffb700 1 -- 172.21.15.84:0/1182162940 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2229748207 0 0) 0x7fbd6c0d1e30 con 0x7fbd6c0d2bf0 2023-09-13T08:25:16.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.842+0000 7fbd69ffb700 1 -- 172.21.15.84:0/1182162940 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd6c0d1b50 con 0x7fbd6c0d2bf0 2023-09-13T08:25:16.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.842+0000 7fbd69ffb700 1 -- 172.21.15.84:0/1182162940 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 356602688 0 0) 0x7fbd540035b0 con 0x7fbd6c15d6e0 2023-09-13T08:25:16.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.842+0000 7fbd69ffb700 1 -- 172.21.15.84:0/1182162940 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbd6c0cdfe0 msgr2=0x7fbd6c0b8ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:16.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.842+0000 7fbd69ffb700 1 --2- 172.21.15.84:0/1182162940 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbd6c0cdfe0 0x7fbd6c0b8ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:16.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.842+0000 7fbd69ffb700 1 -- 172.21.15.84:0/1182162940 >> v1:172.21.15.161:6789/0 conn(0x7fbd6c0d2bf0 legacy=0x7fbd6c0d1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:16.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.842+0000 7fbd69ffb700 1 -- 172.21.15.84:0/1182162940 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd6c0d2110 con 0x7fbd6c15d6e0 2023-09-13T08:25:16.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.842+0000 7fbd69ffb700 1 -- 172.21.15.84:0/1182162940 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2302733408 0 0) 0x7fbd60001670 con 0x7fbd6c15d6e0 2023-09-13T08:25:16.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.842+0000 7fbd69ffb700 1 -- 172.21.15.84:0/1182162940 >> v1:172.21.15.84:6789/0 conn(0x7fbd6c15d6e0 legacy=0x7fbd6c0ce3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:16.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.842+0000 7fbd69ffb700 1 --2- 172.21.15.84:0/1182162940 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbd54003bc0 0x7fbd54003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:16.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.842+0000 7fbd69ffb700 1 --2- 172.21.15.84:0/1182162940 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd54004850 0x7fbd54004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:16.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.842+0000 7fbd69ffb700 1 --2- 172.21.15.84:0/1182162940 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbd54005210 0x7fbd5400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:16.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.842+0000 7fbd69ffb700 1 -- 172.21.15.84:0/1182162940 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6c0d30a0 con 0x7fbd54004850 2023-09-13T08:25:16.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.842+0000 7fbd69ffb700 1 -- 172.21.15.84:0/1182162940 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd5400bf80 con 0x7fbd54003bc0 2023-09-13T08:25:16.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.842+0000 7fbd69ffb700 1 -- 172.21.15.84:0/1182162940 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd5400c140 con 0x7fbd54005210 2023-09-13T08:25:16.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.842+0000 7fbd6affd700 1 --2- 172.21.15.84:0/1182162940 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbd6c0cdfe0 0x7fbd6c0b8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T08:25:16.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.842+0000 7fbd6a7fc700 1 --2- 172.21.15.84:0/1182162940 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd54004850 0x7fbd54004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:16.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.842+0000 7fbd6b7fe700 1 --2- 172.21.15.84:0/1182162940 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbd54005210 0x7fbd5400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:16.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.843+0000 7fbd6affd700 1 --2- 172.21.15.84:0/1182162940 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbd54003bc0 0x7fbd54003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:16.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.843+0000 7fbd6a7fc700 1 -- 172.21.15.84:0/1182162940 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbd54005210 msgr2=0x7fbd5400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:16.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.843+0000 7fbd6a7fc700 1 --2- 172.21.15.84:0/1182162940 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbd54005210 0x7fbd5400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:16.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.843+0000 7fbd6a7fc700 1 -- 172.21.15.84:0/1182162940 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbd54003bc0 msgr2=0x7fbd54003fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:16.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.843+0000 7fbd6a7fc700 1 --2- 172.21.15.84:0/1182162940 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbd54003bc0 0x7fbd54003fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:16.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.843+0000 7fbd6a7fc700 1 -- 172.21.15.84:0/1182162940 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd540035b0 con 0x7fbd54004850 2023-09-13T08:25:16.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.843+0000 7fbd6a7fc700 1 --2- 172.21.15.84:0/1182162940 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd54004850 0x7fbd54004cd0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c15dae0 tx=0x7fbd54005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4463c316d1ac34c0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:16.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.843+0000 7fbd69ffb700 1 -- 172.21.15.84:0/1182162940 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd6000cd20 con 0x7fbd54004850 2023-09-13T08:25:16.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.843+0000 7fbd69ffb700 1 -- 172.21.15.84:0/1182162940 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd60001af0 con 0x7fbd54004850 2023-09-13T08:25:16.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.843+0000 7fbd69ffb700 1 -- 172.21.15.84:0/1182162940 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd6000cea0 con 0x7fbd54004850 2023-09-13T08:25:16.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.843+0000 7fbd719cf700 1 -- 172.21.15.84:0/1182162940 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd54004850 msgr2=0x7fbd54004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:16.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.843+0000 7fbd719cf700 1 --2- 172.21.15.84:0/1182162940 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd54004850 0x7fbd54004cd0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c15dae0 tx=0x7fbd54005880 comp rx=0 tx=0).stop 2023-09-13T08:25:16.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.843+0000 7fbd6b7fe700 1 -- 172.21.15.84:0/1182162940 reap_dead start 2023-09-13T08:25:16.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.843+0000 7fbd719cf700 1 -- 172.21.15.84:0/1182162940 shutdown_connections 2023-09-13T08:25:16.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.843+0000 7fbd719cf700 1 -- 172.21.15.84:0/1182162940 >> 172.21.15.84:0/1182162940 conn(0x7fbd6c06b110 msgr2=0x7fbd6c06b4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:16.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.843+0000 7fbd719cf700 1 -- 172.21.15.84:0/1182162940 shutdown_connections 2023-09-13T08:25:16.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.844+0000 7fbd719cf700 1 -- 172.21.15.84:0/1182162940 wait complete. 2023-09-13T08:25:16.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.845+0000 7fbd719cf700 1 Processor -- start 2023-09-13T08:25:16.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.845+0000 7fbd719cf700 1 -- start start 2023-09-13T08:25:16.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.846+0000 7fbd719cf700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd54004850 0x7fbd6c158c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:16.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.846+0000 7fbd719cf700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbd6c0ca370 0x7fbd6c14b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:16.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.846+0000 7fbd719cf700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbd6c1e8190 0x7fbd6c1e8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:16.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.846+0000 7fbd719cf700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6c1e8b50 con 0x7fbd54004850 2023-09-13T08:25:16.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.846+0000 7fbd719cf700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6c0b5b00 con 0x7fbd6c0ca370 2023-09-13T08:25:16.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.846+0000 7fbd719cf700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6c1e76a0 con 0x7fbd6c1e8190 2023-09-13T08:25:16.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.846+0000 7fbd6affd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd54004850 0x7fbd6c158c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:16.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.846+0000 7fbd6affd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd54004850 0x7fbd6c158c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44372/0 (socket says 172.21.15.84:44372) 2023-09-13T08:25:16.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.846+0000 7fbd6affd700 1 -- 172.21.15.84:0/3981583279 learned_addr learned my addr 172.21.15.84:0/3981583279 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:16.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.846+0000 7fbd6a7fc700 1 --2- 172.21.15.84:0/3981583279 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbd6c0ca370 0x7fbd6c14b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:16.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.846+0000 7fbd6b7fe700 1 --2- 172.21.15.84:0/3981583279 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbd6c1e8190 0x7fbd6c1e8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:16.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.846+0000 7fbd6affd700 1 -- 172.21.15.84:0/3981583279 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbd6c1e8190 msgr2=0x7fbd6c1e8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:16.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.846+0000 7fbd6affd700 1 --2- 172.21.15.84:0/3981583279 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbd6c1e8190 0x7fbd6c1e8610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:16.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.846+0000 7fbd6affd700 1 -- 172.21.15.84:0/3981583279 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbd6c0ca370 msgr2=0x7fbd6c14b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:16.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.846+0000 7fbd6affd700 1 --2- 172.21.15.84:0/3981583279 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbd6c0ca370 0x7fbd6c14b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:16.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.846+0000 7fbd6affd700 1 -- 172.21.15.84:0/3981583279 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd6c0b4f50 con 0x7fbd54004850 2023-09-13T08:25:16.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.846+0000 7fbd6affd700 1 --2- 172.21.15.84:0/3981583279 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd54004850 0x7fbd6c158c60 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c011800 tx=0x7fbd5c011b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:16.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.846+0000 7fbd53fff700 1 -- 172.21.15.84:0/3981583279 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd5c015870 con 0x7fbd54004850 2023-09-13T08:25:16.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.846+0000 7fbd53fff700 1 -- 172.21.15.84:0/3981583279 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd5c0159d0 con 0x7fbd54004850 2023-09-13T08:25:16.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.846+0000 7fbd719cf700 1 -- 172.21.15.84:0/3981583279 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd6c14beb0 con 0x7fbd54004850 2023-09-13T08:25:16.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.846+0000 7fbd53fff700 1 -- 172.21.15.84:0/3981583279 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd5c015d80 con 0x7fbd54004850 2023-09-13T08:25:16.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.846+0000 7fbd719cf700 1 -- 172.21.15.84:0/3981583279 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd6c0b54b0 con 0x7fbd54004850 2023-09-13T08:25:16.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.847+0000 7fbd719cf700 1 -- 172.21.15.84:0/3981583279 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd6c067a50 con 0x7fbd54004850 2023-09-13T08:25:16.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.848+0000 7fbd53fff700 1 -- 172.21.15.84:0/3981583279 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fbd5c013400 con 0x7fbd54004850 2023-09-13T08:25:16.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.848+0000 7fbd53fff700 1 --2- 172.21.15.84:0/3981583279 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fbd5806a580 0x7fbd5806ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:16.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.848+0000 7fbd6a7fc700 1 --2- 172.21.15.84:0/3981583279 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fbd5806a580 0x7fbd5806ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:16.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.848+0000 7fbd53fff700 1 -- 172.21.15.84:0/3981583279 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbd5c089190 con 0x7fbd54004850 2023-09-13T08:25:16.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.849+0000 7fbd6a7fc700 1 --2- 172.21.15.84:0/3981583279 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fbd5806a580 0x7fbd5806ca40 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fbd600018b0 tx=0x7fbd6000a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:16.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:16.853+0000 7fbd53fff700 1 -- 172.21.15.84:0/3981583279 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fbd5c054390 con 0x7fbd54004850 2023-09-13T08:25:17.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.044+0000 7fbd719cf700 1 -- 172.21.15.84:0/3981583279 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbd6c04e9b0 con 0x7fbd54004850 2023-09-13T08:25:17.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.045+0000 7fbd53fff700 1 -- 172.21.15.84:0/3981583279 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18322 (secure 0 0 0) 0x7fbd5c0579b0 con 0x7fbd54004850 2023-09-13T08:25:17.045 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:25:17.046 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":24,"fsid":"0107440b-b634-42c5-a643-5d31ea826116","created":"2023-09-13T08:24:16.931917+0000","modified":"2023-09-13T08:24:47.176259+0000","last_up_change":"2023-09-13T08:24:28.422631+0000","last_in_change":"2023-09-13T08:24:19.425578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T08:24:28.583720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-13T08:24:39.862832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-13T08:24:41.145511+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-13T08:24:44.775160+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4a53ec12-1469-4356-b4e1-2b8fc9b7c0f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6817","nonce":1599532366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6819","nonce":1599532366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6823","nonce":1599532366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6821","nonce":1599532366}]},"public_addr":"172.21.15.84:6817/1599532366","cluster_addr":"172.21.15.84:6819/1599532366","heartbeat_back_addr":"172.21.15.84:6823/1599532366","heartbeat_front_addr":"172.21.15.84:6821/1599532366","state":["exists","up"]},{"osd":1,"uuid":"11e964a0-b80c-4afc-bfbf-e2067969db29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6825","nonce":461860977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6827","nonce":461860977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6831","nonce":461860977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6829","nonce":461860977}]},"public_addr":"172.21.15.84:6825/461860977","cluster_addr":"172.21.15.84:6827/461860977","heartbeat_back_addr":"172.21.15.84:6831/461860977","heartbeat_front_addr":"172.21.15.84:6829/461860977","state":["exists","up"]},{"osd":2,"uuid":"3ce74529-4dd1-44c7-9576-968f5fdc0c25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6809","nonce":1168316165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6811","nonce":1168316165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6815","nonce":1168316165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6813","nonce":1168316165}]},"public_addr":"172.21.15.84:6809/1168316165","cluster_addr":"172.21.15.84:6811/1168316165","heartbeat_back_addr":"172.21.15.84:6815/1168316165","heartbeat_front_addr":"172.21.15.84:6813/1168316165","state":["exists","up"]},{"osd":3,"uuid":"460cb5c5-590a-4d06-a4d9-5bac2fdf33b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6801","nonce":1661609810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6803","nonce":1661609810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6807","nonce":1661609810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6805","nonce":1661609810}]},"public_addr":"172.21.15.84:6801/1661609810","cluster_addr":"172.21.15.84:6803/1661609810","heartbeat_back_addr":"172.21.15.84:6807/1661609810","heartbeat_front_addr":"172.21.15.84:6805/1661609810","state":["exists","up"]},{"osd":4,"uuid":"bf237dd0-3ebd-44b5-8078-24a63e00d792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6801","nonce":1303562374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6803","nonce":1303562374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6807","nonce":1303562374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6805","nonce":1303562374}]},"public_addr":"172.21.15.161:6801/1303562374","cluster_addr":"172.21.15.161:6803/1303562374","heartbeat_back_addr":"172.21.15.161:6807/1303562374","heartbeat_front_addr":"172.21.15.161:6805/1303562374","state":["exists","up"]},{"osd":5,"uuid":"e1e538e0-5844-456b-8c6e-434d3a914af1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6818","nonce":961120854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6822","nonce":961120854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6830","nonce":961120854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6826","nonce":961120854}]},"public_addr":"172.21.15.161:6818/961120854","cluster_addr":"172.21.15.161:6822/961120854","heartbeat_back_addr":"172.21.15.161:6830/961120854","heartbeat_front_addr":"172.21.15.161:6826/961120854","state":["exists","up"]},{"osd":6,"uuid":"5cb1785e-960f-4dd4-b295-9e21b2c3f875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6809","nonce":980533466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6811","nonce":980533466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6815","nonce":980533466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6813","nonce":980533466}]},"public_addr":"172.21.15.161:6809/980533466","cluster_addr":"172.21.15.161:6811/980533466","heartbeat_back_addr":"172.21.15.161:6815/980533466","heartbeat_front_addr":"172.21.15.161:6813/980533466","state":["exists","up"]},{"osd":7,"uuid":"5acb6619-e933-4b46-b1c2-60af30acb839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6817","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6819","nonce":2479691549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6821","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6823","nonce":2479691549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6829","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6831","nonce":2479691549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6825","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6827","nonce":2479691549}]},"public_addr":"172.21.15.161:6819/2479691549","cluster_addr":"172.21.15.161:6823/2479691549","heartbeat_back_addr":"172.21.15.161:6831/2479691549","heartbeat_front_addr":"172.21.15.161:6827/2479691549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.678857+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.685341+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.613603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.634940+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.564387+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.697347+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.637437+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.619397+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T08:25:17.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.047+0000 7fbd719cf700 1 -- 172.21.15.84:0/3981583279 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fbd5806a580 msgr2=0x7fbd5806ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:17.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.047+0000 7fbd719cf700 1 --2- 172.21.15.84:0/3981583279 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fbd5806a580 0x7fbd5806ca40 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fbd600018b0 tx=0x7fbd6000a000 comp rx=0 tx=0).stop 2023-09-13T08:25:17.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.047+0000 7fbd719cf700 1 -- 172.21.15.84:0/3981583279 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd54004850 msgr2=0x7fbd6c158c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:17.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.047+0000 7fbd719cf700 1 --2- 172.21.15.84:0/3981583279 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd54004850 0x7fbd6c158c60 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c011800 tx=0x7fbd5c011b10 comp rx=0 tx=0).stop 2023-09-13T08:25:17.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.047+0000 7fbd719cf700 1 -- 172.21.15.84:0/3981583279 shutdown_connections 2023-09-13T08:25:17.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.047+0000 7fbd719cf700 1 --2- 172.21.15.84:0/3981583279 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbd6c1e8190 0x7fbd6c1e8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:17.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.047+0000 7fbd719cf700 1 --2- 172.21.15.84:0/3981583279 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd54004850 0x7fbd6c158c60 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:17.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.047+0000 7fbd719cf700 1 --2- 172.21.15.84:0/3981583279 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fbd5806a580 0x7fbd5806ca40 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:17.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.047+0000 7fbd719cf700 1 --2- 172.21.15.84:0/3981583279 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbd6c0ca370 0x7fbd6c14b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:17.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.047+0000 7fbd719cf700 1 -- 172.21.15.84:0/3981583279 >> 172.21.15.84:0/3981583279 conn(0x7fbd6c06b110 msgr2=0x7fbd6c15db10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:17.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.047+0000 7fbd719cf700 1 -- 172.21.15.84:0/3981583279 shutdown_connections 2023-09-13T08:25:17.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.048+0000 7fbd719cf700 1 -- 172.21.15.84:0/3981583279 wait complete. 2023-09-13T08:25:17.060 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T08:25:17.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.180+0000 7f5e7210b700 1 Processor -- start 2023-09-13T08:25:17.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.180+0000 7f5e7210b700 1 -- start start 2023-09-13T08:25:17.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.181+0000 7f5e7210b700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5e6c15d530 0x7f5e6c161bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:17.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.181+0000 7f5e7210b700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5e6c0ca920 0x7f5e6c06d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:17.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.181+0000 7f5e7210b700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e6c1620f0 con 0x7f5e6c06a620 2023-09-13T08:25:17.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.181+0000 7f5e7210b700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e6c0cff20 con 0x7f5e6c15d530 2023-09-13T08:25:17.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.181+0000 7f5e7210b700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e6c0cae50 con 0x7f5e6c0ca920 2023-09-13T08:25:17.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.181+0000 7f5e6bfff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f5e6c06a620 0x7f5e6c0ce490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:47030/0 (socket says 172.21.15.84:47030) 2023-09-13T08:25:17.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.181+0000 7f5e6bfff700 1 -- 172.21.15.84:0/2479659014 learned_addr learned my addr 172.21.15.84:0/2479659014 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:25:17.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.181+0000 7f5e6b7fe700 1 --2- 172.21.15.84:0/2479659014 >> v2:172.21.15.161:3300/0 conn(0x7f5e6c15d530 0x7f5e6c161bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:17.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.181+0000 7f5e6affd700 1 --2- 172.21.15.84:0/2479659014 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5e6c0ca920 0x7f5e6c06d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:17.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.181+0000 7f5e6a7fc700 1 -- 172.21.15.84:0/2479659014 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1923816601 0 0) 0x7f5e6c1620f0 con 0x7f5e6c06a620 2023-09-13T08:25:17.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.181+0000 7f5e6a7fc700 1 -- 172.21.15.84:0/2479659014 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e540035b0 con 0x7f5e6c06a620 2023-09-13T08:25:17.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.182+0000 7f5e6a7fc700 1 -- 172.21.15.84:0/2479659014 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 342691727 0 0) 0x7f5e540035b0 con 0x7f5e6c06a620 2023-09-13T08:25:17.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.182+0000 7f5e6a7fc700 1 -- 172.21.15.84:0/2479659014 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5e6c0ca920 msgr2=0x7f5e6c06d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:17.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.182+0000 7f5e6a7fc700 1 --2- 172.21.15.84:0/2479659014 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5e6c0ca920 0x7f5e6c06d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:17.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.182+0000 7f5e6a7fc700 1 -- 172.21.15.84:0/2479659014 >> v2:172.21.15.161:3300/0 conn(0x7f5e6c15d530 msgr2=0x7f5e6c161bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:17.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.182+0000 7f5e6a7fc700 1 --2- 172.21.15.84:0/2479659014 >> v2:172.21.15.161:3300/0 conn(0x7f5e6c15d530 0x7f5e6c161bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:17.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.182+0000 7f5e6a7fc700 1 -- 172.21.15.84:0/2479659014 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e6c0cb130 con 0x7f5e6c06a620 2023-09-13T08:25:17.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.182+0000 7f5e6a7fc700 1 -- 172.21.15.84:0/2479659014 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2302733408 0 0) 0x7f5e640019f0 con 0x7f5e6c06a620 2023-09-13T08:25:17.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.182+0000 7f5e6b7fe700 1 --2- 172.21.15.84:0/2479659014 >> v2:172.21.15.161:3300/0 conn(0x7f5e6c15d530 0x7f5e6c161bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T08:25:17.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.182+0000 7f5e6a7fc700 1 -- 172.21.15.84:0/2479659014 >> v1:172.21.15.84:6789/0 conn(0x7f5e6c06a620 legacy=0x7f5e6c0ce490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:17.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.182+0000 7f5e6a7fc700 1 --2- 172.21.15.84:0/2479659014 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5e54003a00 0x7f5e54003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:17.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.182+0000 7f5e6a7fc700 1 --2- 172.21.15.84:0/2479659014 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e54004850 0x7f5e54004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:17.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.182+0000 7f5e6a7fc700 1 --2- 172.21.15.84:0/2479659014 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5e6c0ca920 0x7f5e54005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:17.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.182+0000 7f5e6a7fc700 1 -- 172.21.15.84:0/2479659014 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e6c0cae50 con 0x7f5e54004850 2023-09-13T08:25:17.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.182+0000 7f5e6a7fc700 1 -- 172.21.15.84:0/2479659014 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5400ba10 con 0x7f5e54003a00 2023-09-13T08:25:17.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.182+0000 7f5e6a7fc700 1 -- 172.21.15.84:0/2479659014 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5400bb50 con 0x7f5e6c0ca920 2023-09-13T08:25:17.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.182+0000 7f5e6affd700 1 --2- 172.21.15.84:0/2479659014 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e54004850 0x7f5e54004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:17.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.182+0000 7f5e6b7fe700 1 --2- 172.21.15.84:0/2479659014 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5e54003a00 0x7f5e54003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:17.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.182+0000 7f5e6bfff700 1 --2- 172.21.15.84:0/2479659014 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5e6c0ca920 0x7f5e54005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:17.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.182+0000 7f5e6affd700 1 -- 172.21.15.84:0/2479659014 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5e6c0ca920 msgr2=0x7f5e54005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:17.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.182+0000 7f5e6affd700 1 --2- 172.21.15.84:0/2479659014 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5e6c0ca920 0x7f5e54005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:17.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.182+0000 7f5e6affd700 1 -- 172.21.15.84:0/2479659014 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5e54003a00 msgr2=0x7f5e54003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:17.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.182+0000 7f5e6affd700 1 --2- 172.21.15.84:0/2479659014 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5e54003a00 0x7f5e54003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:17.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.182+0000 7f5e6affd700 1 -- 172.21.15.84:0/2479659014 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e540035b0 con 0x7f5e54004850 2023-09-13T08:25:17.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.182+0000 7f5e6affd700 1 --2- 172.21.15.84:0/2479659014 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e54004850 0x7f5e54004cd0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c009b30 tx=0x7f5e54005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee5ceadcf30ec185 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:17.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.182+0000 7f5e6a7fc700 1 -- 172.21.15.84:0/2479659014 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e5c00e6c0 con 0x7f5e54004850 2023-09-13T08:25:17.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.182+0000 7f5e6a7fc700 1 -- 172.21.15.84:0/2479659014 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e5c00e820 con 0x7f5e54004850 2023-09-13T08:25:17.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.182+0000 7f5e6a7fc700 1 -- 172.21.15.84:0/2479659014 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e5c00eb90 con 0x7f5e54004850 2023-09-13T08:25:17.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.183+0000 7f5e7210b700 1 -- 172.21.15.84:0/2479659014 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e54004850 msgr2=0x7f5e54004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:17.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.183+0000 7f5e7210b700 1 --2- 172.21.15.84:0/2479659014 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e54004850 0x7f5e54004cd0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c009b30 tx=0x7f5e54005880 comp rx=0 tx=0).stop 2023-09-13T08:25:17.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.183+0000 7f5e6bfff700 1 -- 172.21.15.84:0/2479659014 reap_dead start 2023-09-13T08:25:17.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.183+0000 7f5e7210b700 1 -- 172.21.15.84:0/2479659014 shutdown_connections 2023-09-13T08:25:17.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.183+0000 7f5e7210b700 1 -- 172.21.15.84:0/2479659014 >> 172.21.15.84:0/2479659014 conn(0x7f5e6c0d00c0 msgr2=0x7f5e6c0d04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:17.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.183+0000 7f5e7210b700 1 -- 172.21.15.84:0/2479659014 shutdown_connections 2023-09-13T08:25:17.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.183+0000 7f5e7210b700 1 -- 172.21.15.84:0/2479659014 wait complete. 2023-09-13T08:25:17.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.184+0000 7f5e7210b700 1 Processor -- start 2023-09-13T08:25:17.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.184+0000 7f5e7210b700 1 -- start start 2023-09-13T08:25:17.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.185+0000 7f5e7210b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e54004850 0x7f5e6c1530f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:17.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.185+0000 7f5e7210b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5e6c153630 0x7f5e6c1f6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:17.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.185+0000 7f5e7210b700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5e6c1f6640 0x7f5e6c151c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:17.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.185+0000 7f5e7210b700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e6c1f6ac0 con 0x7f5e54004850 2023-09-13T08:25:17.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.185+0000 7f5e7210b700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e6c156150 con 0x7f5e6c153630 2023-09-13T08:25:17.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.185+0000 7f5e7210b700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e6c153c60 con 0x7f5e6c1f6640 2023-09-13T08:25:17.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.185+0000 7f5e6b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e54004850 0x7f5e6c1530f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:17.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.185+0000 7f5e6b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e54004850 0x7f5e6c1530f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44392/0 (socket says 172.21.15.84:44392) 2023-09-13T08:25:17.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.185+0000 7f5e6b7fe700 1 -- 172.21.15.84:0/4022684785 learned_addr learned my addr 172.21.15.84:0/4022684785 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:17.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.185+0000 7f5e6b7fe700 1 -- 172.21.15.84:0/4022684785 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5e6c1f6640 msgr2=0x7f5e6c151c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:17.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.185+0000 7f5e6b7fe700 1 --2- 172.21.15.84:0/4022684785 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5e6c1f6640 0x7f5e6c151c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:17.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.185+0000 7f5e6b7fe700 1 -- 172.21.15.84:0/4022684785 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5e6c153630 msgr2=0x7f5e6c1f6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:17.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.185+0000 7f5e6b7fe700 1 --2- 172.21.15.84:0/4022684785 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5e6c153630 0x7f5e6c1f6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:17.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.185+0000 7f5e6b7fe700 1 -- 172.21.15.84:0/4022684785 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e6c153f40 con 0x7f5e54004850 2023-09-13T08:25:17.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.186+0000 7f5e6b7fe700 1 --2- 172.21.15.84:0/4022684785 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e54004850 0x7f5e6c1530f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f5e60011c20 tx=0x7f5e6000f240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:17.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.186+0000 7f5e53fff700 1 -- 172.21.15.84:0/4022684785 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6000fb00 con 0x7f5e54004850 2023-09-13T08:25:17.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.186+0000 7f5e53fff700 1 -- 172.21.15.84:0/4022684785 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e6000fc60 con 0x7f5e54004850 2023-09-13T08:25:17.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.186+0000 7f5e7210b700 1 -- 172.21.15.84:0/4022684785 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e6c154220 con 0x7f5e54004850 2023-09-13T08:25:17.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.186+0000 7f5e53fff700 1 -- 172.21.15.84:0/4022684785 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e60004020 con 0x7f5e54004850 2023-09-13T08:25:17.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.186+0000 7f5e7210b700 1 -- 172.21.15.84:0/4022684785 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e6c1547e0 con 0x7f5e54004850 2023-09-13T08:25:17.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.187+0000 7f5e7210b700 1 -- 172.21.15.84:0/4022684785 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e6c0c89d0 con 0x7f5e54004850 2023-09-13T08:25:17.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.187+0000 7f5e53fff700 1 -- 172.21.15.84:0/4022684785 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f5e60004180 con 0x7f5e54004850 2023-09-13T08:25:17.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.188+0000 7f5e53fff700 1 --2- 172.21.15.84:0/4022684785 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f5e5806a580 0x7f5e5806ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:17.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.188+0000 7f5e53fff700 1 -- 172.21.15.84:0/4022684785 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5e60089690 con 0x7f5e54004850 2023-09-13T08:25:17.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.188+0000 7f5e6affd700 1 --2- 172.21.15.84:0/4022684785 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f5e5806a580 0x7f5e5806ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:17.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.188+0000 7f5e6affd700 1 --2- 172.21.15.84:0/4022684785 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f5e5806a580 0x7f5e5806ca40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c1f3c40 tx=0x7f5e5c013000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:17.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.192+0000 7f5e53fff700 1 -- 172.21.15.84:0/4022684785 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f5e600549b0 con 0x7f5e54004850 2023-09-13T08:25:17.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.425+0000 7f5e7210b700 1 -- 172.21.15.84:0/4022684785 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5e6c04e9b0 con 0x7f5e54004850 2023-09-13T08:25:17.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.426+0000 7f5e53fff700 1 -- 172.21.15.84:0/4022684785 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4909 (secure 0 0 0) 0x7f5e60022090 con 0x7f5e54004850 2023-09-13T08:25:17.426 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:25:17.427 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/3581118217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6833","nonce":3581118217},{"type":"v1","addr":"172.21.15.161:6835","nonce":3581118217}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4296,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/566416855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":566416855},{"type":"v1","addr":"172.21.15.84:6835","nonce":566416855}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4299,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/482729238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":482729238},{"type":"v1","addr":"172.21.15.84:6837","nonce":482729238}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T08:24:42.132788+0000","modified":"2023-09-13T08:25:05.211766+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4314},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4314":{"gid":4314,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.161:6834/2524298549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":2524298549},{"type":"v1","addr":"172.21.15.161:6834","nonce":2524298549}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-13T08:25:17.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.428+0000 7f5e7210b700 1 -- 172.21.15.84:0/4022684785 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f5e5806a580 msgr2=0x7f5e5806ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:17.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.428+0000 7f5e7210b700 1 --2- 172.21.15.84:0/4022684785 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f5e5806a580 0x7f5e5806ca40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c1f3c40 tx=0x7f5e5c013000 comp rx=0 tx=0).stop 2023-09-13T08:25:17.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.428+0000 7f5e7210b700 1 -- 172.21.15.84:0/4022684785 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e54004850 msgr2=0x7f5e6c1530f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:17.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.428+0000 7f5e7210b700 1 --2- 172.21.15.84:0/4022684785 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e54004850 0x7f5e6c1530f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f5e60011c20 tx=0x7f5e6000f240 comp rx=0 tx=0).stop 2023-09-13T08:25:17.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.428+0000 7f5e7210b700 1 -- 172.21.15.84:0/4022684785 shutdown_connections 2023-09-13T08:25:17.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.428+0000 7f5e7210b700 1 --2- 172.21.15.84:0/4022684785 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5e6c1f6640 0x7f5e6c151c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:17.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.428+0000 7f5e7210b700 1 --2- 172.21.15.84:0/4022684785 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e54004850 0x7f5e6c1530f0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:17.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.428+0000 7f5e7210b700 1 --2- 172.21.15.84:0/4022684785 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f5e5806a580 0x7f5e5806ca40 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:17.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.428+0000 7f5e7210b700 1 --2- 172.21.15.84:0/4022684785 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5e6c153630 0x7f5e6c1f6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:17.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.428+0000 7f5e7210b700 1 -- 172.21.15.84:0/4022684785 >> 172.21.15.84:0/4022684785 conn(0x7f5e6c0d00c0 msgr2=0x7f5e6c15c6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:17.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.428+0000 7f5e7210b700 1 -- 172.21.15.84:0/4022684785 shutdown_connections 2023-09-13T08:25:17.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.428+0000 7f5e7210b700 1 -- 172.21.15.84:0/4022684785 wait complete. 2023-09-13T08:25:17.431 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 9 2023-09-13T08:25:17.842 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-09-13T08:24:42.132788+0000', 'modified': '2023-09-13T08:25:05.211766+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4314}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4314': {'gid': 4314, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.161:6834/2524298549', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.161:6832', 'nonce': 2524298549}, {'type': 'v1', 'addr': '172.21.15.161:6834', 'nonce': 2524298549}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-09-13T08:25:17.843 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-09-13T08:25:17.843 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-09-13T08:25:17.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.967+0000 7fc4695ab700 1 Processor -- start 2023-09-13T08:25:17.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.967+0000 7fc4695ab700 1 -- start start 2023-09-13T08:25:17.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.968+0000 7fc4695ab700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc4640cdfe0 0x7fc4640b8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:17.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.968+0000 7fc4695ab700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4640d3060 con 0x7fc46415d6e0 2023-09-13T08:25:17.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.968+0000 7fc4695ab700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4640d1b50 con 0x7fc4640d2bf0 2023-09-13T08:25:17.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.968+0000 7fc4695ab700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4640d1e30 con 0x7fc4640cdfe0 2023-09-13T08:25:17.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.968+0000 7fc4627fc700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fc46415d6e0 0x7fc4640ce3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:47046/0 (socket says 172.21.15.84:47046) 2023-09-13T08:25:17.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.968+0000 7fc4627fc700 1 -- 172.21.15.84:0/2389521771 learned_addr learned my addr 172.21.15.84:0/2389521771 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:25:17.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.968+0000 7fc462ffd700 1 --2- 172.21.15.84:0/2389521771 >> v2:172.21.15.161:3300/0 conn(0x7fc4640cdfe0 0x7fc4640b8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:17.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.968+0000 7fc461ffb700 1 -- 172.21.15.84:0/2389521771 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 932861061 0 0) 0x7fc4640d3060 con 0x7fc46415d6e0 2023-09-13T08:25:17.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.968+0000 7fc461ffb700 1 -- 172.21.15.84:0/2389521771 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc44c0035b0 con 0x7fc46415d6e0 2023-09-13T08:25:17.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.968+0000 7fc461ffb700 1 -- 172.21.15.84:0/2389521771 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2644968011 0 0) 0x7fc44c0035b0 con 0x7fc46415d6e0 2023-09-13T08:25:17.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.968+0000 7fc461ffb700 1 -- 172.21.15.84:0/2389521771 >> v2:172.21.15.161:3300/0 conn(0x7fc4640cdfe0 msgr2=0x7fc4640b8ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:17.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.968+0000 7fc461ffb700 1 --2- 172.21.15.84:0/2389521771 >> v2:172.21.15.161:3300/0 conn(0x7fc4640cdfe0 0x7fc4640b8ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:17.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.968+0000 7fc461ffb700 1 -- 172.21.15.84:0/2389521771 >> v1:172.21.15.161:6789/0 conn(0x7fc4640d2bf0 legacy=0x7fc4640d1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:17.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.968+0000 7fc461ffb700 1 -- 172.21.15.84:0/2389521771 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4640d2110 con 0x7fc46415d6e0 2023-09-13T08:25:17.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.968+0000 7fc461ffb700 1 -- 172.21.15.84:0/2389521771 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2302733408 0 0) 0x7fc458001670 con 0x7fc46415d6e0 2023-09-13T08:25:17.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.968+0000 7fc461ffb700 1 -- 172.21.15.84:0/2389521771 >> v1:172.21.15.84:6789/0 conn(0x7fc46415d6e0 legacy=0x7fc4640ce3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:17.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.968+0000 7fc461ffb700 1 --2- 172.21.15.84:0/2389521771 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc44c003a00 0x7fc44c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:17.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.968+0000 7fc461ffb700 1 --2- 172.21.15.84:0/2389521771 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc44c004850 0x7fc44c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:17.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.968+0000 7fc461ffb700 1 --2- 172.21.15.84:0/2389521771 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc44c005210 0x7fc44c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:17.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.968+0000 7fc461ffb700 1 -- 172.21.15.84:0/2389521771 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4640d1e30 con 0x7fc44c005210 2023-09-13T08:25:17.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.968+0000 7fc461ffb700 1 -- 172.21.15.84:0/2389521771 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc44c00c0c0 con 0x7fc44c003a00 2023-09-13T08:25:17.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.968+0000 7fc461ffb700 1 -- 172.21.15.84:0/2389521771 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc44c00c280 con 0x7fc44c004850 2023-09-13T08:25:17.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.968+0000 7fc4637fe700 1 --2- 172.21.15.84:0/2389521771 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc44c005210 0x7fc44c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:17.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.969+0000 7fc462ffd700 1 --2- 172.21.15.84:0/2389521771 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc44c003a00 0x7fc44c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:17.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.969+0000 7fc4627fc700 1 --2- 172.21.15.84:0/2389521771 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc44c004850 0x7fc44c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:17.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.969+0000 7fc4637fe700 1 -- 172.21.15.84:0/2389521771 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc44c004850 msgr2=0x7fc44c004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:17.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.969+0000 7fc4637fe700 1 --2- 172.21.15.84:0/2389521771 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc44c004850 0x7fc44c004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:17.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.969+0000 7fc4637fe700 1 -- 172.21.15.84:0/2389521771 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc44c003a00 msgr2=0x7fc44c003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:17.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.969+0000 7fc4637fe700 1 --2- 172.21.15.84:0/2389521771 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc44c003a00 0x7fc44c003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:17.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.969+0000 7fc4637fe700 1 -- 172.21.15.84:0/2389521771 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc44c0035b0 con 0x7fc44c005210 2023-09-13T08:25:17.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.969+0000 7fc4627fc700 1 --2- 172.21.15.84:0/2389521771 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc44c004850 0x7fc44c004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T08:25:17.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.969+0000 7fc4637fe700 1 -- 172.21.15.84:0/2389521771 reap_dead start 2023-09-13T08:25:17.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.969+0000 7fc4637fe700 1 --2- 172.21.15.84:0/2389521771 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc44c005210 0x7fc44c00ba10 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc45c00c190 tx=0x7fc44c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58de7ec48b30940e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:17.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.969+0000 7fc461ffb700 1 -- 172.21.15.84:0/2389521771 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc45c001db0 con 0x7fc44c005210 2023-09-13T08:25:17.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.969+0000 7fc461ffb700 1 -- 172.21.15.84:0/2389521771 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc45c00ccf0 con 0x7fc44c005210 2023-09-13T08:25:17.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.969+0000 7fc461ffb700 1 -- 172.21.15.84:0/2389521771 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc45c003c40 con 0x7fc44c005210 2023-09-13T08:25:17.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.969+0000 7fc4695ab700 1 -- 172.21.15.84:0/2389521771 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc44c005210 msgr2=0x7fc44c00ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:17.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.969+0000 7fc4695ab700 1 --2- 172.21.15.84:0/2389521771 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc44c005210 0x7fc44c00ba10 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc45c00c190 tx=0x7fc44c005880 comp rx=0 tx=0).stop 2023-09-13T08:25:17.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.970+0000 7fc4695ab700 1 -- 172.21.15.84:0/2389521771 shutdown_connections 2023-09-13T08:25:17.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.970+0000 7fc4695ab700 1 --2- 172.21.15.84:0/2389521771 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc44c005210 0x7fc44c00ba10 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:17.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.970+0000 7fc4695ab700 1 -- 172.21.15.84:0/2389521771 >> 172.21.15.84:0/2389521771 conn(0x7fc46406b110 msgr2=0x7fc46406b4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:17.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.970+0000 7fc4695ab700 1 -- 172.21.15.84:0/2389521771 shutdown_connections 2023-09-13T08:25:17.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.970+0000 7fc4695ab700 1 -- 172.21.15.84:0/2389521771 wait complete. 2023-09-13T08:25:17.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.971+0000 7fc4695ab700 1 Processor -- start 2023-09-13T08:25:17.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.971+0000 7fc4695ab700 1 -- start start 2023-09-13T08:25:17.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.972+0000 7fc4695ab700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc44c005210 0x7fc4640c8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:17.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.972+0000 7fc4695ab700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc4640b5720 0x7fc464152e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:17.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.972+0000 7fc4695ab700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc4640cfad0 0x7fc4640cff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:17.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.972+0000 7fc4695ab700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4640d04a0 con 0x7fc44c005210 2023-09-13T08:25:17.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.972+0000 7fc4695ab700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc464153350 con 0x7fc4640b5720 2023-09-13T08:25:17.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.972+0000 7fc4695ab700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4640c96d0 con 0x7fc4640cfad0 2023-09-13T08:25:17.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.972+0000 7fc462ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc44c005210 0x7fc4640c8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:17.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.972+0000 7fc462ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc44c005210 0x7fc4640c8ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44412/0 (socket says 172.21.15.84:44412) 2023-09-13T08:25:17.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.972+0000 7fc462ffd700 1 -- 172.21.15.84:0/2865648514 learned_addr learned my addr 172.21.15.84:0/2865648514 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:17.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.972+0000 7fc4627fc700 1 --2- 172.21.15.84:0/2865648514 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc4640b5720 0x7fc464152e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:17.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.972+0000 7fc4637fe700 1 --2- 172.21.15.84:0/2865648514 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc4640cfad0 0x7fc4640cff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:17.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.972+0000 7fc462ffd700 1 -- 172.21.15.84:0/2865648514 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc4640cfad0 msgr2=0x7fc4640cff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:17.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.972+0000 7fc462ffd700 1 --2- 172.21.15.84:0/2865648514 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc4640cfad0 0x7fc4640cff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:17.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.972+0000 7fc462ffd700 1 -- 172.21.15.84:0/2865648514 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc4640b5720 msgr2=0x7fc464152e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:17.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.972+0000 7fc462ffd700 1 --2- 172.21.15.84:0/2865648514 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc4640b5720 0x7fc464152e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:17.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.972+0000 7fc462ffd700 1 -- 172.21.15.84:0/2865648514 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4640c99b0 con 0x7fc44c005210 2023-09-13T08:25:17.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.972+0000 7fc462ffd700 1 --2- 172.21.15.84:0/2865648514 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc44c005210 0x7fc4640c8ff0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc4540119a0 tx=0x7fc454011cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:17.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.972+0000 7fc44b7fe700 1 -- 172.21.15.84:0/2865648514 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc45400f940 con 0x7fc44c005210 2023-09-13T08:25:17.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.972+0000 7fc44b7fe700 1 -- 172.21.15.84:0/2865648514 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc45400faa0 con 0x7fc44c005210 2023-09-13T08:25:17.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.972+0000 7fc4695ab700 1 -- 172.21.15.84:0/2865648514 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4640b2e80 con 0x7fc44c005210 2023-09-13T08:25:17.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.972+0000 7fc44b7fe700 1 -- 172.21.15.84:0/2865648514 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc45400fe30 con 0x7fc44c005210 2023-09-13T08:25:17.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.972+0000 7fc4695ab700 1 -- 172.21.15.84:0/2865648514 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4640b5ba0 con 0x7fc44c005210 2023-09-13T08:25:17.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.974+0000 7fc44b7fe700 1 -- 172.21.15.84:0/2865648514 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fc454014440 con 0x7fc44c005210 2023-09-13T08:25:17.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.975+0000 7fc44b7fe700 1 --2- 172.21.15.84:0/2865648514 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fc45006a580 0x7fc45006ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:17.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.975+0000 7fc44b7fe700 1 -- 172.21.15.84:0/2865648514 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc454089350 con 0x7fc44c005210 2023-09-13T08:25:17.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.975+0000 7fc4627fc700 1 --2- 172.21.15.84:0/2865648514 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fc45006a580 0x7fc45006ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:17.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.975+0000 7fc4627fc700 1 --2- 172.21.15.84:0/2865648514 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fc45006a580 0x7fc45006ca40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc458005b80 tx=0x7fc458007040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:17.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.976+0000 7fc475790b80 1 Processor -- start 2023-09-13T08:25:17.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.977+0000 7fc475790b80 1 -- start start 2023-09-13T08:25:17.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.977+0000 7fc475790b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55bcdee7bcf0 0x55bcdee550d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:17.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.977+0000 7fc475790b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bcdee91ab0 0x55bcdee7c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:17.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.977+0000 7fc475790b80 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55bcdee7c9d0 0x55bcdee7fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:17.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.977+0000 7fc475790b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bcdedae730 con 0x55bcdee91ab0 2023-09-13T08:25:17.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.977+0000 7fc475790b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bcdedac050 con 0x55bcdee7bcf0 2023-09-13T08:25:17.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.977+0000 7fc475790b80 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bcdeda7940 con 0x55bcdee7c9d0 2023-09-13T08:25:17.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.977+0000 7fc4627fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bcdee91ab0 0x55bcdee7c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:17.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.977+0000 7fc4627fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bcdee91ab0 0x55bcdee7c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44422/0 (socket says 172.21.15.84:44422) 2023-09-13T08:25:17.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.977+0000 7fc4627fc700 1 -- 172.21.15.84:0/3451559853 learned_addr learned my addr 172.21.15.84:0/3451559853 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:17.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.978+0000 7fc4637fe700 1 --2- 172.21.15.84:0/3451559853 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55bcdee7c9d0 0x55bcdee7fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:17.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.978+0000 7fc462ffd700 1 --2- 172.21.15.84:0/3451559853 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55bcdee7bcf0 0x55bcdee550d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:17.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.978+0000 7fc4627fc700 1 -- 172.21.15.84:0/3451559853 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55bcdee7c9d0 msgr2=0x55bcdee7fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:17.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.978+0000 7fc4627fc700 1 --2- 172.21.15.84:0/3451559853 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55bcdee7c9d0 0x55bcdee7fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:17.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.978+0000 7fc4627fc700 1 -- 172.21.15.84:0/3451559853 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55bcdee7bcf0 msgr2=0x55bcdee550d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:17.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.978+0000 7fc4627fc700 1 --2- 172.21.15.84:0/3451559853 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55bcdee7bcf0 0x55bcdee550d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:17.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.978+0000 7fc4627fc700 1 -- 172.21.15.84:0/3451559853 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bcdec275e0 con 0x55bcdee91ab0 2023-09-13T08:25:17.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.978+0000 7fc4637fe700 1 --2- 172.21.15.84:0/3451559853 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55bcdee7c9d0 0x55bcdee7fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T08:25:17.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.978+0000 7fc4627fc700 1 --2- 172.21.15.84:0/3451559853 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bcdee91ab0 0x55bcdee7c490 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc458011a50 tx=0x7fc458000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ca303fa522a0d97 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:17.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.978+0000 7fc448ff9700 1 -- 172.21.15.84:0/3451559853 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc458017110 con 0x55bcdee91ab0 2023-09-13T08:25:17.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.978+0000 7fc448ff9700 1 -- 172.21.15.84:0/3451559853 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc458017270 con 0x55bcdee91ab0 2023-09-13T08:25:17.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.978+0000 7fc448ff9700 1 -- 172.21.15.84:0/3451559853 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc458017b20 con 0x55bcdee91ab0 2023-09-13T08:25:17.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.979+0000 7fc475790b80 1 -- 172.21.15.84:0/3451559853 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bcdee91ab0 msgr2=0x55bcdee7c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:17.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.979+0000 7fc475790b80 1 --2- 172.21.15.84:0/3451559853 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bcdee91ab0 0x55bcdee7c490 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc458011a50 tx=0x7fc458000ed0 comp rx=0 tx=0).stop 2023-09-13T08:25:17.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.979+0000 7fc475790b80 1 -- 172.21.15.84:0/3451559853 shutdown_connections 2023-09-13T08:25:17.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.979+0000 7fc475790b80 1 --2- 172.21.15.84:0/3451559853 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55bcdee7c9d0 0x55bcdee7fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:17.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.979+0000 7fc475790b80 1 --2- 172.21.15.84:0/3451559853 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55bcdee7bcf0 0x55bcdee550d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:17.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.979+0000 7fc475790b80 1 --2- 172.21.15.84:0/3451559853 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bcdee91ab0 0x55bcdee7c490 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:17.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.979+0000 7fc475790b80 1 -- 172.21.15.84:0/3451559853 >> 172.21.15.84:0/3451559853 conn(0x55bcdedb3c30 msgr2=0x55bcdee9aea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:18.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.979+0000 7fc475790b80 1 -- 172.21.15.84:0/3451559853 shutdown_connections 2023-09-13T08:25:18.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.979+0000 7fc475790b80 1 -- 172.21.15.84:0/3451559853 wait complete. 2023-09-13T08:25:18.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.979+0000 7fc475790b80 1 -- start start 2023-09-13T08:25:18.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.979+0000 7fc475790b80 1 Processor -- start 2023-09-13T08:25:18.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.980+0000 7fc475790b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bcdee7bcf0 0x55bcdee9eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:18.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.980+0000 7fc475790b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55bcdee7c9d0 0x55bcdee9aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:18.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.980+0000 7fc475790b80 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55bcdee91ab0 0x55bcdee9af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:18.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.980+0000 7fc475790b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bcded45b60 con 0x55bcdee7bcf0 2023-09-13T08:25:18.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.980+0000 7fc475790b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bcded45860 con 0x55bcdee7c9d0 2023-09-13T08:25:18.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.980+0000 7fc475790b80 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bcdec298d0 con 0x55bcdee91ab0 2023-09-13T08:25:18.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.980+0000 7fc475790b80 10 client.0 _ll_register_callbacks cb 0x55bcded43630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T08:25:18.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.980+0000 7fc462ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bcdee7bcf0 0x55bcdee9eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:18.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.980+0000 7fc462ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bcdee7bcf0 0x55bcdee9eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44426/0 (socket says 172.21.15.84:44426) 2023-09-13T08:25:18.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.980+0000 7fc462ffd700 1 -- 172.21.15.84:0/1148239241 learned_addr learned my addr 172.21.15.84:0/1148239241 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:18.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.980+0000 7fc4627fc700 1 --2- 172.21.15.84:0/1148239241 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55bcdee7c9d0 0x55bcdee9aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:18.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.980+0000 7fc4637fe700 1 --2- 172.21.15.84:0/1148239241 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55bcdee91ab0 0x55bcdee9af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:18.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.980+0000 7fc462ffd700 1 -- 172.21.15.84:0/1148239241 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55bcdee91ab0 msgr2=0x55bcdee9af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:18.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.980+0000 7fc462ffd700 1 --2- 172.21.15.84:0/1148239241 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55bcdee91ab0 0x55bcdee9af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:18.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.981+0000 7fc462ffd700 1 -- 172.21.15.84:0/1148239241 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55bcdee7c9d0 msgr2=0x55bcdee9aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:18.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.981+0000 7fc462ffd700 1 --2- 172.21.15.84:0/1148239241 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55bcdee7c9d0 0x55bcdee9aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:18.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.981+0000 7fc462ffd700 1 -- 172.21.15.84:0/1148239241 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc45800f040 con 0x55bcdee7bcf0 2023-09-13T08:25:18.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.981+0000 7fc4627fc700 1 --2- 172.21.15.84:0/1148239241 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55bcdee7c9d0 0x55bcdee9aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T08:25:18.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.981+0000 7fc4637fe700 1 --2- 172.21.15.84:0/1148239241 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55bcdee91ab0 0x55bcdee9af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T08:25:18.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.981+0000 7fc462ffd700 1 --2- 172.21.15.84:0/1148239241 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bcdee7bcf0 0x55bcdee9eac0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc4540875c0 tx=0x7fc454058b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b5c31e1362e4468 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:18.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.981+0000 7fc441ffb700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-09-13T08:25:18.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.981+0000 7fc441ffb700 1 -- 172.21.15.84:0/1148239241 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc45405cea0 con 0x55bcdee7bcf0 2023-09-13T08:25:18.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.981+0000 7fc441ffb700 1 -- 172.21.15.84:0/1148239241 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc454060310 con 0x55bcdee7bcf0 2023-09-13T08:25:18.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.981+0000 7fc475790b80 1 -- 172.21.15.84:0/1148239241 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bcdee48810 con 0x55bcdee7bcf0 2023-09-13T08:25:18.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.981+0000 7fc441ffb700 1 -- 172.21.15.84:0/1148239241 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc45405e0b0 con 0x55bcdee7bcf0 2023-09-13T08:25:18.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.981+0000 7fc475790b80 10 client.4869 fetch_fsmap learned FSMap version 9 2023-09-13T08:25:18.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.981+0000 7fc475790b80 1 -- 172.21.15.84:0/1148239241 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x55bcdedbf750 con 0x55bcdee7bcf0 2023-09-13T08:25:18.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.981+0000 7fc441ffb700 1 -- 172.21.15.84:0/1148239241 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55bcdee48810 con 0x55bcdee7bcf0 2023-09-13T08:25:18.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.981+0000 7fc441ffb700 1 -- 172.21.15.84:0/1148239241 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 9) v1 ==== 3302+0+0 (secure 0 0 0) 0x7fc454058590 con 0x55bcdee7bcf0 2023-09-13T08:25:18.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.981+0000 7fc475790b80 10 client.4869 fetch_fsmap finished waiting for FSMap version 9 2023-09-13T08:25:18.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.981+0000 7fc475790b80 10 client.4869 resolve_mds: resolved name 'b' to daemon mds.b 2023-09-13T08:25:18.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.981+0000 7fc475790b80 20 client.4869 populate_metadata read hostname 'smithi084' 2023-09-13T08:25:18.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.981+0000 7fc475790b80 1 --2- 172.21.15.84:0/1148239241 >> [v2:172.21.15.161:6832/2524298549,v1:172.21.15.161:6834/2524298549] conn(0x55bcdee9ca50 0x55bcdeeb7e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:18.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.981+0000 7fc475790b80 4 client.4869 mds_command: new command op to 4314 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T08:25:18.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.981+0000 7fc475790b80 1 -- 172.21.15.84:0/1148239241 --> [v2:172.21.15.161:6832/2524298549,v1:172.21.15.161:6834/2524298549] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bcdeda0920 con 0x55bcdee9ca50 2023-09-13T08:25:18.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.981+0000 7fc4627fc700 1 --2- 172.21.15.84:0/1148239241 >> [v2:172.21.15.161:6832/2524298549,v1:172.21.15.161:6834/2524298549] conn(0x55bcdee9ca50 0x55bcdeeb7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:18.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.982+0000 7fc441ffb700 10 client.4869 ms_handle_connect on v2:172.21.15.161:6832/2524298549 2023-09-13T08:25:18.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.982+0000 7fc4627fc700 1 --2- 172.21.15.84:0/1148239241 >> [v2:172.21.15.161:6832/2524298549,v1:172.21.15.161:6834/2524298549] conn(0x55bcdee9ca50 0x55bcdeeb7e60 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e8cd842ef6100385 server_cookie=fe395421d2a38ebc in_seq=0 out_seq=0 2023-09-13T08:25:18.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.982+0000 7fc441ffb700 1 -- 172.21.15.84:0/1148239241 <== mds.0 v2:172.21.15.161:6832/2524298549 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55bcdeda0920 con 0x55bcdee9ca50 2023-09-13T08:25:18.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.982+0000 7fc441ffb700 10 client.4869 handle_command_reply: tid=0 2023-09-13T08:25:18.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.982+0000 7fc475790b80 1 client.4869 shutdown 2023-09-13T08:25:18.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.983+0000 7fc475790b80 1 -- 172.21.15.84:0/1148239241 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bcdee7bcf0 msgr2=0x55bcdee9eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:18.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.983+0000 7fc475790b80 1 --2- 172.21.15.84:0/1148239241 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bcdee7bcf0 0x55bcdee9eac0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc4540875c0 tx=0x7fc454058b60 comp rx=0 tx=0).stop 2023-09-13T08:25:18.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.983+0000 7fc475790b80 1 -- 172.21.15.84:0/1148239241 shutdown_connections 2023-09-13T08:25:18.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.983+0000 7fc475790b80 1 --2- 172.21.15.84:0/1148239241 >> [v2:172.21.15.161:6832/2524298549,v1:172.21.15.161:6834/2524298549] conn(0x55bcdee9ca50 0x55bcdeeb7e60 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:18.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.983+0000 7fc475790b80 1 --2- 172.21.15.84:0/1148239241 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55bcdee91ab0 0x55bcdee9af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:18.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.983+0000 7fc475790b80 1 --2- 172.21.15.84:0/1148239241 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bcdee7bcf0 0x55bcdee9eac0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:18.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.983+0000 7fc475790b80 1 --2- 172.21.15.84:0/1148239241 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55bcdee7c9d0 0x55bcdee9aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:18.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.983+0000 7fc441ffb700 0 client.4869 ms_handle_reset on v2:172.21.15.161:6832/2524298549 2023-09-13T08:25:18.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.983+0000 7fc475790b80 1 -- 172.21.15.84:0/1148239241 >> 172.21.15.84:0/1148239241 conn(0x55bcdedb3c30 msgr2=0x55bcdee4a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:18.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.983+0000 7fc475790b80 1 -- 172.21.15.84:0/1148239241 shutdown_connections 2023-09-13T08:25:18.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.983+0000 7fc475790b80 1 -- 172.21.15.84:0/1148239241 wait complete. 2023-09-13T08:25:18.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:17.983+0000 7fc475790b80 20 client.4869 trim_cache size 0 max 16384 2023-09-13T08:25:18.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.000+0000 7fc475790b80 1 Processor -- start 2023-09-13T08:25:18.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.000+0000 7fc475790b80 1 -- start start 2023-09-13T08:25:18.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.001+0000 7fc475790b80 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55bcdee7bcf0 0x55bcdee80220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:18.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.001+0000 7fc475790b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bcdee7c9d0 0x55bcdee7cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:18.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.001+0000 7fc475790b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55bcdee91ab0 0x55bcdee6dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:18.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.001+0000 7fc475790b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bcdee4a8d0 con 0x55bcdee7c9d0 2023-09-13T08:25:18.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.001+0000 7fc475790b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bcdee326f0 con 0x55bcdee91ab0 2023-09-13T08:25:18.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.001+0000 7fc475790b80 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bcdeebc610 con 0x55bcdee7bcf0 2023-09-13T08:25:18.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.001+0000 7fc4627fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bcdee7c9d0 0x55bcdee7cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:18.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.001+0000 7fc4627fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bcdee7c9d0 0x55bcdee7cfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44436/0 (socket says 172.21.15.84:44436) 2023-09-13T08:25:18.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.001+0000 7fc4627fc700 1 -- 172.21.15.84:0/2843928561 learned_addr learned my addr 172.21.15.84:0/2843928561 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:18.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.001+0000 7fc462ffd700 1 --2- 172.21.15.84:0/2843928561 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55bcdee7bcf0 0x55bcdee80220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:18.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.001+0000 7fc4637fe700 1 --2- 172.21.15.84:0/2843928561 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55bcdee91ab0 0x55bcdee6dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:18.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.001+0000 7fc4627fc700 1 -- 172.21.15.84:0/2843928561 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55bcdee7bcf0 msgr2=0x55bcdee80220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:18.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.001+0000 7fc4627fc700 1 --2- 172.21.15.84:0/2843928561 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55bcdee7bcf0 0x55bcdee80220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:18.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.001+0000 7fc4627fc700 1 -- 172.21.15.84:0/2843928561 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55bcdee91ab0 msgr2=0x55bcdee6dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:18.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.001+0000 7fc4627fc700 1 --2- 172.21.15.84:0/2843928561 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55bcdee91ab0 0x55bcdee6dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:18.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.001+0000 7fc4627fc700 1 -- 172.21.15.84:0/2843928561 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bcdebd3d90 con 0x55bcdee7c9d0 2023-09-13T08:25:18.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.001+0000 7fc4627fc700 1 --2- 172.21.15.84:0/2843928561 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bcdee7c9d0 0x55bcdee7cfa0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc4580014e0 tx=0x7fc45800c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad586a765a0c28c1 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:18.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.001+0000 7fc4497fa700 1 -- 172.21.15.84:0/2843928561 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc45802a040 con 0x55bcdee7c9d0 2023-09-13T08:25:18.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.001+0000 7fc4497fa700 1 -- 172.21.15.84:0/2843928561 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc45801b030 con 0x55bcdee7c9d0 2023-09-13T08:25:18.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.001+0000 7fc4497fa700 1 -- 172.21.15.84:0/2843928561 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc458017ba0 con 0x55bcdee7c9d0 2023-09-13T08:25:18.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.002+0000 7fc475790b80 1 -- 172.21.15.84:0/2843928561 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bcdee7c9d0 msgr2=0x55bcdee7cfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:18.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.002+0000 7fc475790b80 1 --2- 172.21.15.84:0/2843928561 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bcdee7c9d0 0x55bcdee7cfa0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc4580014e0 tx=0x7fc45800c000 comp rx=0 tx=0).stop 2023-09-13T08:25:18.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.002+0000 7fc475790b80 1 -- 172.21.15.84:0/2843928561 shutdown_connections 2023-09-13T08:25:18.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.002+0000 7fc475790b80 1 --2- 172.21.15.84:0/2843928561 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55bcdee91ab0 0x55bcdee6dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:18.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.002+0000 7fc475790b80 1 --2- 172.21.15.84:0/2843928561 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55bcdee7bcf0 0x55bcdee80220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:18.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.002+0000 7fc475790b80 1 --2- 172.21.15.84:0/2843928561 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bcdee7c9d0 0x55bcdee7cfa0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:18.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.002+0000 7fc475790b80 1 -- 172.21.15.84:0/2843928561 >> 172.21.15.84:0/2843928561 conn(0x55bcdedb3c30 msgr2=0x55bcdee51360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:18.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.002+0000 7fc475790b80 1 -- 172.21.15.84:0/2843928561 shutdown_connections 2023-09-13T08:25:18.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.002+0000 7fc475790b80 1 -- 172.21.15.84:0/2843928561 wait complete. 2023-09-13T08:25:18.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.002+0000 7fc475790b80 1 -- start start 2023-09-13T08:25:18.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.002+0000 7fc475790b80 1 Processor -- start 2023-09-13T08:25:18.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.003+0000 7fc475790b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55bcdee7bcf0 0x55bcdeee3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:18.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.003+0000 7fc475790b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bcdee7c9d0 0x55bcdee6dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:18.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.003+0000 7fc475790b80 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55bcdee91ab0 0x55bcdeef8c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:18.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.003+0000 7fc475790b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bcdee6e530 con 0x55bcdee7c9d0 2023-09-13T08:25:18.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.003+0000 7fc475790b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bcdeee3f90 con 0x55bcdee7bcf0 2023-09-13T08:25:18.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.003+0000 7fc475790b80 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bcdeee1640 con 0x55bcdee91ab0 2023-09-13T08:25:18.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.003+0000 7fc475790b80 10 client.0 _ll_register_callbacks cb 0x55bcded43630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T08:25:18.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.003+0000 7fc4627fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bcdee7c9d0 0x55bcdee6dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:18.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.003+0000 7fc4627fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bcdee7c9d0 0x55bcdee6dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44442/0 (socket says 172.21.15.84:44442) 2023-09-13T08:25:18.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.003+0000 7fc4627fc700 1 -- 172.21.15.84:0/119373679 learned_addr learned my addr 172.21.15.84:0/119373679 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:18.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.003+0000 7fc462ffd700 1 --2- 172.21.15.84:0/119373679 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55bcdee7bcf0 0x55bcdeee3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:18.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.003+0000 7fc4637fe700 1 --2- 172.21.15.84:0/119373679 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55bcdee91ab0 0x55bcdeef8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:18.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.003+0000 7fc4627fc700 1 -- 172.21.15.84:0/119373679 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55bcdee91ab0 msgr2=0x55bcdeef8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:18.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.003+0000 7fc4627fc700 1 --2- 172.21.15.84:0/119373679 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55bcdee91ab0 0x55bcdeef8c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:18.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.003+0000 7fc4627fc700 1 -- 172.21.15.84:0/119373679 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55bcdee7bcf0 msgr2=0x55bcdeee3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:18.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.003+0000 7fc4627fc700 1 --2- 172.21.15.84:0/119373679 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55bcdee7bcf0 0x55bcdeee3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:18.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.003+0000 7fc4627fc700 1 -- 172.21.15.84:0/119373679 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bcdec275e0 con 0x55bcdee7c9d0 2023-09-13T08:25:18.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.004+0000 7fc462ffd700 1 --2- 172.21.15.84:0/119373679 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55bcdee7bcf0 0x55bcdeee3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T08:25:18.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.004+0000 7fc4627fc700 1 --2- 172.21.15.84:0/119373679 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bcdee7c9d0 0x55bcdee6dc00 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc4580015c0 tx=0x7fc458001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35ba094b3a890cbc server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:18.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.004+0000 7fc441ffb700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-09-13T08:25:18.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.004+0000 7fc441ffb700 1 -- 172.21.15.84:0/119373679 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc45802a070 con 0x55bcdee7c9d0 2023-09-13T08:25:18.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.004+0000 7fc441ffb700 1 -- 172.21.15.84:0/119373679 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc458017ba0 con 0x55bcdee7c9d0 2023-09-13T08:25:18.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.004+0000 7fc475790b80 1 -- 172.21.15.84:0/119373679 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc458017270 con 0x55bcdee7c9d0 2023-09-13T08:25:18.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.004+0000 7fc441ffb700 1 -- 172.21.15.84:0/119373679 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc458017d60 con 0x55bcdee7c9d0 2023-09-13T08:25:18.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.004+0000 7fc475790b80 10 client.4875 fetch_fsmap learned FSMap version 9 2023-09-13T08:25:18.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.004+0000 7fc475790b80 1 -- 172.21.15.84:0/119373679 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x55bcdebbcc10 con 0x55bcdee7c9d0 2023-09-13T08:25:18.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.004+0000 7fc441ffb700 1 -- 172.21.15.84:0/119373679 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc458017270 con 0x55bcdee7c9d0 2023-09-13T08:25:18.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.004+0000 7fc441ffb700 1 -- 172.21.15.84:0/119373679 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 9) v1 ==== 3302+0+0 (secure 0 0 0) 0x7fc45802f900 con 0x55bcdee7c9d0 2023-09-13T08:25:18.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.004+0000 7fc475790b80 10 client.4875 fetch_fsmap finished waiting for FSMap version 9 2023-09-13T08:25:18.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.004+0000 7fc475790b80 10 client.4875 resolve_mds: resolved name 'b' to daemon mds.b 2023-09-13T08:25:18.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.004+0000 7fc475790b80 20 client.4875 populate_metadata read hostname 'smithi084' 2023-09-13T08:25:18.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.004+0000 7fc475790b80 1 --2- 172.21.15.84:0/119373679 >> [v2:172.21.15.161:6832/2524298549,v1:172.21.15.161:6834/2524298549] conn(0x55bcdee56bc0 0x55bcdee56fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:18.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.004+0000 7fc475790b80 4 client.4875 mds_command: new command op to 4314 tid=0 multi_id=0 [{"prefix": "status"}] 2023-09-13T08:25:18.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.004+0000 7fc475790b80 1 -- 172.21.15.84:0/119373679 --> [v2:172.21.15.161:6832/2524298549,v1:172.21.15.161:6834/2524298549] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55bcded61000 con 0x55bcdee56bc0 2023-09-13T08:25:18.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.004+0000 7fc462ffd700 1 --2- 172.21.15.84:0/119373679 >> [v2:172.21.15.161:6832/2524298549,v1:172.21.15.161:6834/2524298549] conn(0x55bcdee56bc0 0x55bcdee56fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:18.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.005+0000 7fc441ffb700 10 client.4875 ms_handle_connect on v2:172.21.15.161:6832/2524298549 2023-09-13T08:25:18.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.005+0000 7fc462ffd700 1 --2- 172.21.15.84:0/119373679 >> [v2:172.21.15.161:6832/2524298549,v1:172.21.15.161:6834/2524298549] conn(0x55bcdee56bc0 0x55bcdee56fa0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd6ad8046d7094e1 server_cookie=3b772bdb2be4c03f in_seq=0 out_seq=0 2023-09-13T08:25:18.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.005+0000 7fc441ffb700 1 -- 172.21.15.84:0/119373679 <== mds.0 v2:172.21.15.161:6832/2524298549 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x55bcded61000 con 0x55bcdee56bc0 2023-09-13T08:25:18.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.005+0000 7fc441ffb700 10 client.4875 handle_command_reply: tid=0 2023-09-13T08:25:18.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.005+0000 7fc475790b80 1 client.4875 shutdown 2023-09-13T08:25:18.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.005+0000 7fc475790b80 1 -- 172.21.15.84:0/119373679 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bcdee7c9d0 msgr2=0x55bcdee6dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:18.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.005+0000 7fc475790b80 1 --2- 172.21.15.84:0/119373679 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bcdee7c9d0 0x55bcdee6dc00 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc4580015c0 tx=0x7fc458001a00 comp rx=0 tx=0).stop 2023-09-13T08:25:18.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.005+0000 7fc475790b80 1 -- 172.21.15.84:0/119373679 shutdown_connections 2023-09-13T08:25:18.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.005+0000 7fc475790b80 1 --2- 172.21.15.84:0/119373679 >> [v2:172.21.15.161:6832/2524298549,v1:172.21.15.161:6834/2524298549] conn(0x55bcdee56bc0 0x55bcdee56fa0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:18.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.005+0000 7fc475790b80 1 --2- 172.21.15.84:0/119373679 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55bcdee91ab0 0x55bcdeef8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:18.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.005+0000 7fc441ffb700 0 client.4875 ms_handle_reset on v2:172.21.15.161:6832/2524298549 2023-09-13T08:25:18.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.005+0000 7fc475790b80 1 --2- 172.21.15.84:0/119373679 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55bcdee7bcf0 0x55bcdeee3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:18.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.005+0000 7fc475790b80 1 --2- 172.21.15.84:0/119373679 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bcdee7c9d0 0x55bcdee6dc00 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:18.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.005+0000 7fc475790b80 1 -- 172.21.15.84:0/119373679 >> 172.21.15.84:0/119373679 conn(0x55bcdedb3c30 msgr2=0x55bcdee7ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:18.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.005+0000 7fc475790b80 1 -- 172.21.15.84:0/119373679 shutdown_connections 2023-09-13T08:25:18.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.005+0000 7fc475790b80 1 -- 172.21.15.84:0/119373679 wait complete. 2023-09-13T08:25:18.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.005+0000 7fc475790b80 20 client.4875 trim_cache size 0 max 16384 2023-09-13T08:25:18.032 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-09-13T08:25:18.032 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "0107440b-b634-42c5-a643-5d31ea826116", 2023-09-13T08:25:18.033 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 0, 2023-09-13T08:25:18.033 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 4314, 2023-09-13T08:25:18.033 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2023-09-13T08:25:18.033 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2023-09-13T08:25:18.033 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2023-09-13T08:25:18.033 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 35.261814528000002, 2023-09-13T08:25:18.034 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 9, 2023-09-13T08:25:18.034 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 24, 2023-09-13T08:25:18.034 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 24, 2023-09-13T08:25:18.034 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 42.871644908999997 2023-09-13T08:25:18.034 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-09-13T08:25:18.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.006+0000 7fc4695ab700 1 -- 172.21.15.84:0/2865648514 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fc45006a580 msgr2=0x7fc45006ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:18.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.006+0000 7fc4695ab700 1 --2- 172.21.15.84:0/2865648514 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fc45006a580 0x7fc45006ca40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc458005b80 tx=0x7fc458007040 comp rx=0 tx=0).stop 2023-09-13T08:25:18.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.006+0000 7fc4695ab700 1 -- 172.21.15.84:0/2865648514 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc44c005210 msgr2=0x7fc4640c8ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:18.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.006+0000 7fc4695ab700 1 --2- 172.21.15.84:0/2865648514 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc44c005210 0x7fc4640c8ff0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc4540119a0 tx=0x7fc454011cb0 comp rx=0 tx=0).stop 2023-09-13T08:25:18.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.006+0000 7fc4695ab700 1 -- 172.21.15.84:0/2865648514 shutdown_connections 2023-09-13T08:25:18.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.006+0000 7fc4695ab700 1 --2- 172.21.15.84:0/2865648514 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc4640cfad0 0x7fc4640cff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:18.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.006+0000 7fc4695ab700 1 --2- 172.21.15.84:0/2865648514 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc44c005210 0x7fc4640c8ff0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:18.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.006+0000 7fc4695ab700 1 --2- 172.21.15.84:0/2865648514 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fc45006a580 0x7fc45006ca40 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:18.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.006+0000 7fc4695ab700 1 --2- 172.21.15.84:0/2865648514 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc4640b5720 0x7fc464152e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:18.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.006+0000 7fc4695ab700 1 -- 172.21.15.84:0/2865648514 >> 172.21.15.84:0/2865648514 conn(0x7fc46406b110 msgr2=0x7fc46415bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:18.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.006+0000 7fc4695ab700 1 -- 172.21.15.84:0/2865648514 shutdown_connections 2023-09-13T08:25:18.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.006+0000 7fc4695ab700 1 -- 172.21.15.84:0/2865648514 wait complete. 2023-09-13T08:25:18.039 INFO:teuthology.run_tasks:Running task kclient... 2023-09-13T08:25:18.071 INFO:tasks.kclient:Mounting kernel clients... 2023-09-13T08:25:18.071 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-09-13T08:25:18.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:25:18.072 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2023-09-13T08:25:18.090 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-09-13T08:25:18.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:25:18.092 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-09-13T08:25:18.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:25:18.177 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link delete ceph-brx 2023-09-13T08:25:18.280 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:25:18.281 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2023-09-13T08:25:18.299 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:25:18.299 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link delete ceph-brx 2023-09-13T08:25:18.368 INFO:teuthology.orchestra.run.smithi084.stderr:Cannot find device "ceph-brx" 2023-09-13T08:25:18.369 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-13T08:25:18.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:25:18.371 DEBUG:teuthology.orchestra.run.smithi161:> ip netns list 2023-09-13T08:25:18.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:25:18.393 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link delete ceph-brx 2023-09-13T08:25:18.467 INFO:teuthology.orchestra.run.smithi161.stderr:Cannot find device "ceph-brx" 2023-09-13T08:25:18.469 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-13T08:25:18.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:25:18.470 DEBUG:teuthology.orchestra.run.smithi161:> ip netns list 2023-09-13T08:25:18.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:25:18.530 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link delete ceph-brx 2023-09-13T08:25:18.600 INFO:teuthology.orchestra.run.smithi161.stderr:Cannot find device "ceph-brx" 2023-09-13T08:25:18.601 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-13T08:25:18.602 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2023-09-13T08:25:18.602 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-09-13T08:25:18.602 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-09-13T08:25:18.603 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-13T08:25:18.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.723+0000 7f8fcdcb7700 1 Processor -- start 2023-09-13T08:25:18.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.723+0000 7f8fcdcb7700 1 -- start start 2023-09-13T08:25:18.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.724+0000 7f8fcdcb7700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8fc8157c30 0x7f8fc8071ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:18.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.724+0000 7f8fcdcb7700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fc815b3f0 con 0x7f8fc80721e0 2023-09-13T08:25:18.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.724+0000 7f8fcdcb7700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fc815b6d0 con 0x7f8fc80cab40 2023-09-13T08:25:18.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.724+0000 7f8fcdcb7700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fc80ca100 con 0x7f8fc8157c30 2023-09-13T08:25:18.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.724+0000 7f8fc77fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8fc8157c30 0x7f8fc8071ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:18.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.724+0000 7f8fc6ffd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f8fc80721e0 0x7f8fc80ca430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:47096/0 (socket says 172.21.15.84:47096) 2023-09-13T08:25:18.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.724+0000 7f8fc6ffd700 1 -- 172.21.15.84:0/3131207559 learned_addr learned my addr 172.21.15.84:0/3131207559 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:25:18.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.724+0000 7f8fc77fe700 1 -- 172.21.15.84:0/3131207559 >> v1:172.21.15.161:6789/0 conn(0x7f8fc80cab40 legacy=0x7f8fc815b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:18.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.725+0000 7f8fc77fe700 1 -- 172.21.15.84:0/3131207559 >> v1:172.21.15.84:6789/0 conn(0x7f8fc80721e0 legacy=0x7f8fc80ca430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:18.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.725+0000 7f8fc67fc700 1 -- 172.21.15.84:0/3131207559 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3739839456 0 0) 0x7f8fc815b3f0 con 0x7f8fc80721e0 2023-09-13T08:25:18.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.725+0000 7f8fc77fe700 1 -- 172.21.15.84:0/3131207559 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fc80711c0 con 0x7f8fc8157c30 2023-09-13T08:25:18.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.725+0000 7f8fc77fe700 1 --2- 172.21.15.84:0/3131207559 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fc8157c30 0x7f8fc8071ca0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc009840 tx=0x7f8fbc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51c77b7ab7dabb64 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:18.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.725+0000 7f8fc67fc700 1 -- 172.21.15.84:0/3131207559 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fbc011830 con 0x7f8fc8157c30 2023-09-13T08:25:18.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.725+0000 7f8fc67fc700 1 -- 172.21.15.84:0/3131207559 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fbc011990 con 0x7f8fc8157c30 2023-09-13T08:25:18.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.725+0000 7f8fc67fc700 1 -- 172.21.15.84:0/3131207559 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fbc011d20 con 0x7f8fc8157c30 2023-09-13T08:25:18.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.725+0000 7f8fcdcb7700 1 -- 172.21.15.84:0/3131207559 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fc8157c30 msgr2=0x7f8fc8071ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:18.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.725+0000 7f8fcdcb7700 1 --2- 172.21.15.84:0/3131207559 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fc8157c30 0x7f8fc8071ca0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc009840 tx=0x7f8fbc009b50 comp rx=0 tx=0).stop 2023-09-13T08:25:18.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.725+0000 7f8fcdcb7700 1 -- 172.21.15.84:0/3131207559 shutdown_connections 2023-09-13T08:25:18.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.725+0000 7f8fcdcb7700 1 --2- 172.21.15.84:0/3131207559 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fc8157c30 0x7f8fc8071ca0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:18.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.725+0000 7f8fcdcb7700 1 -- 172.21.15.84:0/3131207559 >> 172.21.15.84:0/3131207559 conn(0x7f8fc80b0a20 msgr2=0x7f8fc80b0e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:18.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.726+0000 7f8fcdcb7700 1 -- 172.21.15.84:0/3131207559 shutdown_connections 2023-09-13T08:25:18.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.726+0000 7f8fcdcb7700 1 -- 172.21.15.84:0/3131207559 wait complete. 2023-09-13T08:25:18.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.727+0000 7f8fcdcb7700 1 Processor -- start 2023-09-13T08:25:18.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.727+0000 7f8fcdcb7700 1 -- start start 2023-09-13T08:25:18.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.728+0000 7f8fcdcb7700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fc80721e0 0x7f8fc814b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:18.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.728+0000 7f8fcdcb7700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8fc80cab40 0x7f8fc80ce120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:18.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.728+0000 7f8fcdcb7700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8fc8157c30 0x7f8fc814f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:18.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.728+0000 7f8fcdcb7700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc814bd90 con 0x7f8fc80721e0 2023-09-13T08:25:18.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.728+0000 7f8fcdcb7700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc80cead0 con 0x7f8fc8157c30 2023-09-13T08:25:18.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.728+0000 7f8fcdcb7700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc80aca10 con 0x7f8fc80cab40 2023-09-13T08:25:18.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.728+0000 7f8fc77fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fc80721e0 0x7f8fc814b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:18.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.728+0000 7f8fc77fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fc80721e0 0x7f8fc814b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44454/0 (socket says 172.21.15.84:44454) 2023-09-13T08:25:18.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.728+0000 7f8fc77fe700 1 -- 172.21.15.84:0/4174894143 learned_addr learned my addr 172.21.15.84:0/4174894143 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:18.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.728+0000 7f8fc7fff700 1 --2- 172.21.15.84:0/4174894143 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8fc8157c30 0x7f8fc814f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:18.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.728+0000 7f8fc6ffd700 1 --2- 172.21.15.84:0/4174894143 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8fc80cab40 0x7f8fc80ce120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:18.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.728+0000 7f8fc77fe700 1 -- 172.21.15.84:0/4174894143 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8fc80cab40 msgr2=0x7f8fc80ce120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:18.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.728+0000 7f8fc77fe700 1 --2- 172.21.15.84:0/4174894143 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8fc80cab40 0x7f8fc80ce120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:18.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.728+0000 7f8fc77fe700 1 -- 172.21.15.84:0/4174894143 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8fc8157c30 msgr2=0x7f8fc814f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:18.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.728+0000 7f8fc77fe700 1 --2- 172.21.15.84:0/4174894143 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8fc8157c30 0x7f8fc814f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:18.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.728+0000 7f8fc77fe700 1 -- 172.21.15.84:0/4174894143 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fbc0094a0 con 0x7f8fc80721e0 2023-09-13T08:25:18.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.728+0000 7f8fc77fe700 1 --2- 172.21.15.84:0/4174894143 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fc80721e0 0x7f8fc814b850 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc0090b0 tx=0x7f8fbc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:18.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.728+0000 7f8faffff700 1 -- 172.21.15.84:0/4174894143 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fbc01a980 con 0x7f8fc80721e0 2023-09-13T08:25:18.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.728+0000 7f8faffff700 1 -- 172.21.15.84:0/4174894143 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fbc01ab00 con 0x7f8fc80721e0 2023-09-13T08:25:18.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.728+0000 7f8fcdcb7700 1 -- 172.21.15.84:0/4174894143 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fc80accf0 con 0x7f8fc80721e0 2023-09-13T08:25:18.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.728+0000 7f8faffff700 1 -- 172.21.15.84:0/4174894143 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fbc024420 con 0x7f8fc80721e0 2023-09-13T08:25:18.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.728+0000 7f8fcdcb7700 1 -- 172.21.15.84:0/4174894143 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fc80ad2b0 con 0x7f8fc80721e0 2023-09-13T08:25:18.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.729+0000 7f8fcdcb7700 1 -- 172.21.15.84:0/4174894143 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fc804e9b0 con 0x7f8fc80721e0 2023-09-13T08:25:18.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.730+0000 7f8faffff700 1 -- 172.21.15.84:0/4174894143 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f8fbc022070 con 0x7f8fc80721e0 2023-09-13T08:25:18.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.730+0000 7f8faffff700 1 --2- 172.21.15.84:0/4174894143 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f8fb406a580 0x7f8fb406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:18.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.730+0000 7f8fc6ffd700 1 --2- 172.21.15.84:0/4174894143 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f8fb406a580 0x7f8fb406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:18.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.730+0000 7f8faffff700 1 -- 172.21.15.84:0/4174894143 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8fbc08a1a0 con 0x7f8fc80721e0 2023-09-13T08:25:18.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.731+0000 7f8fc6ffd700 1 --2- 172.21.15.84:0/4174894143 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f8fb406a580 0x7f8fb406ca40 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8fc814eb00 tx=0x7f8fb8007d90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:18.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.734+0000 7f8faffff700 1 -- 172.21.15.84:0/4174894143 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f8fbc0555e0 con 0x7f8fc80721e0 2023-09-13T08:25:18.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.973+0000 7f8fcdcb7700 1 -- 172.21.15.84:0/4174894143 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f8fc80b16c0 con 0x7f8fc80721e0 2023-09-13T08:25:18.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.973+0000 7f8faffff700 1 -- 172.21.15.84:0/4174894143 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f8fbc015070 con 0x7f8fc80721e0 2023-09-13T08:25:18.973 INFO:teuthology.orchestra.run.smithi084.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-09-13T08:25:18.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.975+0000 7f8fcdcb7700 1 -- 172.21.15.84:0/4174894143 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f8fb406a580 msgr2=0x7f8fb406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:18.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.975+0000 7f8fcdcb7700 1 --2- 172.21.15.84:0/4174894143 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f8fb406a580 0x7f8fb406ca40 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8fc814eb00 tx=0x7f8fb8007d90 comp rx=0 tx=0).stop 2023-09-13T08:25:18.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.975+0000 7f8fcdcb7700 1 -- 172.21.15.84:0/4174894143 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fc80721e0 msgr2=0x7f8fc814b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:18.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.975+0000 7f8fcdcb7700 1 --2- 172.21.15.84:0/4174894143 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fc80721e0 0x7f8fc814b850 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc0090b0 tx=0x7f8fbc004750 comp rx=0 tx=0).stop 2023-09-13T08:25:18.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.975+0000 7f8fcdcb7700 1 -- 172.21.15.84:0/4174894143 shutdown_connections 2023-09-13T08:25:18.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.975+0000 7f8fcdcb7700 1 --2- 172.21.15.84:0/4174894143 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f8fb406a580 0x7f8fb406ca40 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:18.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.975+0000 7f8fcdcb7700 1 --2- 172.21.15.84:0/4174894143 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8fc8157c30 0x7f8fc814f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:18.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.975+0000 7f8fcdcb7700 1 --2- 172.21.15.84:0/4174894143 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fc80721e0 0x7f8fc814b850 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:18.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.975+0000 7f8fcdcb7700 1 --2- 172.21.15.84:0/4174894143 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8fc80cab40 0x7f8fc80ce120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:18.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.975+0000 7f8fcdcb7700 1 -- 172.21.15.84:0/4174894143 >> 172.21.15.84:0/4174894143 conn(0x7f8fc80b0a20 msgr2=0x7f8fc815c320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:18.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.975+0000 7f8fcdcb7700 1 -- 172.21.15.84:0/4174894143 shutdown_connections 2023-09-13T08:25:18.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:18.975+0000 7f8fcdcb7700 1 -- 172.21.15.84:0/4174894143 wait complete. 2023-09-13T08:25:18.987 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-09-13T08:25:18.987 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-13T08:25:18.987 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi084.front.sepia.ceph.com 2023-09-13T08:25:18.988 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-09-13T08:25:18.988 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-09-13T08:25:18.988 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-09-13T08:25:18.988 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-09-13T08:25:18.989 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-13T08:25:18.989 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-09-13T08:25:18.989 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:25:18.990 DEBUG:teuthology.orchestra.run.smithi084:> ip addr 2023-09-13T08:25:19.006 INFO:teuthology.orchestra.run.smithi084.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-13T08:25:19.007 INFO:teuthology.orchestra.run.smithi084.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-13T08:25:19.007 INFO:teuthology.orchestra.run.smithi084.stdout: inet 127.0.0.1/8 scope host lo 2023-09-13T08:25:19.007 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-09-13T08:25:19.007 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 ::1/128 scope host 2023-09-13T08:25:19.007 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-09-13T08:25:19.008 INFO:teuthology.orchestra.run.smithi084.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-13T08:25:19.008 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:68 brd ff:ff:ff:ff:ff:ff 2023-09-13T08:25:19.008 INFO:teuthology.orchestra.run.smithi084.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-13T08:25:19.008 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:69 brd ff:ff:ff:ff:ff:ff 2023-09-13T08:25:19.008 INFO:teuthology.orchestra.run.smithi084.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-13T08:25:19.009 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:50 brd ff:ff:ff:ff:ff:ff 2023-09-13T08:25:19.009 INFO:teuthology.orchestra.run.smithi084.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-13T08:25:19.009 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:51 brd ff:ff:ff:ff:ff:ff 2023-09-13T08:25:19.009 INFO:teuthology.orchestra.run.smithi084.stdout: inet 172.21.15.84/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-09-13T08:25:19.009 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft 42360sec preferred_lft 42360sec 2023-09-13T08:25:19.010 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::9f71:f307:edb2:844f/64 scope link noprefixroute 2023-09-13T08:25:19.010 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-09-13T08:25:19.013 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-09-13T08:25:19.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:25:19.014 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-09-13T08:25:19.014 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-09-13T08:25:19.015 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link add name ceph-brx type bridge 2023-09-13T08:25:19.015 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip addr flush dev ceph-brx 2023-09-13T08:25:19.016 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set ceph-brx up 2023-09-13T08:25:19.016 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-09-13T08:25:19.016 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-09-13T08:25:19.122 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:25:19.123 DEBUG:teuthology.orchestra.run.smithi084:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-13T08:25:19.149 INFO:teuthology.orchestra.run.smithi084.stdout:1 2023-09-13T08:25:19.150 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:25:19.151 DEBUG:teuthology.orchestra.run.smithi084:> route 2023-09-13T08:25:19.209 INFO:teuthology.orchestra.run.smithi084.stdout:Kernel IP routing table 2023-09-13T08:25:19.209 INFO:teuthology.orchestra.run.smithi084.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-13T08:25:19.209 INFO:teuthology.orchestra.run.smithi084.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-09-13T08:25:19.210 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-09-13T08:25:19.210 INFO:teuthology.orchestra.run.smithi084.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-13T08:25:19.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:25:19.211 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-09-13T08:25:19.211 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-09-13T08:25:19.211 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-09-13T08:25:19.211 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-09-13T08:25:19.212 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-09-13T08:25:19.212 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-09-13T08:25:19.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:25:19.314 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2023-09-13T08:25:19.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:25:19.332 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list-id 2023-09-13T08:25:19.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:25:19.389 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-09-13T08:25:19.389 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-09-13T08:25:19.389 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-13T08:25:19.389 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-09-13T08:25:19.390 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-09-13T08:25:19.482 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-09-13T08:25:19.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:25:19.483 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-09-13T08:25:19.483 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-09-13T08:25:19.483 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-09-13T08:25:19.484 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-09-13T08:25:19.484 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-09-13T08:25:19.484 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-09-13T08:25:19.485 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-09-13T08:25:19.485 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-09-13T08:25:19.691 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:25:19.692 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-09-13T08:25:19.692 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-09-13T08:25:19.692 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set brx.0 up 2023-09-13T08:25:19.693 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set dev brx.0 master ceph-brx 2023-09-13T08:25:19.693 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-09-13T08:25:19.798 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-13T08:25:19.799 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-09-13T08:25:19.819 INFO:teuthology.orchestra.run.smithi084.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-09-13T08:25:19.820 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-13T08:25:19.820 DEBUG:teuthology.orchestra.run.smithi084:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-09-13T08:25:19.876 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-09-13T08:25:19.876 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:25:19.877 DEBUG:teuthology.orchestra.run.smithi084:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-13T08:25:19.960 INFO:teuthology.orchestra.run.smithi084.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-13T08:25:19.961 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-09-13T08:25:19.961 INFO:teuthology.orchestra.run.smithi084.stdout:invalid new device string format 2023-09-13T08:25:20.065 INFO:teuthology.orchestra.run.smithi084.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-13T08:25:20.065 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-09-13T08:25:20.065 INFO:teuthology.orchestra.run.smithi084.stdout:invalid new device string format 2023-09-13T08:25:20.066 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: resolved to: "172.21.15.84:3300,172.21.15.161:3300,172.21.15.161:3301" 2023-09-13T08:25:20.066 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-13T08:25:20.103 INFO:teuthology.orchestra.run.smithi084.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-13T08:25:20.104 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-09-13T08:25:20.104 INFO:teuthology.orchestra.run.smithi084.stdout:invalid new device string format 2023-09-13T08:25:20.104 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: resolved to: "172.21.15.84:3300,172.21.15.161:3300,172.21.15.161:3301" 2023-09-13T08:25:20.104 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-13T08:25:20.105 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: resolved to: "172.21.15.84:6789,172.21.15.161:6789,172.21.15.161:6790" 2023-09-13T08:25:20.105 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.84:6789,172.21.15.161:6789,172.21.15.161:6790:/ 2023-09-13T08:25:20.105 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=0107440b-b634-42c5-a643-5d31ea826116" will pass to kernel 2023-09-13T08:25:20.107 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-09-13T08:25:20.108 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:25:20.108 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-09-13T08:25:20.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:25:20.139 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-13T08:25:20.210 INFO:teuthology.orchestra.run.smithi084.stdout:client4887 2023-09-13T08:25:20.211 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-09-13T08:25:20.211 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T08:25:20.269 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:25:20.270 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-13T08:25:20.342 INFO:teuthology.orchestra.run.smithi084.stdout:client4887 2023-09-13T08:25:20.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:25:20.344 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-13T08:25:20.415 INFO:teuthology.orchestra.run.smithi084.stdout:client4887 2023-09-13T08:25:20.416 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:25:20.417 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/0107440b-b634-42c5-a643-5d31ea826116.client4887/status') 2023-09-13T08:25:20.495 INFO:teuthology.orchestra.run.smithi084.stdout:instance: client.4887 (3)192.168.0.1:0/2628097240 2023-09-13T08:25:20.495 INFO:teuthology.orchestra.run.smithi084.stdout:blocklisted: false 2023-09-13T08:25:20.496 INFO:teuthology.orchestra.run.smithi084.stderr:0+1 records in 2023-09-13T08:25:20.496 INFO:teuthology.orchestra.run.smithi084.stderr:0+1 records out 2023-09-13T08:25:20.496 INFO:teuthology.orchestra.run.smithi084.stderr:69 bytes copied, 2.1159e-05 s, 3.3 MB/s 2023-09-13T08:25:20.497 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2023-09-13T08:25:20.497 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-09-13T08:25:20.497 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-09-13T08:25:20.498 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-13T08:25:20.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:20.657+0000 7f3b1bb3d700 1 Processor -- start 2023-09-13T08:25:20.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:20.657+0000 7f3b1bb3d700 1 -- start start 2023-09-13T08:25:20.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:20.658+0000 7f3b1bb3d700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3b141543b0 0x7f3b14154790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:20.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:20.658+0000 7f3b1bb3d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3b140cbc80 0x7f3b1415e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:20.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:20.658+0000 7f3b1bb3d700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b1406bf90 con 0x7f3b140af1f0 2023-09-13T08:25:20.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:20.658+0000 7f3b1bb3d700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b1415a6d0 con 0x7f3b140cbc80 2023-09-13T08:25:20.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:20.658+0000 7f3b1bb3d700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b1415ebe0 con 0x7f3b141543b0 2023-09-13T08:25:20.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:20.658+0000 7f3b1a0da700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3b140cbc80 0x7f3b1415e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:20.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:20.658+0000 7f3b1a0da700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3b140cbc80 0x7f3b1415e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44466/0 (socket says 172.21.15.84:44466) 2023-09-13T08:25:20.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:20.658+0000 7f3b1a0da700 1 -- 172.21.15.84:0/855287910 learned_addr learned my addr 172.21.15.84:0/855287910 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:20.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:20.658+0000 7f3b190d8700 1 --1- 172.21.15.84:0/855287910 >> v1:172.21.15.84:6789/0 conn(0x7f3b140af1f0 0x7f3b140cb570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:47112/0 (socket says 172.21.15.84:47112) 2023-09-13T08:25:20.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:20.658+0000 7f3b198d9700 1 --2- 172.21.15.84:0/855287910 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3b141543b0 0x7f3b14154790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:20.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:20.658+0000 7f3b188d7700 1 -- 172.21.15.84:0/855287910 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1010204450 0 0) 0x7f3b1406bf90 con 0x7f3b140af1f0 2023-09-13T08:25:20.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:20.658+0000 7f3b188d7700 1 -- 172.21.15.84:0/855287910 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b000035b0 con 0x7f3b140af1f0 2023-09-13T08:25:20.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:20.658+0000 7f3b1a0da700 1 -- 172.21.15.84:0/855287910 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3b141543b0 msgr2=0x7f3b14154790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:20.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:20.658+0000 7f3b1a0da700 1 --2- 172.21.15.84:0/855287910 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3b141543b0 0x7f3b14154790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:20.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:20.658+0000 7f3b1a0da700 1 -- 172.21.15.84:0/855287910 >> v1:172.21.15.84:6789/0 conn(0x7f3b140af1f0 legacy=0x7f3b140cb570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:20.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:20.658+0000 7f3b1a0da700 1 -- 172.21.15.84:0/855287910 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b1415a8c0 con 0x7f3b140cbc80 2023-09-13T08:25:20.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:20.658+0000 7f3b1a0da700 1 --2- 172.21.15.84:0/855287910 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b140cbc80 0x7f3b1415e6a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c00d180 tx=0x7f3b0c00d490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2a971c63a36efde server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:20.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:20.659+0000 7f3b188d7700 1 -- 172.21.15.84:0/855287910 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b0c010070 con 0x7f3b140cbc80 2023-09-13T08:25:20.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:20.659+0000 7f3b188d7700 1 -- 172.21.15.84:0/855287910 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b0c00dd00 con 0x7f3b140cbc80 2023-09-13T08:25:20.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:20.659+0000 7f3b188d7700 1 -- 172.21.15.84:0/855287910 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b0c00b310 con 0x7f3b140cbc80 2023-09-13T08:25:20.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:20.659+0000 7f3b1bb3d700 1 -- 172.21.15.84:0/855287910 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b140cbc80 msgr2=0x7f3b1415e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:20.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:20.659+0000 7f3b1bb3d700 1 --2- 172.21.15.84:0/855287910 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b140cbc80 0x7f3b1415e6a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c00d180 tx=0x7f3b0c00d490 comp rx=0 tx=0).stop 2023-09-13T08:25:20.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:20.659+0000 7f3b1bb3d700 1 -- 172.21.15.84:0/855287910 shutdown_connections 2023-09-13T08:25:20.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:20.659+0000 7f3b1bb3d700 1 --2- 172.21.15.84:0/855287910 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b140cbc80 0x7f3b1415e6a0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:20.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:20.659+0000 7f3b1bb3d700 1 --2- 172.21.15.84:0/855287910 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3b141543b0 0x7f3b14154790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:20.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:20.659+0000 7f3b1bb3d700 1 -- 172.21.15.84:0/855287910 >> 172.21.15.84:0/855287910 conn(0x7f3b140cc230 msgr2=0x7f3b140cc640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:20.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:20.659+0000 7f3b1bb3d700 1 -- 172.21.15.84:0/855287910 shutdown_connections 2023-09-13T08:25:20.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:20.659+0000 7f3b1bb3d700 1 -- 172.21.15.84:0/855287910 wait complete. 2023-09-13T08:25:20.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:20.661+0000 7f3b1bb3d700 1 Processor -- start 2023-09-13T08:25:20.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:20.661+0000 7f3b1bb3d700 1 -- start start 2023-09-13T08:25:20.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:20.662+0000 7f3b1bb3d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3b140af1f0 0x7f3b14151c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:20.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:20.662+0000 7f3b1bb3d700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3b140cbc80 0x7f3b141576c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:20.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:20.662+0000 7f3b1bb3d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b141543b0 0x7f3b1415c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:20.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:20.662+0000 7f3b1bb3d700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b140c41f0 con 0x7f3b141543b0 2023-09-13T08:25:20.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:20.662+0000 7f3b1bb3d700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b140c44d0 con 0x7f3b140af1f0 2023-09-13T08:25:20.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:20.662+0000 7f3b1bb3d700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b140c47b0 con 0x7f3b140cbc80 2023-09-13T08:25:20.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:20.662+0000 7f3b1a0da700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b141543b0 0x7f3b1415c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:20.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:20.662+0000 7f3b1a0da700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b141543b0 0x7f3b1415c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44476/0 (socket says 172.21.15.84:44476) 2023-09-13T08:25:20.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:20.662+0000 7f3b1a0da700 1 -- 172.21.15.84:0/582901482 learned_addr learned my addr 172.21.15.84:0/582901482 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:20.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:20.662+0000 7f3b190d8700 1 --2- 172.21.15.84:0/582901482 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3b140cbc80 0x7f3b141576c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:20.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:20.662+0000 7f3b198d9700 1 --2- 172.21.15.84:0/582901482 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3b140af1f0 0x7f3b14151c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:20.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:20.662+0000 7f3b1a0da700 1 -- 172.21.15.84:0/582901482 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3b140cbc80 msgr2=0x7f3b141576c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:20.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:20.662+0000 7f3b1a0da700 1 --2- 172.21.15.84:0/582901482 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3b140cbc80 0x7f3b141576c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:20.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:20.662+0000 7f3b1a0da700 1 -- 172.21.15.84:0/582901482 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3b140af1f0 msgr2=0x7f3b14151c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:20.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:20.662+0000 7f3b1a0da700 1 --2- 172.21.15.84:0/582901482 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3b140af1f0 0x7f3b14151c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:20.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:20.662+0000 7f3b1a0da700 1 -- 172.21.15.84:0/582901482 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b0c00bd40 con 0x7f3b141543b0 2023-09-13T08:25:20.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:20.662+0000 7f3b1a0da700 1 --2- 172.21.15.84:0/582901482 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b141543b0 0x7f3b1415c850 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c00d7e0 tx=0x7f3b0c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:20.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:20.662+0000 7f3b0a7fc700 1 -- 172.21.15.84:0/582901482 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b0c00bbc0 con 0x7f3b141543b0 2023-09-13T08:25:20.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:20.662+0000 7f3b0a7fc700 1 -- 172.21.15.84:0/582901482 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b0c00b4c0 con 0x7f3b141543b0 2023-09-13T08:25:20.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:20.662+0000 7f3b1bb3d700 1 -- 172.21.15.84:0/582901482 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b140c4a90 con 0x7f3b141543b0 2023-09-13T08:25:20.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:20.662+0000 7f3b0a7fc700 1 -- 172.21.15.84:0/582901482 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b0c004040 con 0x7f3b141543b0 2023-09-13T08:25:20.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:20.662+0000 7f3b1bb3d700 1 -- 172.21.15.84:0/582901482 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b14152140 con 0x7f3b141543b0 2023-09-13T08:25:20.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:20.663+0000 7f3b1bb3d700 1 -- 172.21.15.84:0/582901482 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b140c4fb0 con 0x7f3b141543b0 2023-09-13T08:25:20.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:20.664+0000 7f3b0a7fc700 1 -- 172.21.15.84:0/582901482 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f3b0c0041a0 con 0x7f3b141543b0 2023-09-13T08:25:20.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:20.664+0000 7f3b0a7fc700 1 --2- 172.21.15.84:0/582901482 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f3af806a580 0x7f3af806ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:20.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:20.664+0000 7f3b0a7fc700 1 -- 172.21.15.84:0/582901482 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3b0c08c620 con 0x7f3b141543b0 2023-09-13T08:25:20.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:20.664+0000 7f3b198d9700 1 --2- 172.21.15.84:0/582901482 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f3af806a580 0x7f3af806ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:20.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:20.664+0000 7f3b198d9700 1 --2- 172.21.15.84:0/582901482 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f3af806a580 0x7f3af806ca40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3b1000b9b0 tx=0x7f3b10008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:20.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:20.668+0000 7f3b0a7fc700 1 -- 172.21.15.84:0/582901482 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f3b140c4fb0 con 0x7f3b141543b0 2023-09-13T08:25:20.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:20.902+0000 7f3b1bb3d700 1 -- 172.21.15.84:0/582901482 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f3b140c4fb0 con 0x7f3b141543b0 2023-09-13T08:25:20.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:20.902+0000 7f3b0a7fc700 1 -- 172.21.15.84:0/582901482 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f3b140c4fb0 con 0x7f3b141543b0 2023-09-13T08:25:20.902 INFO:teuthology.orchestra.run.smithi084.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-09-13T08:25:20.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:20.904+0000 7f3b1bb3d700 1 -- 172.21.15.84:0/582901482 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f3af806a580 msgr2=0x7f3af806ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:20.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:20.904+0000 7f3b1bb3d700 1 --2- 172.21.15.84:0/582901482 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f3af806a580 0x7f3af806ca40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3b1000b9b0 tx=0x7f3b10008040 comp rx=0 tx=0).stop 2023-09-13T08:25:20.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:20.904+0000 7f3b1bb3d700 1 -- 172.21.15.84:0/582901482 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b141543b0 msgr2=0x7f3b1415c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:20.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:20.904+0000 7f3b1bb3d700 1 --2- 172.21.15.84:0/582901482 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b141543b0 0x7f3b1415c850 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c00d7e0 tx=0x7f3b0c004ad0 comp rx=0 tx=0).stop 2023-09-13T08:25:20.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:20.904+0000 7f3b1bb3d700 1 -- 172.21.15.84:0/582901482 shutdown_connections 2023-09-13T08:25:20.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:20.904+0000 7f3b1bb3d700 1 --2- 172.21.15.84:0/582901482 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b141543b0 0x7f3b1415c850 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:20.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:20.904+0000 7f3b1bb3d700 1 --2- 172.21.15.84:0/582901482 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f3af806a580 0x7f3af806ca40 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:20.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:20.904+0000 7f3b1bb3d700 1 --2- 172.21.15.84:0/582901482 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3b140af1f0 0x7f3b14151c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:20.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:20.904+0000 7f3b1bb3d700 1 --2- 172.21.15.84:0/582901482 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3b140cbc80 0x7f3b141576c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:20.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:20.904+0000 7f3b1bb3d700 1 -- 172.21.15.84:0/582901482 >> 172.21.15.84:0/582901482 conn(0x7f3b140cc230 msgr2=0x7f3b140b0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:20.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:20.904+0000 7f3b1bb3d700 1 -- 172.21.15.84:0/582901482 shutdown_connections 2023-09-13T08:25:20.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:20.904+0000 7f3b1bb3d700 1 -- 172.21.15.84:0/582901482 wait complete. 2023-09-13T08:25:20.916 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-09-13T08:25:20.916 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-13T08:25:20.916 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi084.front.sepia.ceph.com 2023-09-13T08:25:20.916 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-09-13T08:25:20.917 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-09-13T08:25:20.917 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-09-13T08:25:20.917 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-09-13T08:25:20.917 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-13T08:25:20.918 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-09-13T08:25:20.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:25:20.918 DEBUG:teuthology.orchestra.run.smithi084:> ip addr 2023-09-13T08:25:20.936 INFO:teuthology.orchestra.run.smithi084.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-13T08:25:20.936 INFO:teuthology.orchestra.run.smithi084.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-13T08:25:20.936 INFO:teuthology.orchestra.run.smithi084.stdout: inet 127.0.0.1/8 scope host lo 2023-09-13T08:25:20.936 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-09-13T08:25:20.936 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 ::1/128 scope host 2023-09-13T08:25:20.937 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-09-13T08:25:20.937 INFO:teuthology.orchestra.run.smithi084.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-13T08:25:20.937 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:68 brd ff:ff:ff:ff:ff:ff 2023-09-13T08:25:20.937 INFO:teuthology.orchestra.run.smithi084.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-13T08:25:20.937 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:69 brd ff:ff:ff:ff:ff:ff 2023-09-13T08:25:20.938 INFO:teuthology.orchestra.run.smithi084.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-13T08:25:20.938 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:50 brd ff:ff:ff:ff:ff:ff 2023-09-13T08:25:20.938 INFO:teuthology.orchestra.run.smithi084.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-13T08:25:20.938 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:51 brd ff:ff:ff:ff:ff:ff 2023-09-13T08:25:20.938 INFO:teuthology.orchestra.run.smithi084.stdout: inet 172.21.15.84/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-09-13T08:25:20.939 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft 42358sec preferred_lft 42358sec 2023-09-13T08:25:20.939 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::9f71:f307:edb2:844f/64 scope link noprefixroute 2023-09-13T08:25:20.939 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-09-13T08:25:20.939 INFO:teuthology.orchestra.run.smithi084.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-13T08:25:20.940 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 9a:83:1f:f8:2d:86 brd ff:ff:ff:ff:ff:ff 2023-09-13T08:25:20.940 INFO:teuthology.orchestra.run.smithi084.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-09-13T08:25:20.940 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-09-13T08:25:20.940 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::3890:2dff:fe73:ffbd/64 scope link tentative 2023-09-13T08:25:20.941 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-09-13T08:25:20.941 INFO:teuthology.orchestra.run.smithi084.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-13T08:25:20.941 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 9a:83:1f:f8:2d:86 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-13T08:25:20.942 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::9883:1fff:fef8:2d86/64 scope link tentative 2023-09-13T08:25:20.942 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-09-13T08:25:20.942 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:25:20.943 DEBUG:teuthology.orchestra.run.smithi084:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-13T08:25:21.001 INFO:teuthology.orchestra.run.smithi084.stdout:1 2023-09-13T08:25:21.002 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:25:21.002 DEBUG:teuthology.orchestra.run.smithi084:> route 2023-09-13T08:25:21.061 INFO:teuthology.orchestra.run.smithi084.stdout:Kernel IP routing table 2023-09-13T08:25:21.061 INFO:teuthology.orchestra.run.smithi084.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-13T08:25:21.061 INFO:teuthology.orchestra.run.smithi084.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-09-13T08:25:21.061 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-09-13T08:25:21.062 INFO:teuthology.orchestra.run.smithi084.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-13T08:25:21.062 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:25:21.062 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-09-13T08:25:21.063 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-09-13T08:25:21.063 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-09-13T08:25:21.063 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-09-13T08:25:21.064 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-09-13T08:25:21.064 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-09-13T08:25:21.165 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:25:21.165 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2023-09-13T08:25:21.182 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-09-13T08:25:21.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:25:21.183 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list-id 2023-09-13T08:25:21.239 INFO:teuthology.orchestra.run.smithi084.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-09-13T08:25:21.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:25:21.240 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-09-13T08:25:21.241 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-09-13T08:25:21.241 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-09-13T08:25:21.241 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-09-13T08:25:21.241 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-09-13T08:25:21.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:25:21.333 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-09-13T08:25:21.368 INFO:teuthology.orchestra.run.smithi084.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-13T08:25:21.369 INFO:teuthology.orchestra.run.smithi084.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-13T08:25:21.369 INFO:teuthology.orchestra.run.smithi084.stdout: inet 127.0.0.1/8 scope host lo 2023-09-13T08:25:21.369 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-09-13T08:25:21.369 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 ::1/128 scope host 2023-09-13T08:25:21.370 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-09-13T08:25:21.370 INFO:teuthology.orchestra.run.smithi084.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-13T08:25:21.370 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 5a:89:01:cc:82:b0 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-09-13T08:25:21.370 INFO:teuthology.orchestra.run.smithi084.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-09-13T08:25:21.371 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-09-13T08:25:21.371 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::5889:1ff:fecc:82b0/64 scope link tentative 2023-09-13T08:25:21.371 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-09-13T08:25:21.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:25:21.382 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-09-13T08:25:21.457 INFO:teuthology.orchestra.run.smithi084.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-13T08:25:21.457 INFO:teuthology.orchestra.run.smithi084.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-13T08:25:21.457 INFO:teuthology.orchestra.run.smithi084.stdout: inet 127.0.0.1/8 scope host lo 2023-09-13T08:25:21.457 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-09-13T08:25:21.458 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 ::1/128 scope host 2023-09-13T08:25:21.458 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-09-13T08:25:21.458 INFO:teuthology.orchestra.run.smithi084.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-13T08:25:21.458 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 5a:89:01:cc:82:b0 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-09-13T08:25:21.458 INFO:teuthology.orchestra.run.smithi084.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-09-13T08:25:21.459 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-09-13T08:25:21.459 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::5889:1ff:fecc:82b0/64 scope link 2023-09-13T08:25:21.459 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-09-13T08:25:21.470 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-09-13T08:25:21.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:25:21.471 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-09-13T08:25:21.471 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-09-13T08:25:21.471 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-09-13T08:25:21.472 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-09-13T08:25:21.472 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-09-13T08:25:21.472 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-09-13T08:25:21.472 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-09-13T08:25:21.473 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-09-13T08:25:21.722 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:25:21.723 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-09-13T08:25:21.723 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-09-13T08:25:21.723 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set brx.1 up 2023-09-13T08:25:21.724 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set dev brx.1 master ceph-brx 2023-09-13T08:25:21.724 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-09-13T08:25:21.836 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-13T08:25:21.837 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-09-13T08:25:21.859 INFO:teuthology.orchestra.run.smithi084.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-09-13T08:25:21.859 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-13T08:25:21.859 DEBUG:teuthology.orchestra.run.smithi084:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-09-13T08:25:21.915 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-09-13T08:25:21.915 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:25:21.916 DEBUG:teuthology.orchestra.run.smithi084:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-09-13T08:25:22.000 INFO:teuthology.orchestra.run.smithi084.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-09-13T08:25:22.001 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-09-13T08:25:22.001 INFO:teuthology.orchestra.run.smithi084.stdout:invalid new device string format 2023-09-13T08:25:22.009 INFO:teuthology.orchestra.run.smithi084.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-09-13T08:25:22.009 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-09-13T08:25:22.009 INFO:teuthology.orchestra.run.smithi084.stdout:invalid new device string format 2023-09-13T08:25:22.010 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: resolved to: "172.21.15.84:3300,172.21.15.161:3300,172.21.15.161:3301" 2023-09-13T08:25:22.010 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-13T08:25:22.084 INFO:teuthology.orchestra.run.smithi084.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-09-13T08:25:22.085 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-09-13T08:25:22.085 INFO:teuthology.orchestra.run.smithi084.stdout:invalid new device string format 2023-09-13T08:25:22.085 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: resolved to: "172.21.15.84:3300,172.21.15.161:3300,172.21.15.161:3301" 2023-09-13T08:25:22.085 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-13T08:25:22.085 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: resolved to: "172.21.15.84:6789,172.21.15.161:6789,172.21.15.161:6790" 2023-09-13T08:25:22.086 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.84:6789,172.21.15.161:6789,172.21.15.161:6790:/ 2023-09-13T08:25:22.086 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=0107440b-b634-42c5-a643-5d31ea826116" will pass to kernel 2023-09-13T08:25:22.087 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-09-13T08:25:22.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:25:22.088 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-09-13T08:25:22.114 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:25:22.114 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-13T08:25:22.185 INFO:teuthology.orchestra.run.smithi084.stdout:client4717 2023-09-13T08:25:22.186 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-09-13T08:25:22.186 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T08:25:22.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:25:22.243 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-13T08:25:22.315 INFO:teuthology.orchestra.run.smithi084.stdout:client4717 2023-09-13T08:25:22.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:25:22.316 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-13T08:25:22.388 INFO:teuthology.orchestra.run.smithi084.stdout:client4717 2023-09-13T08:25:22.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:25:22.389 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/0107440b-b634-42c5-a643-5d31ea826116.client4717/status') 2023-09-13T08:25:22.468 INFO:teuthology.orchestra.run.smithi084.stdout:instance: client.4717 (3)172.21.15.84:0/930312325 2023-09-13T08:25:22.468 INFO:teuthology.orchestra.run.smithi084.stdout:blocklisted: false 2023-09-13T08:25:22.469 INFO:teuthology.orchestra.run.smithi084.stderr:0+1 records in 2023-09-13T08:25:22.469 INFO:teuthology.orchestra.run.smithi084.stderr:0+1 records out 2023-09-13T08:25:22.470 INFO:teuthology.orchestra.run.smithi084.stderr:69 bytes copied, 2.2632e-05 s, 3.0 MB/s 2023-09-13T08:25:22.470 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2023-09-13T08:25:22.470 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-09-13T08:25:22.471 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-09-13T08:25:22.471 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-13T08:25:22.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:22.632+0000 7f62aee52700 1 Processor -- start 2023-09-13T08:25:22.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:22.632+0000 7f62aee52700 1 -- start start 2023-09-13T08:25:22.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:22.632+0000 7f62aee52700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f62a815ec30 0x7f62a80cdb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:22.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:22.632+0000 7f62aee52700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f62a80ccce0 0x7f62a80b17a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:22.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:22.632+0000 7f62aee52700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62a80b0250 con 0x7f62a80ce060 2023-09-13T08:25:22.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:22.632+0000 7f62aee52700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62a80b0c70 con 0x7f62a80ccce0 2023-09-13T08:25:22.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:22.632+0000 7f62aee52700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62a80ce4e0 con 0x7f62a815ec30 2023-09-13T08:25:22.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:22.633+0000 7f62ad3ef700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f62a80ccce0 0x7f62a80b17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:22.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:22.633+0000 7f62ad3ef700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f62a80ccce0 0x7f62a80b17a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44488/0 (socket says 172.21.15.84:44488) 2023-09-13T08:25:22.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:22.633+0000 7f62ad3ef700 1 -- 172.21.15.84:0/3817242678 learned_addr learned my addr 172.21.15.84:0/3817242678 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:22.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:22.633+0000 7f62acbee700 1 --2- 172.21.15.84:0/3817242678 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f62a815ec30 0x7f62a80cdb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:22.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:22.633+0000 7f62ad3ef700 1 -- 172.21.15.84:0/3817242678 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f62a815ec30 msgr2=0x7f62a80cdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:22.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:22.633+0000 7f62ad3ef700 1 --2- 172.21.15.84:0/3817242678 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f62a815ec30 0x7f62a80cdb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:22.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:22.633+0000 7f62ad3ef700 1 -- 172.21.15.84:0/3817242678 >> v1:172.21.15.161:6789/0 conn(0x7f62a80ce060 legacy=0x7f62a80b1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:22.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:22.633+0000 7f62ad3ef700 1 -- 172.21.15.84:0/3817242678 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62a80cf880 con 0x7f62a80ccce0 2023-09-13T08:25:22.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:22.633+0000 7f62ad3ef700 1 --2- 172.21.15.84:0/3817242678 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62a80ccce0 0x7f62a80b17a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f62a0009e50 tx=0x7f62a000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8646f76b215ee53 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:22.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:22.633+0000 7f62a77fe700 1 -- 172.21.15.84:0/3817242678 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a000e070 con 0x7f62a80ccce0 2023-09-13T08:25:22.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:22.633+0000 7f62a77fe700 1 -- 172.21.15.84:0/3817242678 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62a000b9c0 con 0x7f62a80ccce0 2023-09-13T08:25:22.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:22.633+0000 7f62a77fe700 1 -- 172.21.15.84:0/3817242678 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a000bd70 con 0x7f62a80ccce0 2023-09-13T08:25:22.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:22.634+0000 7f62aee52700 1 -- 172.21.15.84:0/3817242678 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62a80ccce0 msgr2=0x7f62a80b17a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:22.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:22.634+0000 7f62aee52700 1 --2- 172.21.15.84:0/3817242678 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62a80ccce0 0x7f62a80b17a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f62a0009e50 tx=0x7f62a000b330 comp rx=0 tx=0).stop 2023-09-13T08:25:22.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:22.634+0000 7f62aee52700 1 -- 172.21.15.84:0/3817242678 shutdown_connections 2023-09-13T08:25:22.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:22.634+0000 7f62aee52700 1 --2- 172.21.15.84:0/3817242678 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62a80ccce0 0x7f62a80b17a0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:22.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:22.634+0000 7f62aee52700 1 --2- 172.21.15.84:0/3817242678 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f62a815ec30 0x7f62a80cdb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:22.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:22.634+0000 7f62aee52700 1 -- 172.21.15.84:0/3817242678 >> 172.21.15.84:0/3817242678 conn(0x7f62a809a4a0 msgr2=0x7f62a80d1170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:22.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:22.634+0000 7f62aee52700 1 -- 172.21.15.84:0/3817242678 shutdown_connections 2023-09-13T08:25:22.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:22.634+0000 7f62aee52700 1 -- 172.21.15.84:0/3817242678 wait complete. 2023-09-13T08:25:22.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:22.635+0000 7f62aee52700 1 Processor -- start 2023-09-13T08:25:22.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:22.635+0000 7f62aee52700 1 -- start start 2023-09-13T08:25:22.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:22.636+0000 7f62aee52700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f62a80ccce0 0x7f62a8156bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:22.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:22.636+0000 7f62aee52700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62a80ce060 0x7f62a80d1170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:22.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:22.636+0000 7f62aee52700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f62a815ec30 0x7f62a80d16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:22.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:22.636+0000 7f62aee52700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62a81f4330 con 0x7f62a80ce060 2023-09-13T08:25:22.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:22.636+0000 7f62aee52700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62a81f4610 con 0x7f62a80ccce0 2023-09-13T08:25:22.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:22.636+0000 7f62aee52700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62a81f48f0 con 0x7f62a815ec30 2023-09-13T08:25:22.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:22.636+0000 7f62a7fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62a80ce060 0x7f62a80d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:22.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:22.636+0000 7f62a7fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62a80ce060 0x7f62a80d1170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44492/0 (socket says 172.21.15.84:44492) 2023-09-13T08:25:22.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:22.636+0000 7f62a7fff700 1 -- 172.21.15.84:0/1254989844 learned_addr learned my addr 172.21.15.84:0/1254989844 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:22.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:22.636+0000 7f62ad3ef700 1 --2- 172.21.15.84:0/1254989844 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f62a815ec30 0x7f62a80d16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:22.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:22.636+0000 7f62acbee700 1 --2- 172.21.15.84:0/1254989844 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f62a80ccce0 0x7f62a8156bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:22.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:22.636+0000 7f62a7fff700 1 -- 172.21.15.84:0/1254989844 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f62a815ec30 msgr2=0x7f62a80d16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:22.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:22.636+0000 7f62a7fff700 1 --2- 172.21.15.84:0/1254989844 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f62a815ec30 0x7f62a80d16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:22.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:22.636+0000 7f62a7fff700 1 -- 172.21.15.84:0/1254989844 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f62a80ccce0 msgr2=0x7f62a8156bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:22.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:22.636+0000 7f62a7fff700 1 --2- 172.21.15.84:0/1254989844 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f62a80ccce0 0x7f62a8156bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:22.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:22.636+0000 7f62a7fff700 1 -- 172.21.15.84:0/1254989844 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62a0009b30 con 0x7f62a80ce060 2023-09-13T08:25:22.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:22.637+0000 7f62a7fff700 1 --2- 172.21.15.84:0/1254989844 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62a80ce060 0x7f62a80d1170 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f629400c450 tx=0x7f629400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:22.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:22.637+0000 7f62a57fa700 1 -- 172.21.15.84:0/1254989844 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62940052d0 con 0x7f62a80ce060 2023-09-13T08:25:22.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:22.637+0000 7f62a57fa700 1 -- 172.21.15.84:0/1254989844 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6294005430 con 0x7f62a80ce060 2023-09-13T08:25:22.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:22.637+0000 7f62aee52700 1 -- 172.21.15.84:0/1254989844 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62a81f4bd0 con 0x7f62a80ce060 2023-09-13T08:25:22.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:22.637+0000 7f62a57fa700 1 -- 172.21.15.84:0/1254989844 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62940038c0 con 0x7f62a80ce060 2023-09-13T08:25:22.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:22.637+0000 7f62aee52700 1 -- 172.21.15.84:0/1254989844 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62a815a990 con 0x7f62a80ce060 2023-09-13T08:25:22.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:22.638+0000 7f62aee52700 1 -- 172.21.15.84:0/1254989844 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62a804e9b0 con 0x7f62a80ce060 2023-09-13T08:25:22.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:22.638+0000 7f62a57fa700 1 -- 172.21.15.84:0/1254989844 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f6294003a20 con 0x7f62a80ce060 2023-09-13T08:25:22.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:22.639+0000 7f62a57fa700 1 --2- 172.21.15.84:0/1254989844 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f628c06a580 0x7f628c06ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:22.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:22.639+0000 7f62acbee700 1 --2- 172.21.15.84:0/1254989844 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f628c06a580 0x7f628c06ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:22.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:22.639+0000 7f62a57fa700 1 -- 172.21.15.84:0/1254989844 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6294087fd0 con 0x7f62a80ce060 2023-09-13T08:25:22.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:22.639+0000 7f62acbee700 1 --2- 172.21.15.84:0/1254989844 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f628c06a580 0x7f628c06ca40 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f629c009930 tx=0x7f629c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:22.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:22.643+0000 7f62a57fa700 1 -- 172.21.15.84:0/1254989844 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f62940532f0 con 0x7f62a80ce060 2023-09-13T08:25:22.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:22.885+0000 7f62aee52700 1 -- 172.21.15.84:0/1254989844 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f62a80b4840 con 0x7f62a80ce060 2023-09-13T08:25:22.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:22.886+0000 7f62a57fa700 1 -- 172.21.15.84:0/1254989844 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f6294056910 con 0x7f62a80ce060 2023-09-13T08:25:22.886 INFO:teuthology.orchestra.run.smithi084.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-09-13T08:25:22.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:22.889+0000 7f62aee52700 1 -- 172.21.15.84:0/1254989844 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f628c06a580 msgr2=0x7f628c06ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:22.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:22.889+0000 7f62aee52700 1 --2- 172.21.15.84:0/1254989844 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f628c06a580 0x7f628c06ca40 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f629c009930 tx=0x7f629c008040 comp rx=0 tx=0).stop 2023-09-13T08:25:22.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:22.889+0000 7f62aee52700 1 -- 172.21.15.84:0/1254989844 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62a80ce060 msgr2=0x7f62a80d1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:22.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:22.889+0000 7f62aee52700 1 --2- 172.21.15.84:0/1254989844 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62a80ce060 0x7f62a80d1170 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f629400c450 tx=0x7f629400c810 comp rx=0 tx=0).stop 2023-09-13T08:25:22.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:22.889+0000 7f62aee52700 1 -- 172.21.15.84:0/1254989844 shutdown_connections 2023-09-13T08:25:22.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:22.889+0000 7f62aee52700 1 --2- 172.21.15.84:0/1254989844 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f62a815ec30 0x7f62a80d16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:22.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:22.889+0000 7f62aee52700 1 --2- 172.21.15.84:0/1254989844 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f628c06a580 0x7f628c06ca40 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:22.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:22.889+0000 7f62aee52700 1 --2- 172.21.15.84:0/1254989844 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f62a80ccce0 0x7f62a8156bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:22.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:22.889+0000 7f62aee52700 1 --2- 172.21.15.84:0/1254989844 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62a80ce060 0x7f62a80d1170 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:22.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:22.889+0000 7f62aee52700 1 -- 172.21.15.84:0/1254989844 >> 172.21.15.84:0/1254989844 conn(0x7f62a809a4a0 msgr2=0x7f62a80ae0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:22.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:22.889+0000 7f62aee52700 1 -- 172.21.15.84:0/1254989844 shutdown_connections 2023-09-13T08:25:22.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:22.889+0000 7f62aee52700 1 -- 172.21.15.84:0/1254989844 wait complete. 2023-09-13T08:25:22.901 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-09-13T08:25:22.901 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-13T08:25:22.902 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi161.front.sepia.ceph.com 2023-09-13T08:25:22.902 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-09-13T08:25:22.902 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-09-13T08:25:22.903 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-09-13T08:25:22.903 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-09-13T08:25:22.903 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-13T08:25:22.903 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-09-13T08:25:22.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:25:22.904 DEBUG:teuthology.orchestra.run.smithi161:> ip addr 2023-09-13T08:25:22.924 INFO:teuthology.orchestra.run.smithi161.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-13T08:25:22.925 INFO:teuthology.orchestra.run.smithi161.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-13T08:25:22.925 INFO:teuthology.orchestra.run.smithi161.stdout: inet 127.0.0.1/8 scope host lo 2023-09-13T08:25:22.925 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-09-13T08:25:22.925 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 ::1/128 scope host 2023-09-13T08:25:22.926 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-09-13T08:25:22.926 INFO:teuthology.orchestra.run.smithi161.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-13T08:25:22.926 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:d9:36:7c brd ff:ff:ff:ff:ff:ff 2023-09-13T08:25:22.926 INFO:teuthology.orchestra.run.smithi161.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-13T08:25:22.926 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:d9:36:7d brd ff:ff:ff:ff:ff:ff 2023-09-13T08:25:22.927 INFO:teuthology.orchestra.run.smithi161.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-13T08:25:22.927 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:88:72:50 brd ff:ff:ff:ff:ff:ff 2023-09-13T08:25:22.927 INFO:teuthology.orchestra.run.smithi161.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-13T08:25:22.927 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:88:72:51 brd ff:ff:ff:ff:ff:ff 2023-09-13T08:25:22.928 INFO:teuthology.orchestra.run.smithi161.stdout: inet 172.21.15.161/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-09-13T08:25:22.928 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft 42367sec preferred_lft 42367sec 2023-09-13T08:25:22.928 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 fe80::e245:5a63:adec:a850/64 scope link noprefixroute 2023-09-13T08:25:22.928 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-09-13T08:25:22.929 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-09-13T08:25:22.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:25:22.929 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2023-09-13T08:25:22.930 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2023-09-13T08:25:22.930 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link add name ceph-brx type bridge 2023-09-13T08:25:22.930 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip addr flush dev ceph-brx 2023-09-13T08:25:22.931 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link set ceph-brx up 2023-09-13T08:25:22.931 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-09-13T08:25:22.931 DEBUG:teuthology.orchestra.run.smithi161:> ') 2023-09-13T08:25:23.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:25:23.095 DEBUG:teuthology.orchestra.run.smithi161:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-13T08:25:23.123 INFO:teuthology.orchestra.run.smithi161.stdout:1 2023-09-13T08:25:23.124 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:25:23.125 DEBUG:teuthology.orchestra.run.smithi161:> route 2023-09-13T08:25:23.199 INFO:teuthology.orchestra.run.smithi161.stdout:Kernel IP routing table 2023-09-13T08:25:23.200 INFO:teuthology.orchestra.run.smithi161.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-13T08:25:23.200 INFO:teuthology.orchestra.run.smithi161.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-09-13T08:25:23.200 INFO:teuthology.orchestra.run.smithi161.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-09-13T08:25:23.200 INFO:teuthology.orchestra.run.smithi161.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-13T08:25:23.201 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:25:23.201 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2023-09-13T08:25:23.202 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2023-09-13T08:25:23.202 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-09-13T08:25:23.202 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-09-13T08:25:23.203 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-09-13T08:25:23.203 DEBUG:teuthology.orchestra.run.smithi161:> ') 2023-09-13T08:25:23.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:25:23.435 DEBUG:teuthology.orchestra.run.smithi161:> ip netns list 2023-09-13T08:25:23.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:25:23.452 DEBUG:teuthology.orchestra.run.smithi161:> ip netns list-id 2023-09-13T08:25:23.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:25:23.513 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2023-09-13T08:25:23.514 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2023-09-13T08:25:23.514 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-09-13T08:25:23.514 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-09-13T08:25:23.515 DEBUG:teuthology.orchestra.run.smithi161:> ') 2023-09-13T08:25:23.607 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-09-13T08:25:23.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:25:23.608 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2023-09-13T08:25:23.608 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2023-09-13T08:25:23.608 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-09-13T08:25:23.609 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-09-13T08:25:23.609 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-09-13T08:25:23.609 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-09-13T08:25:23.610 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-09-13T08:25:23.610 DEBUG:teuthology.orchestra.run.smithi161:> ') 2023-09-13T08:25:23.818 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:25:23.819 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2023-09-13T08:25:23.819 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2023-09-13T08:25:23.819 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link set brx.0 up 2023-09-13T08:25:23.820 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link set dev brx.0 master ceph-brx 2023-09-13T08:25:23.820 DEBUG:teuthology.orchestra.run.smithi161:> ') 2023-09-13T08:25:23.926 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-13T08:25:23.926 DEBUG:teuthology.orchestra.run.smithi161:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-09-13T08:25:23.946 INFO:teuthology.orchestra.run.smithi161.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-09-13T08:25:23.947 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-13T08:25:23.948 DEBUG:teuthology.orchestra.run.smithi161:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-09-13T08:25:24.003 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-09-13T08:25:24.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:25:24.004 DEBUG:teuthology.orchestra.run.smithi161:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-13T08:25:24.096 INFO:teuthology.orchestra.run.smithi161.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-13T08:25:24.096 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-09-13T08:25:24.097 INFO:teuthology.orchestra.run.smithi161.stdout:invalid new device string format 2023-09-13T08:25:24.193 INFO:teuthology.orchestra.run.smithi161.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-13T08:25:24.193 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-09-13T08:25:24.193 INFO:teuthology.orchestra.run.smithi161.stdout:invalid new device string format 2023-09-13T08:25:24.194 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: resolved to: "172.21.15.84:3300,172.21.15.161:3300,172.21.15.161:3301" 2023-09-13T08:25:24.194 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-13T08:25:24.235 INFO:teuthology.orchestra.run.smithi161.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-13T08:25:24.235 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-09-13T08:25:24.236 INFO:teuthology.orchestra.run.smithi161.stdout:invalid new device string format 2023-09-13T08:25:24.236 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: resolved to: "172.21.15.84:3300,172.21.15.161:3300,172.21.15.161:3301" 2023-09-13T08:25:24.236 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-13T08:25:24.236 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: resolved to: "172.21.15.84:6789,172.21.15.161:6789,172.21.15.161:6790" 2023-09-13T08:25:24.237 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.84:6789,172.21.15.161:6789,172.21.15.161:6790:/ 2023-09-13T08:25:24.237 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=0107440b-b634-42c5-a643-5d31ea826116" will pass to kernel 2023-09-13T08:25:24.253 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-09-13T08:25:24.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:25:24.254 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-09-13T08:25:24.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:25:24.281 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-13T08:25:24.353 INFO:teuthology.orchestra.run.smithi161.stdout:client4568 2023-09-13T08:25:24.353 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-09-13T08:25:24.354 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T08:25:24.411 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:25:24.412 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-13T08:25:24.484 INFO:teuthology.orchestra.run.smithi161.stdout:client4568 2023-09-13T08:25:24.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:25:24.485 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-13T08:25:24.556 INFO:teuthology.orchestra.run.smithi161.stdout:client4568 2023-09-13T08:25:24.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:25:24.557 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/0107440b-b634-42c5-a643-5d31ea826116.client4568/status') 2023-09-13T08:25:24.636 INFO:teuthology.orchestra.run.smithi161.stdout:instance: client.4568 (3)192.168.0.1:0/1197906085 2023-09-13T08:25:24.636 INFO:teuthology.orchestra.run.smithi161.stdout:blocklisted: false 2023-09-13T08:25:24.637 INFO:teuthology.orchestra.run.smithi161.stderr:0+1 records in 2023-09-13T08:25:24.638 INFO:teuthology.orchestra.run.smithi161.stderr:0+1 records out 2023-09-13T08:25:24.638 INFO:teuthology.orchestra.run.smithi161.stderr:69 bytes copied, 3.7509e-05 s, 1.8 MB/s 2023-09-13T08:25:24.638 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2023-09-13T08:25:24.638 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-09-13T08:25:24.639 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-09-13T08:25:24.639 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-13T08:25:24.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:24.772+0000 7ff5d4b4b700 1 Processor -- start 2023-09-13T08:25:24.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:24.772+0000 7ff5d4b4b700 1 -- start start 2023-09-13T08:25:24.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:24.773+0000 7ff5d4b4b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff5d006d620 0x7ff5d00b3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:24.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:24.773+0000 7ff5d4b4b700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5d00cad60 con 0x7ff5d006a620 2023-09-13T08:25:24.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:24.773+0000 7ff5d4b4b700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5d006da30 con 0x7ff5d015b580 2023-09-13T08:25:24.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:24.773+0000 7ff5d4b4b700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5d00caa80 con 0x7ff5d006d620 2023-09-13T08:25:24.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:24.773+0000 7ff5ced9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff5d006d620 0x7ff5d00b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:24.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:24.773+0000 7ff5ced9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff5d006d620 0x7ff5d00b3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44502/0 (socket says 172.21.15.84:44502) 2023-09-13T08:25:24.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:24.773+0000 7ff5ce59c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7ff5d006a620 0x7ff5d006aa00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:47144/0 (socket says 172.21.15.84:47144) 2023-09-13T08:25:24.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:24.773+0000 7ff5ced9d700 1 -- 172.21.15.84:0/3978191456 learned_addr learned my addr 172.21.15.84:0/3978191456 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:24.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:24.773+0000 7ff5ced9d700 1 -- 172.21.15.84:0/3978191456 >> v1:172.21.15.161:6789/0 conn(0x7ff5d015b580 legacy=0x7ff5d00b2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:24.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:24.773+0000 7ff5ced9d700 1 -- 172.21.15.84:0/3978191456 >> v1:172.21.15.84:6789/0 conn(0x7ff5d006a620 legacy=0x7ff5d006aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:24.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:24.773+0000 7ff5ced9d700 1 -- 172.21.15.84:0/3978191456 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5d00ccec0 con 0x7ff5d006d620 2023-09-13T08:25:24.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:24.773+0000 7ff5cd59a700 1 -- 172.21.15.84:0/3978191456 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4087419900 0 0) 0x7ff5d00cad60 con 0x7ff5d006a620 2023-09-13T08:25:24.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:24.774+0000 7ff5ced9d700 1 --2- 172.21.15.84:0/3978191456 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5d006d620 0x7ff5d00b3590 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff5c8009e50 tx=0x7ff5c800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ba859344450151c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:24.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:24.774+0000 7ff5cd59a700 1 -- 172.21.15.84:0/3978191456 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c800e070 con 0x7ff5d006d620 2023-09-13T08:25:24.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:24.774+0000 7ff5cd59a700 1 -- 172.21.15.84:0/3978191456 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5c800b9c0 con 0x7ff5d006d620 2023-09-13T08:25:24.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:24.774+0000 7ff5cd59a700 1 -- 172.21.15.84:0/3978191456 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c800bd70 con 0x7ff5d006d620 2023-09-13T08:25:24.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:24.774+0000 7ff5d4b4b700 1 -- 172.21.15.84:0/3978191456 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5d006d620 msgr2=0x7ff5d00b3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:24.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:24.774+0000 7ff5d4b4b700 1 --2- 172.21.15.84:0/3978191456 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5d006d620 0x7ff5d00b3590 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff5c8009e50 tx=0x7ff5c800b330 comp rx=0 tx=0).stop 2023-09-13T08:25:24.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:24.774+0000 7ff5d4b4b700 1 -- 172.21.15.84:0/3978191456 shutdown_connections 2023-09-13T08:25:24.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:24.774+0000 7ff5d4b4b700 1 --2- 172.21.15.84:0/3978191456 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5d006d620 0x7ff5d00b3590 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:24.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:24.774+0000 7ff5d4b4b700 1 -- 172.21.15.84:0/3978191456 >> 172.21.15.84:0/3978191456 conn(0x7ff5d00b1b80 msgr2=0x7ff5d00b1f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:24.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:24.774+0000 7ff5d4b4b700 1 -- 172.21.15.84:0/3978191456 shutdown_connections 2023-09-13T08:25:24.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:24.774+0000 7ff5d4b4b700 1 -- 172.21.15.84:0/3978191456 wait complete. 2023-09-13T08:25:24.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:24.776+0000 7ff5d4b4b700 1 Processor -- start 2023-09-13T08:25:24.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:24.776+0000 7ff5d4b4b700 1 -- start start 2023-09-13T08:25:24.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:24.776+0000 7ff5d4b4b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5d006a620 0x7ff5d01f5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:24.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:24.776+0000 7ff5d4b4b700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff5d006d620 0x7ff5d00acd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:24.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:24.777+0000 7ff5d4b4b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5d015b580 0x7ff5d00ad2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:24.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:24.777+0000 7ff5d4b4b700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d015e250 con 0x7ff5d015b580 2023-09-13T08:25:24.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:24.777+0000 7ff5d4b4b700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d015d640 con 0x7ff5d006a620 2023-09-13T08:25:24.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:24.777+0000 7ff5d4b4b700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d015d920 con 0x7ff5d006d620 2023-09-13T08:25:24.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:24.777+0000 7ff5ced9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5d015b580 0x7ff5d00ad2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:24.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:24.777+0000 7ff5ced9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5d015b580 0x7ff5d00ad2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44508/0 (socket says 172.21.15.84:44508) 2023-09-13T08:25:24.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:24.777+0000 7ff5ced9d700 1 -- 172.21.15.84:0/1283319881 learned_addr learned my addr 172.21.15.84:0/1283319881 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:24.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:24.777+0000 7ff5ce59c700 1 --2- 172.21.15.84:0/1283319881 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5d006a620 0x7ff5d01f5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:24.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:24.777+0000 7ff5cdd9b700 1 --2- 172.21.15.84:0/1283319881 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff5d006d620 0x7ff5d00acd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:24.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:24.777+0000 7ff5ced9d700 1 -- 172.21.15.84:0/1283319881 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff5d006d620 msgr2=0x7ff5d00acd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:24.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:24.777+0000 7ff5ced9d700 1 --2- 172.21.15.84:0/1283319881 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff5d006d620 0x7ff5d00acd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:24.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:24.777+0000 7ff5ced9d700 1 -- 172.21.15.84:0/1283319881 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5d006a620 msgr2=0x7ff5d01f5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:24.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:24.777+0000 7ff5ced9d700 1 --2- 172.21.15.84:0/1283319881 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5d006a620 0x7ff5d01f5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:24.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:24.777+0000 7ff5ced9d700 1 -- 172.21.15.84:0/1283319881 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5c8009b30 con 0x7ff5d015b580 2023-09-13T08:25:24.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:24.777+0000 7ff5ced9d700 1 --2- 172.21.15.84:0/1283319881 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5d015b580 0x7ff5d00ad2c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff5c800b730 tx=0x7ff5c8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:24.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:24.777+0000 7ff5beffd700 1 -- 172.21.15.84:0/1283319881 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c801c640 con 0x7ff5d015b580 2023-09-13T08:25:24.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:24.777+0000 7ff5beffd700 1 -- 172.21.15.84:0/1283319881 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5c801c7c0 con 0x7ff5d015b580 2023-09-13T08:25:24.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:24.777+0000 7ff5d4b4b700 1 -- 172.21.15.84:0/1283319881 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5d015dc00 con 0x7ff5d015b580 2023-09-13T08:25:24.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:24.777+0000 7ff5beffd700 1 -- 172.21.15.84:0/1283319881 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c801cb70 con 0x7ff5d015b580 2023-09-13T08:25:24.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:24.777+0000 7ff5d4b4b700 1 -- 172.21.15.84:0/1283319881 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5d01f5ca0 con 0x7ff5d015b580 2023-09-13T08:25:24.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:24.778+0000 7ff5d4b4b700 1 -- 172.21.15.84:0/1283319881 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5d004e9b0 con 0x7ff5d015b580 2023-09-13T08:25:24.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:24.779+0000 7ff5beffd700 1 -- 172.21.15.84:0/1283319881 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7ff5c801ccd0 con 0x7ff5d015b580 2023-09-13T08:25:24.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:24.779+0000 7ff5beffd700 1 --2- 172.21.15.84:0/1283319881 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7ff5b006a580 0x7ff5b006ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:24.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:24.779+0000 7ff5beffd700 1 -- 172.21.15.84:0/1283319881 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7ff5c808a6d0 con 0x7ff5d015b580 2023-09-13T08:25:24.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:24.779+0000 7ff5ce59c700 1 --2- 172.21.15.84:0/1283319881 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7ff5b006a580 0x7ff5b006ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:24.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:24.780+0000 7ff5ce59c700 1 --2- 172.21.15.84:0/1283319881 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7ff5b006a580 0x7ff5b006ca40 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff5c4007b10 tx=0x7ff5c4007a60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:24.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:24.783+0000 7ff5beffd700 1 -- 172.21.15.84:0/1283319881 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7ff5c8055900 con 0x7ff5d015b580 2023-09-13T08:25:25.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:25.021+0000 7ff5d4b4b700 1 -- 172.21.15.84:0/1283319881 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff5d015e390 con 0x7ff5d015b580 2023-09-13T08:25:25.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:25.021+0000 7ff5beffd700 1 -- 172.21.15.84:0/1283319881 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7ff5d015e390 con 0x7ff5d015b580 2023-09-13T08:25:25.022 INFO:teuthology.orchestra.run.smithi084.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-09-13T08:25:25.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:25.023+0000 7ff5d4b4b700 1 -- 172.21.15.84:0/1283319881 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7ff5b006a580 msgr2=0x7ff5b006ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:25.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:25.023+0000 7ff5d4b4b700 1 --2- 172.21.15.84:0/1283319881 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7ff5b006a580 0x7ff5b006ca40 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff5c4007b10 tx=0x7ff5c4007a60 comp rx=0 tx=0).stop 2023-09-13T08:25:25.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:25.023+0000 7ff5d4b4b700 1 -- 172.21.15.84:0/1283319881 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5d015b580 msgr2=0x7ff5d00ad2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:25.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:25.023+0000 7ff5d4b4b700 1 --2- 172.21.15.84:0/1283319881 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5d015b580 0x7ff5d00ad2c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff5c800b730 tx=0x7ff5c8004ad0 comp rx=0 tx=0).stop 2023-09-13T08:25:25.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:25.023+0000 7ff5d4b4b700 1 -- 172.21.15.84:0/1283319881 shutdown_connections 2023-09-13T08:25:25.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:25.023+0000 7ff5d4b4b700 1 --2- 172.21.15.84:0/1283319881 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5d015b580 0x7ff5d00ad2c0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:25.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:25.023+0000 7ff5d4b4b700 1 --2- 172.21.15.84:0/1283319881 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7ff5b006a580 0x7ff5b006ca40 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:25.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:25.023+0000 7ff5d4b4b700 1 --2- 172.21.15.84:0/1283319881 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5d006a620 0x7ff5d01f5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:25.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:25.023+0000 7ff5d4b4b700 1 --2- 172.21.15.84:0/1283319881 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff5d006d620 0x7ff5d00acd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:25.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:25.023+0000 7ff5d4b4b700 1 -- 172.21.15.84:0/1283319881 >> 172.21.15.84:0/1283319881 conn(0x7ff5d00b1b80 msgr2=0x7ff5d00b1f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:25.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:25.024+0000 7ff5d4b4b700 1 -- 172.21.15.84:0/1283319881 shutdown_connections 2023-09-13T08:25:25.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:25.024+0000 7ff5d4b4b700 1 -- 172.21.15.84:0/1283319881 wait complete. 2023-09-13T08:25:25.035 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-09-13T08:25:25.036 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-13T08:25:25.036 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi161.front.sepia.ceph.com 2023-09-13T08:25:25.036 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-09-13T08:25:25.037 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-09-13T08:25:25.037 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-09-13T08:25:25.037 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-09-13T08:25:25.038 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-13T08:25:25.038 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-09-13T08:25:25.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:25:25.039 DEBUG:teuthology.orchestra.run.smithi161:> ip addr 2023-09-13T08:25:25.057 INFO:teuthology.orchestra.run.smithi161.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-13T08:25:25.057 INFO:teuthology.orchestra.run.smithi161.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-13T08:25:25.057 INFO:teuthology.orchestra.run.smithi161.stdout: inet 127.0.0.1/8 scope host lo 2023-09-13T08:25:25.058 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-09-13T08:25:25.058 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 ::1/128 scope host 2023-09-13T08:25:25.058 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-09-13T08:25:25.058 INFO:teuthology.orchestra.run.smithi161.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-13T08:25:25.058 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:d9:36:7c brd ff:ff:ff:ff:ff:ff 2023-09-13T08:25:25.059 INFO:teuthology.orchestra.run.smithi161.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-13T08:25:25.059 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:d9:36:7d brd ff:ff:ff:ff:ff:ff 2023-09-13T08:25:25.059 INFO:teuthology.orchestra.run.smithi161.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-13T08:25:25.059 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:88:72:50 brd ff:ff:ff:ff:ff:ff 2023-09-13T08:25:25.059 INFO:teuthology.orchestra.run.smithi161.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-13T08:25:25.060 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:88:72:51 brd ff:ff:ff:ff:ff:ff 2023-09-13T08:25:25.060 INFO:teuthology.orchestra.run.smithi161.stdout: inet 172.21.15.161/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-09-13T08:25:25.060 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft 42365sec preferred_lft 42365sec 2023-09-13T08:25:25.060 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 fe80::e245:5a63:adec:a850/64 scope link noprefixroute 2023-09-13T08:25:25.061 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-09-13T08:25:25.061 INFO:teuthology.orchestra.run.smithi161.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-13T08:25:25.061 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 92:7b:80:9f:06:05 brd ff:ff:ff:ff:ff:ff 2023-09-13T08:25:25.061 INFO:teuthology.orchestra.run.smithi161.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-09-13T08:25:25.061 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-09-13T08:25:25.062 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 fe80::389b:48ff:fe02:b28/64 scope link 2023-09-13T08:25:25.062 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-09-13T08:25:25.062 INFO:teuthology.orchestra.run.smithi161.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-13T08:25:25.062 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 92:7b:80:9f:06:05 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-09-13T08:25:25.062 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 fe80::907b:80ff:fe9f:605/64 scope link tentative 2023-09-13T08:25:25.063 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-09-13T08:25:25.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:25:25.063 DEBUG:teuthology.orchestra.run.smithi161:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-13T08:25:25.122 INFO:teuthology.orchestra.run.smithi161.stdout:1 2023-09-13T08:25:25.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:25:25.124 DEBUG:teuthology.orchestra.run.smithi161:> route 2023-09-13T08:25:25.183 INFO:teuthology.orchestra.run.smithi161.stdout:Kernel IP routing table 2023-09-13T08:25:25.183 INFO:teuthology.orchestra.run.smithi161.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-13T08:25:25.184 INFO:teuthology.orchestra.run.smithi161.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-09-13T08:25:25.184 INFO:teuthology.orchestra.run.smithi161.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-09-13T08:25:25.184 INFO:teuthology.orchestra.run.smithi161.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-13T08:25:25.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:25:25.185 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2023-09-13T08:25:25.185 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2023-09-13T08:25:25.186 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-09-13T08:25:25.186 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-09-13T08:25:25.186 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-09-13T08:25:25.187 DEBUG:teuthology.orchestra.run.smithi161:> ') 2023-09-13T08:25:25.288 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:25:25.288 DEBUG:teuthology.orchestra.run.smithi161:> ip netns list 2023-09-13T08:25:25.305 INFO:teuthology.orchestra.run.smithi161.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-09-13T08:25:25.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:25:25.306 DEBUG:teuthology.orchestra.run.smithi161:> ip netns list-id 2023-09-13T08:25:25.362 INFO:teuthology.orchestra.run.smithi161.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-09-13T08:25:25.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:25:25.363 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2023-09-13T08:25:25.363 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2023-09-13T08:25:25.364 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-09-13T08:25:25.364 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-09-13T08:25:25.364 DEBUG:teuthology.orchestra.run.smithi161:> ') 2023-09-13T08:25:25.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:25:25.457 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-09-13T08:25:25.498 INFO:teuthology.orchestra.run.smithi161.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-13T08:25:25.499 INFO:teuthology.orchestra.run.smithi161.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-13T08:25:25.499 INFO:teuthology.orchestra.run.smithi161.stdout: inet 127.0.0.1/8 scope host lo 2023-09-13T08:25:25.499 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-09-13T08:25:25.499 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 ::1/128 scope host 2023-09-13T08:25:25.500 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-09-13T08:25:25.500 INFO:teuthology.orchestra.run.smithi161.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-13T08:25:25.500 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 7e:b7:29:1b:1b:70 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-09-13T08:25:25.500 INFO:teuthology.orchestra.run.smithi161.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-09-13T08:25:25.500 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-09-13T08:25:25.501 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 fe80::7cb7:29ff:fe1b:1b70/64 scope link tentative 2023-09-13T08:25:25.501 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-09-13T08:25:25.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:25:25.524 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-09-13T08:25:25.598 INFO:teuthology.orchestra.run.smithi161.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-13T08:25:25.599 INFO:teuthology.orchestra.run.smithi161.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-13T08:25:25.599 INFO:teuthology.orchestra.run.smithi161.stdout: inet 127.0.0.1/8 scope host lo 2023-09-13T08:25:25.599 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-09-13T08:25:25.599 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 ::1/128 scope host 2023-09-13T08:25:25.599 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-09-13T08:25:25.600 INFO:teuthology.orchestra.run.smithi161.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-13T08:25:25.600 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 7e:b7:29:1b:1b:70 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-09-13T08:25:25.600 INFO:teuthology.orchestra.run.smithi161.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-09-13T08:25:25.601 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-09-13T08:25:25.601 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 fe80::7cb7:29ff:fe1b:1b70/64 scope link tentative 2023-09-13T08:25:25.601 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-09-13T08:25:25.614 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-09-13T08:25:25.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:25:25.615 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2023-09-13T08:25:25.616 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2023-09-13T08:25:25.616 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-09-13T08:25:25.616 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-09-13T08:25:25.617 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-09-13T08:25:25.617 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-09-13T08:25:25.617 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-09-13T08:25:25.617 DEBUG:teuthology.orchestra.run.smithi161:> ') 2023-09-13T08:25:25.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:25:25.868 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2023-09-13T08:25:25.868 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2023-09-13T08:25:25.869 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link set brx.1 up 2023-09-13T08:25:25.869 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link set dev brx.1 master ceph-brx 2023-09-13T08:25:25.870 DEBUG:teuthology.orchestra.run.smithi161:> ') 2023-09-13T08:25:25.975 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-13T08:25:25.977 DEBUG:teuthology.orchestra.run.smithi161:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-09-13T08:25:25.997 INFO:teuthology.orchestra.run.smithi161.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-09-13T08:25:25.997 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-13T08:25:25.998 DEBUG:teuthology.orchestra.run.smithi161:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-09-13T08:25:26.053 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-09-13T08:25:26.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:25:26.054 DEBUG:teuthology.orchestra.run.smithi161:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-09-13T08:25:26.140 INFO:teuthology.orchestra.run.smithi161.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-09-13T08:25:26.140 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-09-13T08:25:26.140 INFO:teuthology.orchestra.run.smithi161.stdout:invalid new device string format 2023-09-13T08:25:26.148 INFO:teuthology.orchestra.run.smithi161.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-09-13T08:25:26.148 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-09-13T08:25:26.149 INFO:teuthology.orchestra.run.smithi161.stdout:invalid new device string format 2023-09-13T08:25:26.149 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: resolved to: "172.21.15.84:3300,172.21.15.161:3300,172.21.15.161:3301" 2023-09-13T08:25:26.149 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-13T08:25:26.179 INFO:teuthology.orchestra.run.smithi161.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-09-13T08:25:26.180 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-09-13T08:25:26.180 INFO:teuthology.orchestra.run.smithi161.stdout:invalid new device string format 2023-09-13T08:25:26.180 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: resolved to: "172.21.15.84:3300,172.21.15.161:3300,172.21.15.161:3301" 2023-09-13T08:25:26.181 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-13T08:25:26.181 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: resolved to: "172.21.15.84:6789,172.21.15.161:6789,172.21.15.161:6790" 2023-09-13T08:25:26.181 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.84:6789,172.21.15.161:6789,172.21.15.161:6790:/ 2023-09-13T08:25:26.181 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=0107440b-b634-42c5-a643-5d31ea826116" will pass to kernel 2023-09-13T08:25:26.183 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-09-13T08:25:26.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:25:26.183 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-09-13T08:25:26.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:25:26.218 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-13T08:25:26.289 INFO:teuthology.orchestra.run.smithi161.stdout:client4574 2023-09-13T08:25:26.289 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-09-13T08:25:26.290 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T08:25:26.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:25:26.347 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-13T08:25:26.419 INFO:teuthology.orchestra.run.smithi161.stdout:client4574 2023-09-13T08:25:26.420 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:25:26.420 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-13T08:25:26.492 INFO:teuthology.orchestra.run.smithi161.stdout:client4574 2023-09-13T08:25:26.492 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:25:26.493 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/0107440b-b634-42c5-a643-5d31ea826116.client4574/status') 2023-09-13T08:25:26.571 INFO:teuthology.orchestra.run.smithi161.stdout:instance: client.4574 (3)192.168.0.2:0/1918541646 2023-09-13T08:25:26.571 INFO:teuthology.orchestra.run.smithi161.stdout:blocklisted: false 2023-09-13T08:25:26.573 INFO:teuthology.orchestra.run.smithi161.stderr:0+1 records in 2023-09-13T08:25:26.573 INFO:teuthology.orchestra.run.smithi161.stderr:0+1 records out 2023-09-13T08:25:26.573 INFO:teuthology.orchestra.run.smithi161.stderr:69 bytes copied, 3.5454e-05 s, 1.9 MB/s 2023-09-13T08:25:26.574 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-09-13T08:25:26.881 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T08:25:27.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.015+0000 7fd56abe3700 1 Processor -- start 2023-09-13T08:25:27.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.015+0000 7fd56abe3700 1 -- start start 2023-09-13T08:25:27.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.016+0000 7fd56abe3700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd5640ca920 0x7fd56406d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:27.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.016+0000 7fd56abe3700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd56406a620 0x7fd56406aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:27.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.016+0000 7fd56abe3700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd56406af90 con 0x7fd56415d530 2023-09-13T08:25:27.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.016+0000 7fd56abe3700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5640cff20 con 0x7fd56406a620 2023-09-13T08:25:27.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.016+0000 7fd56abe3700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5640cae50 con 0x7fd5640ca920 2023-09-13T08:25:27.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.017+0000 7fd569180700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd56406a620 0x7fd56406aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:27.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.017+0000 7fd563fff700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd5640ca920 0x7fd56406d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:27.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.017+0000 7fd56897f700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fd56415d530 0x7fd564161bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.84:33328/0 (socket says 172.21.15.84:33328) 2023-09-13T08:25:27.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.017+0000 7fd56897f700 1 -- 172.21.15.84:0/3210836645 learned_addr learned my addr 172.21.15.84:0/3210836645 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:25:27.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.017+0000 7fd5637fe700 1 -- 172.21.15.84:0/3210836645 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1485758364 0 0) 0x7fd56406af90 con 0x7fd56415d530 2023-09-13T08:25:27.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.017+0000 7fd563fff700 1 -- 172.21.15.84:0/3210836645 >> v2:172.21.15.161:3300/0 conn(0x7fd56406a620 msgr2=0x7fd56406aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:27.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.017+0000 7fd563fff700 1 --2- 172.21.15.84:0/3210836645 >> v2:172.21.15.161:3300/0 conn(0x7fd56406a620 0x7fd56406aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:27.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.017+0000 7fd563fff700 1 -- 172.21.15.84:0/3210836645 >> v1:172.21.15.161:6789/0 conn(0x7fd56415d530 legacy=0x7fd564161bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:27.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.017+0000 7fd563fff700 1 -- 172.21.15.84:0/3210836645 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5640cb130 con 0x7fd5640ca920 2023-09-13T08:25:27.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.017+0000 7fd563fff700 1 --2- 172.21.15.84:0/3210836645 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd5640ca920 0x7fd56406d700 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd550009840 tx=0x7fd550009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5fb18ab4034dde6f server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:27.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.017+0000 7fd5637fe700 1 -- 172.21.15.84:0/3210836645 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd550011830 con 0x7fd5640ca920 2023-09-13T08:25:27.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.017+0000 7fd5637fe700 1 -- 172.21.15.84:0/3210836645 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd550011990 con 0x7fd5640ca920 2023-09-13T08:25:27.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.017+0000 7fd5637fe700 1 -- 172.21.15.84:0/3210836645 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd550011d20 con 0x7fd5640ca920 2023-09-13T08:25:27.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.018+0000 7fd56abe3700 1 -- 172.21.15.84:0/3210836645 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd5640ca920 msgr2=0x7fd56406d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:27.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.018+0000 7fd56abe3700 1 --2- 172.21.15.84:0/3210836645 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd5640ca920 0x7fd56406d700 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd550009840 tx=0x7fd550009b50 comp rx=0 tx=0).stop 2023-09-13T08:25:27.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.018+0000 7fd56abe3700 1 -- 172.21.15.84:0/3210836645 shutdown_connections 2023-09-13T08:25:27.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.018+0000 7fd56abe3700 1 --2- 172.21.15.84:0/3210836645 >> v2:172.21.15.161:3300/0 conn(0x7fd56406a620 0x7fd56406aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:27.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.018+0000 7fd56abe3700 1 --2- 172.21.15.84:0/3210836645 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd5640ca920 0x7fd56406d700 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:27.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.018+0000 7fd56abe3700 1 -- 172.21.15.84:0/3210836645 >> 172.21.15.84:0/3210836645 conn(0x7fd5640d00c0 msgr2=0x7fd5640d04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:27.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.018+0000 7fd56abe3700 1 -- 172.21.15.84:0/3210836645 shutdown_connections 2023-09-13T08:25:27.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.018+0000 7fd56abe3700 1 -- 172.21.15.84:0/3210836645 wait complete. 2023-09-13T08:25:27.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.019+0000 7fd56abe3700 1 Processor -- start 2023-09-13T08:25:27.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.019+0000 7fd56abe3700 1 -- start start 2023-09-13T08:25:27.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.020+0000 7fd56abe3700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd56406a620 0x7fd5640b37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:27.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.020+0000 7fd56abe3700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd5640ca920 0x7fd5641f3030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:27.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.020+0000 7fd56abe3700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd56415d530 0x7fd564158c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:27.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.020+0000 7fd56abe3700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd564158860 con 0x7fd56406a620 2023-09-13T08:25:27.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.020+0000 7fd56abe3700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5641f3fd0 con 0x7fd5640ca920 2023-09-13T08:25:27.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.020+0000 7fd56abe3700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5641f3a10 con 0x7fd56415d530 2023-09-13T08:25:27.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.020+0000 7fd56897f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd56406a620 0x7fd5640b37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:27.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.021+0000 7fd56897f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd56406a620 0x7fd5640b37a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44518/0 (socket says 172.21.15.84:44518) 2023-09-13T08:25:27.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.021+0000 7fd56897f700 1 -- 172.21.15.84:0/701721830 learned_addr learned my addr 172.21.15.84:0/701721830 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:27.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.021+0000 7fd563fff700 1 --2- 172.21.15.84:0/701721830 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd5640ca920 0x7fd5641f3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:27.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.021+0000 7fd569180700 1 --2- 172.21.15.84:0/701721830 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd56415d530 0x7fd564158c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:27.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.021+0000 7fd56897f700 1 -- 172.21.15.84:0/701721830 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd56415d530 msgr2=0x7fd564158c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:27.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.021+0000 7fd56897f700 1 --2- 172.21.15.84:0/701721830 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd56415d530 0x7fd564158c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:27.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.021+0000 7fd56897f700 1 -- 172.21.15.84:0/701721830 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd5640ca920 msgr2=0x7fd5641f3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:27.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.021+0000 7fd56897f700 1 --2- 172.21.15.84:0/701721830 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd5640ca920 0x7fd5641f3030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:27.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.021+0000 7fd56897f700 1 -- 172.21.15.84:0/701721830 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5500094a0 con 0x7fd56406a620 2023-09-13T08:25:27.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.021+0000 7fd56897f700 1 --2- 172.21.15.84:0/701721830 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd56406a620 0x7fd5640b37a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd55800c550 tx=0x7fd55800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:27.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.021+0000 7fd5617fa700 1 -- 172.21.15.84:0/701721830 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd558004c80 con 0x7fd56406a620 2023-09-13T08:25:27.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.021+0000 7fd5617fa700 1 -- 172.21.15.84:0/701721830 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd558004e00 con 0x7fd56406a620 2023-09-13T08:25:27.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.021+0000 7fd5617fa700 1 -- 172.21.15.84:0/701721830 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd558007310 con 0x7fd56406a620 2023-09-13T08:25:27.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.021+0000 7fd56abe3700 1 -- 172.21.15.84:0/701721830 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5641f3cf0 con 0x7fd56406a620 2023-09-13T08:25:27.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.021+0000 7fd56abe3700 1 -- 172.21.15.84:0/701721830 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5640b3ce0 con 0x7fd56406a620 2023-09-13T08:25:27.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.022+0000 7fd56abe3700 1 -- 172.21.15.84:0/701721830 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5640b3f30 con 0x7fd56406a620 2023-09-13T08:25:27.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.022+0000 7fd5617fa700 1 -- 172.21.15.84:0/701721830 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fd558007470 con 0x7fd56406a620 2023-09-13T08:25:27.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.023+0000 7fd5617fa700 1 --2- 172.21.15.84:0/701721830 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fd54806a580 0x7fd54806ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:27.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.023+0000 7fd5617fa700 1 -- 172.21.15.84:0/701721830 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fd5580889b0 con 0x7fd56406a620 2023-09-13T08:25:27.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.023+0000 7fd563fff700 1 --2- 172.21.15.84:0/701721830 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fd54806a580 0x7fd54806ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:27.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.023+0000 7fd563fff700 1 --2- 172.21.15.84:0/701721830 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fd54806a580 0x7fd54806ca40 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd5640cad80 tx=0x7fd550008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:27.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.028+0000 7fd5617fa700 1 -- 172.21.15.84:0/701721830 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fd558053be0 con 0x7fd56406a620 2023-09-13T08:25:27.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.218+0000 7fd56abe3700 1 -- 172.21.15.84:0/701721830 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd5640cdc60 con 0x7fd56406a620 2023-09-13T08:25:27.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.219+0000 7fd5617fa700 1 -- 172.21.15.84:0/701721830 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18757 (secure 0 0 0) 0x7fd558057200 con 0x7fd56406a620 2023-09-13T08:25:27.219 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:25:27.220 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":26,"fsid":"0107440b-b634-42c5-a643-5d31ea826116","created":"2023-09-13T08:24:16.931917+0000","modified":"2023-09-13T08:25:23.878460+0000","last_up_change":"2023-09-13T08:24:28.422631+0000","last_in_change":"2023-09-13T08:24:19.425578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T08:24:28.583720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-13T08:24:39.862832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-13T08:24:41.145511+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-13T08:24:44.775160+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4a53ec12-1469-4356-b4e1-2b8fc9b7c0f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6817","nonce":1599532366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6819","nonce":1599532366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6823","nonce":1599532366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6821","nonce":1599532366}]},"public_addr":"172.21.15.84:6817/1599532366","cluster_addr":"172.21.15.84:6819/1599532366","heartbeat_back_addr":"172.21.15.84:6823/1599532366","heartbeat_front_addr":"172.21.15.84:6821/1599532366","state":["exists","up"]},{"osd":1,"uuid":"11e964a0-b80c-4afc-bfbf-e2067969db29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6825","nonce":461860977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6827","nonce":461860977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6831","nonce":461860977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6829","nonce":461860977}]},"public_addr":"172.21.15.84:6825/461860977","cluster_addr":"172.21.15.84:6827/461860977","heartbeat_back_addr":"172.21.15.84:6831/461860977","heartbeat_front_addr":"172.21.15.84:6829/461860977","state":["exists","up"]},{"osd":2,"uuid":"3ce74529-4dd1-44c7-9576-968f5fdc0c25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6809","nonce":1168316165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6811","nonce":1168316165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6815","nonce":1168316165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6813","nonce":1168316165}]},"public_addr":"172.21.15.84:6809/1168316165","cluster_addr":"172.21.15.84:6811/1168316165","heartbeat_back_addr":"172.21.15.84:6815/1168316165","heartbeat_front_addr":"172.21.15.84:6813/1168316165","state":["exists","up"]},{"osd":3,"uuid":"460cb5c5-590a-4d06-a4d9-5bac2fdf33b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6801","nonce":1661609810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6803","nonce":1661609810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6807","nonce":1661609810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6805","nonce":1661609810}]},"public_addr":"172.21.15.84:6801/1661609810","cluster_addr":"172.21.15.84:6803/1661609810","heartbeat_back_addr":"172.21.15.84:6807/1661609810","heartbeat_front_addr":"172.21.15.84:6805/1661609810","state":["exists","up"]},{"osd":4,"uuid":"bf237dd0-3ebd-44b5-8078-24a63e00d792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6801","nonce":1303562374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6803","nonce":1303562374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6807","nonce":1303562374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6805","nonce":1303562374}]},"public_addr":"172.21.15.161:6801/1303562374","cluster_addr":"172.21.15.161:6803/1303562374","heartbeat_back_addr":"172.21.15.161:6807/1303562374","heartbeat_front_addr":"172.21.15.161:6805/1303562374","state":["exists","up"]},{"osd":5,"uuid":"e1e538e0-5844-456b-8c6e-434d3a914af1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6818","nonce":961120854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6822","nonce":961120854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6830","nonce":961120854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6826","nonce":961120854}]},"public_addr":"172.21.15.161:6818/961120854","cluster_addr":"172.21.15.161:6822/961120854","heartbeat_back_addr":"172.21.15.161:6830/961120854","heartbeat_front_addr":"172.21.15.161:6826/961120854","state":["exists","up"]},{"osd":6,"uuid":"5cb1785e-960f-4dd4-b295-9e21b2c3f875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6809","nonce":980533466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6811","nonce":980533466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6815","nonce":980533466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6813","nonce":980533466}]},"public_addr":"172.21.15.161:6809/980533466","cluster_addr":"172.21.15.161:6811/980533466","heartbeat_back_addr":"172.21.15.161:6815/980533466","heartbeat_front_addr":"172.21.15.161:6813/980533466","state":["exists","up"]},{"osd":7,"uuid":"5acb6619-e933-4b46-b1c2-60af30acb839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6817","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6819","nonce":2479691549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6821","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6823","nonce":2479691549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6829","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6831","nonce":2479691549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6825","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6827","nonce":2479691549}]},"public_addr":"172.21.15.161:6819/2479691549","cluster_addr":"172.21.15.161:6823/2479691549","heartbeat_back_addr":"172.21.15.161:6831/2479691549","heartbeat_front_addr":"172.21.15.161:6827/2479691549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.678857+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.685341+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.613603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.634940+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.564387+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.697347+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.637437+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.619397+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":1}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T08:25:27.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.221+0000 7fd56abe3700 1 -- 172.21.15.84:0/701721830 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fd54806a580 msgr2=0x7fd54806ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:27.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.221+0000 7fd56abe3700 1 --2- 172.21.15.84:0/701721830 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fd54806a580 0x7fd54806ca40 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd5640cad80 tx=0x7fd550008030 comp rx=0 tx=0).stop 2023-09-13T08:25:27.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.221+0000 7fd56abe3700 1 -- 172.21.15.84:0/701721830 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd56406a620 msgr2=0x7fd5640b37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:27.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.221+0000 7fd56abe3700 1 --2- 172.21.15.84:0/701721830 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd56406a620 0x7fd5640b37a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd55800c550 tx=0x7fd55800c860 comp rx=0 tx=0).stop 2023-09-13T08:25:27.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.221+0000 7fd56abe3700 1 -- 172.21.15.84:0/701721830 shutdown_connections 2023-09-13T08:25:27.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.221+0000 7fd56abe3700 1 --2- 172.21.15.84:0/701721830 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd56415d530 0x7fd564158c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:27.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.221+0000 7fd56abe3700 1 --2- 172.21.15.84:0/701721830 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd56406a620 0x7fd5640b37a0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:27.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.221+0000 7fd56abe3700 1 --2- 172.21.15.84:0/701721830 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fd54806a580 0x7fd54806ca40 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:27.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.221+0000 7fd56abe3700 1 --2- 172.21.15.84:0/701721830 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd5640ca920 0x7fd5641f3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:27.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.221+0000 7fd56abe3700 1 -- 172.21.15.84:0/701721830 >> 172.21.15.84:0/701721830 conn(0x7fd5640d00c0 msgr2=0x7fd5640b5430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:27.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.221+0000 7fd56abe3700 1 -- 172.21.15.84:0/701721830 shutdown_connections 2023-09-13T08:25:27.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.221+0000 7fd56abe3700 1 -- 172.21.15.84:0/701721830 wait complete. 2023-09-13T08:25:27.233 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T08:24:28.583720+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-13T08:24:39.862832+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-13T08:24:41.145511+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-09-13T08:24:44.775160+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-13T08:25:27.234 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T08:25:27.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.357+0000 7fd255d2e700 1 Processor -- start 2023-09-13T08:25:27.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.357+0000 7fd255d2e700 1 -- start start 2023-09-13T08:25:27.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.358+0000 7fd255d2e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd25015a190 0x7fd25006d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:27.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.358+0000 7fd255d2e700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd2500b47d0 0x7fd25006e380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:27.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.358+0000 7fd255d2e700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd25006e8c0 0x7fd25015dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:27.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.358+0000 7fd255d2e700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd25015a570 con 0x7fd25015a190 2023-09-13T08:25:27.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.358+0000 7fd255d2e700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2500aeef0 con 0x7fd2500b47d0 2023-09-13T08:25:27.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.358+0000 7fd255d2e700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd25006ed10 con 0x7fd25006e8c0 2023-09-13T08:25:27.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.358+0000 7fd24f7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd25015a190 0x7fd25006d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:27.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.358+0000 7fd24f7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd25015a190 0x7fd25006d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44526/0 (socket says 172.21.15.84:44526) 2023-09-13T08:25:27.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.358+0000 7fd24f7fe700 1 -- 172.21.15.84:0/1587477385 learned_addr learned my addr 172.21.15.84:0/1587477385 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:27.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.358+0000 7fd24effd700 1 --2- 172.21.15.84:0/1587477385 >> v2:172.21.15.161:3300/0 conn(0x7fd2500b47d0 0x7fd25006e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:27.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.358+0000 7fd24ffff700 1 --2- 172.21.15.84:0/1587477385 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd25006e8c0 0x7fd25015dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:27.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.358+0000 7fd24f7fe700 1 -- 172.21.15.84:0/1587477385 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd25006e8c0 msgr2=0x7fd25015dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:27.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.358+0000 7fd24f7fe700 1 --2- 172.21.15.84:0/1587477385 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd25006e8c0 0x7fd25015dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:27.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.358+0000 7fd24f7fe700 1 -- 172.21.15.84:0/1587477385 >> v2:172.21.15.161:3300/0 conn(0x7fd2500b47d0 msgr2=0x7fd25006e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:27.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.358+0000 7fd24f7fe700 1 --2- 172.21.15.84:0/1587477385 >> v2:172.21.15.161:3300/0 conn(0x7fd2500b47d0 0x7fd25006e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:27.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.358+0000 7fd24f7fe700 1 -- 172.21.15.84:0/1587477385 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd25006dc50 con 0x7fd25015a190 2023-09-13T08:25:27.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.358+0000 7fd24ffff700 1 --2- 172.21.15.84:0/1587477385 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd25006e8c0 0x7fd25015dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T08:25:27.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.358+0000 7fd24f7fe700 1 --2- 172.21.15.84:0/1587477385 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd25015a190 0x7fd25006d550 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fd25015dbb0 tx=0x7fd244009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=534803faecdbf394 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:27.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.359+0000 7fd24e7fc700 1 -- 172.21.15.84:0/1587477385 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd244011830 con 0x7fd25015a190 2023-09-13T08:25:27.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.359+0000 7fd24e7fc700 1 -- 172.21.15.84:0/1587477385 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd244011990 con 0x7fd25015a190 2023-09-13T08:25:27.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.359+0000 7fd24e7fc700 1 -- 172.21.15.84:0/1587477385 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd244011d20 con 0x7fd25015a190 2023-09-13T08:25:27.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.359+0000 7fd255d2e700 1 -- 172.21.15.84:0/1587477385 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd25015a190 msgr2=0x7fd25006d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:27.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.359+0000 7fd255d2e700 1 --2- 172.21.15.84:0/1587477385 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd25015a190 0x7fd25006d550 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fd25015dbb0 tx=0x7fd244009c00 comp rx=0 tx=0).stop 2023-09-13T08:25:27.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.359+0000 7fd255d2e700 1 -- 172.21.15.84:0/1587477385 shutdown_connections 2023-09-13T08:25:27.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.359+0000 7fd255d2e700 1 --2- 172.21.15.84:0/1587477385 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd25006e8c0 0x7fd25015dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:27.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.359+0000 7fd255d2e700 1 --2- 172.21.15.84:0/1587477385 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd25015a190 0x7fd25006d550 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:27.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.359+0000 7fd255d2e700 1 --2- 172.21.15.84:0/1587477385 >> v2:172.21.15.161:3300/0 conn(0x7fd2500b47d0 0x7fd25006e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:27.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.359+0000 7fd255d2e700 1 -- 172.21.15.84:0/1587477385 >> 172.21.15.84:0/1587477385 conn(0x7fd2500cf8f0 msgr2=0x7fd2500cfd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:27.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.359+0000 7fd255d2e700 1 -- 172.21.15.84:0/1587477385 shutdown_connections 2023-09-13T08:25:27.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.359+0000 7fd255d2e700 1 -- 172.21.15.84:0/1587477385 wait complete. 2023-09-13T08:25:27.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.360+0000 7fd255d2e700 1 Processor -- start 2023-09-13T08:25:27.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.361+0000 7fd255d2e700 1 -- start start 2023-09-13T08:25:27.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.361+0000 7fd255d2e700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd25006e8c0 0x7fd2500aade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:27.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.361+0000 7fd255d2e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2500b47d0 0x7fd2500a9b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:27.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.361+0000 7fd255d2e700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd25015a190 0x7fd25014bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:27.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.361+0000 7fd255d2e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2500ab320 con 0x7fd2500b47d0 2023-09-13T08:25:27.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.361+0000 7fd255d2e700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2500aa060 con 0x7fd25015a190 2023-09-13T08:25:27.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.361+0000 7fd255d2e700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2500ab530 con 0x7fd25006e8c0 2023-09-13T08:25:27.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.361+0000 7fd24effd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2500b47d0 0x7fd2500a9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:27.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.361+0000 7fd24effd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2500b47d0 0x7fd2500a9b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44534/0 (socket says 172.21.15.84:44534) 2023-09-13T08:25:27.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.362+0000 7fd24effd700 1 -- 172.21.15.84:0/1462471919 learned_addr learned my addr 172.21.15.84:0/1462471919 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:27.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.362+0000 7fd24ffff700 1 --2- 172.21.15.84:0/1462471919 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd25015a190 0x7fd25014bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:27.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.362+0000 7fd24f7fe700 1 --2- 172.21.15.84:0/1462471919 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd25006e8c0 0x7fd2500aade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:27.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.362+0000 7fd24effd700 1 -- 172.21.15.84:0/1462471919 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd25006e8c0 msgr2=0x7fd2500aade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:27.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.362+0000 7fd24effd700 1 --2- 172.21.15.84:0/1462471919 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd25006e8c0 0x7fd2500aade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:27.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.362+0000 7fd24effd700 1 -- 172.21.15.84:0/1462471919 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd25015a190 msgr2=0x7fd25014bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:27.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.362+0000 7fd24effd700 1 --2- 172.21.15.84:0/1462471919 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd25015a190 0x7fd25014bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:27.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.362+0000 7fd24effd700 1 -- 172.21.15.84:0/1462471919 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd244009550 con 0x7fd2500b47d0 2023-09-13T08:25:27.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.362+0000 7fd24ffff700 1 --2- 172.21.15.84:0/1462471919 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd25015a190 0x7fd25014bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T08:25:27.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.362+0000 7fd24f7fe700 1 --2- 172.21.15.84:0/1462471919 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd25006e8c0 0x7fd2500aade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T08:25:27.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.362+0000 7fd24effd700 1 --2- 172.21.15.84:0/1462471919 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2500b47d0 0x7fd2500a9b20 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd24000e840 tx=0x7fd24000ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:27.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.362+0000 7fd237fff700 1 -- 172.21.15.84:0/1462471919 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd240009590 con 0x7fd2500b47d0 2023-09-13T08:25:27.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.362+0000 7fd237fff700 1 -- 172.21.15.84:0/1462471919 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd240013680 con 0x7fd2500b47d0 2023-09-13T08:25:27.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.362+0000 7fd237fff700 1 -- 172.21.15.84:0/1462471919 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd240013a10 con 0x7fd2500b47d0 2023-09-13T08:25:27.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.362+0000 7fd255d2e700 1 -- 172.21.15.84:0/1462471919 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2500ab810 con 0x7fd2500b47d0 2023-09-13T08:25:27.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.362+0000 7fd255d2e700 1 -- 172.21.15.84:0/1462471919 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2500abdd0 con 0x7fd2500b47d0 2023-09-13T08:25:27.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.363+0000 7fd255d2e700 1 -- 172.21.15.84:0/1462471919 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd25004f200 con 0x7fd2500b47d0 2023-09-13T08:25:27.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.364+0000 7fd237fff700 1 -- 172.21.15.84:0/1462471919 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fd240013b70 con 0x7fd2500b47d0 2023-09-13T08:25:27.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.364+0000 7fd237fff700 1 --2- 172.21.15.84:0/1462471919 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fd23c06a580 0x7fd23c06ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:27.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.364+0000 7fd237fff700 1 -- 172.21.15.84:0/1462471919 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fd240088d90 con 0x7fd2500b47d0 2023-09-13T08:25:27.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.364+0000 7fd24f7fe700 1 --2- 172.21.15.84:0/1462471919 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fd23c06a580 0x7fd23c06ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:27.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.364+0000 7fd24f7fe700 1 --2- 172.21.15.84:0/1462471919 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fd23c06a580 0x7fd23c06ca40 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd2440098f0 tx=0x7fd244008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:27.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.368+0000 7fd237fff700 1 -- 172.21.15.84:0/1462471919 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fd240053ea0 con 0x7fd2500b47d0 2023-09-13T08:25:27.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.556+0000 7fd255d2e700 1 -- 172.21.15.84:0/1462471919 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd2500b2c70 con 0x7fd2500b47d0 2023-09-13T08:25:27.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.557+0000 7fd237fff700 1 -- 172.21.15.84:0/1462471919 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd240021020 con 0x7fd2500b47d0 2023-09-13T08:25:27.557 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-09-13T08:25:27.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.559+0000 7fd255d2e700 1 -- 172.21.15.84:0/1462471919 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fd23c06a580 msgr2=0x7fd23c06ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:27.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.559+0000 7fd255d2e700 1 --2- 172.21.15.84:0/1462471919 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fd23c06a580 0x7fd23c06ca40 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd2440098f0 tx=0x7fd244008030 comp rx=0 tx=0).stop 2023-09-13T08:25:27.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.559+0000 7fd255d2e700 1 -- 172.21.15.84:0/1462471919 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2500b47d0 msgr2=0x7fd2500a9b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:27.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.559+0000 7fd255d2e700 1 --2- 172.21.15.84:0/1462471919 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2500b47d0 0x7fd2500a9b20 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd24000e840 tx=0x7fd24000ec00 comp rx=0 tx=0).stop 2023-09-13T08:25:27.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.559+0000 7fd255d2e700 1 -- 172.21.15.84:0/1462471919 shutdown_connections 2023-09-13T08:25:27.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.559+0000 7fd255d2e700 1 --2- 172.21.15.84:0/1462471919 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fd23c06a580 0x7fd23c06ca40 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:27.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.559+0000 7fd255d2e700 1 --2- 172.21.15.84:0/1462471919 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd25015a190 0x7fd25014bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:27.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.559+0000 7fd255d2e700 1 --2- 172.21.15.84:0/1462471919 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd25006e8c0 0x7fd2500aade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:27.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.559+0000 7fd255d2e700 1 --2- 172.21.15.84:0/1462471919 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2500b47d0 0x7fd2500a9b20 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:27.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.559+0000 7fd255d2e700 1 -- 172.21.15.84:0/1462471919 >> 172.21.15.84:0/1462471919 conn(0x7fd2500cf8f0 msgr2=0x7fd25015c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:27.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.559+0000 7fd255d2e700 1 -- 172.21.15.84:0/1462471919 shutdown_connections 2023-09-13T08:25:27.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.559+0000 7fd255d2e700 1 -- 172.21.15.84:0/1462471919 wait complete. 2023-09-13T08:25:27.571 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-13T08:25:27.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.694+0000 7ff8c3162700 1 Processor -- start 2023-09-13T08:25:27.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.694+0000 7ff8c3162700 1 -- start start 2023-09-13T08:25:27.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.694+0000 7ff8c3162700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff8bc0ca8e0 0x7ff8bc0cf570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:27.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.694+0000 7ff8c3162700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8bc15e480 con 0x7ff8bc0cd590 2023-09-13T08:25:27.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.694+0000 7ff8c3162700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8bc0cfbe0 con 0x7ff8bc15e910 2023-09-13T08:25:27.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.694+0000 7ff8c3162700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8bc15de30 con 0x7ff8bc0ca8e0 2023-09-13T08:25:27.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.695+0000 7ff8c16ff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7ff8bc0cd590 0x7ff8bc0cdbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:47190/0 (socket says 172.21.15.84:47190) 2023-09-13T08:25:27.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.695+0000 7ff8c16ff700 1 -- 172.21.15.84:0/1096838284 learned_addr learned my addr 172.21.15.84:0/1096838284 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:25:27.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.695+0000 7ff8c0efe700 1 --2- 172.21.15.84:0/1096838284 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff8bc0ca8e0 0x7ff8bc0cf570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:27.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.695+0000 7ff8bb7fe700 1 -- 172.21.15.84:0/1096838284 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1483582530 0 0) 0x7ff8bc15e480 con 0x7ff8bc0cd590 2023-09-13T08:25:27.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.695+0000 7ff8bb7fe700 1 -- 172.21.15.84:0/1096838284 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8ac0035b0 con 0x7ff8bc0cd590 2023-09-13T08:25:27.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.695+0000 7ff8bb7fe700 1 -- 172.21.15.84:0/1096838284 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4149742985 0 0) 0x7ff8ac0035b0 con 0x7ff8bc0cd590 2023-09-13T08:25:27.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.695+0000 7ff8bb7fe700 1 -- 172.21.15.84:0/1096838284 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff8bc0ca8e0 msgr2=0x7ff8bc0cf570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:27.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.695+0000 7ff8bb7fe700 1 --2- 172.21.15.84:0/1096838284 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff8bc0ca8e0 0x7ff8bc0cf570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:27.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.695+0000 7ff8bb7fe700 1 -- 172.21.15.84:0/1096838284 >> v1:172.21.15.161:6789/0 conn(0x7ff8bc15e910 legacy=0x7ff8bc0cacc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:27.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.695+0000 7ff8bb7fe700 1 -- 172.21.15.84:0/1096838284 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8bc15e110 con 0x7ff8bc0cd590 2023-09-13T08:25:27.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.695+0000 7ff8bb7fe700 1 -- 172.21.15.84:0/1096838284 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2302733408 0 0) 0x7ff8b40019f0 con 0x7ff8bc0cd590 2023-09-13T08:25:27.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.695+0000 7ff8bb7fe700 1 -- 172.21.15.84:0/1096838284 >> v1:172.21.15.84:6789/0 conn(0x7ff8bc0cd590 legacy=0x7ff8bc0cdbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:27.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.695+0000 7ff8bb7fe700 1 --2- 172.21.15.84:0/1096838284 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8ac003a30 0x7ff8ac003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:27.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.695+0000 7ff8bb7fe700 1 --2- 172.21.15.84:0/1096838284 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff8bc0ca8e0 0x7ff8ac004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:27.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.695+0000 7ff8bb7fe700 1 --2- 172.21.15.84:0/1096838284 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff8ac004d90 0x7ff8ac005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:27.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.695+0000 7ff8bb7fe700 1 -- 172.21.15.84:0/1096838284 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8bc15de30 con 0x7ff8ac003a30 2023-09-13T08:25:27.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.695+0000 7ff8bb7fe700 1 -- 172.21.15.84:0/1096838284 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ac00bbd0 con 0x7ff8ac004d90 2023-09-13T08:25:27.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.695+0000 7ff8bb7fe700 1 -- 172.21.15.84:0/1096838284 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ac00bd90 con 0x7ff8bc0ca8e0 2023-09-13T08:25:27.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.695+0000 7ff8c0efe700 1 --2- 172.21.15.84:0/1096838284 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8ac003a30 0x7ff8ac003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:27.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.695+0000 7ff8c16ff700 1 --2- 172.21.15.84:0/1096838284 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff8ac004d90 0x7ff8ac005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:27.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.695+0000 7ff8bbfff700 1 --2- 172.21.15.84:0/1096838284 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff8bc0ca8e0 0x7ff8ac004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:27.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.695+0000 7ff8c0efe700 1 -- 172.21.15.84:0/1096838284 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff8bc0ca8e0 msgr2=0x7ff8ac004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:27.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.695+0000 7ff8c0efe700 1 --2- 172.21.15.84:0/1096838284 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff8bc0ca8e0 0x7ff8ac004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:27.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.696+0000 7ff8c0efe700 1 -- 172.21.15.84:0/1096838284 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff8ac004d90 msgr2=0x7ff8ac005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:27.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.696+0000 7ff8c0efe700 1 --2- 172.21.15.84:0/1096838284 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff8ac004d90 0x7ff8ac005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:27.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.696+0000 7ff8c0efe700 1 -- 172.21.15.84:0/1096838284 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8ac0035b0 con 0x7ff8ac003a30 2023-09-13T08:25:27.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.696+0000 7ff8c16ff700 1 --2- 172.21.15.84:0/1096838284 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff8ac004d90 0x7ff8ac005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T08:25:27.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.696+0000 7ff8bbfff700 1 --2- 172.21.15.84:0/1096838284 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff8bc0ca8e0 0x7ff8ac004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T08:25:27.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.696+0000 7ff8c0efe700 1 --2- 172.21.15.84:0/1096838284 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8ac003a30 0x7ff8ac003e50 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff8b0009b60 tx=0x7ff8ac005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef6d564528c406ac server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:27.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.696+0000 7ff8bb7fe700 1 -- 172.21.15.84:0/1096838284 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b000e6c0 con 0x7ff8ac003a30 2023-09-13T08:25:27.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.696+0000 7ff8bb7fe700 1 -- 172.21.15.84:0/1096838284 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8b000e820 con 0x7ff8ac003a30 2023-09-13T08:25:27.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.696+0000 7ff8bb7fe700 1 -- 172.21.15.84:0/1096838284 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b000eb90 con 0x7ff8ac003a30 2023-09-13T08:25:27.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.696+0000 7ff8c3162700 1 -- 172.21.15.84:0/1096838284 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8ac003a30 msgr2=0x7ff8ac003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:27.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.696+0000 7ff8c3162700 1 --2- 172.21.15.84:0/1096838284 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8ac003a30 0x7ff8ac003e50 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff8b0009b60 tx=0x7ff8ac005880 comp rx=0 tx=0).stop 2023-09-13T08:25:27.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.696+0000 7ff8c16ff700 1 -- 172.21.15.84:0/1096838284 reap_dead start 2023-09-13T08:25:27.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.696+0000 7ff8c3162700 1 -- 172.21.15.84:0/1096838284 shutdown_connections 2023-09-13T08:25:27.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.696+0000 7ff8c3162700 1 -- 172.21.15.84:0/1096838284 >> 172.21.15.84:0/1096838284 conn(0x7ff8bc0cca70 msgr2=0x7ff8bc0cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:27.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.696+0000 7ff8c3162700 1 -- 172.21.15.84:0/1096838284 shutdown_connections 2023-09-13T08:25:27.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.696+0000 7ff8c3162700 1 -- 172.21.15.84:0/1096838284 wait complete. 2023-09-13T08:25:27.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.698+0000 7ff8c3162700 1 Processor -- start 2023-09-13T08:25:27.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.698+0000 7ff8c3162700 1 -- start start 2023-09-13T08:25:27.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.699+0000 7ff8c3162700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff8ac003a30 0x7ff8bc06e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:27.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.699+0000 7ff8c3162700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff8bc0ac9c0 0x7ff8bc0c6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:27.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.699+0000 7ff8c3162700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8bc154bf0 0x7ff8bc1550a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:27.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.699+0000 7ff8c3162700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8bc0c5a50 con 0x7ff8bc154bf0 2023-09-13T08:25:27.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.699+0000 7ff8c3162700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8bc0ae680 con 0x7ff8bc0ac9c0 2023-09-13T08:25:27.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.699+0000 7ff8c3162700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8bc0ae960 con 0x7ff8ac003a30 2023-09-13T08:25:27.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.699+0000 7ff8c16ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8bc154bf0 0x7ff8bc1550a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:27.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.699+0000 7ff8c16ff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8bc154bf0 0x7ff8bc1550a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44556/0 (socket says 172.21.15.84:44556) 2023-09-13T08:25:27.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.699+0000 7ff8c16ff700 1 -- 172.21.15.84:0/3101042464 learned_addr learned my addr 172.21.15.84:0/3101042464 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:27.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.699+0000 7ff8bbfff700 1 --2- 172.21.15.84:0/3101042464 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff8bc0ac9c0 0x7ff8bc0c6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:27.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.700+0000 7ff8c0efe700 1 --2- 172.21.15.84:0/3101042464 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff8ac003a30 0x7ff8bc06e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:27.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.700+0000 7ff8c16ff700 1 -- 172.21.15.84:0/3101042464 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff8ac003a30 msgr2=0x7ff8bc06e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:27.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.700+0000 7ff8c16ff700 1 --2- 172.21.15.84:0/3101042464 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff8ac003a30 0x7ff8bc06e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:27.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.700+0000 7ff8c16ff700 1 -- 172.21.15.84:0/3101042464 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff8bc0ac9c0 msgr2=0x7ff8bc0c6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:27.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.700+0000 7ff8c16ff700 1 --2- 172.21.15.84:0/3101042464 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff8bc0ac9c0 0x7ff8bc0c6330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:27.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.700+0000 7ff8c16ff700 1 -- 172.21.15.84:0/3101042464 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8bc0aec40 con 0x7ff8bc154bf0 2023-09-13T08:25:27.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.700+0000 7ff8c16ff700 1 --2- 172.21.15.84:0/3101042464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8bc154bf0 0x7ff8bc1550a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc0b6160 tx=0x7ff8b4007c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:27.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.700+0000 7ff8b97fa700 1 -- 172.21.15.84:0/3101042464 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b400ec60 con 0x7ff8bc154bf0 2023-09-13T08:25:27.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.700+0000 7ff8b97fa700 1 -- 172.21.15.84:0/3101042464 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8b400ede0 con 0x7ff8bc154bf0 2023-09-13T08:25:27.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.700+0000 7ff8c3162700 1 -- 172.21.15.84:0/3101042464 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8bc0aef20 con 0x7ff8bc154bf0 2023-09-13T08:25:27.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.700+0000 7ff8b97fa700 1 -- 172.21.15.84:0/3101042464 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b4013660 con 0x7ff8bc154bf0 2023-09-13T08:25:27.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.700+0000 7ff8c3162700 1 -- 172.21.15.84:0/3101042464 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8bc1555e0 con 0x7ff8bc154bf0 2023-09-13T08:25:27.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.701+0000 7ff8c3162700 1 -- 172.21.15.84:0/3101042464 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8bc0af440 con 0x7ff8bc154bf0 2023-09-13T08:25:27.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.701+0000 7ff8b97fa700 1 -- 172.21.15.84:0/3101042464 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7ff8b40137c0 con 0x7ff8bc154bf0 2023-09-13T08:25:27.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.702+0000 7ff8b97fa700 1 --2- 172.21.15.84:0/3101042464 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7ff8a006a580 0x7ff8a006ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:27.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.702+0000 7ff8b97fa700 1 -- 172.21.15.84:0/3101042464 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7ff8b4089430 con 0x7ff8bc154bf0 2023-09-13T08:25:27.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.702+0000 7ff8c0efe700 1 --2- 172.21.15.84:0/3101042464 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7ff8a006a580 0x7ff8a006ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:27.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.702+0000 7ff8c0efe700 1 --2- 172.21.15.84:0/3101042464 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7ff8a006a580 0x7ff8a006ca40 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff8b00090b0 tx=0x7ff8b0008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:27.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.706+0000 7ff8b97fa700 1 -- 172.21.15.84:0/3101042464 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7ff8b40545d0 con 0x7ff8bc154bf0 2023-09-13T08:25:27.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.894+0000 7ff8c3162700 1 -- 172.21.15.84:0/3101042464 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff8bc04f200 con 0x7ff8bc154bf0 2023-09-13T08:25:27.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.895+0000 7ff8b97fa700 1 -- 172.21.15.84:0/3101042464 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff8b4057bf0 con 0x7ff8bc154bf0 2023-09-13T08:25:27.895 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-09-13T08:25:27.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.897+0000 7ff8c3162700 1 -- 172.21.15.84:0/3101042464 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7ff8a006a580 msgr2=0x7ff8a006ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:27.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.897+0000 7ff8c3162700 1 --2- 172.21.15.84:0/3101042464 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7ff8a006a580 0x7ff8a006ca40 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff8b00090b0 tx=0x7ff8b0008030 comp rx=0 tx=0).stop 2023-09-13T08:25:27.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.897+0000 7ff8c3162700 1 -- 172.21.15.84:0/3101042464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8bc154bf0 msgr2=0x7ff8bc1550a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:27.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.897+0000 7ff8c3162700 1 --2- 172.21.15.84:0/3101042464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8bc154bf0 0x7ff8bc1550a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc0b6160 tx=0x7ff8b4007c90 comp rx=0 tx=0).stop 2023-09-13T08:25:27.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.897+0000 7ff8c3162700 1 -- 172.21.15.84:0/3101042464 shutdown_connections 2023-09-13T08:25:27.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.897+0000 7ff8c3162700 1 --2- 172.21.15.84:0/3101042464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff8bc154bf0 0x7ff8bc1550a0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:27.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.897+0000 7ff8c3162700 1 --2- 172.21.15.84:0/3101042464 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff8ac003a30 0x7ff8bc06e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:27.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.897+0000 7ff8c3162700 1 --2- 172.21.15.84:0/3101042464 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7ff8a006a580 0x7ff8a006ca40 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:27.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.897+0000 7ff8c3162700 1 --2- 172.21.15.84:0/3101042464 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff8bc0ac9c0 0x7ff8bc0c6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:27.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.897+0000 7ff8c3162700 1 -- 172.21.15.84:0/3101042464 >> 172.21.15.84:0/3101042464 conn(0x7ff8bc0cca70 msgr2=0x7ff8bc158570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:27.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.897+0000 7ff8c3162700 1 -- 172.21.15.84:0/3101042464 shutdown_connections 2023-09-13T08:25:27.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:27.897+0000 7ff8c3162700 1 -- 172.21.15.84:0/3101042464 wait complete. 2023-09-13T08:25:27.909 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-13T08:25:28.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.032+0000 7ff96cb97700 1 Processor -- start 2023-09-13T08:25:28.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.032+0000 7ff96cb97700 1 -- start start 2023-09-13T08:25:28.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.033+0000 7ff96cb97700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff9680ca8e0 0x7ff9680cf570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:28.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.033+0000 7ff96cb97700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff96815e910 0x7ff9680cacc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:28.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.033+0000 7ff96cb97700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff9680cd590 0x7ff968161150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:28.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.033+0000 7ff96cb97700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff96815e480 con 0x7ff96815e910 2023-09-13T08:25:28.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.033+0000 7ff96cb97700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9680cb200 con 0x7ff9680cd590 2023-09-13T08:25:28.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.033+0000 7ff96cb97700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9680cfbe0 con 0x7ff9680ca8e0 2023-09-13T08:25:28.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.033+0000 7ff965d9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff96815e910 0x7ff9680cacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:28.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.033+0000 7ff965d9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff96815e910 0x7ff9680cacc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44560/0 (socket says 172.21.15.84:44560) 2023-09-13T08:25:28.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.033+0000 7ff965d9b700 1 -- 172.21.15.84:0/1560091274 learned_addr learned my addr 172.21.15.84:0/1560091274 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:28.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.033+0000 7ff965d9b700 1 -- 172.21.15.84:0/1560091274 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff9680ca8e0 msgr2=0x7ff9680cf570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:28.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.033+0000 7ff965d9b700 1 --2- 172.21.15.84:0/1560091274 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff9680ca8e0 0x7ff9680cf570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:28.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.033+0000 7ff965d9b700 1 -- 172.21.15.84:0/1560091274 >> v2:172.21.15.161:3300/0 conn(0x7ff9680cd590 msgr2=0x7ff968161150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:28.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.033+0000 7ff965d9b700 1 --2- 172.21.15.84:0/1560091274 >> v2:172.21.15.161:3300/0 conn(0x7ff9680cd590 0x7ff968161150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:28.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.033+0000 7ff965d9b700 1 -- 172.21.15.84:0/1560091274 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff96815de30 con 0x7ff96815e910 2023-09-13T08:25:28.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.033+0000 7ff965d9b700 1 --2- 172.21.15.84:0/1560091274 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff96815e910 0x7ff9680cacc0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ff9680712f0 tx=0x7ff95c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22464da3620d8092 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:28.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.033+0000 7ff96559a700 1 -- 172.21.15.84:0/1560091274 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95c00b870 con 0x7ff96815e910 2023-09-13T08:25:28.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.033+0000 7ff96559a700 1 -- 172.21.15.84:0/1560091274 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff95c00b9d0 con 0x7ff96815e910 2023-09-13T08:25:28.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.033+0000 7ff96559a700 1 -- 172.21.15.84:0/1560091274 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95c00bd60 con 0x7ff96815e910 2023-09-13T08:25:28.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.034+0000 7ff96cb97700 1 -- 172.21.15.84:0/1560091274 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff96815e910 msgr2=0x7ff9680cacc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:28.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.034+0000 7ff96cb97700 1 --2- 172.21.15.84:0/1560091274 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff96815e910 0x7ff9680cacc0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ff9680712f0 tx=0x7ff95c009bd0 comp rx=0 tx=0).stop 2023-09-13T08:25:28.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.034+0000 7ff96cb97700 1 -- 172.21.15.84:0/1560091274 shutdown_connections 2023-09-13T08:25:28.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.034+0000 7ff96cb97700 1 --2- 172.21.15.84:0/1560091274 >> v2:172.21.15.161:3300/0 conn(0x7ff9680cd590 0x7ff968161150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:28.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.034+0000 7ff96cb97700 1 --2- 172.21.15.84:0/1560091274 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff9680ca8e0 0x7ff9680cf570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:28.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.034+0000 7ff96cb97700 1 --2- 172.21.15.84:0/1560091274 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff96815e910 0x7ff9680cacc0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:28.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.034+0000 7ff96cb97700 1 -- 172.21.15.84:0/1560091274 >> 172.21.15.84:0/1560091274 conn(0x7ff9680cca70 msgr2=0x7ff9680cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:28.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.034+0000 7ff96cb97700 1 -- 172.21.15.84:0/1560091274 shutdown_connections 2023-09-13T08:25:28.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.034+0000 7ff96cb97700 1 -- 172.21.15.84:0/1560091274 wait complete. 2023-09-13T08:25:28.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.035+0000 7ff96cb97700 1 Processor -- start 2023-09-13T08:25:28.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.036+0000 7ff96cb97700 1 -- start start 2023-09-13T08:25:28.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.036+0000 7ff96cb97700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9680ca8e0 0x7ff9680c64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:28.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.036+0000 7ff96cb97700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff9680cd590 0x7ff9681f2670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:28.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.036+0000 7ff96cb97700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff96815e910 0x7ff9680aec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:28.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.036+0000 7ff96cb97700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9680c69e0 con 0x7ff9680ca8e0 2023-09-13T08:25:28.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.036+0000 7ff96cb97700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9680c52a0 con 0x7ff9680cd590 2023-09-13T08:25:28.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.036+0000 7ff96cb97700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9680c46d0 con 0x7ff96815e910 2023-09-13T08:25:28.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.036+0000 7ff96659c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9680ca8e0 0x7ff9680c64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:28.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.036+0000 7ff96659c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9680ca8e0 0x7ff9680c64a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44566/0 (socket says 172.21.15.84:44566) 2023-09-13T08:25:28.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.036+0000 7ff96659c700 1 -- 172.21.15.84:0/4270968187 learned_addr learned my addr 172.21.15.84:0/4270968187 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:28.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.036+0000 7ff965d9b700 1 --2- 172.21.15.84:0/4270968187 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff9680cd590 0x7ff9681f2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:28.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.037+0000 7ff966d9d700 1 --2- 172.21.15.84:0/4270968187 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff96815e910 0x7ff9680aec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:28.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.037+0000 7ff96659c700 1 -- 172.21.15.84:0/4270968187 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff96815e910 msgr2=0x7ff9680aec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:28.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.037+0000 7ff96659c700 1 --2- 172.21.15.84:0/4270968187 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff96815e910 0x7ff9680aec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:28.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.037+0000 7ff96659c700 1 -- 172.21.15.84:0/4270968187 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff9680cd590 msgr2=0x7ff9681f2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:28.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.037+0000 7ff96659c700 1 --2- 172.21.15.84:0/4270968187 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff9680cd590 0x7ff9681f2670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:28.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.037+0000 7ff96659c700 1 -- 172.21.15.84:0/4270968187 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff95c009550 con 0x7ff9680ca8e0 2023-09-13T08:25:28.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.037+0000 7ff965d9b700 1 --2- 172.21.15.84:0/4270968187 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff9680cd590 0x7ff9681f2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T08:25:28.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.037+0000 7ff96659c700 1 --2- 172.21.15.84:0/4270968187 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9680ca8e0 0x7ff9680c64a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff95800b530 tx=0x7ff95800b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:28.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.037+0000 7ff956ffd700 1 -- 172.21.15.84:0/4270968187 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff958011830 con 0x7ff9680ca8e0 2023-09-13T08:25:28.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.037+0000 7ff956ffd700 1 -- 172.21.15.84:0/4270968187 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9580119b0 con 0x7ff9680ca8e0 2023-09-13T08:25:28.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.037+0000 7ff956ffd700 1 -- 172.21.15.84:0/4270968187 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff958011d60 con 0x7ff9680ca8e0 2023-09-13T08:25:28.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.037+0000 7ff96cb97700 1 -- 172.21.15.84:0/4270968187 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9680c4970 con 0x7ff9680ca8e0 2023-09-13T08:25:28.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.037+0000 7ff96cb97700 1 -- 172.21.15.84:0/4270968187 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9680c4f30 con 0x7ff9680ca8e0 2023-09-13T08:25:28.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.038+0000 7ff96cb97700 1 -- 172.21.15.84:0/4270968187 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff96804f200 con 0x7ff9680ca8e0 2023-09-13T08:25:28.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.038+0000 7ff956ffd700 1 -- 172.21.15.84:0/4270968187 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7ff95801a400 con 0x7ff9680ca8e0 2023-09-13T08:25:28.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.039+0000 7ff956ffd700 1 --2- 172.21.15.84:0/4270968187 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7ff94806a580 0x7ff94806ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:28.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.039+0000 7ff956ffd700 1 -- 172.21.15.84:0/4270968187 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7ff958088ef0 con 0x7ff9680ca8e0 2023-09-13T08:25:28.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.039+0000 7ff965d9b700 1 --2- 172.21.15.84:0/4270968187 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7ff94806a580 0x7ff94806ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:28.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.039+0000 7ff965d9b700 1 --2- 172.21.15.84:0/4270968187 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7ff94806a580 0x7ff94806ca40 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff9680712f0 tx=0x7ff95c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:28.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.043+0000 7ff956ffd700 1 -- 172.21.15.84:0/4270968187 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7ff958054090 con 0x7ff9680ca8e0 2023-09-13T08:25:28.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.231+0000 7ff96cb97700 1 -- 172.21.15.84:0/4270968187 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff9680cd0a0 con 0x7ff9680ca8e0 2023-09-13T08:25:28.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.232+0000 7ff956ffd700 1 -- 172.21.15.84:0/4270968187 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff958015020 con 0x7ff9680ca8e0 2023-09-13T08:25:28.232 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-09-13T08:25:28.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.234+0000 7ff96cb97700 1 -- 172.21.15.84:0/4270968187 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7ff94806a580 msgr2=0x7ff94806ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:28.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.234+0000 7ff96cb97700 1 --2- 172.21.15.84:0/4270968187 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7ff94806a580 0x7ff94806ca40 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff9680712f0 tx=0x7ff95c008030 comp rx=0 tx=0).stop 2023-09-13T08:25:28.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.234+0000 7ff96cb97700 1 -- 172.21.15.84:0/4270968187 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9680ca8e0 msgr2=0x7ff9680c64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:28.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.234+0000 7ff96cb97700 1 --2- 172.21.15.84:0/4270968187 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9680ca8e0 0x7ff9680c64a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff95800b530 tx=0x7ff95800b8f0 comp rx=0 tx=0).stop 2023-09-13T08:25:28.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.234+0000 7ff96cb97700 1 -- 172.21.15.84:0/4270968187 shutdown_connections 2023-09-13T08:25:28.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.234+0000 7ff96cb97700 1 --2- 172.21.15.84:0/4270968187 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff96815e910 0x7ff9680aec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:28.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.234+0000 7ff96cb97700 1 --2- 172.21.15.84:0/4270968187 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9680ca8e0 0x7ff9680c64a0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:28.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.234+0000 7ff96cb97700 1 --2- 172.21.15.84:0/4270968187 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7ff94806a580 0x7ff94806ca40 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:28.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.234+0000 7ff96cb97700 1 --2- 172.21.15.84:0/4270968187 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff9680cd590 0x7ff9681f2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:28.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.234+0000 7ff96cb97700 1 -- 172.21.15.84:0/4270968187 >> 172.21.15.84:0/4270968187 conn(0x7ff9680cca70 msgr2=0x7ff9680b11c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:28.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.234+0000 7ff96cb97700 1 -- 172.21.15.84:0/4270968187 shutdown_connections 2023-09-13T08:25:28.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.234+0000 7ff96cb97700 1 -- 172.21.15.84:0/4270968187 wait complete. 2023-09-13T08:25:28.246 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-09-13T08:25:28.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.369+0000 7f3a1b081700 1 Processor -- start 2023-09-13T08:25:28.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.369+0000 7f3a1b081700 1 -- start start 2023-09-13T08:25:28.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.370+0000 7f3a1b081700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3a14157c30 0x7f3a14071ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:28.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.370+0000 7f3a1b081700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f3a140cab40 0x7f3a1415b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:28.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.370+0000 7f3a1b081700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a1415b3f0 con 0x7f3a140721e0 2023-09-13T08:25:28.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.370+0000 7f3a1b081700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a140ca100 con 0x7f3a140cab40 2023-09-13T08:25:28.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.370+0000 7f3a1b081700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1415b6d0 con 0x7f3a14157c30 2023-09-13T08:25:28.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.371+0000 7f3a1961e700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f3a140cab40 0x7f3a1415b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:28.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.371+0000 7f3a18e1d700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3a14157c30 0x7f3a14071ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:28.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.371+0000 7f3a13fff700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f3a140721e0 0x7f3a140ca430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.84:33390/0 (socket says 172.21.15.84:33390) 2023-09-13T08:25:28.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.371+0000 7f3a13fff700 1 -- 172.21.15.84:0/1668960927 learned_addr learned my addr 172.21.15.84:0/1668960927 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:25:28.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.371+0000 7f3a18e1d700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3a14157c30 0x7f3a14071ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.84:54438/0 (socket says 172.21.15.84:54438) 2023-09-13T08:25:28.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.371+0000 7f3a18e1d700 1 -- 172.21.15.84:0/1668960927 >> v2:172.21.15.161:3300/0 conn(0x7f3a140cab40 msgr2=0x7f3a1415b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:28.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.371+0000 7f3a18e1d700 1 --2- 172.21.15.84:0/1668960927 >> v2:172.21.15.161:3300/0 conn(0x7f3a140cab40 0x7f3a1415b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:28.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.371+0000 7f3a18e1d700 1 -- 172.21.15.84:0/1668960927 >> v1:172.21.15.161:6789/0 conn(0x7f3a140721e0 legacy=0x7f3a140ca430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:28.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.371+0000 7f3a18e1d700 1 -- 172.21.15.84:0/1668960927 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a140711c0 con 0x7f3a14157c30 2023-09-13T08:25:28.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.371+0000 7f3a1961e700 1 --2- 172.21.15.84:0/1668960927 >> v2:172.21.15.161:3300/0 conn(0x7f3a140cab40 0x7f3a1415b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T08:25:28.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.371+0000 7f3a18e1d700 1 --2- 172.21.15.84:0/1668960927 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3a14157c30 0x7f3a14071ca0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3a08009840 tx=0x7f3a08009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=431d50a366bf8d8 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:28.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.371+0000 7f3a137fe700 1 -- 172.21.15.84:0/1668960927 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a08011830 con 0x7f3a14157c30 2023-09-13T08:25:28.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.371+0000 7f3a137fe700 1 -- 172.21.15.84:0/1668960927 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a08011990 con 0x7f3a14157c30 2023-09-13T08:25:28.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.372+0000 7f3a137fe700 1 -- 172.21.15.84:0/1668960927 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a08011d20 con 0x7f3a14157c30 2023-09-13T08:25:28.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.372+0000 7f3a1b081700 1 -- 172.21.15.84:0/1668960927 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3a14157c30 msgr2=0x7f3a14071ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:28.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.372+0000 7f3a1b081700 1 --2- 172.21.15.84:0/1668960927 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3a14157c30 0x7f3a14071ca0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3a08009840 tx=0x7f3a08009b50 comp rx=0 tx=0).stop 2023-09-13T08:25:28.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.372+0000 7f3a1b081700 1 -- 172.21.15.84:0/1668960927 shutdown_connections 2023-09-13T08:25:28.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.372+0000 7f3a1b081700 1 --2- 172.21.15.84:0/1668960927 >> v2:172.21.15.161:3300/0 conn(0x7f3a140cab40 0x7f3a1415b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:28.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.372+0000 7f3a1b081700 1 --2- 172.21.15.84:0/1668960927 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3a14157c30 0x7f3a14071ca0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:28.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.372+0000 7f3a1b081700 1 -- 172.21.15.84:0/1668960927 >> 172.21.15.84:0/1668960927 conn(0x7f3a140b0a20 msgr2=0x7f3a140b0e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:28.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.372+0000 7f3a1b081700 1 -- 172.21.15.84:0/1668960927 shutdown_connections 2023-09-13T08:25:28.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.372+0000 7f3a1b081700 1 -- 172.21.15.84:0/1668960927 wait complete. 2023-09-13T08:25:28.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.373+0000 7f3a1b081700 1 Processor -- start 2023-09-13T08:25:28.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.373+0000 7f3a1b081700 1 -- start start 2023-09-13T08:25:28.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.374+0000 7f3a1b081700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3a140721e0 0x7f3a140c57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:28.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.374+0000 7f3a1b081700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a140cab40 0x7f3a14153980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:28.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.374+0000 7f3a1b081700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3a14157c30 0x7f3a140c81f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:28.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.374+0000 7f3a1b081700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a14155050 con 0x7f3a140cab40 2023-09-13T08:25:28.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.374+0000 7f3a1b081700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a14154440 con 0x7f3a14157c30 2023-09-13T08:25:28.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.374+0000 7f3a1b081700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a14154720 con 0x7f3a140721e0 2023-09-13T08:25:28.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.374+0000 7f3a13fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a140cab40 0x7f3a14153980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:28.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.374+0000 7f3a13fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a140cab40 0x7f3a14153980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44582/0 (socket says 172.21.15.84:44582) 2023-09-13T08:25:28.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.374+0000 7f3a13fff700 1 -- 172.21.15.84:0/2563233827 learned_addr learned my addr 172.21.15.84:0/2563233827 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:28.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.375+0000 7f3a1961e700 1 --2- 172.21.15.84:0/2563233827 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3a14157c30 0x7f3a140c81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:28.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.375+0000 7f3a18e1d700 1 --2- 172.21.15.84:0/2563233827 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3a140721e0 0x7f3a140c57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:28.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.375+0000 7f3a13fff700 1 -- 172.21.15.84:0/2563233827 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3a140721e0 msgr2=0x7f3a140c57e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:28.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.375+0000 7f3a13fff700 1 --2- 172.21.15.84:0/2563233827 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3a140721e0 0x7f3a140c57e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:28.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.375+0000 7f3a13fff700 1 -- 172.21.15.84:0/2563233827 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3a14157c30 msgr2=0x7f3a140c81f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:28.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.375+0000 7f3a13fff700 1 --2- 172.21.15.84:0/2563233827 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3a14157c30 0x7f3a140c81f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:28.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.375+0000 7f3a13fff700 1 -- 172.21.15.84:0/2563233827 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a0c009a70 con 0x7f3a140cab40 2023-09-13T08:25:28.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.375+0000 7f3a1961e700 1 --2- 172.21.15.84:0/2563233827 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3a14157c30 0x7f3a140c81f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T08:25:28.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.375+0000 7f3a13fff700 1 --2- 172.21.15.84:0/2563233827 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a140cab40 0x7f3a14153980 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f3a0000c500 tx=0x7f3a0000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:28.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.375+0000 7f3a117fa700 1 -- 172.21.15.84:0/2563233827 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a00005d70 con 0x7f3a140cab40 2023-09-13T08:25:28.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.375+0000 7f3a117fa700 1 -- 172.21.15.84:0/2563233827 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a000070d0 con 0x7f3a140cab40 2023-09-13T08:25:28.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.375+0000 7f3a1b081700 1 -- 172.21.15.84:0/2563233827 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a080094a0 con 0x7f3a140cab40 2023-09-13T08:25:28.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.375+0000 7f3a117fa700 1 -- 172.21.15.84:0/2563233827 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a00007440 con 0x7f3a140cab40 2023-09-13T08:25:28.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.375+0000 7f3a1b081700 1 -- 172.21.15.84:0/2563233827 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a14154ce0 con 0x7f3a140cab40 2023-09-13T08:25:28.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.376+0000 7f3a1b081700 1 -- 172.21.15.84:0/2563233827 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a1404f200 con 0x7f3a140cab40 2023-09-13T08:25:28.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.376+0000 7f3a117fa700 1 -- 172.21.15.84:0/2563233827 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f3a000075a0 con 0x7f3a140cab40 2023-09-13T08:25:28.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.377+0000 7f3a117fa700 1 --2- 172.21.15.84:0/2563233827 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f39f806a5b0 0x7f39f806ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:28.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.377+0000 7f3a117fa700 1 -- 172.21.15.84:0/2563233827 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f3a000881f0 con 0x7f3a140cab40 2023-09-13T08:25:28.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.377+0000 7f3a18e1d700 1 --2- 172.21.15.84:0/2563233827 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f39f806a5b0 0x7f39f806ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:28.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.377+0000 7f3a18e1d700 1 --2- 172.21.15.84:0/2563233827 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f39f806a5b0 0x7f39f806ca70 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3a08000c00 tx=0x7f3a08008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:28.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.381+0000 7f3a117fa700 1 -- 172.21.15.84:0/2563233827 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f3a00053440 con 0x7f3a140cab40 2023-09-13T08:25:28.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.570+0000 7f3a1b081700 1 -- 172.21.15.84:0/2563233827 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f3a140b16c0 con 0x7f3a140cab40 2023-09-13T08:25:28.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.571+0000 7f3a117fa700 1 -- 172.21.15.84:0/2563233827 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f3a00056a60 con 0x7f3a140cab40 2023-09-13T08:25:28.571 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-09-13T08:25:28.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.573+0000 7f3a1b081700 1 -- 172.21.15.84:0/2563233827 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f39f806a5b0 msgr2=0x7f39f806ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:28.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.573+0000 7f3a1b081700 1 --2- 172.21.15.84:0/2563233827 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f39f806a5b0 0x7f39f806ca70 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3a08000c00 tx=0x7f3a08008030 comp rx=0 tx=0).stop 2023-09-13T08:25:28.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.573+0000 7f3a1b081700 1 -- 172.21.15.84:0/2563233827 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a140cab40 msgr2=0x7f3a14153980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:28.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.573+0000 7f3a1b081700 1 --2- 172.21.15.84:0/2563233827 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a140cab40 0x7f3a14153980 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f3a0000c500 tx=0x7f3a0000c8c0 comp rx=0 tx=0).stop 2023-09-13T08:25:28.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.573+0000 7f3a1b081700 1 -- 172.21.15.84:0/2563233827 shutdown_connections 2023-09-13T08:25:28.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.573+0000 7f3a1b081700 1 --2- 172.21.15.84:0/2563233827 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f39f806a5b0 0x7f39f806ca70 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:28.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.573+0000 7f3a1b081700 1 --2- 172.21.15.84:0/2563233827 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3a14157c30 0x7f3a140c81f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:28.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.573+0000 7f3a1b081700 1 --2- 172.21.15.84:0/2563233827 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3a140721e0 0x7f3a140c57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:28.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.573+0000 7f3a1b081700 1 --2- 172.21.15.84:0/2563233827 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a140cab40 0x7f3a14153980 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:28.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.573+0000 7f3a1b081700 1 -- 172.21.15.84:0/2563233827 >> 172.21.15.84:0/2563233827 conn(0x7f3a140b0a20 msgr2=0x7f3a1415a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:28.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.573+0000 7f3a1b081700 1 -- 172.21.15.84:0/2563233827 shutdown_connections 2023-09-13T08:25:28.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.573+0000 7f3a1b081700 1 -- 172.21.15.84:0/2563233827 wait complete. 2023-09-13T08:25:28.585 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T08:25:28.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.704+0000 7f5091137700 1 Processor -- start 2023-09-13T08:25:28.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.705+0000 7f5091137700 1 -- start start 2023-09-13T08:25:28.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.705+0000 7f5091137700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f508c0cc340 0x7f508c0713b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:28.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.705+0000 7f5091137700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f508c15eb80 0x7f508c0718f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:28.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.705+0000 7f5091137700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f508c15a8c0 0x7f508c15ad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:28.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.705+0000 7f5091137700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f508c15b970 con 0x7f508c15eb80 2023-09-13T08:25:28.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.705+0000 7f5091137700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f508c0cc720 con 0x7f508c15a8c0 2023-09-13T08:25:28.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.705+0000 7f5091137700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f508c154e50 con 0x7f508c0cc340 2023-09-13T08:25:28.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.705+0000 7f508a59c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f508c15eb80 0x7f508c0718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:28.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.705+0000 7f508a59c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f508c15eb80 0x7f508c0718f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44590/0 (socket says 172.21.15.84:44590) 2023-09-13T08:25:28.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.705+0000 7f508a59c700 1 -- 172.21.15.84:0/1189366005 learned_addr learned my addr 172.21.15.84:0/1189366005 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:28.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.706+0000 7f508b59e700 1 --2- 172.21.15.84:0/1189366005 >> v2:172.21.15.161:3300/0 conn(0x7f508c15a8c0 0x7f508c15ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:28.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.706+0000 7f508ad9d700 1 --2- 172.21.15.84:0/1189366005 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f508c0cc340 0x7f508c0713b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:28.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.706+0000 7f508a59c700 1 -- 172.21.15.84:0/1189366005 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f508c0cc340 msgr2=0x7f508c0713b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:28.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.706+0000 7f508a59c700 1 --2- 172.21.15.84:0/1189366005 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f508c0cc340 0x7f508c0713b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:28.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.706+0000 7f508a59c700 1 -- 172.21.15.84:0/1189366005 >> v2:172.21.15.161:3300/0 conn(0x7f508c15a8c0 msgr2=0x7f508c15ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:28.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.706+0000 7f508a59c700 1 --2- 172.21.15.84:0/1189366005 >> v2:172.21.15.161:3300/0 conn(0x7f508c15a8c0 0x7f508c15ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:28.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.706+0000 7f508a59c700 1 -- 172.21.15.84:0/1189366005 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f508c15b690 con 0x7f508c15eb80 2023-09-13T08:25:28.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.706+0000 7f508b59e700 1 --2- 172.21.15.84:0/1189366005 >> v2:172.21.15.161:3300/0 conn(0x7f508c15a8c0 0x7f508c15ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T08:25:28.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.706+0000 7f508ad9d700 1 --2- 172.21.15.84:0/1189366005 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f508c0cc340 0x7f508c0713b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T08:25:28.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.706+0000 7f508a59c700 1 --2- 172.21.15.84:0/1189366005 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f508c15eb80 0x7f508c0718f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f508c0c7120 tx=0x7f507c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d9fff61efef585e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:28.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.706+0000 7f5089d9b700 1 -- 172.21.15.84:0/1189366005 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f507c00b870 con 0x7f508c15eb80 2023-09-13T08:25:28.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.706+0000 7f5089d9b700 1 -- 172.21.15.84:0/1189366005 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f507c00b9d0 con 0x7f508c15eb80 2023-09-13T08:25:28.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.706+0000 7f5089d9b700 1 -- 172.21.15.84:0/1189366005 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f507c00bd60 con 0x7f508c15eb80 2023-09-13T08:25:28.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.707+0000 7f5091137700 1 -- 172.21.15.84:0/1189366005 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f508c15eb80 msgr2=0x7f508c0718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:28.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.707+0000 7f5091137700 1 --2- 172.21.15.84:0/1189366005 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f508c15eb80 0x7f508c0718f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f508c0c7120 tx=0x7f507c009bd0 comp rx=0 tx=0).stop 2023-09-13T08:25:28.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.707+0000 7f5091137700 1 -- 172.21.15.84:0/1189366005 shutdown_connections 2023-09-13T08:25:28.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.707+0000 7f5091137700 1 --2- 172.21.15.84:0/1189366005 >> v2:172.21.15.161:3300/0 conn(0x7f508c15a8c0 0x7f508c15ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:28.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.707+0000 7f5091137700 1 --2- 172.21.15.84:0/1189366005 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f508c0cc340 0x7f508c0713b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:28.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.707+0000 7f5091137700 1 --2- 172.21.15.84:0/1189366005 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f508c15eb80 0x7f508c0718f0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:28.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.707+0000 7f5091137700 1 -- 172.21.15.84:0/1189366005 >> 172.21.15.84:0/1189366005 conn(0x7f508c0d00c0 msgr2=0x7f508c0d04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:28.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.707+0000 7f5091137700 1 -- 172.21.15.84:0/1189366005 shutdown_connections 2023-09-13T08:25:28.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.707+0000 7f5091137700 1 -- 172.21.15.84:0/1189366005 wait complete. 2023-09-13T08:25:28.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.708+0000 7f5091137700 1 Processor -- start 2023-09-13T08:25:28.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.708+0000 7f5091137700 1 -- start start 2023-09-13T08:25:28.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.709+0000 7f5091137700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f508c0cc340 0x7f508c0b1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:28.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.709+0000 7f5091137700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f508c15a8c0 0x7f508c0cea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:28.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.709+0000 7f5091137700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f508c15eb80 0x7f508c1f02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:28.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.709+0000 7f5091137700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f508c0cfa30 con 0x7f508c15eb80 2023-09-13T08:25:28.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.709+0000 7f5091137700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f508c1f41e0 con 0x7f508c15a8c0 2023-09-13T08:25:28.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.709+0000 7f5091137700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f508c0cef40 con 0x7f508c0cc340 2023-09-13T08:25:28.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.709+0000 7f508b59e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f508c15eb80 0x7f508c1f02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:28.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.709+0000 7f508b59e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f508c15eb80 0x7f508c1f02a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44598/0 (socket says 172.21.15.84:44598) 2023-09-13T08:25:28.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.709+0000 7f508b59e700 1 -- 172.21.15.84:0/637924880 learned_addr learned my addr 172.21.15.84:0/637924880 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:28.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.709+0000 7f508a59c700 1 --2- 172.21.15.84:0/637924880 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f508c15a8c0 0x7f508c0cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:28.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.709+0000 7f508ad9d700 1 --2- 172.21.15.84:0/637924880 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f508c0cc340 0x7f508c0b1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:28.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.709+0000 7f508b59e700 1 -- 172.21.15.84:0/637924880 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f508c0cc340 msgr2=0x7f508c0b1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:28.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.709+0000 7f508b59e700 1 --2- 172.21.15.84:0/637924880 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f508c0cc340 0x7f508c0b1530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:28.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.709+0000 7f508b59e700 1 -- 172.21.15.84:0/637924880 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f508c15a8c0 msgr2=0x7f508c0cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:28.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.709+0000 7f508b59e700 1 --2- 172.21.15.84:0/637924880 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f508c15a8c0 0x7f508c0cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:28.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.709+0000 7f508b59e700 1 -- 172.21.15.84:0/637924880 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f507c009550 con 0x7f508c15eb80 2023-09-13T08:25:28.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.710+0000 7f508b59e700 1 --2- 172.21.15.84:0/637924880 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f508c15eb80 0x7f508c1f02a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f508400ccd0 tx=0x7f508400a280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:28.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.710+0000 7f50737fe700 1 -- 172.21.15.84:0/637924880 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f508400acb0 con 0x7f508c15eb80 2023-09-13T08:25:28.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.710+0000 7f50737fe700 1 -- 172.21.15.84:0/637924880 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f508400ae30 con 0x7f508c15eb80 2023-09-13T08:25:28.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.710+0000 7f5091137700 1 -- 172.21.15.84:0/637924880 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f508c1f07e0 con 0x7f508c15eb80 2023-09-13T08:25:28.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.710+0000 7f50737fe700 1 -- 172.21.15.84:0/637924880 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f508400f6c0 con 0x7f508c15eb80 2023-09-13T08:25:28.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.710+0000 7f5091137700 1 -- 172.21.15.84:0/637924880 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f508c0cf470 con 0x7f508c15eb80 2023-09-13T08:25:28.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.711+0000 7f5091137700 1 -- 172.21.15.84:0/637924880 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f508c04e9b0 con 0x7f508c15eb80 2023-09-13T08:25:28.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.711+0000 7f50737fe700 1 -- 172.21.15.84:0/637924880 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f508400b040 con 0x7f508c15eb80 2023-09-13T08:25:28.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.712+0000 7f50737fe700 1 --2- 172.21.15.84:0/637924880 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f507806a580 0x7f507806ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:28.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.712+0000 7f50737fe700 1 -- 172.21.15.84:0/637924880 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f5084089470 con 0x7f508c15eb80 2023-09-13T08:25:28.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.712+0000 7f508ad9d700 1 --2- 172.21.15.84:0/637924880 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f507806a580 0x7f507806ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:28.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.712+0000 7f508ad9d700 1 --2- 172.21.15.84:0/637924880 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f507806a580 0x7f507806ca40 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f508c0c5f70 tx=0x7f5080008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:28.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.716+0000 7f50737fe700 1 -- 172.21.15.84:0/637924880 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f5084054610 con 0x7f508c15eb80 2023-09-13T08:25:28.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.910+0000 7f5091137700 1 -- 172.21.15.84:0/637924880 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f508c15e070 con 0x7f508c15eb80 2023-09-13T08:25:28.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.911+0000 7f50737fe700 1 -- 172.21.15.84:0/637924880 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18757 (secure 0 0 0) 0x7f5084057c30 con 0x7f508c15eb80 2023-09-13T08:25:28.911 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:25:28.911 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":26,"fsid":"0107440b-b634-42c5-a643-5d31ea826116","created":"2023-09-13T08:24:16.931917+0000","modified":"2023-09-13T08:25:23.878460+0000","last_up_change":"2023-09-13T08:24:28.422631+0000","last_in_change":"2023-09-13T08:24:19.425578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T08:24:28.583720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-13T08:24:39.862832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-13T08:24:41.145511+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-13T08:24:44.775160+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4a53ec12-1469-4356-b4e1-2b8fc9b7c0f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6817","nonce":1599532366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6819","nonce":1599532366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6823","nonce":1599532366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6821","nonce":1599532366}]},"public_addr":"172.21.15.84:6817/1599532366","cluster_addr":"172.21.15.84:6819/1599532366","heartbeat_back_addr":"172.21.15.84:6823/1599532366","heartbeat_front_addr":"172.21.15.84:6821/1599532366","state":["exists","up"]},{"osd":1,"uuid":"11e964a0-b80c-4afc-bfbf-e2067969db29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6825","nonce":461860977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6827","nonce":461860977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6831","nonce":461860977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6829","nonce":461860977}]},"public_addr":"172.21.15.84:6825/461860977","cluster_addr":"172.21.15.84:6827/461860977","heartbeat_back_addr":"172.21.15.84:6831/461860977","heartbeat_front_addr":"172.21.15.84:6829/461860977","state":["exists","up"]},{"osd":2,"uuid":"3ce74529-4dd1-44c7-9576-968f5fdc0c25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6809","nonce":1168316165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6811","nonce":1168316165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6815","nonce":1168316165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6813","nonce":1168316165}]},"public_addr":"172.21.15.84:6809/1168316165","cluster_addr":"172.21.15.84:6811/1168316165","heartbeat_back_addr":"172.21.15.84:6815/1168316165","heartbeat_front_addr":"172.21.15.84:6813/1168316165","state":["exists","up"]},{"osd":3,"uuid":"460cb5c5-590a-4d06-a4d9-5bac2fdf33b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6801","nonce":1661609810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6803","nonce":1661609810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6807","nonce":1661609810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6805","nonce":1661609810}]},"public_addr":"172.21.15.84:6801/1661609810","cluster_addr":"172.21.15.84:6803/1661609810","heartbeat_back_addr":"172.21.15.84:6807/1661609810","heartbeat_front_addr":"172.21.15.84:6805/1661609810","state":["exists","up"]},{"osd":4,"uuid":"bf237dd0-3ebd-44b5-8078-24a63e00d792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6801","nonce":1303562374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6803","nonce":1303562374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6807","nonce":1303562374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6805","nonce":1303562374}]},"public_addr":"172.21.15.161:6801/1303562374","cluster_addr":"172.21.15.161:6803/1303562374","heartbeat_back_addr":"172.21.15.161:6807/1303562374","heartbeat_front_addr":"172.21.15.161:6805/1303562374","state":["exists","up"]},{"osd":5,"uuid":"e1e538e0-5844-456b-8c6e-434d3a914af1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6818","nonce":961120854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6822","nonce":961120854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6830","nonce":961120854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6826","nonce":961120854}]},"public_addr":"172.21.15.161:6818/961120854","cluster_addr":"172.21.15.161:6822/961120854","heartbeat_back_addr":"172.21.15.161:6830/961120854","heartbeat_front_addr":"172.21.15.161:6826/961120854","state":["exists","up"]},{"osd":6,"uuid":"5cb1785e-960f-4dd4-b295-9e21b2c3f875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6809","nonce":980533466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6811","nonce":980533466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6815","nonce":980533466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6813","nonce":980533466}]},"public_addr":"172.21.15.161:6809/980533466","cluster_addr":"172.21.15.161:6811/980533466","heartbeat_back_addr":"172.21.15.161:6815/980533466","heartbeat_front_addr":"172.21.15.161:6813/980533466","state":["exists","up"]},{"osd":7,"uuid":"5acb6619-e933-4b46-b1c2-60af30acb839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6817","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6819","nonce":2479691549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6821","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6823","nonce":2479691549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6829","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6831","nonce":2479691549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6825","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6827","nonce":2479691549}]},"public_addr":"172.21.15.161:6819/2479691549","cluster_addr":"172.21.15.161:6823/2479691549","heartbeat_back_addr":"172.21.15.161:6831/2479691549","heartbeat_front_addr":"172.21.15.161:6827/2479691549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.678857+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.685341+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.613603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.634940+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.564387+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.697347+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.637437+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.619397+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":1}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T08:25:28.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.913+0000 7f5091137700 1 -- 172.21.15.84:0/637924880 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f507806a580 msgr2=0x7f507806ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:28.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.913+0000 7f5091137700 1 --2- 172.21.15.84:0/637924880 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f507806a580 0x7f507806ca40 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f508c0c5f70 tx=0x7f5080008040 comp rx=0 tx=0).stop 2023-09-13T08:25:28.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.913+0000 7f5091137700 1 -- 172.21.15.84:0/637924880 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f508c15eb80 msgr2=0x7f508c1f02a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:28.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.913+0000 7f5091137700 1 --2- 172.21.15.84:0/637924880 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f508c15eb80 0x7f508c1f02a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f508400ccd0 tx=0x7f508400a280 comp rx=0 tx=0).stop 2023-09-13T08:25:28.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.913+0000 7f5091137700 1 -- 172.21.15.84:0/637924880 shutdown_connections 2023-09-13T08:25:28.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.913+0000 7f5091137700 1 --2- 172.21.15.84:0/637924880 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f508c15eb80 0x7f508c1f02a0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:28.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.913+0000 7f5091137700 1 --2- 172.21.15.84:0/637924880 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f508c0cc340 0x7f508c0b1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:28.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.913+0000 7f5091137700 1 --2- 172.21.15.84:0/637924880 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f507806a580 0x7f507806ca40 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:28.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.913+0000 7f5091137700 1 --2- 172.21.15.84:0/637924880 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f508c15a8c0 0x7f508c0cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:28.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.913+0000 7f5091137700 1 -- 172.21.15.84:0/637924880 >> 172.21.15.84:0/637924880 conn(0x7f508c0d00c0 msgr2=0x7f508c0712b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:28.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.913+0000 7f5091137700 1 -- 172.21.15.84:0/637924880 shutdown_connections 2023-09-13T08:25:28.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:28.913+0000 7f5091137700 1 -- 172.21.15.84:0/637924880 wait complete. 2023-09-13T08:25:28.925 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T08:24:28.583720+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-13T08:24:39.862832+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-13T08:24:41.145511+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-09-13T08:24:44.775160+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-13T08:25:28.926 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T08:25:29.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.049+0000 7f5a8930f700 1 Processor -- start 2023-09-13T08:25:29.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.049+0000 7f5a8930f700 1 -- start start 2023-09-13T08:25:29.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.050+0000 7f5a8930f700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5a840ced40 0x7f5a840cda40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:29.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.050+0000 7f5a8930f700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5a840cdf80 0x7f5a8415f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:29.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.050+0000 7f5a8930f700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a840cd170 con 0x7f5a8415ea00 2023-09-13T08:25:29.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.050+0000 7f5a8930f700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a840ce410 con 0x7f5a840ced40 2023-09-13T08:25:29.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.050+0000 7f5a8930f700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a840cc8d0 con 0x7f5a840cdf80 2023-09-13T08:25:29.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.050+0000 7f5a827fc700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5a840ced40 0x7f5a840cda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:29.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.050+0000 7f5a82ffd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f5a8415ea00 0x7f5a840cbd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:47248/0 (socket says 172.21.15.84:47248) 2023-09-13T08:25:29.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.050+0000 7f5a82ffd700 1 -- 172.21.15.84:0/80805246 learned_addr learned my addr 172.21.15.84:0/80805246 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:25:29.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.051+0000 7f5a827fc700 1 -- 172.21.15.84:0/80805246 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5a840cdf80 msgr2=0x7f5a8415f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:29.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.051+0000 7f5a837fe700 1 --2- 172.21.15.84:0/80805246 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5a840cdf80 0x7f5a8415f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:29.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.051+0000 7f5a81ffb700 1 -- 172.21.15.84:0/80805246 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3702273961 0 0) 0x7f5a840cd170 con 0x7f5a8415ea00 2023-09-13T08:25:29.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.051+0000 7f5a827fc700 1 --2- 172.21.15.84:0/80805246 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5a840cdf80 0x7f5a8415f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:29.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.051+0000 7f5a827fc700 1 -- 172.21.15.84:0/80805246 >> v1:172.21.15.84:6789/0 conn(0x7f5a8415ea00 legacy=0x7f5a840cbd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:29.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.051+0000 7f5a827fc700 1 -- 172.21.15.84:0/80805246 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a840ccbb0 con 0x7f5a840ced40 2023-09-13T08:25:29.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.051+0000 7f5a837fe700 1 --2- 172.21.15.84:0/80805246 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5a840cdf80 0x7f5a8415f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T08:25:29.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.051+0000 7f5a827fc700 1 --2- 172.21.15.84:0/80805246 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a840ced40 0x7f5a840cda40 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f5a74009840 tx=0x7f5a74009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8eb7cee15034561 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:29.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.051+0000 7f5a81ffb700 1 -- 172.21.15.84:0/80805246 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a74011830 con 0x7f5a840ced40 2023-09-13T08:25:29.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.051+0000 7f5a81ffb700 1 -- 172.21.15.84:0/80805246 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a74011990 con 0x7f5a840ced40 2023-09-13T08:25:29.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.051+0000 7f5a81ffb700 1 -- 172.21.15.84:0/80805246 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a74011d20 con 0x7f5a840ced40 2023-09-13T08:25:29.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.051+0000 7f5a8930f700 1 -- 172.21.15.84:0/80805246 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a840ced40 msgr2=0x7f5a840cda40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:29.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.051+0000 7f5a8930f700 1 --2- 172.21.15.84:0/80805246 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a840ced40 0x7f5a840cda40 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f5a74009840 tx=0x7f5a74009b50 comp rx=0 tx=0).stop 2023-09-13T08:25:29.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.052+0000 7f5a8930f700 1 -- 172.21.15.84:0/80805246 shutdown_connections 2023-09-13T08:25:29.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.052+0000 7f5a8930f700 1 --2- 172.21.15.84:0/80805246 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5a840cdf80 0x7f5a8415f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:29.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.052+0000 7f5a8930f700 1 --2- 172.21.15.84:0/80805246 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a840ced40 0x7f5a840cda40 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:29.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.052+0000 7f5a8930f700 1 -- 172.21.15.84:0/80805246 >> 172.21.15.84:0/80805246 conn(0x7f5a8409a470 msgr2=0x7f5a840d1170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:29.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.052+0000 7f5a8930f700 1 -- 172.21.15.84:0/80805246 shutdown_connections 2023-09-13T08:25:29.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.052+0000 7f5a8930f700 1 -- 172.21.15.84:0/80805246 wait complete. 2023-09-13T08:25:29.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.053+0000 7f5a8930f700 1 Processor -- start 2023-09-13T08:25:29.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.053+0000 7f5a8930f700 1 -- start start 2023-09-13T08:25:29.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.054+0000 7f5a8930f700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5a840cdf80 0x7f5a84158680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:29.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.054+0000 7f5a8930f700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5a840ced40 0x7f5a840af520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:29.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.054+0000 7f5a8930f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a8415ea00 0x7f5a840c8240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:29.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.054+0000 7f5a8930f700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a840ca180 con 0x7f5a8415ea00 2023-09-13T08:25:29.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.054+0000 7f5a8930f700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a840ca420 con 0x7f5a840cdf80 2023-09-13T08:25:29.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.054+0000 7f5a8930f700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a840ca700 con 0x7f5a840ced40 2023-09-13T08:25:29.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.054+0000 7f5a837fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a8415ea00 0x7f5a840c8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:29.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.054+0000 7f5a837fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a8415ea00 0x7f5a840c8240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44612/0 (socket says 172.21.15.84:44612) 2023-09-13T08:25:29.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.054+0000 7f5a837fe700 1 -- 172.21.15.84:0/1395094861 learned_addr learned my addr 172.21.15.84:0/1395094861 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:29.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.054+0000 7f5a82ffd700 1 --2- 172.21.15.84:0/1395094861 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5a840cdf80 0x7f5a84158680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:29.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.054+0000 7f5a827fc700 1 --2- 172.21.15.84:0/1395094861 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5a840ced40 0x7f5a840af520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:29.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.054+0000 7f5a837fe700 1 -- 172.21.15.84:0/1395094861 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5a840ced40 msgr2=0x7f5a840af520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:29.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.054+0000 7f5a837fe700 1 --2- 172.21.15.84:0/1395094861 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5a840ced40 0x7f5a840af520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:29.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.054+0000 7f5a837fe700 1 -- 172.21.15.84:0/1395094861 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5a840cdf80 msgr2=0x7f5a84158680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:29.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.054+0000 7f5a837fe700 1 --2- 172.21.15.84:0/1395094861 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5a840cdf80 0x7f5a84158680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:29.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.054+0000 7f5a837fe700 1 -- 172.21.15.84:0/1395094861 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a740094a0 con 0x7f5a8415ea00 2023-09-13T08:25:29.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.054+0000 7f5a837fe700 1 --2- 172.21.15.84:0/1395094861 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a8415ea00 0x7f5a840c8240 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f5a7c00cd50 tx=0x7f5a7c00a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:29.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.054+0000 7f5a6b7fe700 1 -- 172.21.15.84:0/1395094861 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a7c00cea0 con 0x7f5a8415ea00 2023-09-13T08:25:29.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.055+0000 7f5a6b7fe700 1 -- 172.21.15.84:0/1395094861 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a7c00f480 con 0x7f5a8415ea00 2023-09-13T08:25:29.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.055+0000 7f5a8930f700 1 -- 172.21.15.84:0/1395094861 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a840ca9e0 con 0x7f5a8415ea00 2023-09-13T08:25:29.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.055+0000 7f5a6b7fe700 1 -- 172.21.15.84:0/1395094861 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a7c00f830 con 0x7f5a8415ea00 2023-09-13T08:25:29.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.055+0000 7f5a8930f700 1 -- 172.21.15.84:0/1395094861 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a840cb030 con 0x7f5a8415ea00 2023-09-13T08:25:29.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.055+0000 7f5a8930f700 1 -- 172.21.15.84:0/1395094861 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a840add60 con 0x7f5a8415ea00 2023-09-13T08:25:29.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.056+0000 7f5a6b7fe700 1 -- 172.21.15.84:0/1395094861 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f5a7c00b040 con 0x7f5a8415ea00 2023-09-13T08:25:29.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.056+0000 7f5a6b7fe700 1 --2- 172.21.15.84:0/1395094861 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f5a7006a580 0x7f5a7006ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:29.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.056+0000 7f5a6b7fe700 1 -- 172.21.15.84:0/1395094861 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f5a7c089520 con 0x7f5a8415ea00 2023-09-13T08:25:29.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.057+0000 7f5a82ffd700 1 --2- 172.21.15.84:0/1395094861 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f5a7006a580 0x7f5a7006ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:29.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.057+0000 7f5a82ffd700 1 --2- 172.21.15.84:0/1395094861 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f5a7006a580 0x7f5a7006ca40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5a780010e0 tx=0x7f5a78009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:29.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.061+0000 7f5a6b7fe700 1 -- 172.21.15.84:0/1395094861 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f5a840add60 con 0x7f5a8415ea00 2023-09-13T08:25:29.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.251+0000 7f5a8930f700 1 -- 172.21.15.84:0/1395094861 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5a840add60 con 0x7f5a8415ea00 2023-09-13T08:25:29.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.251+0000 7f5a6b7fe700 1 -- 172.21.15.84:0/1395094861 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5a840add60 con 0x7f5a8415ea00 2023-09-13T08:25:29.252 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-09-13T08:25:29.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.253+0000 7f5a8930f700 1 -- 172.21.15.84:0/1395094861 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f5a7006a580 msgr2=0x7f5a7006ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:29.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.253+0000 7f5a8930f700 1 --2- 172.21.15.84:0/1395094861 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f5a7006a580 0x7f5a7006ca40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5a780010e0 tx=0x7f5a78009040 comp rx=0 tx=0).stop 2023-09-13T08:25:29.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.253+0000 7f5a8930f700 1 -- 172.21.15.84:0/1395094861 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a8415ea00 msgr2=0x7f5a840c8240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:29.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.253+0000 7f5a8930f700 1 --2- 172.21.15.84:0/1395094861 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a8415ea00 0x7f5a840c8240 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f5a7c00cd50 tx=0x7f5a7c00a560 comp rx=0 tx=0).stop 2023-09-13T08:25:29.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.253+0000 7f5a8930f700 1 -- 172.21.15.84:0/1395094861 shutdown_connections 2023-09-13T08:25:29.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.253+0000 7f5a8930f700 1 --2- 172.21.15.84:0/1395094861 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a8415ea00 0x7f5a840c8240 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:29.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.253+0000 7f5a8930f700 1 --2- 172.21.15.84:0/1395094861 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f5a7006a580 0x7f5a7006ca40 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:29.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.253+0000 7f5a8930f700 1 --2- 172.21.15.84:0/1395094861 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5a840cdf80 0x7f5a84158680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:29.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.253+0000 7f5a8930f700 1 --2- 172.21.15.84:0/1395094861 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5a840ced40 0x7f5a840af520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:29.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.253+0000 7f5a8930f700 1 -- 172.21.15.84:0/1395094861 >> 172.21.15.84:0/1395094861 conn(0x7f5a8409a470 msgr2=0x7f5a840731c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:29.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.254+0000 7f5a8930f700 1 -- 172.21.15.84:0/1395094861 shutdown_connections 2023-09-13T08:25:29.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.254+0000 7f5a8930f700 1 -- 172.21.15.84:0/1395094861 wait complete. 2023-09-13T08:25:29.266 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-13T08:25:29.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.390+0000 7f0ec2577700 1 Processor -- start 2023-09-13T08:25:29.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.390+0000 7f0ec2577700 1 -- start start 2023-09-13T08:25:29.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.391+0000 7f0ec2577700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0ebc06c3c0 0x7f0ebc0b17a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:29.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.391+0000 7f0ec2577700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ebc160e90 con 0x7f0ebc160ab0 2023-09-13T08:25:29.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.391+0000 7f0ec2577700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ebc0d0820 con 0x7f0ebc06bf40 2023-09-13T08:25:29.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.391+0000 7f0ec2577700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ebc06c850 con 0x7f0ebc06c3c0 2023-09-13T08:25:29.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.391+0000 7f0ec0b14700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0ebc06c3c0 0x7f0ebc0b17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:29.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.391+0000 7f0ec0b14700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0ebc06c3c0 0x7f0ebc0b17a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44620/0 (socket says 172.21.15.84:44620) 2023-09-13T08:25:29.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.391+0000 7f0ec0b14700 1 -- 172.21.15.84:0/2518137600 learned_addr learned my addr 172.21.15.84:0/2518137600 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:29.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.391+0000 7f0ebbfff700 1 --1- 172.21.15.84:0/2518137600 >> v1:172.21.15.84:6789/0 conn(0x7f0ebc160ab0 0x7f0ebc0cf4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:47262/0 (socket says 172.21.15.84:47262) 2023-09-13T08:25:29.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.391+0000 7f0ec0b14700 1 -- 172.21.15.84:0/2518137600 >> v1:172.21.15.161:6789/0 conn(0x7f0ebc06bf40 legacy=0x7f0ebc0b1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:29.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.391+0000 7f0ec0b14700 1 -- 172.21.15.84:0/2518137600 >> v1:172.21.15.84:6789/0 conn(0x7f0ebc160ab0 legacy=0x7f0ebc0cf4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:29.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.391+0000 7f0ec0b14700 1 -- 172.21.15.84:0/2518137600 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ebc0cff80 con 0x7f0ebc06c3c0 2023-09-13T08:25:29.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.391+0000 7f0ebaffd700 1 -- 172.21.15.84:0/2518137600 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2112600449 0 0) 0x7f0ebc160e90 con 0x7f0ebc160ab0 2023-09-13T08:25:29.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.391+0000 7f0ec0b14700 1 --2- 172.21.15.84:0/2518137600 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ebc06c3c0 0x7f0ebc0b17a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0eb4009e50 tx=0x7f0eb400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e2223494ded825e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:29.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.391+0000 7f0ebaffd700 1 -- 172.21.15.84:0/2518137600 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb400e070 con 0x7f0ebc06c3c0 2023-09-13T08:25:29.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.392+0000 7f0ebaffd700 1 -- 172.21.15.84:0/2518137600 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eb4003a20 con 0x7f0ebc06c3c0 2023-09-13T08:25:29.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.392+0000 7f0ebaffd700 1 -- 172.21.15.84:0/2518137600 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb4003dd0 con 0x7f0ebc06c3c0 2023-09-13T08:25:29.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.392+0000 7f0ec2577700 1 -- 172.21.15.84:0/2518137600 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ebc06c3c0 msgr2=0x7f0ebc0b17a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:29.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.392+0000 7f0ec2577700 1 --2- 172.21.15.84:0/2518137600 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ebc06c3c0 0x7f0ebc0b17a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0eb4009e50 tx=0x7f0eb400b330 comp rx=0 tx=0).stop 2023-09-13T08:25:29.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.392+0000 7f0ec2577700 1 -- 172.21.15.84:0/2518137600 shutdown_connections 2023-09-13T08:25:29.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.392+0000 7f0ec2577700 1 --2- 172.21.15.84:0/2518137600 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ebc06c3c0 0x7f0ebc0b17a0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:29.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.392+0000 7f0ec2577700 1 -- 172.21.15.84:0/2518137600 >> 172.21.15.84:0/2518137600 conn(0x7f0ebc09a470 msgr2=0x7f0ebc0d1170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:29.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.392+0000 7f0ec2577700 1 -- 172.21.15.84:0/2518137600 shutdown_connections 2023-09-13T08:25:29.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.392+0000 7f0ec2577700 1 -- 172.21.15.84:0/2518137600 wait complete. 2023-09-13T08:25:29.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.393+0000 7f0ec2577700 1 Processor -- start 2023-09-13T08:25:29.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.393+0000 7f0ec2577700 1 -- start start 2023-09-13T08:25:29.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.394+0000 7f0ec2577700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ebc06bf40 0x7f0ebc0c6f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:29.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.394+0000 7f0ec2577700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0ebc06c3c0 0x7f0ebc0b2720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:29.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.394+0000 7f0ec2577700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0ebc160ab0 0x7f0ebc0b2c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:29.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.394+0000 7f0ec2577700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ebc0b44a0 con 0x7f0ebc06bf40 2023-09-13T08:25:29.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.394+0000 7f0ec2577700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ebc0c7550 con 0x7f0ebc160ab0 2023-09-13T08:25:29.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.394+0000 7f0ec2577700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ebc0c7830 con 0x7f0ebc06c3c0 2023-09-13T08:25:29.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.394+0000 7f0ebbfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ebc06bf40 0x7f0ebc0c6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:29.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.394+0000 7f0ebbfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ebc06bf40 0x7f0ebc0c6f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44622/0 (socket says 172.21.15.84:44622) 2023-09-13T08:25:29.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.394+0000 7f0ebbfff700 1 -- 172.21.15.84:0/391922563 learned_addr learned my addr 172.21.15.84:0/391922563 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:29.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.395+0000 7f0ebbfff700 1 -- 172.21.15.84:0/391922563 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0ebc06c3c0 msgr2=0x7f0ebc0b2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:29.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.395+0000 7f0ebb7fe700 1 --2- 172.21.15.84:0/391922563 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0ebc06c3c0 0x7f0ebc0b2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:29.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.395+0000 7f0ec0b14700 1 --2- 172.21.15.84:0/391922563 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0ebc160ab0 0x7f0ebc0b2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:29.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.395+0000 7f0ebbfff700 1 --2- 172.21.15.84:0/391922563 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0ebc06c3c0 0x7f0ebc0b2720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:29.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.395+0000 7f0ebbfff700 1 -- 172.21.15.84:0/391922563 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0ebc160ab0 msgr2=0x7f0ebc0b2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:29.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.395+0000 7f0ebbfff700 1 --2- 172.21.15.84:0/391922563 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0ebc160ab0 0x7f0ebc0b2c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:29.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.395+0000 7f0ebbfff700 1 -- 172.21.15.84:0/391922563 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eb4009b30 con 0x7f0ebc06bf40 2023-09-13T08:25:29.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.395+0000 7f0ebbfff700 1 --2- 172.21.15.84:0/391922563 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ebc06bf40 0x7f0ebc0c6f70 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f0eb000c520 tx=0x7f0eb000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:29.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.395+0000 7f0eb8ff9700 1 -- 172.21.15.84:0/391922563 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb00074e0 con 0x7f0ebc06bf40 2023-09-13T08:25:29.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.395+0000 7f0eb8ff9700 1 -- 172.21.15.84:0/391922563 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eb0007640 con 0x7f0ebc06bf40 2023-09-13T08:25:29.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.395+0000 7f0ec2577700 1 -- 172.21.15.84:0/391922563 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ebc0c7b10 con 0x7f0ebc06bf40 2023-09-13T08:25:29.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.395+0000 7f0eb8ff9700 1 -- 172.21.15.84:0/391922563 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb0005a50 con 0x7f0ebc06bf40 2023-09-13T08:25:29.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.395+0000 7f0ec2577700 1 -- 172.21.15.84:0/391922563 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ebc0c4e30 con 0x7f0ebc06bf40 2023-09-13T08:25:29.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.396+0000 7f0ec2577700 1 -- 172.21.15.84:0/391922563 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ebc0d0520 con 0x7f0ebc06bf40 2023-09-13T08:25:29.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.396+0000 7f0eb8ff9700 1 -- 172.21.15.84:0/391922563 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f0eb0005bb0 con 0x7f0ebc06bf40 2023-09-13T08:25:29.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.397+0000 7f0eb8ff9700 1 --2- 172.21.15.84:0/391922563 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f0ea806a580 0x7f0ea806ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:29.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.397+0000 7f0eb8ff9700 1 -- 172.21.15.84:0/391922563 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f0eb00882f0 con 0x7f0ebc06bf40 2023-09-13T08:25:29.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.397+0000 7f0ebb7fe700 1 --2- 172.21.15.84:0/391922563 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f0ea806a580 0x7f0ea806ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:29.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.397+0000 7f0ebb7fe700 1 --2- 172.21.15.84:0/391922563 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f0ea806a580 0x7f0ea806ca40 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0ebc0b6df0 tx=0x7f0eac008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:29.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.401+0000 7f0eb8ff9700 1 -- 172.21.15.84:0/391922563 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f0ebc0d0520 con 0x7f0ebc06bf40 2023-09-13T08:25:29.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.592+0000 7f0ec2577700 1 -- 172.21.15.84:0/391922563 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0ebc0d0520 con 0x7f0ebc06bf40 2023-09-13T08:25:29.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.592+0000 7f0eb8ff9700 1 -- 172.21.15.84:0/391922563 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0ebc0d0520 con 0x7f0ebc06bf40 2023-09-13T08:25:29.593 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-09-13T08:25:29.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.594+0000 7f0ec2577700 1 -- 172.21.15.84:0/391922563 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f0ea806a580 msgr2=0x7f0ea806ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:29.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.594+0000 7f0ec2577700 1 --2- 172.21.15.84:0/391922563 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f0ea806a580 0x7f0ea806ca40 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0ebc0b6df0 tx=0x7f0eac008040 comp rx=0 tx=0).stop 2023-09-13T08:25:29.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.594+0000 7f0ec2577700 1 -- 172.21.15.84:0/391922563 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ebc06bf40 msgr2=0x7f0ebc0c6f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:29.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.594+0000 7f0ec2577700 1 --2- 172.21.15.84:0/391922563 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ebc06bf40 0x7f0ebc0c6f70 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f0eb000c520 tx=0x7f0eb000c8e0 comp rx=0 tx=0).stop 2023-09-13T08:25:29.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.594+0000 7f0ec2577700 1 -- 172.21.15.84:0/391922563 shutdown_connections 2023-09-13T08:25:29.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.594+0000 7f0ec2577700 1 --2- 172.21.15.84:0/391922563 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f0ea806a580 0x7f0ea806ca40 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:29.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.594+0000 7f0ec2577700 1 --2- 172.21.15.84:0/391922563 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0ebc160ab0 0x7f0ebc0b2c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:29.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.594+0000 7f0ec2577700 1 --2- 172.21.15.84:0/391922563 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ebc06bf40 0x7f0ebc0c6f70 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:29.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.594+0000 7f0ec2577700 1 --2- 172.21.15.84:0/391922563 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0ebc06c3c0 0x7f0ebc0b2720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:29.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.594+0000 7f0ec2577700 1 -- 172.21.15.84:0/391922563 >> 172.21.15.84:0/391922563 conn(0x7f0ebc09a470 msgr2=0x7f0ebc15e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:29.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.594+0000 7f0ec2577700 1 -- 172.21.15.84:0/391922563 shutdown_connections 2023-09-13T08:25:29.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.594+0000 7f0ec2577700 1 -- 172.21.15.84:0/391922563 wait complete. 2023-09-13T08:25:29.606 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-13T08:25:29.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.729+0000 7f352ce22700 1 Processor -- start 2023-09-13T08:25:29.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.729+0000 7f352ce22700 1 -- start start 2023-09-13T08:25:29.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.730+0000 7f352ce22700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f352815e910 0x7f35280cf570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:29.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.730+0000 7f352ce22700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f35280cd590 0x7f35280cdbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:29.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.730+0000 7f352ce22700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f352815e480 con 0x7f35280ca8e0 2023-09-13T08:25:29.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.730+0000 7f352ce22700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35280cfbe0 con 0x7f352815e910 2023-09-13T08:25:29.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.730+0000 7f352ce22700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f352815de30 con 0x7f35280cd590 2023-09-13T08:25:29.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.730+0000 7f352659c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f35280ca8e0 0x7f35280cacc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:47276/0 (socket says 172.21.15.84:47276) 2023-09-13T08:25:29.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.730+0000 7f352659c700 1 -- 172.21.15.84:0/1663794403 learned_addr learned my addr 172.21.15.84:0/1663794403 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:25:29.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.731+0000 7f3526d9d700 1 --2- 172.21.15.84:0/1663794403 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f35280cd590 0x7f35280cdbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:29.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.731+0000 7f352559a700 1 -- 172.21.15.84:0/1663794403 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1526977262 0 0) 0x7f352815e480 con 0x7f35280ca8e0 2023-09-13T08:25:29.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.731+0000 7f3525d9b700 1 --2- 172.21.15.84:0/1663794403 >> v2:172.21.15.161:3300/0 conn(0x7f352815e910 0x7f35280cf570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:29.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.731+0000 7f352559a700 1 -- 172.21.15.84:0/1663794403 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35100035b0 con 0x7f35280ca8e0 2023-09-13T08:25:29.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.731+0000 7f352559a700 1 -- 172.21.15.84:0/1663794403 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1610816979 0 0) 0x7f35100035b0 con 0x7f35280ca8e0 2023-09-13T08:25:29.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.731+0000 7f352559a700 1 -- 172.21.15.84:0/1663794403 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f35280cd590 msgr2=0x7f35280cdbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:29.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.731+0000 7f352559a700 1 --2- 172.21.15.84:0/1663794403 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f35280cd590 0x7f35280cdbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:29.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.731+0000 7f352559a700 1 -- 172.21.15.84:0/1663794403 >> v2:172.21.15.161:3300/0 conn(0x7f352815e910 msgr2=0x7f35280cf570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:29.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.731+0000 7f352559a700 1 --2- 172.21.15.84:0/1663794403 >> v2:172.21.15.161:3300/0 conn(0x7f352815e910 0x7f35280cf570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:29.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.731+0000 7f352559a700 1 -- 172.21.15.84:0/1663794403 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f352815e110 con 0x7f35280ca8e0 2023-09-13T08:25:29.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.731+0000 7f352559a700 1 -- 172.21.15.84:0/1663794403 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2302733408 0 0) 0x7f351c001670 con 0x7f35280ca8e0 2023-09-13T08:25:29.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.731+0000 7f352559a700 1 -- 172.21.15.84:0/1663794403 >> v1:172.21.15.84:6789/0 conn(0x7f35280ca8e0 legacy=0x7f35280cacc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:29.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.731+0000 7f352559a700 1 --2- 172.21.15.84:0/1663794403 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f35280cd590 0x7f3510003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:29.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.731+0000 7f352559a700 1 --2- 172.21.15.84:0/1663794403 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3510003f80 0x7f3510004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:29.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.731+0000 7f352559a700 1 --2- 172.21.15.84:0/1663794403 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3510004d90 0x7f3510005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:29.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.731+0000 7f352559a700 1 -- 172.21.15.84:0/1663794403 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35280cfbe0 con 0x7f3510003f80 2023-09-13T08:25:29.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.731+0000 7f352559a700 1 -- 172.21.15.84:0/1663794403 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f352815de30 con 0x7f3510004d90 2023-09-13T08:25:29.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.731+0000 7f352559a700 1 -- 172.21.15.84:0/1663794403 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f351000ba60 con 0x7f35280cd590 2023-09-13T08:25:29.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.731+0000 7f3525d9b700 1 --2- 172.21.15.84:0/1663794403 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3510003f80 0x7f3510004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:29.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.731+0000 7f352659c700 1 --2- 172.21.15.84:0/1663794403 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f35280cd590 0x7f3510003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:29.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.731+0000 7f3526d9d700 1 --2- 172.21.15.84:0/1663794403 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3510004d90 0x7f3510005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:29.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.731+0000 7f3525d9b700 1 -- 172.21.15.84:0/1663794403 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f35280cd590 msgr2=0x7f3510003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:29.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.731+0000 7f3525d9b700 1 --2- 172.21.15.84:0/1663794403 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f35280cd590 0x7f3510003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:29.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.731+0000 7f3525d9b700 1 -- 172.21.15.84:0/1663794403 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3510004d90 msgr2=0x7f3510005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:29.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.731+0000 7f3525d9b700 1 --2- 172.21.15.84:0/1663794403 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3510004d90 0x7f3510005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:29.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.731+0000 7f3525d9b700 1 -- 172.21.15.84:0/1663794403 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35100035b0 con 0x7f3510003f80 2023-09-13T08:25:29.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.731+0000 7f3526d9d700 1 --2- 172.21.15.84:0/1663794403 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3510004d90 0x7f3510005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T08:25:29.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.732+0000 7f3525d9b700 1 --2- 172.21.15.84:0/1663794403 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3510003f80 0x7f3510004850 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f35280c3590 tx=0x7f3510005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74259d31d251c5d6 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:29.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.732+0000 7f352559a700 1 -- 172.21.15.84:0/1663794403 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f351800e6c0 con 0x7f3510003f80 2023-09-13T08:25:29.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.732+0000 7f352559a700 1 -- 172.21.15.84:0/1663794403 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f351800e820 con 0x7f3510003f80 2023-09-13T08:25:29.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.732+0000 7f352559a700 1 -- 172.21.15.84:0/1663794403 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f351800eb90 con 0x7f3510003f80 2023-09-13T08:25:29.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.732+0000 7f352ce22700 1 -- 172.21.15.84:0/1663794403 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3510003f80 msgr2=0x7f3510004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:29.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.732+0000 7f352ce22700 1 --2- 172.21.15.84:0/1663794403 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3510003f80 0x7f3510004850 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f35280c3590 tx=0x7f3510005880 comp rx=0 tx=0).stop 2023-09-13T08:25:29.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.732+0000 7f3526d9d700 1 -- 172.21.15.84:0/1663794403 reap_dead start 2023-09-13T08:25:29.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.732+0000 7f352ce22700 1 -- 172.21.15.84:0/1663794403 shutdown_connections 2023-09-13T08:25:29.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.732+0000 7f352ce22700 1 -- 172.21.15.84:0/1663794403 >> 172.21.15.84:0/1663794403 conn(0x7f35280cca70 msgr2=0x7f35280cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:29.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.732+0000 7f352ce22700 1 -- 172.21.15.84:0/1663794403 shutdown_connections 2023-09-13T08:25:29.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.732+0000 7f352ce22700 1 -- 172.21.15.84:0/1663794403 wait complete. 2023-09-13T08:25:29.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.734+0000 7f352ce22700 1 Processor -- start 2023-09-13T08:25:29.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.734+0000 7f352ce22700 1 -- start start 2023-09-13T08:25:29.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.735+0000 7f352ce22700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3510003f80 0x7f3528154dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:29.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.735+0000 7f352ce22700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f35281554b0 0x7f35280ad2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:29.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.735+0000 7f352ce22700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35280b0220 0x7f35280b06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:29.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.735+0000 7f352ce22700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35280b0bf0 con 0x7f35280b0220 2023-09-13T08:25:29.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.735+0000 7f352ce22700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35280c45d0 con 0x7f35281554b0 2023-09-13T08:25:29.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.735+0000 7f352ce22700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35280c48b0 con 0x7f3510003f80 2023-09-13T08:25:29.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.735+0000 7f3526d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35280b0220 0x7f35280b06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:29.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.735+0000 7f3526d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35280b0220 0x7f35280b06b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44644/0 (socket says 172.21.15.84:44644) 2023-09-13T08:25:29.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.735+0000 7f3526d9d700 1 -- 172.21.15.84:0/1456620966 learned_addr learned my addr 172.21.15.84:0/1456620966 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:29.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.735+0000 7f3526d9d700 1 -- 172.21.15.84:0/1456620966 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3510003f80 msgr2=0x7f3528154dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:29.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.735+0000 7f3526d9d700 1 --2- 172.21.15.84:0/1456620966 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3510003f80 0x7f3528154dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:29.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.735+0000 7f3526d9d700 1 -- 172.21.15.84:0/1456620966 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f35281554b0 msgr2=0x7f35280ad2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:29.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.735+0000 7f3525d9b700 1 --2- 172.21.15.84:0/1456620966 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f35281554b0 0x7f35280ad2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:29.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.735+0000 7f3526d9d700 1 --2- 172.21.15.84:0/1456620966 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f35281554b0 0x7f35280ad2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:29.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.735+0000 7f3526d9d700 1 -- 172.21.15.84:0/1456620966 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35280c4b90 con 0x7f35280b0220 2023-09-13T08:25:29.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.736+0000 7f3526d9d700 1 --2- 172.21.15.84:0/1456620966 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35280b0220 0x7f35280b06b0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f35280712f0 tx=0x7f35200104a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:29.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.736+0000 7f3516ffd700 1 -- 172.21.15.84:0/1456620966 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f352000e050 con 0x7f35280b0220 2023-09-13T08:25:29.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.736+0000 7f3516ffd700 1 -- 172.21.15.84:0/1456620966 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f352000f040 con 0x7f35280b0220 2023-09-13T08:25:29.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.736+0000 7f352ce22700 1 -- 172.21.15.84:0/1456620966 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35280c4e70 con 0x7f35280b0220 2023-09-13T08:25:29.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.736+0000 7f3516ffd700 1 -- 172.21.15.84:0/1456620966 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3520010db0 con 0x7f35280b0220 2023-09-13T08:25:29.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.736+0000 7f352ce22700 1 -- 172.21.15.84:0/1456620966 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35280c5430 con 0x7f35280b0220 2023-09-13T08:25:29.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.737+0000 7f352ce22700 1 -- 172.21.15.84:0/1456620966 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35280c5650 con 0x7f35280b0220 2023-09-13T08:25:29.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.737+0000 7f3516ffd700 1 -- 172.21.15.84:0/1456620966 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f3520015440 con 0x7f35280b0220 2023-09-13T08:25:29.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.738+0000 7f3516ffd700 1 --2- 172.21.15.84:0/1456620966 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f350806a580 0x7f350806ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:29.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.738+0000 7f3516ffd700 1 -- 172.21.15.84:0/1456620966 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f3520088ef0 con 0x7f35280b0220 2023-09-13T08:25:29.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.738+0000 7f352659c700 1 --2- 172.21.15.84:0/1456620966 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f350806a580 0x7f350806ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:29.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.738+0000 7f352659c700 1 --2- 172.21.15.84:0/1456620966 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f350806a580 0x7f350806ca40 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f351c000fb0 tx=0x7f351c000bc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:29.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.742+0000 7f3516ffd700 1 -- 172.21.15.84:0/1456620966 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f3520054120 con 0x7f35280b0220 2023-09-13T08:25:29.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.935+0000 7f352ce22700 1 -- 172.21.15.84:0/1456620966 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f352804f200 con 0x7f35280b0220 2023-09-13T08:25:29.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.935+0000 7f3516ffd700 1 -- 172.21.15.84:0/1456620966 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3520057740 con 0x7f35280b0220 2023-09-13T08:25:29.936 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-09-13T08:25:29.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.938+0000 7f352ce22700 1 -- 172.21.15.84:0/1456620966 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f350806a580 msgr2=0x7f350806ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:29.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.938+0000 7f352ce22700 1 --2- 172.21.15.84:0/1456620966 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f350806a580 0x7f350806ca40 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f351c000fb0 tx=0x7f351c000bc0 comp rx=0 tx=0).stop 2023-09-13T08:25:29.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.938+0000 7f352ce22700 1 -- 172.21.15.84:0/1456620966 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35280b0220 msgr2=0x7f35280b06b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:29.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.938+0000 7f352ce22700 1 --2- 172.21.15.84:0/1456620966 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35280b0220 0x7f35280b06b0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f35280712f0 tx=0x7f35200104a0 comp rx=0 tx=0).stop 2023-09-13T08:25:29.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.938+0000 7f352ce22700 1 -- 172.21.15.84:0/1456620966 shutdown_connections 2023-09-13T08:25:29.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.938+0000 7f352ce22700 1 --2- 172.21.15.84:0/1456620966 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35280b0220 0x7f35280b06b0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:29.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.938+0000 7f352ce22700 1 --2- 172.21.15.84:0/1456620966 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3510003f80 0x7f3528154dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:29.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.938+0000 7f352ce22700 1 --2- 172.21.15.84:0/1456620966 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f350806a580 0x7f350806ca40 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:29.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.938+0000 7f352ce22700 1 --2- 172.21.15.84:0/1456620966 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f35281554b0 0x7f35280ad2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:29.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.938+0000 7f352ce22700 1 -- 172.21.15.84:0/1456620966 >> 172.21.15.84:0/1456620966 conn(0x7f35280cca70 msgr2=0x7f352806d620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:29.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.938+0000 7f352ce22700 1 -- 172.21.15.84:0/1456620966 shutdown_connections 2023-09-13T08:25:29.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:29.938+0000 7f352ce22700 1 -- 172.21.15.84:0/1456620966 wait complete. 2023-09-13T08:25:29.951 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-09-13T08:25:30.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.074+0000 7f5939ee3700 1 Processor -- start 2023-09-13T08:25:30.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.074+0000 7f5939ee3700 1 -- start start 2023-09-13T08:25:30.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.075+0000 7f5939ee3700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f59340cd590 0x7f59340cf570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:30.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.075+0000 7f5939ee3700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f593415e480 con 0x7f59340ca8e0 2023-09-13T08:25:30.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.075+0000 7f5939ee3700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59340cfbe0 con 0x7f593415e910 2023-09-13T08:25:30.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.075+0000 7f5939ee3700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f593415de30 con 0x7f59340cd590 2023-09-13T08:25:30.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.075+0000 7f59337fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f59340ca8e0 0x7f59340cacc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:47294/0 (socket says 172.21.15.84:47294) 2023-09-13T08:25:30.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.075+0000 7f59337fe700 1 -- 172.21.15.84:0/4114224953 learned_addr learned my addr 172.21.15.84:0/4114224953 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:25:30.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.075+0000 7f5933fff700 1 --2- 172.21.15.84:0/4114224953 >> v2:172.21.15.161:3300/0 conn(0x7f59340cd590 0x7f59340cf570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:30.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.075+0000 7f5932ffd700 1 -- 172.21.15.84:0/4114224953 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3805571226 0 0) 0x7f593415e480 con 0x7f59340ca8e0 2023-09-13T08:25:30.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.075+0000 7f5932ffd700 1 -- 172.21.15.84:0/4114224953 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59200035b0 con 0x7f59340ca8e0 2023-09-13T08:25:30.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.075+0000 7f5932ffd700 1 -- 172.21.15.84:0/4114224953 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1237741184 0 0) 0x7f59340cfbe0 con 0x7f593415e910 2023-09-13T08:25:30.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.075+0000 7f5932ffd700 1 -- 172.21.15.84:0/4114224953 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f593415e480 con 0x7f593415e910 2023-09-13T08:25:30.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.075+0000 7f5932ffd700 1 -- 172.21.15.84:0/4114224953 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1724439695 0 0) 0x7f59200035b0 con 0x7f59340ca8e0 2023-09-13T08:25:30.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.075+0000 7f5932ffd700 1 -- 172.21.15.84:0/4114224953 >> v2:172.21.15.161:3300/0 conn(0x7f59340cd590 msgr2=0x7f59340cf570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:30.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.075+0000 7f5932ffd700 1 --2- 172.21.15.84:0/4114224953 >> v2:172.21.15.161:3300/0 conn(0x7f59340cd590 0x7f59340cf570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:30.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.075+0000 7f5932ffd700 1 -- 172.21.15.84:0/4114224953 >> v1:172.21.15.161:6789/0 conn(0x7f593415e910 legacy=0x7f59340cdbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:30.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.075+0000 7f5932ffd700 1 -- 172.21.15.84:0/4114224953 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f593415e110 con 0x7f59340ca8e0 2023-09-13T08:25:30.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.075+0000 7f5932ffd700 1 -- 172.21.15.84:0/4114224953 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2302733408 0 0) 0x7f5924001670 con 0x7f59340ca8e0 2023-09-13T08:25:30.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.075+0000 7f5932ffd700 1 -- 172.21.15.84:0/4114224953 >> v1:172.21.15.84:6789/0 conn(0x7f59340ca8e0 legacy=0x7f59340cacc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:30.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.076+0000 7f5932ffd700 1 --2- 172.21.15.84:0/4114224953 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5920003b90 0x7f5920003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:30.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.076+0000 7f5932ffd700 1 --2- 172.21.15.84:0/4114224953 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5920004850 0x7f5920004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:30.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.076+0000 7f5932ffd700 1 --2- 172.21.15.84:0/4114224953 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5920005210 0x7f592000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:30.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.076+0000 7f5932ffd700 1 -- 172.21.15.84:0/4114224953 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f593415de30 con 0x7f5920003b90 2023-09-13T08:25:30.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.076+0000 7f5932ffd700 1 -- 172.21.15.84:0/4114224953 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f592000c140 con 0x7f5920005210 2023-09-13T08:25:30.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.076+0000 7f5932ffd700 1 -- 172.21.15.84:0/4114224953 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f592000c300 con 0x7f5920004850 2023-09-13T08:25:30.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.076+0000 7f59337fe700 1 --2- 172.21.15.84:0/4114224953 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5920003b90 0x7f5920003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:30.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.076+0000 7f5933fff700 1 --2- 172.21.15.84:0/4114224953 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5920005210 0x7f592000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:30.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.076+0000 7f592affd700 1 --2- 172.21.15.84:0/4114224953 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5920004850 0x7f5920004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:30.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.076+0000 7f59337fe700 1 -- 172.21.15.84:0/4114224953 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5920004850 msgr2=0x7f5920004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:30.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.076+0000 7f59337fe700 1 --2- 172.21.15.84:0/4114224953 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5920004850 0x7f5920004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:30.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.076+0000 7f59337fe700 1 -- 172.21.15.84:0/4114224953 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5920005210 msgr2=0x7f592000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:30.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.076+0000 7f59337fe700 1 --2- 172.21.15.84:0/4114224953 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5920005210 0x7f592000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:30.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.076+0000 7f59337fe700 1 -- 172.21.15.84:0/4114224953 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59200035b0 con 0x7f5920003b90 2023-09-13T08:25:30.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.076+0000 7f5933fff700 1 -- 172.21.15.84:0/4114224953 reap_dead start 2023-09-13T08:25:30.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.076+0000 7f59337fe700 1 --2- 172.21.15.84:0/4114224953 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5920003b90 0x7f5920003f90 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f592400c240 tx=0x7f5920005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94cb41af055fedc1 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:30.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.076+0000 7f5932ffd700 1 -- 172.21.15.84:0/4114224953 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f592400cd80 con 0x7f5920003b90 2023-09-13T08:25:30.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.076+0000 7f5932ffd700 1 -- 172.21.15.84:0/4114224953 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5924005960 con 0x7f5920003b90 2023-09-13T08:25:30.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.076+0000 7f5932ffd700 1 -- 172.21.15.84:0/4114224953 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5924005d10 con 0x7f5920003b90 2023-09-13T08:25:30.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.077+0000 7f5939ee3700 1 -- 172.21.15.84:0/4114224953 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5920003b90 msgr2=0x7f5920003f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:30.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.077+0000 7f5939ee3700 1 --2- 172.21.15.84:0/4114224953 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5920003b90 0x7f5920003f90 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f592400c240 tx=0x7f5920005880 comp rx=0 tx=0).stop 2023-09-13T08:25:30.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.077+0000 7f5939ee3700 1 -- 172.21.15.84:0/4114224953 shutdown_connections 2023-09-13T08:25:30.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.077+0000 7f5939ee3700 1 --2- 172.21.15.84:0/4114224953 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5920003b90 0x7f5920003f90 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:30.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.077+0000 7f5939ee3700 1 -- 172.21.15.84:0/4114224953 >> 172.21.15.84:0/4114224953 conn(0x7f59340cca70 msgr2=0x7f59340cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:30.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.077+0000 7f5939ee3700 1 -- 172.21.15.84:0/4114224953 shutdown_connections 2023-09-13T08:25:30.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.077+0000 7f5939ee3700 1 -- 172.21.15.84:0/4114224953 wait complete. 2023-09-13T08:25:30.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.078+0000 7f5939ee3700 1 Processor -- start 2023-09-13T08:25:30.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.078+0000 7f5939ee3700 1 -- start start 2023-09-13T08:25:30.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.079+0000 7f5939ee3700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5920003b90 0x7f59341f2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:30.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.079+0000 7f5939ee3700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f59340b5c80 0x7f59341f6f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:30.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.079+0000 7f5939ee3700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f593415b700 0x7f593415bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:30.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.079+0000 7f5939ee3700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f593415c0c0 con 0x7f5920003b90 2023-09-13T08:25:30.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.079+0000 7f5939ee3700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59341f74a0 con 0x7f59340b5c80 2023-09-13T08:25:30.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.079+0000 7f5939ee3700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59340ae860 con 0x7f593415b700 2023-09-13T08:25:30.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.079+0000 7f59337fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5920003b90 0x7f59341f2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:30.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.079+0000 7f59337fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5920003b90 0x7f59341f2af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44660/0 (socket says 172.21.15.84:44660) 2023-09-13T08:25:30.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.079+0000 7f59337fe700 1 -- 172.21.15.84:0/1951665147 learned_addr learned my addr 172.21.15.84:0/1951665147 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:30.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.079+0000 7f592affd700 1 --2- 172.21.15.84:0/1951665147 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f59340b5c80 0x7f59341f6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:30.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.079+0000 7f59337fe700 1 -- 172.21.15.84:0/1951665147 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f593415b700 msgr2=0x7f593415bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:30.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.079+0000 7f59337fe700 1 --2- 172.21.15.84:0/1951665147 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f593415b700 0x7f593415bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:30.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.079+0000 7f59337fe700 1 -- 172.21.15.84:0/1951665147 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f59340b5c80 msgr2=0x7f59341f6f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:30.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.079+0000 7f59337fe700 1 --2- 172.21.15.84:0/1951665147 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f59340b5c80 0x7f59341f6f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:30.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.079+0000 7f59337fe700 1 -- 172.21.15.84:0/1951665147 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59340aeb40 con 0x7f5920003b90 2023-09-13T08:25:30.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.079+0000 7f59337fe700 1 --2- 172.21.15.84:0/1951665147 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5920003b90 0x7f59341f2af0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f5924011000 tx=0x7f59340cc990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:30.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.079+0000 7f5930ff9700 1 -- 172.21.15.84:0/1951665147 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5924004c80 con 0x7f5920003b90 2023-09-13T08:25:30.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.079+0000 7f5930ff9700 1 -- 172.21.15.84:0/1951665147 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5924004de0 con 0x7f5920003b90 2023-09-13T08:25:30.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.079+0000 7f5939ee3700 1 -- 172.21.15.84:0/1951665147 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59340aee20 con 0x7f5920003b90 2023-09-13T08:25:30.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.079+0000 7f5930ff9700 1 -- 172.21.15.84:0/1951665147 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59240072f0 con 0x7f5920003b90 2023-09-13T08:25:30.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.080+0000 7f5939ee3700 1 -- 172.21.15.84:0/1951665147 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59340c3ea0 con 0x7f5920003b90 2023-09-13T08:25:30.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.080+0000 7f5939ee3700 1 -- 172.21.15.84:0/1951665147 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59340c4060 con 0x7f5920003b90 2023-09-13T08:25:30.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.081+0000 7f5930ff9700 1 -- 172.21.15.84:0/1951665147 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f5924007450 con 0x7f5920003b90 2023-09-13T08:25:30.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.081+0000 7f5930ff9700 1 --2- 172.21.15.84:0/1951665147 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f591406a580 0x7f591406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:30.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.081+0000 7f5930ff9700 1 -- 172.21.15.84:0/1951665147 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f5924089850 con 0x7f5920003b90 2023-09-13T08:25:30.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.081+0000 7f592affd700 1 --2- 172.21.15.84:0/1951665147 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f591406a580 0x7f591406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:30.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.082+0000 7f592affd700 1 --2- 172.21.15.84:0/1951665147 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f591406a580 0x7f591406ca40 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f593415c380 tx=0x7f591c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:30.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.086+0000 7f5930ff9700 1 -- 172.21.15.84:0/1951665147 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f5924054a80 con 0x7f5920003b90 2023-09-13T08:25:30.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.272+0000 7f5939ee3700 1 -- 172.21.15.84:0/1951665147 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f59340c4210 con 0x7f5920003b90 2023-09-13T08:25:30.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.273+0000 7f5930ff9700 1 -- 172.21.15.84:0/1951665147 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f59240580a0 con 0x7f5920003b90 2023-09-13T08:25:30.274 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-09-13T08:25:30.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.275+0000 7f5939ee3700 1 -- 172.21.15.84:0/1951665147 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f591406a580 msgr2=0x7f591406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:30.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.275+0000 7f5939ee3700 1 --2- 172.21.15.84:0/1951665147 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f591406a580 0x7f591406ca40 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f593415c380 tx=0x7f591c009040 comp rx=0 tx=0).stop 2023-09-13T08:25:30.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.275+0000 7f5939ee3700 1 -- 172.21.15.84:0/1951665147 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5920003b90 msgr2=0x7f59341f2af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:30.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.275+0000 7f5939ee3700 1 --2- 172.21.15.84:0/1951665147 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5920003b90 0x7f59341f2af0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f5924011000 tx=0x7f59340cc990 comp rx=0 tx=0).stop 2023-09-13T08:25:30.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.275+0000 7f5939ee3700 1 -- 172.21.15.84:0/1951665147 shutdown_connections 2023-09-13T08:25:30.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.275+0000 7f5939ee3700 1 --2- 172.21.15.84:0/1951665147 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f593415b700 0x7f593415bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:30.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.275+0000 7f5939ee3700 1 --2- 172.21.15.84:0/1951665147 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5920003b90 0x7f59341f2af0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:30.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.275+0000 7f5939ee3700 1 --2- 172.21.15.84:0/1951665147 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f591406a580 0x7f591406ca40 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:30.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.275+0000 7f5939ee3700 1 --2- 172.21.15.84:0/1951665147 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f59340b5c80 0x7f59341f6f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:30.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.275+0000 7f5939ee3700 1 -- 172.21.15.84:0/1951665147 >> 172.21.15.84:0/1951665147 conn(0x7f59340cca70 msgr2=0x7f59340afbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:30.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.275+0000 7f5939ee3700 1 -- 172.21.15.84:0/1951665147 shutdown_connections 2023-09-13T08:25:30.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.275+0000 7f5939ee3700 1 -- 172.21.15.84:0/1951665147 wait complete. 2023-09-13T08:25:30.287 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T08:25:30.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.407+0000 7fead528a700 1 Processor -- start 2023-09-13T08:25:30.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.407+0000 7fead528a700 1 -- start start 2023-09-13T08:25:30.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.408+0000 7fead528a700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fead015d7b0 0x7fead00718f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:30.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.408+0000 7fead528a700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fead00aefd0 0x7fead00acda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:30.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.408+0000 7fead528a700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fead00ca680 con 0x7fead006a620 2023-09-13T08:25:30.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.408+0000 7fead528a700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fead00721c0 con 0x7fead00aefd0 2023-09-13T08:25:30.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.408+0000 7fead528a700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fead00ca8d0 con 0x7fead015d7b0 2023-09-13T08:25:30.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.408+0000 7feacf7fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fead006a620 0x7fead00cb690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:47318/0 (socket says 172.21.15.84:47318) 2023-09-13T08:25:30.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.408+0000 7feacf7fe700 1 -- 172.21.15.84:0/135518418 learned_addr learned my addr 172.21.15.84:0/135518418 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:25:30.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.408+0000 7feace7fc700 1 --2- 172.21.15.84:0/135518418 >> v2:172.21.15.161:3300/0 conn(0x7fead00aefd0 0x7fead00acda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:30.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.408+0000 7feaceffd700 1 --2- 172.21.15.84:0/135518418 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fead015d7b0 0x7fead00718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:30.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.408+0000 7feacdffb700 1 -- 172.21.15.84:0/135518418 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3164206234 0 0) 0x7fead00ca680 con 0x7fead006a620 2023-09-13T08:25:30.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.409+0000 7feacdffb700 1 -- 172.21.15.84:0/135518418 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feab80035b0 con 0x7fead006a620 2023-09-13T08:25:30.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.409+0000 7feacdffb700 1 -- 172.21.15.84:0/135518418 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4175122353 0 0) 0x7feab80035b0 con 0x7fead006a620 2023-09-13T08:25:30.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.409+0000 7feacdffb700 1 -- 172.21.15.84:0/135518418 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fead015d7b0 msgr2=0x7fead00718f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:30.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.409+0000 7feacdffb700 1 --2- 172.21.15.84:0/135518418 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fead015d7b0 0x7fead00718f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:30.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.409+0000 7feacdffb700 1 -- 172.21.15.84:0/135518418 >> v2:172.21.15.161:3300/0 conn(0x7fead00aefd0 msgr2=0x7fead00acda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:30.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.409+0000 7feacdffb700 1 --2- 172.21.15.84:0/135518418 >> v2:172.21.15.161:3300/0 conn(0x7fead00aefd0 0x7fead00acda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:30.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.409+0000 7feacdffb700 1 -- 172.21.15.84:0/135518418 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fead00cabb0 con 0x7fead006a620 2023-09-13T08:25:30.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.409+0000 7feacdffb700 1 -- 172.21.15.84:0/135518418 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2302733408 0 0) 0x7feac80019f0 con 0x7fead006a620 2023-09-13T08:25:30.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.409+0000 7feacdffb700 1 -- 172.21.15.84:0/135518418 >> v1:172.21.15.84:6789/0 conn(0x7fead006a620 legacy=0x7fead00cb690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:30.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.409+0000 7feacdffb700 1 --2- 172.21.15.84:0/135518418 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feab8003a00 0x7feab8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:30.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.409+0000 7feacdffb700 1 --2- 172.21.15.84:0/135518418 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feab8004850 0x7feab8004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:30.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.409+0000 7feacdffb700 1 --2- 172.21.15.84:0/135518418 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fead015d7b0 0x7feab8005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:30.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.409+0000 7feacdffb700 1 -- 172.21.15.84:0/135518418 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead00721c0 con 0x7feab8004850 2023-09-13T08:25:30.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.409+0000 7feacdffb700 1 -- 172.21.15.84:0/135518418 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead00ca8d0 con 0x7feab8003a00 2023-09-13T08:25:30.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.409+0000 7feacdffb700 1 -- 172.21.15.84:0/135518418 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feab800ba10 con 0x7fead015d7b0 2023-09-13T08:25:30.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.409+0000 7feace7fc700 1 --2- 172.21.15.84:0/135518418 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feab8004850 0x7feab8004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:30.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.409+0000 7feaceffd700 1 --2- 172.21.15.84:0/135518418 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feab8003a00 0x7feab8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:30.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.409+0000 7feacf7fe700 1 --2- 172.21.15.84:0/135518418 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fead015d7b0 0x7feab8005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:30.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.409+0000 7feace7fc700 1 -- 172.21.15.84:0/135518418 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fead015d7b0 msgr2=0x7feab8005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:30.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.409+0000 7feace7fc700 1 --2- 172.21.15.84:0/135518418 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fead015d7b0 0x7feab8005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:30.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.409+0000 7feace7fc700 1 -- 172.21.15.84:0/135518418 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feab8003a00 msgr2=0x7feab8003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:30.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.409+0000 7feace7fc700 1 --2- 172.21.15.84:0/135518418 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feab8003a00 0x7feab8003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:30.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.409+0000 7feace7fc700 1 -- 172.21.15.84:0/135518418 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feab80035b0 con 0x7feab8004850 2023-09-13T08:25:30.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.409+0000 7feacf7fe700 1 --2- 172.21.15.84:0/135518418 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fead015d7b0 0x7feab8005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T08:25:30.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.409+0000 7feace7fc700 1 --2- 172.21.15.84:0/135518418 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feab8004850 0x7feab8004cd0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7feac0009b90 tx=0x7feab8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9afca9a0181205b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:30.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.410+0000 7feacdffb700 1 -- 172.21.15.84:0/135518418 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac000e6c0 con 0x7feab8004850 2023-09-13T08:25:30.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.410+0000 7feacdffb700 1 -- 172.21.15.84:0/135518418 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feac000e820 con 0x7feab8004850 2023-09-13T08:25:30.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.410+0000 7feacdffb700 1 -- 172.21.15.84:0/135518418 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac000eb90 con 0x7feab8004850 2023-09-13T08:25:30.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.410+0000 7fead528a700 1 -- 172.21.15.84:0/135518418 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feab8004850 msgr2=0x7feab8004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:30.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.410+0000 7fead528a700 1 --2- 172.21.15.84:0/135518418 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feab8004850 0x7feab8004cd0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7feac0009b90 tx=0x7feab8005880 comp rx=0 tx=0).stop 2023-09-13T08:25:30.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.410+0000 7feacf7fe700 1 -- 172.21.15.84:0/135518418 reap_dead start 2023-09-13T08:25:30.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.410+0000 7fead528a700 1 -- 172.21.15.84:0/135518418 shutdown_connections 2023-09-13T08:25:30.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.410+0000 7fead528a700 1 -- 172.21.15.84:0/135518418 >> 172.21.15.84:0/135518418 conn(0x7fead00ccab0 msgr2=0x7fead00ccec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:30.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.410+0000 7fead528a700 1 -- 172.21.15.84:0/135518418 shutdown_connections 2023-09-13T08:25:30.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.410+0000 7fead528a700 1 -- 172.21.15.84:0/135518418 wait complete. 2023-09-13T08:25:30.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.411+0000 7fead528a700 1 Processor -- start 2023-09-13T08:25:30.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.412+0000 7fead528a700 1 -- start start 2023-09-13T08:25:30.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.412+0000 7fead528a700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feab8004850 0x7fead00b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:30.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.412+0000 7fead528a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fead00c7100 0x7fead01516f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:30.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.412+0000 7fead528a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fead00b0710 0x7fead00b0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:30.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.412+0000 7fead528a700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead00b10d0 con 0x7fead00c7100 2023-09-13T08:25:30.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.412+0000 7fead528a700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead00c7830 con 0x7fead00b0710 2023-09-13T08:25:30.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.412+0000 7fead528a700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fead0151c30 con 0x7feab8004850 2023-09-13T08:25:30.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.412+0000 7feace7fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fead00c7100 0x7fead01516f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:30.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.412+0000 7feace7fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fead00c7100 0x7fead01516f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44682/0 (socket says 172.21.15.84:44682) 2023-09-13T08:25:30.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.412+0000 7feace7fc700 1 -- 172.21.15.84:0/2449518351 learned_addr learned my addr 172.21.15.84:0/2449518351 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:30.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.413+0000 7feaceffd700 1 --2- 172.21.15.84:0/2449518351 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feab8004850 0x7fead00b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:30.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.413+0000 7feacf7fe700 1 --2- 172.21.15.84:0/2449518351 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fead00b0710 0x7fead00b0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:30.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.413+0000 7feace7fc700 1 -- 172.21.15.84:0/2449518351 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feab8004850 msgr2=0x7fead00b25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:30.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.413+0000 7feace7fc700 1 --2- 172.21.15.84:0/2449518351 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feab8004850 0x7fead00b25a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:30.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.413+0000 7feace7fc700 1 -- 172.21.15.84:0/2449518351 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fead00b0710 msgr2=0x7fead00b0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:30.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.413+0000 7feace7fc700 1 --2- 172.21.15.84:0/2449518351 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fead00b0710 0x7fead00b0b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:30.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.413+0000 7feace7fc700 1 -- 172.21.15.84:0/2449518351 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fead00ca410 con 0x7fead00c7100 2023-09-13T08:25:30.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.413+0000 7feace7fc700 1 --2- 172.21.15.84:0/2449518351 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fead00c7100 0x7fead01516f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7feac000e4b0 tx=0x7feac00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:30.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.413+0000 7feab77fe700 1 -- 172.21.15.84:0/2449518351 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac0021070 con 0x7fead00c7100 2023-09-13T08:25:30.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.413+0000 7feab77fe700 1 -- 172.21.15.84:0/2449518351 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feac0004580 con 0x7fead00c7100 2023-09-13T08:25:30.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.413+0000 7fead528a700 1 -- 172.21.15.84:0/2449518351 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fead00c7580 con 0x7fead00c7100 2023-09-13T08:25:30.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.413+0000 7feab77fe700 1 -- 172.21.15.84:0/2449518351 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac000e6c0 con 0x7fead00c7100 2023-09-13T08:25:30.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.413+0000 7fead528a700 1 -- 172.21.15.84:0/2449518351 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fead00b0200 con 0x7fead00c7100 2023-09-13T08:25:30.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.414+0000 7fead528a700 1 -- 172.21.15.84:0/2449518351 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fead00cfe30 con 0x7fead00c7100 2023-09-13T08:25:30.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.414+0000 7feab77fe700 1 -- 172.21.15.84:0/2449518351 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7feac0025070 con 0x7fead00c7100 2023-09-13T08:25:30.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.415+0000 7feab77fe700 1 --2- 172.21.15.84:0/2449518351 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7feabc06a5b0 0x7feabc06ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:30.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.415+0000 7feab77fe700 1 -- 172.21.15.84:0/2449518351 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7feac008a2b0 con 0x7fead00c7100 2023-09-13T08:25:30.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.415+0000 7feaceffd700 1 --2- 172.21.15.84:0/2449518351 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7feabc06a5b0 0x7feabc06ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:30.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.415+0000 7feaceffd700 1 --2- 172.21.15.84:0/2449518351 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7feabc06a5b0 0x7feabc06ca70 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7feac40099c0 tx=0x7feac4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:30.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.419+0000 7feab77fe700 1 -- 172.21.15.84:0/2449518351 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7feac0055600 con 0x7fead00c7100 2023-09-13T08:25:30.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.612+0000 7fead528a700 1 -- 172.21.15.84:0/2449518351 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fead00d1180 con 0x7fead00c7100 2023-09-13T08:25:30.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.613+0000 7feab77fe700 1 -- 172.21.15.84:0/2449518351 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18757 (secure 0 0 0) 0x7feac0058c20 con 0x7fead00c7100 2023-09-13T08:25:30.613 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:25:30.613 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":26,"fsid":"0107440b-b634-42c5-a643-5d31ea826116","created":"2023-09-13T08:24:16.931917+0000","modified":"2023-09-13T08:25:23.878460+0000","last_up_change":"2023-09-13T08:24:28.422631+0000","last_in_change":"2023-09-13T08:24:19.425578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T08:24:28.583720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-13T08:24:39.862832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-13T08:24:41.145511+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-13T08:24:44.775160+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4a53ec12-1469-4356-b4e1-2b8fc9b7c0f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6817","nonce":1599532366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6819","nonce":1599532366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6823","nonce":1599532366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6821","nonce":1599532366}]},"public_addr":"172.21.15.84:6817/1599532366","cluster_addr":"172.21.15.84:6819/1599532366","heartbeat_back_addr":"172.21.15.84:6823/1599532366","heartbeat_front_addr":"172.21.15.84:6821/1599532366","state":["exists","up"]},{"osd":1,"uuid":"11e964a0-b80c-4afc-bfbf-e2067969db29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6825","nonce":461860977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6827","nonce":461860977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6831","nonce":461860977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6829","nonce":461860977}]},"public_addr":"172.21.15.84:6825/461860977","cluster_addr":"172.21.15.84:6827/461860977","heartbeat_back_addr":"172.21.15.84:6831/461860977","heartbeat_front_addr":"172.21.15.84:6829/461860977","state":["exists","up"]},{"osd":2,"uuid":"3ce74529-4dd1-44c7-9576-968f5fdc0c25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6809","nonce":1168316165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6811","nonce":1168316165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6815","nonce":1168316165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6813","nonce":1168316165}]},"public_addr":"172.21.15.84:6809/1168316165","cluster_addr":"172.21.15.84:6811/1168316165","heartbeat_back_addr":"172.21.15.84:6815/1168316165","heartbeat_front_addr":"172.21.15.84:6813/1168316165","state":["exists","up"]},{"osd":3,"uuid":"460cb5c5-590a-4d06-a4d9-5bac2fdf33b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6801","nonce":1661609810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6803","nonce":1661609810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6807","nonce":1661609810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6805","nonce":1661609810}]},"public_addr":"172.21.15.84:6801/1661609810","cluster_addr":"172.21.15.84:6803/1661609810","heartbeat_back_addr":"172.21.15.84:6807/1661609810","heartbeat_front_addr":"172.21.15.84:6805/1661609810","state":["exists","up"]},{"osd":4,"uuid":"bf237dd0-3ebd-44b5-8078-24a63e00d792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6801","nonce":1303562374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6803","nonce":1303562374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6807","nonce":1303562374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6805","nonce":1303562374}]},"public_addr":"172.21.15.161:6801/1303562374","cluster_addr":"172.21.15.161:6803/1303562374","heartbeat_back_addr":"172.21.15.161:6807/1303562374","heartbeat_front_addr":"172.21.15.161:6805/1303562374","state":["exists","up"]},{"osd":5,"uuid":"e1e538e0-5844-456b-8c6e-434d3a914af1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6818","nonce":961120854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6822","nonce":961120854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6830","nonce":961120854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6826","nonce":961120854}]},"public_addr":"172.21.15.161:6818/961120854","cluster_addr":"172.21.15.161:6822/961120854","heartbeat_back_addr":"172.21.15.161:6830/961120854","heartbeat_front_addr":"172.21.15.161:6826/961120854","state":["exists","up"]},{"osd":6,"uuid":"5cb1785e-960f-4dd4-b295-9e21b2c3f875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6809","nonce":980533466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6811","nonce":980533466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6815","nonce":980533466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6813","nonce":980533466}]},"public_addr":"172.21.15.161:6809/980533466","cluster_addr":"172.21.15.161:6811/980533466","heartbeat_back_addr":"172.21.15.161:6815/980533466","heartbeat_front_addr":"172.21.15.161:6813/980533466","state":["exists","up"]},{"osd":7,"uuid":"5acb6619-e933-4b46-b1c2-60af30acb839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6817","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6819","nonce":2479691549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6821","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6823","nonce":2479691549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6829","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6831","nonce":2479691549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6825","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6827","nonce":2479691549}]},"public_addr":"172.21.15.161:6819/2479691549","cluster_addr":"172.21.15.161:6823/2479691549","heartbeat_back_addr":"172.21.15.161:6831/2479691549","heartbeat_front_addr":"172.21.15.161:6827/2479691549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.678857+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.685341+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.613603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.634940+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.564387+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.697347+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.637437+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.619397+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":1}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T08:25:30.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.615+0000 7fead528a700 1 -- 172.21.15.84:0/2449518351 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7feabc06a5b0 msgr2=0x7feabc06ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:30.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.615+0000 7fead528a700 1 --2- 172.21.15.84:0/2449518351 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7feabc06a5b0 0x7feabc06ca70 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7feac40099c0 tx=0x7feac4008040 comp rx=0 tx=0).stop 2023-09-13T08:25:30.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.615+0000 7fead528a700 1 -- 172.21.15.84:0/2449518351 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fead00c7100 msgr2=0x7fead01516f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:30.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.615+0000 7fead528a700 1 --2- 172.21.15.84:0/2449518351 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fead00c7100 0x7fead01516f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7feac000e4b0 tx=0x7feac00047c0 comp rx=0 tx=0).stop 2023-09-13T08:25:30.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.615+0000 7fead528a700 1 -- 172.21.15.84:0/2449518351 shutdown_connections 2023-09-13T08:25:30.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.615+0000 7fead528a700 1 --2- 172.21.15.84:0/2449518351 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7feabc06a5b0 0x7feabc06ca70 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:30.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.615+0000 7fead528a700 1 --2- 172.21.15.84:0/2449518351 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fead00b0710 0x7fead00b0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:30.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.615+0000 7fead528a700 1 --2- 172.21.15.84:0/2449518351 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feab8004850 0x7fead00b25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:30.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.615+0000 7fead528a700 1 --2- 172.21.15.84:0/2449518351 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fead00c7100 0x7fead01516f0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:30.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.615+0000 7fead528a700 1 -- 172.21.15.84:0/2449518351 >> 172.21.15.84:0/2449518351 conn(0x7fead00ccab0 msgr2=0x7fead00cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:30.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.615+0000 7fead528a700 1 -- 172.21.15.84:0/2449518351 shutdown_connections 2023-09-13T08:25:30.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.615+0000 7fead528a700 1 -- 172.21.15.84:0/2449518351 wait complete. 2023-09-13T08:25:30.628 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T08:24:28.583720+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-13T08:24:39.862832+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-13T08:24:41.145511+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-09-13T08:24:44.775160+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-13T08:25:30.628 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T08:25:30.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.752+0000 7f9c0a1d4700 1 Processor -- start 2023-09-13T08:25:30.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.752+0000 7f9c0a1d4700 1 -- start start 2023-09-13T08:25:30.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.753+0000 7f9c0a1d4700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9c0415a170 0x7f9c0406e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:30.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.753+0000 7f9c0a1d4700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9c040cf910 0x7f9c0406ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:30.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.753+0000 7f9c0a1d4700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9c0406f1c0 0x7f9c0415dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:30.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.753+0000 7f9c0a1d4700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c040cfe40 con 0x7f9c0406f1c0 2023-09-13T08:25:30.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.753+0000 7f9c0a1d4700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c0415a550 con 0x7f9c040cf910 2023-09-13T08:25:30.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.753+0000 7f9c0a1d4700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c040cf4c0 con 0x7f9c0415a170 2023-09-13T08:25:30.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.753+0000 7f9c03fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9c0406f1c0 0x7f9c0415dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:30.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.753+0000 7f9c03fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9c0406f1c0 0x7f9c0415dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44692/0 (socket says 172.21.15.84:44692) 2023-09-13T08:25:30.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.753+0000 7f9c03fff700 1 -- 172.21.15.84:0/2131618888 learned_addr learned my addr 172.21.15.84:0/2131618888 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:30.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.753+0000 7f9c037fe700 1 --2- 172.21.15.84:0/2131618888 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9c0415a170 0x7f9c0406e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:30.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.753+0000 7f9c02ffd700 1 --2- 172.21.15.84:0/2131618888 >> v2:172.21.15.161:3300/0 conn(0x7f9c040cf910 0x7f9c0406ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:30.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.754+0000 7f9c03fff700 1 -- 172.21.15.84:0/2131618888 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9c0415a170 msgr2=0x7f9c0406e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:30.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.754+0000 7f9c03fff700 1 --2- 172.21.15.84:0/2131618888 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9c0415a170 0x7f9c0406e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:30.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.754+0000 7f9c03fff700 1 -- 172.21.15.84:0/2131618888 >> v2:172.21.15.161:3300/0 conn(0x7f9c040cf910 msgr2=0x7f9c0406ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:30.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.754+0000 7f9c03fff700 1 --2- 172.21.15.84:0/2131618888 >> v2:172.21.15.161:3300/0 conn(0x7f9c040cf910 0x7f9c0406ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:30.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.754+0000 7f9c03fff700 1 -- 172.21.15.84:0/2131618888 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c040ce700 con 0x7f9c0406f1c0 2023-09-13T08:25:30.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.754+0000 7f9c03fff700 1 --2- 172.21.15.84:0/2131618888 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c0406f1c0 0x7f9c0415dc50 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f9c040b2bd0 tx=0x7f9bfc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12639463c5b8656c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:30.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.754+0000 7f9c027fc700 1 -- 172.21.15.84:0/2131618888 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bfc00e070 con 0x7f9c0406f1c0 2023-09-13T08:25:30.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.754+0000 7f9c027fc700 1 -- 172.21.15.84:0/2131618888 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bfc00b910 con 0x7f9c0406f1c0 2023-09-13T08:25:30.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.754+0000 7f9c027fc700 1 -- 172.21.15.84:0/2131618888 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bfc00bcc0 con 0x7f9c0406f1c0 2023-09-13T08:25:30.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.755+0000 7f9c0a1d4700 1 -- 172.21.15.84:0/2131618888 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c0406f1c0 msgr2=0x7f9c0415dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:30.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.755+0000 7f9c0a1d4700 1 --2- 172.21.15.84:0/2131618888 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c0406f1c0 0x7f9c0415dc50 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f9c040b2bd0 tx=0x7f9bfc00b330 comp rx=0 tx=0).stop 2023-09-13T08:25:30.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.755+0000 7f9c0a1d4700 1 -- 172.21.15.84:0/2131618888 shutdown_connections 2023-09-13T08:25:30.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.755+0000 7f9c0a1d4700 1 --2- 172.21.15.84:0/2131618888 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c0406f1c0 0x7f9c0415dc50 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:30.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.755+0000 7f9c0a1d4700 1 --2- 172.21.15.84:0/2131618888 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9c0415a170 0x7f9c0406e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:30.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.755+0000 7f9c0a1d4700 1 --2- 172.21.15.84:0/2131618888 >> v2:172.21.15.161:3300/0 conn(0x7f9c040cf910 0x7f9c0406ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:30.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.755+0000 7f9c0a1d4700 1 -- 172.21.15.84:0/2131618888 >> 172.21.15.84:0/2131618888 conn(0x7f9c040cca70 msgr2=0x7f9c040cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:30.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.755+0000 7f9c0a1d4700 1 -- 172.21.15.84:0/2131618888 shutdown_connections 2023-09-13T08:25:30.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.755+0000 7f9c0a1d4700 1 -- 172.21.15.84:0/2131618888 wait complete. 2023-09-13T08:25:30.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.756+0000 7f9c0a1d4700 1 Processor -- start 2023-09-13T08:25:30.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.756+0000 7f9c0a1d4700 1 -- start start 2023-09-13T08:25:30.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.757+0000 7f9c0a1d4700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c0406f1c0 0x7f9c042023b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:30.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.757+0000 7f9c0a1d4700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9c040cf910 0x7f9c0406a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:30.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.757+0000 7f9c0a1d4700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9c0415a170 0x7f9c0406ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:30.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.757+0000 7f9c0a1d4700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c040c9ec0 con 0x7f9c0406f1c0 2023-09-13T08:25:30.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.757+0000 7f9c0a1d4700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c040ca160 con 0x7f9c0415a170 2023-09-13T08:25:30.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.757+0000 7f9c0a1d4700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c040c8a20 con 0x7f9c040cf910 2023-09-13T08:25:30.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.757+0000 7f9c037fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c0406f1c0 0x7f9c042023b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:30.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.757+0000 7f9c037fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c0406f1c0 0x7f9c042023b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44694/0 (socket says 172.21.15.84:44694) 2023-09-13T08:25:30.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.757+0000 7f9c037fe700 1 -- 172.21.15.84:0/853501236 learned_addr learned my addr 172.21.15.84:0/853501236 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:30.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.757+0000 7f9c02ffd700 1 --2- 172.21.15.84:0/853501236 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9c040cf910 0x7f9c0406a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:30.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.757+0000 7f9c03fff700 1 --2- 172.21.15.84:0/853501236 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9c0415a170 0x7f9c0406ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:30.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.758+0000 7f9c037fe700 1 -- 172.21.15.84:0/853501236 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9c040cf910 msgr2=0x7f9c0406a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:30.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.758+0000 7f9c037fe700 1 --2- 172.21.15.84:0/853501236 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9c040cf910 0x7f9c0406a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:30.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.758+0000 7f9c037fe700 1 -- 172.21.15.84:0/853501236 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9c0415a170 msgr2=0x7f9c0406ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:30.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.758+0000 7f9c037fe700 1 --2- 172.21.15.84:0/853501236 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9c0415a170 0x7f9c0406ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:30.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.758+0000 7f9c037fe700 1 -- 172.21.15.84:0/853501236 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bfc009b30 con 0x7f9c0406f1c0 2023-09-13T08:25:30.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.758+0000 7f9c037fe700 1 --2- 172.21.15.84:0/853501236 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c0406f1c0 0x7f9c042023b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f9bf400e870 tx=0x7f9bf400eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:30.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.758+0000 7f9bebfff700 1 -- 172.21.15.84:0/853501236 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf4009590 con 0x7f9c0406f1c0 2023-09-13T08:25:30.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.758+0000 7f9bebfff700 1 -- 172.21.15.84:0/853501236 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bf4013680 con 0x7f9c0406f1c0 2023-09-13T08:25:30.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.758+0000 7f9c0a1d4700 1 -- 172.21.15.84:0/853501236 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c040ca400 con 0x7f9c0406f1c0 2023-09-13T08:25:30.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.758+0000 7f9bebfff700 1 -- 172.21.15.84:0/853501236 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf40139f0 con 0x7f9c0406f1c0 2023-09-13T08:25:30.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.758+0000 7f9c0a1d4700 1 -- 172.21.15.84:0/853501236 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c040ca9c0 con 0x7f9c0406f1c0 2023-09-13T08:25:30.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.759+0000 7f9c0a1d4700 1 -- 172.21.15.84:0/853501236 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c0404f200 con 0x7f9c0406f1c0 2023-09-13T08:25:30.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.760+0000 7f9bebfff700 1 -- 172.21.15.84:0/853501236 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f9bf4013b50 con 0x7f9c0406f1c0 2023-09-13T08:25:30.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.760+0000 7f9bebfff700 1 --2- 172.21.15.84:0/853501236 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f9bf006a580 0x7f9bf006ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:30.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.760+0000 7f9bebfff700 1 -- 172.21.15.84:0/853501236 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f9bf4088b70 con 0x7f9c0406f1c0 2023-09-13T08:25:30.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.760+0000 7f9c02ffd700 1 --2- 172.21.15.84:0/853501236 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f9bf006a580 0x7f9bf006ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:30.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.760+0000 7f9c02ffd700 1 --2- 172.21.15.84:0/853501236 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f9bf006a580 0x7f9bf006ca40 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9c0415cc60 tx=0x7f9bf8009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:30.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.765+0000 7f9bebfff700 1 -- 172.21.15.84:0/853501236 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f9bf4053da0 con 0x7f9c0406f1c0 2023-09-13T08:25:30.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.954+0000 7f9c0a1d4700 1 -- 172.21.15.84:0/853501236 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9c040cc850 con 0x7f9c0406f1c0 2023-09-13T08:25:30.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.954+0000 7f9bebfff700 1 -- 172.21.15.84:0/853501236 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9bf40210a0 con 0x7f9c0406f1c0 2023-09-13T08:25:30.955 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-09-13T08:25:30.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.956+0000 7f9c0a1d4700 1 -- 172.21.15.84:0/853501236 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f9bf006a580 msgr2=0x7f9bf006ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:30.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.956+0000 7f9c0a1d4700 1 --2- 172.21.15.84:0/853501236 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f9bf006a580 0x7f9bf006ca40 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9c0415cc60 tx=0x7f9bf8009210 comp rx=0 tx=0).stop 2023-09-13T08:25:30.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.956+0000 7f9c0a1d4700 1 -- 172.21.15.84:0/853501236 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c0406f1c0 msgr2=0x7f9c042023b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:30.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.956+0000 7f9c0a1d4700 1 --2- 172.21.15.84:0/853501236 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c0406f1c0 0x7f9c042023b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f9bf400e870 tx=0x7f9bf400eb80 comp rx=0 tx=0).stop 2023-09-13T08:25:30.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.956+0000 7f9c0a1d4700 1 -- 172.21.15.84:0/853501236 shutdown_connections 2023-09-13T08:25:30.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.956+0000 7f9c0a1d4700 1 --2- 172.21.15.84:0/853501236 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f9bf006a580 0x7f9bf006ca40 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:30.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.956+0000 7f9c0a1d4700 1 --2- 172.21.15.84:0/853501236 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9c0415a170 0x7f9c0406ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:30.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.956+0000 7f9c0a1d4700 1 --2- 172.21.15.84:0/853501236 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c0406f1c0 0x7f9c042023b0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:30.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.956+0000 7f9c0a1d4700 1 --2- 172.21.15.84:0/853501236 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9c040cf910 0x7f9c0406a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:30.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.956+0000 7f9c0a1d4700 1 -- 172.21.15.84:0/853501236 >> 172.21.15.84:0/853501236 conn(0x7f9c040cca70 msgr2=0x7f9c040af990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:30.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.957+0000 7f9c0a1d4700 1 -- 172.21.15.84:0/853501236 shutdown_connections 2023-09-13T08:25:30.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:30.957+0000 7f9c0a1d4700 1 -- 172.21.15.84:0/853501236 wait complete. 2023-09-13T08:25:30.968 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-13T08:25:31.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.091+0000 7fc86b225700 1 Processor -- start 2023-09-13T08:25:31.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.091+0000 7fc86b225700 1 -- start start 2023-09-13T08:25:31.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.092+0000 7fc86b225700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc8640cd590 0x7fc8640cf570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:31.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.092+0000 7fc86b225700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc86415e480 con 0x7fc8640ca8e0 2023-09-13T08:25:31.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.092+0000 7fc86b225700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8640cfbe0 con 0x7fc86415e910 2023-09-13T08:25:31.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.092+0000 7fc86b225700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc86415de30 con 0x7fc8640cd590 2023-09-13T08:25:31.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.092+0000 7fc868fc1700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fc8640ca8e0 0x7fc8640cacc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:47348/0 (socket says 172.21.15.84:47348) 2023-09-13T08:25:31.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.092+0000 7fc868fc1700 1 -- 172.21.15.84:0/3553904674 learned_addr learned my addr 172.21.15.84:0/3553904674 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:25:31.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.092+0000 7fc8697c2700 1 --2- 172.21.15.84:0/3553904674 >> v2:172.21.15.161:3300/0 conn(0x7fc8640cd590 0x7fc8640cf570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:31.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.092+0000 7fc8637fe700 1 -- 172.21.15.84:0/3553904674 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3080122245 0 0) 0x7fc86415e480 con 0x7fc8640ca8e0 2023-09-13T08:25:31.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.093+0000 7fc8637fe700 1 -- 172.21.15.84:0/3553904674 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8540035b0 con 0x7fc8640ca8e0 2023-09-13T08:25:31.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.093+0000 7fc8637fe700 1 -- 172.21.15.84:0/3553904674 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4175405693 0 0) 0x7fc8540035b0 con 0x7fc8640ca8e0 2023-09-13T08:25:31.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.093+0000 7fc8637fe700 1 -- 172.21.15.84:0/3553904674 >> v2:172.21.15.161:3300/0 conn(0x7fc8640cd590 msgr2=0x7fc8640cf570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:31.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.093+0000 7fc8637fe700 1 --2- 172.21.15.84:0/3553904674 >> v2:172.21.15.161:3300/0 conn(0x7fc8640cd590 0x7fc8640cf570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:31.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.093+0000 7fc8637fe700 1 -- 172.21.15.84:0/3553904674 >> v1:172.21.15.161:6789/0 conn(0x7fc86415e910 legacy=0x7fc8640cdbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:31.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.093+0000 7fc8637fe700 1 -- 172.21.15.84:0/3553904674 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc86415e110 con 0x7fc8640ca8e0 2023-09-13T08:25:31.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.093+0000 7fc8637fe700 1 -- 172.21.15.84:0/3553904674 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2302733408 0 0) 0x7fc858001670 con 0x7fc8640ca8e0 2023-09-13T08:25:31.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.093+0000 7fc8637fe700 1 -- 172.21.15.84:0/3553904674 >> v1:172.21.15.84:6789/0 conn(0x7fc8640ca8e0 legacy=0x7fc8640cacc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:31.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.093+0000 7fc8637fe700 1 --2- 172.21.15.84:0/3553904674 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc854003a00 0x7fc854003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:31.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.093+0000 7fc8637fe700 1 --2- 172.21.15.84:0/3553904674 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc854004850 0x7fc854004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:31.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.093+0000 7fc8637fe700 1 --2- 172.21.15.84:0/3553904674 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc854005210 0x7fc85400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:31.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.093+0000 7fc8637fe700 1 -- 172.21.15.84:0/3553904674 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc86415de30 con 0x7fc854005210 2023-09-13T08:25:31.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.093+0000 7fc8637fe700 1 -- 172.21.15.84:0/3553904674 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc85400c1b0 con 0x7fc854003a00 2023-09-13T08:25:31.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.093+0000 7fc8637fe700 1 -- 172.21.15.84:0/3553904674 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc85400c370 con 0x7fc854004850 2023-09-13T08:25:31.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.093+0000 7fc8697c2700 1 --2- 172.21.15.84:0/3553904674 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc854005210 0x7fc85400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:31.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.093+0000 7fc868fc1700 1 --2- 172.21.15.84:0/3553904674 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc854003a00 0x7fc854003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:31.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.093+0000 7fc863fff700 1 --2- 172.21.15.84:0/3553904674 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc854004850 0x7fc854004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:31.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.093+0000 7fc8697c2700 1 -- 172.21.15.84:0/3553904674 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc854004850 msgr2=0x7fc854004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:31.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.093+0000 7fc8697c2700 1 --2- 172.21.15.84:0/3553904674 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc854004850 0x7fc854004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:31.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.093+0000 7fc8697c2700 1 -- 172.21.15.84:0/3553904674 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc854003a00 msgr2=0x7fc854003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:31.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.093+0000 7fc8697c2700 1 --2- 172.21.15.84:0/3553904674 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc854003a00 0x7fc854003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:31.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.093+0000 7fc8697c2700 1 -- 172.21.15.84:0/3553904674 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8540035b0 con 0x7fc854005210 2023-09-13T08:25:31.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.093+0000 7fc8697c2700 1 -- 172.21.15.84:0/3553904674 reap_dead start 2023-09-13T08:25:31.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.093+0000 7fc8697c2700 1 --2- 172.21.15.84:0/3553904674 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc854005210 0x7fc85400ba10 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fc85c009fc0 tx=0x7fc854005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85eaf0526ee60442 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:31.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.094+0000 7fc8637fe700 1 -- 172.21.15.84:0/3553904674 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc85c003a20 con 0x7fc854005210 2023-09-13T08:25:31.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.094+0000 7fc8637fe700 1 -- 172.21.15.84:0/3553904674 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc85c00f040 con 0x7fc854005210 2023-09-13T08:25:31.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.094+0000 7fc8637fe700 1 -- 172.21.15.84:0/3553904674 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc85c003de0 con 0x7fc854005210 2023-09-13T08:25:31.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.094+0000 7fc86b225700 1 -- 172.21.15.84:0/3553904674 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc854005210 msgr2=0x7fc85400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:31.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.094+0000 7fc86b225700 1 --2- 172.21.15.84:0/3553904674 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc854005210 0x7fc85400ba10 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fc85c009fc0 tx=0x7fc854005880 comp rx=0 tx=0).stop 2023-09-13T08:25:31.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.094+0000 7fc86b225700 1 -- 172.21.15.84:0/3553904674 shutdown_connections 2023-09-13T08:25:31.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.094+0000 7fc86b225700 1 --2- 172.21.15.84:0/3553904674 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc854005210 0x7fc85400ba10 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:31.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.094+0000 7fc86b225700 1 -- 172.21.15.84:0/3553904674 >> 172.21.15.84:0/3553904674 conn(0x7fc8640cca70 msgr2=0x7fc8640cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:31.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.094+0000 7fc86b225700 1 -- 172.21.15.84:0/3553904674 shutdown_connections 2023-09-13T08:25:31.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.094+0000 7fc86b225700 1 -- 172.21.15.84:0/3553904674 wait complete. 2023-09-13T08:25:31.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.095+0000 7fc86b225700 1 Processor -- start 2023-09-13T08:25:31.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.095+0000 7fc86b225700 1 -- start start 2023-09-13T08:25:31.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.096+0000 7fc86b225700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc854005210 0x7fc8641f2a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:31.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.096+0000 7fc86b225700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc8640b4b00 0x7fc86415b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:31.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.096+0000 7fc86b225700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc8640b4170 0x7fc86415ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:31.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.096+0000 7fc86b225700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8640b5030 con 0x7fc8640b4b00 2023-09-13T08:25:31.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.096+0000 7fc86b225700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8640b5310 con 0x7fc854005210 2023-09-13T08:25:31.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.096+0000 7fc86b225700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8640b55f0 con 0x7fc8640b4170 2023-09-13T08:25:31.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.096+0000 7fc863fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc8640b4b00 0x7fc86415b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:31.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.096+0000 7fc863fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc8640b4b00 0x7fc86415b500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44714/0 (socket says 172.21.15.84:44714) 2023-09-13T08:25:31.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.096+0000 7fc863fff700 1 -- 172.21.15.84:0/2059366533 learned_addr learned my addr 172.21.15.84:0/2059366533 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:31.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.096+0000 7fc868fc1700 1 --2- 172.21.15.84:0/2059366533 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc854005210 0x7fc8641f2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:31.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.096+0000 7fc8697c2700 1 --2- 172.21.15.84:0/2059366533 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc8640b4170 0x7fc86415ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:31.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.097+0000 7fc863fff700 1 -- 172.21.15.84:0/2059366533 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc8640b4170 msgr2=0x7fc86415ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:31.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.097+0000 7fc863fff700 1 --2- 172.21.15.84:0/2059366533 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc8640b4170 0x7fc86415ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:31.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.097+0000 7fc863fff700 1 -- 172.21.15.84:0/2059366533 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc854005210 msgr2=0x7fc8641f2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:31.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.097+0000 7fc863fff700 1 --2- 172.21.15.84:0/2059366533 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc854005210 0x7fc8641f2a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:31.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.097+0000 7fc863fff700 1 -- 172.21.15.84:0/2059366533 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8640b58d0 con 0x7fc8640b4b00 2023-09-13T08:25:31.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.097+0000 7fc863fff700 1 --2- 172.21.15.84:0/2059366533 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc8640b4b00 0x7fc86415b500 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fc850001eb0 tx=0x7fc85000f950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:31.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.097+0000 7fc8617fa700 1 -- 172.21.15.84:0/2059366533 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8500053e0 con 0x7fc8640b4b00 2023-09-13T08:25:31.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.097+0000 7fc8617fa700 1 -- 172.21.15.84:0/2059366533 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc850005540 con 0x7fc8640b4b00 2023-09-13T08:25:31.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.097+0000 7fc8617fa700 1 -- 172.21.15.84:0/2059366533 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc850006aa0 con 0x7fc8640b4b00 2023-09-13T08:25:31.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.097+0000 7fc86b225700 1 -- 172.21.15.84:0/2059366533 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8640ae050 con 0x7fc8640b4b00 2023-09-13T08:25:31.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.097+0000 7fc86b225700 1 -- 172.21.15.84:0/2059366533 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8640b2e30 con 0x7fc8640b4b00 2023-09-13T08:25:31.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.098+0000 7fc86b225700 1 -- 172.21.15.84:0/2059366533 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc86404f200 con 0x7fc8640b4b00 2023-09-13T08:25:31.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.098+0000 7fc8617fa700 1 -- 172.21.15.84:0/2059366533 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fc850006c00 con 0x7fc8640b4b00 2023-09-13T08:25:31.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.099+0000 7fc8617fa700 1 --2- 172.21.15.84:0/2059366533 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fc84806a5b0 0x7fc84806ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:31.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.099+0000 7fc8617fa700 1 -- 172.21.15.84:0/2059366533 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fc850088290 con 0x7fc8640b4b00 2023-09-13T08:25:31.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.099+0000 7fc868fc1700 1 --2- 172.21.15.84:0/2059366533 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fc84806a5b0 0x7fc84806ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:31.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.099+0000 7fc868fc1700 1 --2- 172.21.15.84:0/2059366533 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fc84806a5b0 0x7fc84806ca70 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc858000fb0 tx=0x7fc858009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:31.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.103+0000 7fc8617fa700 1 -- 172.21.15.84:0/2059366533 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fc850053420 con 0x7fc8640b4b00 2023-09-13T08:25:31.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.292+0000 7fc86b225700 1 -- 172.21.15.84:0/2059366533 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc864071ef0 con 0x7fc8640b4b00 2023-09-13T08:25:31.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.292+0000 7fc8617fa700 1 -- 172.21.15.84:0/2059366533 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc850056a40 con 0x7fc8640b4b00 2023-09-13T08:25:31.294 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-09-13T08:25:31.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.294+0000 7fc86b225700 1 -- 172.21.15.84:0/2059366533 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fc84806a5b0 msgr2=0x7fc84806ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:31.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.294+0000 7fc86b225700 1 --2- 172.21.15.84:0/2059366533 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fc84806a5b0 0x7fc84806ca70 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc858000fb0 tx=0x7fc858009040 comp rx=0 tx=0).stop 2023-09-13T08:25:31.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.294+0000 7fc86b225700 1 -- 172.21.15.84:0/2059366533 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc8640b4b00 msgr2=0x7fc86415b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:31.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.294+0000 7fc86b225700 1 --2- 172.21.15.84:0/2059366533 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc8640b4b00 0x7fc86415b500 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fc850001eb0 tx=0x7fc85000f950 comp rx=0 tx=0).stop 2023-09-13T08:25:31.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.294+0000 7fc86b225700 1 -- 172.21.15.84:0/2059366533 shutdown_connections 2023-09-13T08:25:31.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.294+0000 7fc86b225700 1 --2- 172.21.15.84:0/2059366533 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc8640b4170 0x7fc86415ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:31.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.294+0000 7fc86b225700 1 --2- 172.21.15.84:0/2059366533 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fc84806a5b0 0x7fc84806ca70 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:31.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.294+0000 7fc86b225700 1 --2- 172.21.15.84:0/2059366533 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc854005210 0x7fc8641f2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:31.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.294+0000 7fc86b225700 1 --2- 172.21.15.84:0/2059366533 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc8640b4b00 0x7fc86415b500 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:31.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.294+0000 7fc86b225700 1 -- 172.21.15.84:0/2059366533 >> 172.21.15.84:0/2059366533 conn(0x7fc8640cca70 msgr2=0x7fc8640cdbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:31.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.294+0000 7fc86b225700 1 -- 172.21.15.84:0/2059366533 shutdown_connections 2023-09-13T08:25:31.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.295+0000 7fc86b225700 1 -- 172.21.15.84:0/2059366533 wait complete. 2023-09-13T08:25:31.307 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-13T08:25:31.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.430+0000 7f1043aaa700 1 Processor -- start 2023-09-13T08:25:31.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.430+0000 7f1043aaa700 1 -- start start 2023-09-13T08:25:31.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.431+0000 7f1043aaa700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f103c162fd0 0x7f103c1653c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:31.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.431+0000 7f1043aaa700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f103c0cfe40 con 0x7f103c0cf910 2023-09-13T08:25:31.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.431+0000 7f1043aaa700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f103c15a550 con 0x7f103c15a170 2023-09-13T08:25:31.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.431+0000 7f1043aaa700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f103c0cf4c0 con 0x7f103c162fd0 2023-09-13T08:25:31.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.431+0000 7f1042047700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f103c162fd0 0x7f103c1653c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:31.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.431+0000 7f1041045700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f103c0cf910 0x7f103c06ee50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:47368/0 (socket says 172.21.15.84:47368) 2023-09-13T08:25:31.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.431+0000 7f1041045700 1 -- 172.21.15.84:0/1510930462 learned_addr learned my addr 172.21.15.84:0/1510930462 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:25:31.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.432+0000 7f1042047700 1 -- 172.21.15.84:0/1510930462 >> v1:172.21.15.161:6789/0 conn(0x7f103c15a170 legacy=0x7f103c06e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:31.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.432+0000 7f1042047700 1 -- 172.21.15.84:0/1510930462 >> v1:172.21.15.84:6789/0 conn(0x7f103c0cf910 legacy=0x7f103c06ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:31.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.432+0000 7f1040844700 1 -- 172.21.15.84:0/1510930462 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2082193579 0 0) 0x7f103c0cfe40 con 0x7f103c0cf910 2023-09-13T08:25:31.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.432+0000 7f1042047700 1 -- 172.21.15.84:0/1510930462 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f103c06f560 con 0x7f103c162fd0 2023-09-13T08:25:31.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.432+0000 7f1042047700 1 --2- 172.21.15.84:0/1510930462 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f103c162fd0 0x7f103c1653c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f1034009d90 tx=0x7f103400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93a046c8308f30c8 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:31.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.432+0000 7f1040844700 1 -- 172.21.15.84:0/1510930462 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f103400e070 con 0x7f103c162fd0 2023-09-13T08:25:31.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.432+0000 7f1040844700 1 -- 172.21.15.84:0/1510930462 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f103400bbd0 con 0x7f103c162fd0 2023-09-13T08:25:31.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.432+0000 7f1040844700 1 -- 172.21.15.84:0/1510930462 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1034012430 con 0x7f103c162fd0 2023-09-13T08:25:31.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.433+0000 7f1043aaa700 1 -- 172.21.15.84:0/1510930462 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f103c162fd0 msgr2=0x7f103c1653c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:31.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.433+0000 7f1043aaa700 1 --2- 172.21.15.84:0/1510930462 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f103c162fd0 0x7f103c1653c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f1034009d90 tx=0x7f103400b330 comp rx=0 tx=0).stop 2023-09-13T08:25:31.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.433+0000 7f1043aaa700 1 -- 172.21.15.84:0/1510930462 shutdown_connections 2023-09-13T08:25:31.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.433+0000 7f1043aaa700 1 --2- 172.21.15.84:0/1510930462 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f103c162fd0 0x7f103c1653c0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:31.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.433+0000 7f1043aaa700 1 -- 172.21.15.84:0/1510930462 >> 172.21.15.84:0/1510930462 conn(0x7f103c0cca70 msgr2=0x7f103c0cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:31.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.433+0000 7f1043aaa700 1 -- 172.21.15.84:0/1510930462 shutdown_connections 2023-09-13T08:25:31.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.433+0000 7f1043aaa700 1 -- 172.21.15.84:0/1510930462 wait complete. 2023-09-13T08:25:31.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.434+0000 7f1043aaa700 1 Processor -- start 2023-09-13T08:25:31.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.434+0000 7f1043aaa700 1 -- start start 2023-09-13T08:25:31.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.435+0000 7f1043aaa700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f103c0cf910 0x7f103c1ef250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:31.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.435+0000 7f1043aaa700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f103c15a170 0x7f103c158e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:31.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.435+0000 7f1043aaa700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f103c162fd0 0x7f103c159370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:31.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.435+0000 7f1043aaa700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f103c1f07d0 con 0x7f103c0cf910 2023-09-13T08:25:31.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.435+0000 7f1043aaa700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f103c1efbc0 con 0x7f103c162fd0 2023-09-13T08:25:31.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.435+0000 7f1043aaa700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f103c1efea0 con 0x7f103c15a170 2023-09-13T08:25:31.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.435+0000 7f1041846700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f103c0cf910 0x7f103c1ef250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:31.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.435+0000 7f1041846700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f103c0cf910 0x7f103c1ef250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44726/0 (socket says 172.21.15.84:44726) 2023-09-13T08:25:31.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.435+0000 7f1041846700 1 -- 172.21.15.84:0/43311479 learned_addr learned my addr 172.21.15.84:0/43311479 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:31.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.435+0000 7f1041045700 1 --2- 172.21.15.84:0/43311479 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f103c15a170 0x7f103c158e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:31.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.435+0000 7f1042047700 1 --2- 172.21.15.84:0/43311479 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f103c162fd0 0x7f103c159370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:31.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.435+0000 7f1041846700 1 -- 172.21.15.84:0/43311479 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f103c15a170 msgr2=0x7f103c158e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:31.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.435+0000 7f1041846700 1 --2- 172.21.15.84:0/43311479 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f103c15a170 0x7f103c158e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:31.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.435+0000 7f1041846700 1 -- 172.21.15.84:0/43311479 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f103c162fd0 msgr2=0x7f103c159370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:31.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.435+0000 7f1041846700 1 --2- 172.21.15.84:0/43311479 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f103c162fd0 0x7f103c159370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:31.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.435+0000 7f1041846700 1 -- 172.21.15.84:0/43311479 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1034009a70 con 0x7f103c0cf910 2023-09-13T08:25:31.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.435+0000 7f1042047700 1 --2- 172.21.15.84:0/43311479 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f103c162fd0 0x7f103c159370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T08:25:31.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.435+0000 7f1041846700 1 --2- 172.21.15.84:0/43311479 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f103c0cf910 0x7f103c1ef250 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f102c00c4e0 tx=0x7f102c00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:31.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.435+0000 7f10327fc700 1 -- 172.21.15.84:0/43311479 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f102c0052d0 con 0x7f103c0cf910 2023-09-13T08:25:31.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.435+0000 7f10327fc700 1 -- 172.21.15.84:0/43311479 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f102c005430 con 0x7f103c0cf910 2023-09-13T08:25:31.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.435+0000 7f1043aaa700 1 -- 172.21.15.84:0/43311479 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f103c1f0180 con 0x7f103c0cf910 2023-09-13T08:25:31.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.435+0000 7f10327fc700 1 -- 172.21.15.84:0/43311479 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f102c0038c0 con 0x7f103c0cf910 2023-09-13T08:25:31.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.435+0000 7f1043aaa700 1 -- 172.21.15.84:0/43311479 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f103c14bcd0 con 0x7f103c0cf910 2023-09-13T08:25:31.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.436+0000 7f1043aaa700 1 -- 172.21.15.84:0/43311479 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f103c04f200 con 0x7f103c0cf910 2023-09-13T08:25:31.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.437+0000 7f10327fc700 1 -- 172.21.15.84:0/43311479 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f102c003a20 con 0x7f103c0cf910 2023-09-13T08:25:31.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.437+0000 7f10327fc700 1 --2- 172.21.15.84:0/43311479 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f102006a580 0x7f102006ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:31.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.437+0000 7f10327fc700 1 -- 172.21.15.84:0/43311479 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f102c088310 con 0x7f103c0cf910 2023-09-13T08:25:31.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.437+0000 7f1041045700 1 --2- 172.21.15.84:0/43311479 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f102006a580 0x7f102006ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:31.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.438+0000 7f1041045700 1 --2- 172.21.15.84:0/43311479 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f102006a580 0x7f102006ca40 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1038007fd0 tx=0x7f1038007c20 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:31.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.442+0000 7f10327fc700 1 -- 172.21.15.84:0/43311479 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f102c0534b0 con 0x7f103c0cf910 2023-09-13T08:25:31.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.631+0000 7f1043aaa700 1 -- 172.21.15.84:0/43311479 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f103c149b20 con 0x7f103c0cf910 2023-09-13T08:25:31.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.632+0000 7f10327fc700 1 -- 172.21.15.84:0/43311479 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f102c056ad0 con 0x7f103c0cf910 2023-09-13T08:25:31.632 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-09-13T08:25:31.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.633+0000 7f1043aaa700 1 -- 172.21.15.84:0/43311479 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f102006a580 msgr2=0x7f102006ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:31.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.633+0000 7f1043aaa700 1 --2- 172.21.15.84:0/43311479 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f102006a580 0x7f102006ca40 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1038007fd0 tx=0x7f1038007c20 comp rx=0 tx=0).stop 2023-09-13T08:25:31.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.633+0000 7f1043aaa700 1 -- 172.21.15.84:0/43311479 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f103c0cf910 msgr2=0x7f103c1ef250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:31.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.633+0000 7f1043aaa700 1 --2- 172.21.15.84:0/43311479 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f103c0cf910 0x7f103c1ef250 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f102c00c4e0 tx=0x7f102c00c8a0 comp rx=0 tx=0).stop 2023-09-13T08:25:31.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.634+0000 7f1043aaa700 1 -- 172.21.15.84:0/43311479 shutdown_connections 2023-09-13T08:25:31.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.634+0000 7f1043aaa700 1 --2- 172.21.15.84:0/43311479 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f102006a580 0x7f102006ca40 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:31.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.634+0000 7f1043aaa700 1 --2- 172.21.15.84:0/43311479 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f103c162fd0 0x7f103c159370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:31.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.634+0000 7f1043aaa700 1 --2- 172.21.15.84:0/43311479 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f103c0cf910 0x7f103c1ef250 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:31.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.634+0000 7f1043aaa700 1 --2- 172.21.15.84:0/43311479 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f103c15a170 0x7f103c158e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:31.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.634+0000 7f1043aaa700 1 -- 172.21.15.84:0/43311479 >> 172.21.15.84:0/43311479 conn(0x7f103c0cca70 msgr2=0x7f103c0b3580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:31.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.634+0000 7f1043aaa700 1 -- 172.21.15.84:0/43311479 shutdown_connections 2023-09-13T08:25:31.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.634+0000 7f1043aaa700 1 -- 172.21.15.84:0/43311479 wait complete. 2023-09-13T08:25:31.646 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-09-13T08:25:31.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.771+0000 7fbcc9e9c700 1 Processor -- start 2023-09-13T08:25:31.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.771+0000 7fbcc9e9c700 1 -- start start 2023-09-13T08:25:31.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.771+0000 7fbcc9e9c700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fbcc415e910 0x7fbcc40cf570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:31.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.771+0000 7fbcc9e9c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fbcc40cd590 0x7fbcc40cdbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:31.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.771+0000 7fbcc9e9c700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcc415e480 con 0x7fbcc40ca8e0 2023-09-13T08:25:31.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.771+0000 7fbcc9e9c700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcc40cfbe0 con 0x7fbcc40cd590 2023-09-13T08:25:31.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.771+0000 7fbcc9e9c700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcc415de30 con 0x7fbcc415e910 2023-09-13T08:25:31.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.772+0000 7fbcc3fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fbcc40cd590 0x7fbcc40cdbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:31.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.772+0000 7fbcc37fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fbcc40ca8e0 0x7fbcc40cacc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:47380/0 (socket says 172.21.15.84:47380) 2023-09-13T08:25:31.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.772+0000 7fbcc3fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fbcc40cd590 0x7fbcc40cdbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44738/0 (socket says 172.21.15.84:44738) 2023-09-13T08:25:31.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.772+0000 7fbcc37fe700 1 -- 172.21.15.84:0/54901374 learned_addr learned my addr 172.21.15.84:0/54901374 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:25:31.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.772+0000 7fbcc3fff700 1 -- 172.21.15.84:0/54901374 >> v2:172.21.15.161:3300/0 conn(0x7fbcc415e910 msgr2=0x7fbcc40cf570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:31.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.772+0000 7fbcc2ffd700 1 --2- 172.21.15.84:0/54901374 >> v2:172.21.15.161:3300/0 conn(0x7fbcc415e910 0x7fbcc40cf570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:31.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.772+0000 7fbcc3fff700 1 --2- 172.21.15.84:0/54901374 >> v2:172.21.15.161:3300/0 conn(0x7fbcc415e910 0x7fbcc40cf570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:31.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.772+0000 7fbcc27fc700 1 -- 172.21.15.84:0/54901374 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1834183436 0 0) 0x7fbcc415e480 con 0x7fbcc40ca8e0 2023-09-13T08:25:31.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.772+0000 7fbcc3fff700 1 -- 172.21.15.84:0/54901374 >> v1:172.21.15.84:6789/0 conn(0x7fbcc40ca8e0 legacy=0x7fbcc40cacc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:31.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.772+0000 7fbcc3fff700 1 -- 172.21.15.84:0/54901374 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcc415e110 con 0x7fbcc40cd590 2023-09-13T08:25:31.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.772+0000 7fbcc3fff700 1 --2- 172.21.15.84:0/54901374 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbcc40cd590 0x7fbcc40cdbc0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fbcc40678a0 tx=0x7fbcbc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70c4181cf1078b4c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:31.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.772+0000 7fbcc27fc700 1 -- 172.21.15.84:0/54901374 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcbc00e070 con 0x7fbcc40cd590 2023-09-13T08:25:31.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.772+0000 7fbcc27fc700 1 -- 172.21.15.84:0/54901374 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcbc00bbd0 con 0x7fbcc40cd590 2023-09-13T08:25:31.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.772+0000 7fbcc27fc700 1 -- 172.21.15.84:0/54901374 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcbc012430 con 0x7fbcc40cd590 2023-09-13T08:25:31.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.773+0000 7fbcc9e9c700 1 -- 172.21.15.84:0/54901374 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbcc40cd590 msgr2=0x7fbcc40cdbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:31.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.773+0000 7fbcc9e9c700 1 --2- 172.21.15.84:0/54901374 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbcc40cd590 0x7fbcc40cdbc0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fbcc40678a0 tx=0x7fbcbc00b330 comp rx=0 tx=0).stop 2023-09-13T08:25:31.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.773+0000 7fbcc9e9c700 1 -- 172.21.15.84:0/54901374 shutdown_connections 2023-09-13T08:25:31.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.773+0000 7fbcc9e9c700 1 --2- 172.21.15.84:0/54901374 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbcc40cd590 0x7fbcc40cdbc0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:31.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.773+0000 7fbcc9e9c700 1 --2- 172.21.15.84:0/54901374 >> v2:172.21.15.161:3300/0 conn(0x7fbcc415e910 0x7fbcc40cf570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:31.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.773+0000 7fbcc9e9c700 1 -- 172.21.15.84:0/54901374 >> 172.21.15.84:0/54901374 conn(0x7fbcc40cca70 msgr2=0x7fbcc40cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:31.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.773+0000 7fbcc9e9c700 1 -- 172.21.15.84:0/54901374 shutdown_connections 2023-09-13T08:25:31.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.773+0000 7fbcc9e9c700 1 -- 172.21.15.84:0/54901374 wait complete. 2023-09-13T08:25:31.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.774+0000 7fbcc9e9c700 1 Processor -- start 2023-09-13T08:25:31.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.774+0000 7fbcc9e9c700 1 -- start start 2023-09-13T08:25:31.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.775+0000 7fbcc9e9c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbcc40ca8e0 0x7fbcc40c5690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:31.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.775+0000 7fbcc9e9c700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbcc40cd590 0x7fbcc406e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:31.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.775+0000 7fbcc9e9c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbcc415e910 0x7fbcc40adbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:31.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.775+0000 7fbcc9e9c700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc40c4020 con 0x7fbcc415e910 2023-09-13T08:25:31.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.775+0000 7fbcc9e9c700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc40c4300 con 0x7fbcc40ca8e0 2023-09-13T08:25:31.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.775+0000 7fbcc9e9c700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc40c45e0 con 0x7fbcc40cd590 2023-09-13T08:25:31.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.776+0000 7fbcc3fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbcc415e910 0x7fbcc40adbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:31.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.776+0000 7fbcc3fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbcc415e910 0x7fbcc40adbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44744/0 (socket says 172.21.15.84:44744) 2023-09-13T08:25:31.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.776+0000 7fbcc3fff700 1 -- 172.21.15.84:0/1266525998 learned_addr learned my addr 172.21.15.84:0/1266525998 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:31.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.776+0000 7fbcc37fe700 1 --2- 172.21.15.84:0/1266525998 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbcc40ca8e0 0x7fbcc40c5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:31.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.776+0000 7fbcc2ffd700 1 --2- 172.21.15.84:0/1266525998 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbcc40cd590 0x7fbcc406e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:31.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.776+0000 7fbcc3fff700 1 -- 172.21.15.84:0/1266525998 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbcc40cd590 msgr2=0x7fbcc406e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:31.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.776+0000 7fbcc3fff700 1 --2- 172.21.15.84:0/1266525998 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbcc40cd590 0x7fbcc406e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:31.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.776+0000 7fbcc3fff700 1 -- 172.21.15.84:0/1266525998 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbcc40ca8e0 msgr2=0x7fbcc40c5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:31.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.776+0000 7fbcc3fff700 1 --2- 172.21.15.84:0/1266525998 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbcc40ca8e0 0x7fbcc40c5690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:31.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.776+0000 7fbcc3fff700 1 -- 172.21.15.84:0/1266525998 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcbc009a70 con 0x7fbcc415e910 2023-09-13T08:25:31.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.776+0000 7fbcc3fff700 1 --2- 172.21.15.84:0/1266525998 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbcc415e910 0x7fbcc40adbc0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fbcc40678f0 tx=0x7fbcbc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:31.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.776+0000 7fbcabfff700 1 -- 172.21.15.84:0/1266525998 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcbc012430 con 0x7fbcc415e910 2023-09-13T08:25:31.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.776+0000 7fbcabfff700 1 -- 172.21.15.84:0/1266525998 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcbc020070 con 0x7fbcc415e910 2023-09-13T08:25:31.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.776+0000 7fbcc9e9c700 1 -- 172.21.15.84:0/1266525998 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcc40c48c0 con 0x7fbcc415e910 2023-09-13T08:25:31.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.776+0000 7fbcabfff700 1 -- 172.21.15.84:0/1266525998 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcbc004280 con 0x7fbcc415e910 2023-09-13T08:25:31.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.776+0000 7fbcc9e9c700 1 -- 172.21.15.84:0/1266525998 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcc406ee20 con 0x7fbcc415e910 2023-09-13T08:25:31.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.777+0000 7fbcc9e9c700 1 -- 172.21.15.84:0/1266525998 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcc406f010 con 0x7fbcc415e910 2023-09-13T08:25:31.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.778+0000 7fbcabfff700 1 -- 172.21.15.84:0/1266525998 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fbcbc0043e0 con 0x7fbcc415e910 2023-09-13T08:25:31.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.778+0000 7fbcabfff700 1 --2- 172.21.15.84:0/1266525998 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fbcb006a580 0x7fbcb006ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:31.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.778+0000 7fbcc37fe700 1 --2- 172.21.15.84:0/1266525998 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fbcb006a580 0x7fbcb006ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:31.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.778+0000 7fbcabfff700 1 -- 172.21.15.84:0/1266525998 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fbcbc022070 con 0x7fbcc415e910 2023-09-13T08:25:31.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.779+0000 7fbcc37fe700 1 --2- 172.21.15.84:0/1266525998 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fbcb006a580 0x7fbcb006ca40 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fbcb4000f60 tx=0x7fbcb4007be0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:31.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.783+0000 7fbcabfff700 1 -- 172.21.15.84:0/1266525998 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fbcbc055f90 con 0x7fbcc415e910 2023-09-13T08:25:31.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.973+0000 7fbcc9e9c700 1 -- 172.21.15.84:0/1266525998 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fbcc41f6350 con 0x7fbcc415e910 2023-09-13T08:25:31.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.974+0000 7fbcabfff700 1 -- 172.21.15.84:0/1266525998 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fbcbc02c0a0 con 0x7fbcc415e910 2023-09-13T08:25:31.974 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-09-13T08:25:31.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.976+0000 7fbcc9e9c700 1 -- 172.21.15.84:0/1266525998 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fbcb006a580 msgr2=0x7fbcb006ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:31.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.976+0000 7fbcc9e9c700 1 --2- 172.21.15.84:0/1266525998 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fbcb006a580 0x7fbcb006ca40 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fbcb4000f60 tx=0x7fbcb4007be0 comp rx=0 tx=0).stop 2023-09-13T08:25:31.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.976+0000 7fbcc9e9c700 1 -- 172.21.15.84:0/1266525998 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbcc415e910 msgr2=0x7fbcc40adbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:31.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.976+0000 7fbcc9e9c700 1 --2- 172.21.15.84:0/1266525998 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbcc415e910 0x7fbcc40adbc0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fbcc40678f0 tx=0x7fbcbc004ad0 comp rx=0 tx=0).stop 2023-09-13T08:25:31.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.976+0000 7fbcc9e9c700 1 -- 172.21.15.84:0/1266525998 shutdown_connections 2023-09-13T08:25:31.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.976+0000 7fbcc9e9c700 1 --2- 172.21.15.84:0/1266525998 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbcc415e910 0x7fbcc40adbc0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:31.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.976+0000 7fbcc9e9c700 1 --2- 172.21.15.84:0/1266525998 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fbcb006a580 0x7fbcb006ca40 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:31.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.976+0000 7fbcc9e9c700 1 --2- 172.21.15.84:0/1266525998 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbcc40ca8e0 0x7fbcc40c5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:31.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.976+0000 7fbcc9e9c700 1 --2- 172.21.15.84:0/1266525998 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbcc40cd590 0x7fbcc406e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:31.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.976+0000 7fbcc9e9c700 1 -- 172.21.15.84:0/1266525998 >> 172.21.15.84:0/1266525998 conn(0x7fbcc40cca70 msgr2=0x7fbcc40cdbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:31.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.976+0000 7fbcc9e9c700 1 -- 172.21.15.84:0/1266525998 shutdown_connections 2023-09-13T08:25:31.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:31.976+0000 7fbcc9e9c700 1 -- 172.21.15.84:0/1266525998 wait complete. 2023-09-13T08:25:31.988 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T08:25:32.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.109+0000 7eff5e966700 1 Processor -- start 2023-09-13T08:25:32.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.109+0000 7eff5e966700 1 -- start start 2023-09-13T08:25:32.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.109+0000 7eff5e966700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7eff580ce920 0x7eff580ced00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:32.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.109+0000 7eff5e966700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7eff5815b200 0x7eff5815de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:32.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.109+0000 7eff5e966700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff58151800 con 0x7eff580cc900 2023-09-13T08:25:32.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.110+0000 7eff5e966700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff5815ad70 con 0x7eff580ce920 2023-09-13T08:25:32.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.110+0000 7eff5e966700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff5815edd0 con 0x7eff5815b200 2023-09-13T08:25:32.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.110+0000 7eff57fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7eff580ce920 0x7eff580ced00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:32.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.110+0000 7eff5cf03700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7eff580cc900 0x7eff580ccd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:47398/0 (socket says 172.21.15.84:47398) 2023-09-13T08:25:32.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.110+0000 7eff5cf03700 1 -- 172.21.15.84:0/3756448245 learned_addr learned my addr 172.21.15.84:0/3756448245 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:25:32.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.110+0000 7eff577fe700 1 --2- 172.21.15.84:0/3756448245 >> v2:172.21.15.161:3300/0 conn(0x7eff5815b200 0x7eff5815de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:32.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.110+0000 7eff56ffd700 1 -- 172.21.15.84:0/3756448245 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1901232620 0 0) 0x7eff50001490 con 0x7eff580cc900 2023-09-13T08:25:32.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.110+0000 7eff56ffd700 1 -- 172.21.15.84:0/3756448245 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff400035b0 con 0x7eff580cc900 2023-09-13T08:25:32.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.110+0000 7eff57fff700 1 -- 172.21.15.84:0/3756448245 >> v2:172.21.15.161:3300/0 conn(0x7eff5815b200 msgr2=0x7eff5815de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:32.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.110+0000 7eff57fff700 1 --2- 172.21.15.84:0/3756448245 >> v2:172.21.15.161:3300/0 conn(0x7eff5815b200 0x7eff5815de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:32.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.110+0000 7eff57fff700 1 -- 172.21.15.84:0/3756448245 >> v1:172.21.15.84:6789/0 conn(0x7eff580cc900 legacy=0x7eff580ccd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:32.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.110+0000 7eff57fff700 1 -- 172.21.15.84:0/3756448245 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff580cf240 con 0x7eff580ce920 2023-09-13T08:25:32.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.110+0000 7eff577fe700 1 --2- 172.21.15.84:0/3756448245 >> v2:172.21.15.161:3300/0 conn(0x7eff5815b200 0x7eff5815de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T08:25:32.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.110+0000 7eff57fff700 1 --2- 172.21.15.84:0/3756448245 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff580ce920 0x7eff580ced00 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7eff580d1110 tx=0x7eff48009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac015b93ea43f268 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:32.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.110+0000 7eff56ffd700 1 -- 172.21.15.84:0/3756448245 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff48011830 con 0x7eff580ce920 2023-09-13T08:25:32.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.110+0000 7eff56ffd700 1 -- 172.21.15.84:0/3756448245 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff48011990 con 0x7eff580ce920 2023-09-13T08:25:32.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.110+0000 7eff56ffd700 1 -- 172.21.15.84:0/3756448245 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff48011d20 con 0x7eff580ce920 2023-09-13T08:25:32.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.111+0000 7eff5e966700 1 -- 172.21.15.84:0/3756448245 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff580ce920 msgr2=0x7eff580ced00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:32.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.111+0000 7eff5e966700 1 --2- 172.21.15.84:0/3756448245 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff580ce920 0x7eff580ced00 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7eff580d1110 tx=0x7eff48009b20 comp rx=0 tx=0).stop 2023-09-13T08:25:32.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.111+0000 7eff5e966700 1 -- 172.21.15.84:0/3756448245 shutdown_connections 2023-09-13T08:25:32.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.111+0000 7eff5e966700 1 --2- 172.21.15.84:0/3756448245 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff580ce920 0x7eff580ced00 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:32.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.111+0000 7eff5e966700 1 --2- 172.21.15.84:0/3756448245 >> v2:172.21.15.161:3300/0 conn(0x7eff5815b200 0x7eff5815de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:32.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.111+0000 7eff5e966700 1 -- 172.21.15.84:0/3756448245 >> 172.21.15.84:0/3756448245 conn(0x7eff580b1b80 msgr2=0x7eff580b1f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:32.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.111+0000 7eff5e966700 1 -- 172.21.15.84:0/3756448245 shutdown_connections 2023-09-13T08:25:32.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.111+0000 7eff5e966700 1 -- 172.21.15.84:0/3756448245 wait complete. 2023-09-13T08:25:32.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.112+0000 7eff5e966700 1 Processor -- start 2023-09-13T08:25:32.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.112+0000 7eff5e966700 1 -- start start 2023-09-13T08:25:32.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.113+0000 7eff5e966700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7eff580cc900 0x7eff580c97b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:32.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.113+0000 7eff5e966700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff580ce920 0x7eff580c54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:32.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.113+0000 7eff5e966700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff5815b200 0x7eff580c5a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:32.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.113+0000 7eff5e966700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff580c8a20 con 0x7eff580ce920 2023-09-13T08:25:32.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.113+0000 7eff5e966700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff580c7b20 con 0x7eff5815b200 2023-09-13T08:25:32.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.113+0000 7eff5e966700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff580cba60 con 0x7eff580cc900 2023-09-13T08:25:32.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.113+0000 7eff577fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff580ce920 0x7eff580c54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:32.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.113+0000 7eff577fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff580ce920 0x7eff580c54f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44756/0 (socket says 172.21.15.84:44756) 2023-09-13T08:25:32.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.113+0000 7eff577fe700 1 -- 172.21.15.84:0/441041929 learned_addr learned my addr 172.21.15.84:0/441041929 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:32.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.113+0000 7eff5cf03700 1 --2- 172.21.15.84:0/441041929 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff5815b200 0x7eff580c5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:32.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.113+0000 7eff57fff700 1 --2- 172.21.15.84:0/441041929 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7eff580cc900 0x7eff580c97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:32.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.113+0000 7eff577fe700 1 -- 172.21.15.84:0/441041929 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7eff580cc900 msgr2=0x7eff580c97b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:32.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.113+0000 7eff577fe700 1 --2- 172.21.15.84:0/441041929 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7eff580cc900 0x7eff580c97b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:32.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.113+0000 7eff577fe700 1 -- 172.21.15.84:0/441041929 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff5815b200 msgr2=0x7eff580c5a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:32.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.113+0000 7eff577fe700 1 --2- 172.21.15.84:0/441041929 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff5815b200 0x7eff580c5a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:32.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.113+0000 7eff577fe700 1 -- 172.21.15.84:0/441041929 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff480094a0 con 0x7eff580ce920 2023-09-13T08:25:32.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.113+0000 7eff577fe700 1 --2- 172.21.15.84:0/441041929 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff580ce920 0x7eff580c54f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7eff4c00e810 tx=0x7eff4c00ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:32.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.113+0000 7eff54ff9700 1 -- 172.21.15.84:0/441041929 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff4c004230 con 0x7eff580ce920 2023-09-13T08:25:32.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.114+0000 7eff54ff9700 1 -- 172.21.15.84:0/441041929 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff4c004390 con 0x7eff580ce920 2023-09-13T08:25:32.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.114+0000 7eff5e966700 1 -- 172.21.15.84:0/441041929 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff580c7da0 con 0x7eff580ce920 2023-09-13T08:25:32.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.114+0000 7eff54ff9700 1 -- 172.21.15.84:0/441041929 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff4c0036a0 con 0x7eff580ce920 2023-09-13T08:25:32.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.114+0000 7eff5e966700 1 -- 172.21.15.84:0/441041929 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff580c8360 con 0x7eff580ce920 2023-09-13T08:25:32.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.115+0000 7eff5e966700 1 -- 172.21.15.84:0/441041929 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff5804e9b0 con 0x7eff580ce920 2023-09-13T08:25:32.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.115+0000 7eff54ff9700 1 -- 172.21.15.84:0/441041929 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7eff4c003800 con 0x7eff580ce920 2023-09-13T08:25:32.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.115+0000 7eff54ff9700 1 --2- 172.21.15.84:0/441041929 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7eff4406a580 0x7eff4406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:32.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.115+0000 7eff54ff9700 1 -- 172.21.15.84:0/441041929 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7eff4c088810 con 0x7eff580ce920 2023-09-13T08:25:32.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.115+0000 7eff57fff700 1 --2- 172.21.15.84:0/441041929 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7eff4406a580 0x7eff4406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:32.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.116+0000 7eff57fff700 1 --2- 172.21.15.84:0/441041929 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7eff4406a580 0x7eff4406ca40 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7eff480090b0 tx=0x7eff48008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:32.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.120+0000 7eff54ff9700 1 -- 172.21.15.84:0/441041929 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7eff4c053a40 con 0x7eff580ce920 2023-09-13T08:25:32.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.311+0000 7eff5e966700 1 -- 172.21.15.84:0/441041929 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7eff580b5fb0 con 0x7eff580ce920 2023-09-13T08:25:32.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.312+0000 7eff54ff9700 1 -- 172.21.15.84:0/441041929 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18757 (secure 0 0 0) 0x7eff4c057060 con 0x7eff580ce920 2023-09-13T08:25:32.313 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:25:32.313 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":26,"fsid":"0107440b-b634-42c5-a643-5d31ea826116","created":"2023-09-13T08:24:16.931917+0000","modified":"2023-09-13T08:25:23.878460+0000","last_up_change":"2023-09-13T08:24:28.422631+0000","last_in_change":"2023-09-13T08:24:19.425578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T08:24:28.583720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-13T08:24:39.862832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-13T08:24:41.145511+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-13T08:24:44.775160+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4a53ec12-1469-4356-b4e1-2b8fc9b7c0f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6817","nonce":1599532366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6819","nonce":1599532366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6823","nonce":1599532366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6821","nonce":1599532366}]},"public_addr":"172.21.15.84:6817/1599532366","cluster_addr":"172.21.15.84:6819/1599532366","heartbeat_back_addr":"172.21.15.84:6823/1599532366","heartbeat_front_addr":"172.21.15.84:6821/1599532366","state":["exists","up"]},{"osd":1,"uuid":"11e964a0-b80c-4afc-bfbf-e2067969db29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6825","nonce":461860977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6827","nonce":461860977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6831","nonce":461860977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6829","nonce":461860977}]},"public_addr":"172.21.15.84:6825/461860977","cluster_addr":"172.21.15.84:6827/461860977","heartbeat_back_addr":"172.21.15.84:6831/461860977","heartbeat_front_addr":"172.21.15.84:6829/461860977","state":["exists","up"]},{"osd":2,"uuid":"3ce74529-4dd1-44c7-9576-968f5fdc0c25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6809","nonce":1168316165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6811","nonce":1168316165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6815","nonce":1168316165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6813","nonce":1168316165}]},"public_addr":"172.21.15.84:6809/1168316165","cluster_addr":"172.21.15.84:6811/1168316165","heartbeat_back_addr":"172.21.15.84:6815/1168316165","heartbeat_front_addr":"172.21.15.84:6813/1168316165","state":["exists","up"]},{"osd":3,"uuid":"460cb5c5-590a-4d06-a4d9-5bac2fdf33b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6801","nonce":1661609810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6803","nonce":1661609810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6807","nonce":1661609810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6805","nonce":1661609810}]},"public_addr":"172.21.15.84:6801/1661609810","cluster_addr":"172.21.15.84:6803/1661609810","heartbeat_back_addr":"172.21.15.84:6807/1661609810","heartbeat_front_addr":"172.21.15.84:6805/1661609810","state":["exists","up"]},{"osd":4,"uuid":"bf237dd0-3ebd-44b5-8078-24a63e00d792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6801","nonce":1303562374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6803","nonce":1303562374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6807","nonce":1303562374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6805","nonce":1303562374}]},"public_addr":"172.21.15.161:6801/1303562374","cluster_addr":"172.21.15.161:6803/1303562374","heartbeat_back_addr":"172.21.15.161:6807/1303562374","heartbeat_front_addr":"172.21.15.161:6805/1303562374","state":["exists","up"]},{"osd":5,"uuid":"e1e538e0-5844-456b-8c6e-434d3a914af1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6818","nonce":961120854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6822","nonce":961120854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6830","nonce":961120854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6826","nonce":961120854}]},"public_addr":"172.21.15.161:6818/961120854","cluster_addr":"172.21.15.161:6822/961120854","heartbeat_back_addr":"172.21.15.161:6830/961120854","heartbeat_front_addr":"172.21.15.161:6826/961120854","state":["exists","up"]},{"osd":6,"uuid":"5cb1785e-960f-4dd4-b295-9e21b2c3f875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6809","nonce":980533466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6811","nonce":980533466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6815","nonce":980533466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6813","nonce":980533466}]},"public_addr":"172.21.15.161:6809/980533466","cluster_addr":"172.21.15.161:6811/980533466","heartbeat_back_addr":"172.21.15.161:6815/980533466","heartbeat_front_addr":"172.21.15.161:6813/980533466","state":["exists","up"]},{"osd":7,"uuid":"5acb6619-e933-4b46-b1c2-60af30acb839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6817","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6819","nonce":2479691549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6821","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6823","nonce":2479691549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6829","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6831","nonce":2479691549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6825","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6827","nonce":2479691549}]},"public_addr":"172.21.15.161:6819/2479691549","cluster_addr":"172.21.15.161:6823/2479691549","heartbeat_back_addr":"172.21.15.161:6831/2479691549","heartbeat_front_addr":"172.21.15.161:6827/2479691549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.678857+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.685341+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.613603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.634940+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.564387+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.697347+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.637437+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.619397+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":1}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T08:25:32.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.315+0000 7eff5e966700 1 -- 172.21.15.84:0/441041929 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7eff4406a580 msgr2=0x7eff4406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:32.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.315+0000 7eff5e966700 1 --2- 172.21.15.84:0/441041929 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7eff4406a580 0x7eff4406ca40 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7eff480090b0 tx=0x7eff48008030 comp rx=0 tx=0).stop 2023-09-13T08:25:32.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.315+0000 7eff5e966700 1 -- 172.21.15.84:0/441041929 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff580ce920 msgr2=0x7eff580c54f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:32.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.315+0000 7eff5e966700 1 --2- 172.21.15.84:0/441041929 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff580ce920 0x7eff580c54f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7eff4c00e810 tx=0x7eff4c00ebd0 comp rx=0 tx=0).stop 2023-09-13T08:25:32.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.315+0000 7eff5e966700 1 -- 172.21.15.84:0/441041929 shutdown_connections 2023-09-13T08:25:32.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.315+0000 7eff5e966700 1 --2- 172.21.15.84:0/441041929 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7eff4406a580 0x7eff4406ca40 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:32.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.315+0000 7eff5e966700 1 --2- 172.21.15.84:0/441041929 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff5815b200 0x7eff580c5a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:32.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.315+0000 7eff5e966700 1 --2- 172.21.15.84:0/441041929 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7eff580cc900 0x7eff580c97b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:32.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.315+0000 7eff5e966700 1 --2- 172.21.15.84:0/441041929 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff580ce920 0x7eff580c54f0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:32.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.315+0000 7eff5e966700 1 -- 172.21.15.84:0/441041929 >> 172.21.15.84:0/441041929 conn(0x7eff580b1b80 msgr2=0x7eff58073370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:32.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.315+0000 7eff5e966700 1 -- 172.21.15.84:0/441041929 shutdown_connections 2023-09-13T08:25:32.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.315+0000 7eff5e966700 1 -- 172.21.15.84:0/441041929 wait complete. 2023-09-13T08:25:32.327 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T08:24:28.583720+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-13T08:24:39.862832+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-13T08:24:41.145511+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-09-13T08:24:44.775160+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-13T08:25:32.328 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T08:25:32.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.451+0000 7f19c7b73700 1 Processor -- start 2023-09-13T08:25:32.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.451+0000 7f19c7b73700 1 -- start start 2023-09-13T08:25:32.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.452+0000 7f19c7b73700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f19c006c3c0 0x7f19c00b17a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:32.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.452+0000 7f19c7b73700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19c0160e90 con 0x7f19c006bf40 2023-09-13T08:25:32.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.452+0000 7f19c7b73700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19c00d0820 con 0x7f19c0160ab0 2023-09-13T08:25:32.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.452+0000 7f19c7b73700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19c006c850 con 0x7f19c006c3c0 2023-09-13T08:25:32.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.452+0000 7f19c510e700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f19c006bf40 0x7f19c00b1090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:47410/0 (socket says 172.21.15.84:47410) 2023-09-13T08:25:32.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.452+0000 7f19c510e700 1 -- 172.21.15.84:0/3479176627 learned_addr learned my addr 172.21.15.84:0/3479176627 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:25:32.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.453+0000 7f19c6110700 1 --2- 172.21.15.84:0/3479176627 >> v2:172.21.15.161:3300/0 conn(0x7f19c006c3c0 0x7f19c00b17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:32.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.453+0000 7f19c490d700 1 -- 172.21.15.84:0/3479176627 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3639926952 0 0) 0x7f19c0160e90 con 0x7f19c006bf40 2023-09-13T08:25:32.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.453+0000 7f19c490d700 1 -- 172.21.15.84:0/3479176627 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19ac0035b0 con 0x7f19c006bf40 2023-09-13T08:25:32.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.453+0000 7f19c490d700 1 -- 172.21.15.84:0/3479176627 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2959650832 0 0) 0x7f19ac0035b0 con 0x7f19c006bf40 2023-09-13T08:25:32.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.453+0000 7f19c490d700 1 -- 172.21.15.84:0/3479176627 >> v2:172.21.15.161:3300/0 conn(0x7f19c006c3c0 msgr2=0x7f19c00b17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:32.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.453+0000 7f19c490d700 1 --2- 172.21.15.84:0/3479176627 >> v2:172.21.15.161:3300/0 conn(0x7f19c006c3c0 0x7f19c00b17a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:32.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.453+0000 7f19c490d700 1 -- 172.21.15.84:0/3479176627 >> v1:172.21.15.161:6789/0 conn(0x7f19c0160ab0 legacy=0x7f19c00cf4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:32.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.453+0000 7f19c490d700 1 -- 172.21.15.84:0/3479176627 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19c00cff80 con 0x7f19c006bf40 2023-09-13T08:25:32.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.453+0000 7f19c490d700 1 -- 172.21.15.84:0/3479176627 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2302733408 0 0) 0x7f19bc001670 con 0x7f19c006bf40 2023-09-13T08:25:32.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.453+0000 7f19c490d700 1 -- 172.21.15.84:0/3479176627 >> v1:172.21.15.84:6789/0 conn(0x7f19c006bf40 legacy=0x7f19c00b1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:32.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.453+0000 7f19c490d700 1 --2- 172.21.15.84:0/3479176627 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f19ac003a00 0x7f19ac003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:32.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.453+0000 7f19c490d700 1 --2- 172.21.15.84:0/3479176627 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19ac004850 0x7f19ac004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:32.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.453+0000 7f19c490d700 1 --2- 172.21.15.84:0/3479176627 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f19ac005210 0x7f19ac00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:32.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.453+0000 7f19c490d700 1 -- 172.21.15.84:0/3479176627 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19c006c850 con 0x7f19ac004850 2023-09-13T08:25:32.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.453+0000 7f19c490d700 1 -- 172.21.15.84:0/3479176627 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19ac00c0b0 con 0x7f19ac003a00 2023-09-13T08:25:32.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.453+0000 7f19c490d700 1 -- 172.21.15.84:0/3479176627 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19ac00c270 con 0x7f19ac005210 2023-09-13T08:25:32.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.453+0000 7f19c510e700 1 --2- 172.21.15.84:0/3479176627 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19ac004850 0x7f19ac004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:32.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.453+0000 7f19c590f700 1 --2- 172.21.15.84:0/3479176627 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f19ac003a00 0x7f19ac003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:32.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.453+0000 7f19c6110700 1 --2- 172.21.15.84:0/3479176627 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f19ac005210 0x7f19ac00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:32.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.453+0000 7f19c510e700 1 -- 172.21.15.84:0/3479176627 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f19ac005210 msgr2=0x7f19ac00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:32.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.453+0000 7f19c510e700 1 --2- 172.21.15.84:0/3479176627 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f19ac005210 0x7f19ac00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:32.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.453+0000 7f19c510e700 1 -- 172.21.15.84:0/3479176627 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f19ac003a00 msgr2=0x7f19ac003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:32.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.453+0000 7f19c510e700 1 --2- 172.21.15.84:0/3479176627 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f19ac003a00 0x7f19ac003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:32.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.453+0000 7f19c510e700 1 -- 172.21.15.84:0/3479176627 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19ac0035b0 con 0x7f19ac004850 2023-09-13T08:25:32.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.453+0000 7f19c6110700 1 -- 172.21.15.84:0/3479176627 reap_dead start 2023-09-13T08:25:32.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.454+0000 7f19c510e700 1 --2- 172.21.15.84:0/3479176627 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19ac004850 0x7f19ac004cd0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f19bc00c240 tx=0x7f19ac005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a97c3cbb9110e6f server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:32.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.454+0000 7f19c490d700 1 -- 172.21.15.84:0/3479176627 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19bc007c10 con 0x7f19ac004850 2023-09-13T08:25:32.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.454+0000 7f19c490d700 1 -- 172.21.15.84:0/3479176627 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19bc00ce00 con 0x7f19ac004850 2023-09-13T08:25:32.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.454+0000 7f19c490d700 1 -- 172.21.15.84:0/3479176627 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19bc005ba0 con 0x7f19ac004850 2023-09-13T08:25:32.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.454+0000 7f19c7b73700 1 -- 172.21.15.84:0/3479176627 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19ac004850 msgr2=0x7f19ac004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:32.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.454+0000 7f19c7b73700 1 --2- 172.21.15.84:0/3479176627 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19ac004850 0x7f19ac004cd0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f19bc00c240 tx=0x7f19ac005880 comp rx=0 tx=0).stop 2023-09-13T08:25:32.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.454+0000 7f19c7b73700 1 -- 172.21.15.84:0/3479176627 shutdown_connections 2023-09-13T08:25:32.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.454+0000 7f19c7b73700 1 --2- 172.21.15.84:0/3479176627 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19ac004850 0x7f19ac004cd0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:32.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.454+0000 7f19c7b73700 1 -- 172.21.15.84:0/3479176627 >> 172.21.15.84:0/3479176627 conn(0x7f19c009a470 msgr2=0x7f19c00d1170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:32.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.454+0000 7f19c7b73700 1 -- 172.21.15.84:0/3479176627 shutdown_connections 2023-09-13T08:25:32.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.454+0000 7f19c7b73700 1 -- 172.21.15.84:0/3479176627 wait complete. 2023-09-13T08:25:32.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.455+0000 7f19c7b73700 1 Processor -- start 2023-09-13T08:25:32.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.456+0000 7f19c7b73700 1 -- start start 2023-09-13T08:25:32.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.456+0000 7f19c7b73700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19ac004850 0x7f19c0155f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:32.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.456+0000 7f19c7b73700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f19c00c8240 0x7f19c0152820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:32.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.456+0000 7f19c7b73700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f19c00ca6d0 0x7f19c00cab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:32.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.456+0000 7f19c7b73700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19c00c8c50 con 0x7f19ac004850 2023-09-13T08:25:32.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.456+0000 7f19c7b73700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19c00c8f30 con 0x7f19c00ca6d0 2023-09-13T08:25:32.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.456+0000 7f19c7b73700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19c00c9210 con 0x7f19c00c8240 2023-09-13T08:25:32.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.456+0000 7f19c590f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19ac004850 0x7f19c0155f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:32.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.456+0000 7f19c590f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19ac004850 0x7f19c0155f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44774/0 (socket says 172.21.15.84:44774) 2023-09-13T08:25:32.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.456+0000 7f19c590f700 1 -- 172.21.15.84:0/371345810 learned_addr learned my addr 172.21.15.84:0/371345810 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:32.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.457+0000 7f19c510e700 1 --2- 172.21.15.84:0/371345810 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f19c00c8240 0x7f19c0152820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:32.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.457+0000 7f19c6110700 1 --2- 172.21.15.84:0/371345810 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f19c00ca6d0 0x7f19c00cab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:32.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.457+0000 7f19c590f700 1 -- 172.21.15.84:0/371345810 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f19c00c8240 msgr2=0x7f19c0152820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:32.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.457+0000 7f19c590f700 1 --2- 172.21.15.84:0/371345810 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f19c00c8240 0x7f19c0152820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:32.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.457+0000 7f19c590f700 1 -- 172.21.15.84:0/371345810 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f19c00ca6d0 msgr2=0x7f19c00cab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:32.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.457+0000 7f19c590f700 1 --2- 172.21.15.84:0/371345810 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f19c00ca6d0 0x7f19c00cab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:32.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.457+0000 7f19c590f700 1 -- 172.21.15.84:0/371345810 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19c00cc3b0 con 0x7f19ac004850 2023-09-13T08:25:32.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.457+0000 7f19c590f700 1 --2- 172.21.15.84:0/371345810 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19ac004850 0x7f19c0155f90 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f19b000f820 tx=0x7f19b000fbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:32.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.457+0000 7f19b67fc700 1 -- 172.21.15.84:0/371345810 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b00052e0 con 0x7f19ac004850 2023-09-13T08:25:32.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.457+0000 7f19b67fc700 1 -- 172.21.15.84:0/371345810 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19b0005440 con 0x7f19ac004850 2023-09-13T08:25:32.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.457+0000 7f19c7b73700 1 -- 172.21.15.84:0/371345810 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19c00cc690 con 0x7f19ac004850 2023-09-13T08:25:32.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.457+0000 7f19b67fc700 1 -- 172.21.15.84:0/371345810 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b00038f0 con 0x7f19ac004850 2023-09-13T08:25:32.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.457+0000 7f19c7b73700 1 -- 172.21.15.84:0/371345810 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19c00cb090 con 0x7f19ac004850 2023-09-13T08:25:32.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.458+0000 7f19c7b73700 1 -- 172.21.15.84:0/371345810 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19c00c8620 con 0x7f19ac004850 2023-09-13T08:25:32.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.458+0000 7f19b67fc700 1 -- 172.21.15.84:0/371345810 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f19b0003a50 con 0x7f19ac004850 2023-09-13T08:25:32.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.459+0000 7f19b67fc700 1 --2- 172.21.15.84:0/371345810 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f19a406a580 0x7f19a406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:32.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.459+0000 7f19c510e700 1 --2- 172.21.15.84:0/371345810 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f19a406a580 0x7f19a406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:32.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.459+0000 7f19b67fc700 1 -- 172.21.15.84:0/371345810 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f19b0088bf0 con 0x7f19ac004850 2023-09-13T08:25:32.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.459+0000 7f19c510e700 1 --2- 172.21.15.84:0/371345810 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f19a406a580 0x7f19a406ca40 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f19c01569e0 tx=0x7f19bc007000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:32.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.463+0000 7f19b67fc700 1 -- 172.21.15.84:0/371345810 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f19b0053da0 con 0x7f19ac004850 2023-09-13T08:25:32.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.651+0000 7f19c7b73700 1 -- 172.21.15.84:0/371345810 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f19c00ccce0 con 0x7f19ac004850 2023-09-13T08:25:32.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.652+0000 7f19b67fc700 1 -- 172.21.15.84:0/371345810 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f19b00573c0 con 0x7f19ac004850 2023-09-13T08:25:32.652 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-09-13T08:25:32.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.653+0000 7f19c7b73700 1 -- 172.21.15.84:0/371345810 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f19a406a580 msgr2=0x7f19a406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:32.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.653+0000 7f19c7b73700 1 --2- 172.21.15.84:0/371345810 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f19a406a580 0x7f19a406ca40 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f19c01569e0 tx=0x7f19bc007000 comp rx=0 tx=0).stop 2023-09-13T08:25:32.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.653+0000 7f19c7b73700 1 -- 172.21.15.84:0/371345810 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19ac004850 msgr2=0x7f19c0155f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:32.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.654+0000 7f19c7b73700 1 --2- 172.21.15.84:0/371345810 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19ac004850 0x7f19c0155f90 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f19b000f820 tx=0x7f19b000fbe0 comp rx=0 tx=0).stop 2023-09-13T08:25:32.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.654+0000 7f19c7b73700 1 -- 172.21.15.84:0/371345810 shutdown_connections 2023-09-13T08:25:32.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.654+0000 7f19c7b73700 1 --2- 172.21.15.84:0/371345810 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f19a406a580 0x7f19a406ca40 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:32.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.654+0000 7f19c7b73700 1 --2- 172.21.15.84:0/371345810 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f19c00ca6d0 0x7f19c00cab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:32.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.654+0000 7f19c7b73700 1 --2- 172.21.15.84:0/371345810 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19ac004850 0x7f19c0155f90 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:32.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.654+0000 7f19c7b73700 1 --2- 172.21.15.84:0/371345810 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f19c00c8240 0x7f19c0152820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:32.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.654+0000 7f19c7b73700 1 -- 172.21.15.84:0/371345810 >> 172.21.15.84:0/371345810 conn(0x7f19c009a470 msgr2=0x7f19c00ae040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:32.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.654+0000 7f19c7b73700 1 -- 172.21.15.84:0/371345810 shutdown_connections 2023-09-13T08:25:32.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.654+0000 7f19c7b73700 1 -- 172.21.15.84:0/371345810 wait complete. 2023-09-13T08:25:32.665 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-13T08:25:32.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.792+0000 7f5075a2d700 1 Processor -- start 2023-09-13T08:25:32.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.792+0000 7f5075a2d700 1 -- start start 2023-09-13T08:25:32.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.792+0000 7f5075a2d700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f507015a0a0 0x7f50700c9f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:32.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.792+0000 7f5075a2d700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f50700ca4b0 0x7f5070070de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:32.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.792+0000 7f5075a2d700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f507006ce20 con 0x7f5070154140 2023-09-13T08:25:32.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.792+0000 7f5075a2d700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f507006cc00 con 0x7f50700ca4b0 2023-09-13T08:25:32.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.792+0000 7f5075a2d700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f507006d100 con 0x7f507015a0a0 2023-09-13T08:25:32.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.793+0000 7f506effd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f5070154140 0x7f507006c4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:47428/0 (socket says 172.21.15.84:47428) 2023-09-13T08:25:32.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.793+0000 7f506effd700 1 -- 172.21.15.84:0/2125751492 learned_addr learned my addr 172.21.15.84:0/2125751492 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:25:32.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.793+0000 7f506dffb700 1 -- 172.21.15.84:0/2125751492 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 273171436 0 0) 0x7f507006ce20 con 0x7f5070154140 2023-09-13T08:25:32.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.793+0000 7f506f7fe700 1 --2- 172.21.15.84:0/2125751492 >> v2:172.21.15.161:3300/0 conn(0x7f50700ca4b0 0x7f5070070de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:32.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.793+0000 7f506e7fc700 1 --2- 172.21.15.84:0/2125751492 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f507015a0a0 0x7f50700c9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:32.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.793+0000 7f506dffb700 1 -- 172.21.15.84:0/2125751492 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50580035b0 con 0x7f5070154140 2023-09-13T08:25:32.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.793+0000 7f506dffb700 1 -- 172.21.15.84:0/2125751492 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 423626475 0 0) 0x7f50580035b0 con 0x7f5070154140 2023-09-13T08:25:32.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.793+0000 7f506dffb700 1 -- 172.21.15.84:0/2125751492 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f507015a0a0 msgr2=0x7f50700c9f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:32.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.793+0000 7f506dffb700 1 --2- 172.21.15.84:0/2125751492 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f507015a0a0 0x7f50700c9f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:32.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.793+0000 7f506dffb700 1 -- 172.21.15.84:0/2125751492 >> v2:172.21.15.161:3300/0 conn(0x7f50700ca4b0 msgr2=0x7f5070070de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:32.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.793+0000 7f506dffb700 1 --2- 172.21.15.84:0/2125751492 >> v2:172.21.15.161:3300/0 conn(0x7f50700ca4b0 0x7f5070070de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:32.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.793+0000 7f506dffb700 1 -- 172.21.15.84:0/2125751492 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f507006d3e0 con 0x7f5070154140 2023-09-13T08:25:32.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.793+0000 7f506dffb700 1 -- 172.21.15.84:0/2125751492 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2302733408 0 0) 0x7f5060001670 con 0x7f5070154140 2023-09-13T08:25:32.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.793+0000 7f506dffb700 1 -- 172.21.15.84:0/2125751492 >> v1:172.21.15.84:6789/0 conn(0x7f5070154140 legacy=0x7f507006c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:32.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.793+0000 7f506dffb700 1 --2- 172.21.15.84:0/2125751492 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f507015a0a0 0x7f5058003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:32.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.793+0000 7f506dffb700 1 --2- 172.21.15.84:0/2125751492 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5058003fb0 0x7f5058004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:32.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.793+0000 7f506dffb700 1 --2- 172.21.15.84:0/2125751492 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5058004d90 0x7f5058005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:32.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.793+0000 7f506dffb700 1 -- 172.21.15.84:0/2125751492 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f507006cc00 con 0x7f5058004d90 2023-09-13T08:25:32.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.793+0000 7f506dffb700 1 -- 172.21.15.84:0/2125751492 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f507006d100 con 0x7f5058003fb0 2023-09-13T08:25:32.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.793+0000 7f506dffb700 1 -- 172.21.15.84:0/2125751492 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f505800ba90 con 0x7f507015a0a0 2023-09-13T08:25:32.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.793+0000 7f506f7fe700 1 --2- 172.21.15.84:0/2125751492 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5058004d90 0x7f5058005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:32.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.793+0000 7f506effd700 1 --2- 172.21.15.84:0/2125751492 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f507015a0a0 0x7f5058003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:32.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.793+0000 7f506e7fc700 1 --2- 172.21.15.84:0/2125751492 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5058003fb0 0x7f5058004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:32.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.794+0000 7f506f7fe700 1 -- 172.21.15.84:0/2125751492 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f507015a0a0 msgr2=0x7f5058003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:32.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.794+0000 7f506f7fe700 1 --2- 172.21.15.84:0/2125751492 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f507015a0a0 0x7f5058003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:32.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.794+0000 7f506f7fe700 1 -- 172.21.15.84:0/2125751492 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5058003fb0 msgr2=0x7f5058004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:32.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.794+0000 7f506f7fe700 1 --2- 172.21.15.84:0/2125751492 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5058003fb0 0x7f5058004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:32.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.794+0000 7f506f7fe700 1 -- 172.21.15.84:0/2125751492 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50580035b0 con 0x7f5058004d90 2023-09-13T08:25:32.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.794+0000 7f506f7fe700 1 --2- 172.21.15.84:0/2125751492 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5058004d90 0x7f5058005210 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f5068009fc0 tx=0x7f5058005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c82718cbdd0bb20 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:32.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.794+0000 7f506dffb700 1 -- 172.21.15.84:0/2125751492 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f506800ec30 con 0x7f5058004d90 2023-09-13T08:25:32.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.794+0000 7f506dffb700 1 -- 172.21.15.84:0/2125751492 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f506800f040 con 0x7f5058004d90 2023-09-13T08:25:32.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.794+0000 7f506dffb700 1 -- 172.21.15.84:0/2125751492 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5068014480 con 0x7f5058004d90 2023-09-13T08:25:32.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.794+0000 7f5075a2d700 1 -- 172.21.15.84:0/2125751492 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5058004d90 msgr2=0x7f5058005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:32.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.794+0000 7f5075a2d700 1 --2- 172.21.15.84:0/2125751492 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5058004d90 0x7f5058005210 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f5068009fc0 tx=0x7f5058005880 comp rx=0 tx=0).stop 2023-09-13T08:25:32.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.794+0000 7f506f7fe700 1 -- 172.21.15.84:0/2125751492 reap_dead start 2023-09-13T08:25:32.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.795+0000 7f5075a2d700 1 -- 172.21.15.84:0/2125751492 shutdown_connections 2023-09-13T08:25:32.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.795+0000 7f5075a2d700 1 -- 172.21.15.84:0/2125751492 >> 172.21.15.84:0/2125751492 conn(0x7f50700b0a20 msgr2=0x7f50700b0e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:32.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.795+0000 7f5075a2d700 1 -- 172.21.15.84:0/2125751492 shutdown_connections 2023-09-13T08:25:32.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.795+0000 7f5075a2d700 1 -- 172.21.15.84:0/2125751492 wait complete. 2023-09-13T08:25:32.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.796+0000 7f5075a2d700 1 Processor -- start 2023-09-13T08:25:32.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.796+0000 7f5075a2d700 1 -- start start 2023-09-13T08:25:32.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.797+0000 7f5075a2d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50700cd080 0x7f50700c7070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:32.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.797+0000 7f5075a2d700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f50700cd460 0x7f50700c8840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:32.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.797+0000 7f5075a2d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f50700b4380 0x7f5070145f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:32.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.797+0000 7f5075a2d700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50700b32e0 con 0x7f50700cd080 2023-09-13T08:25:32.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.797+0000 7f5075a2d700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50700b35c0 con 0x7f50700b4380 2023-09-13T08:25:32.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.797+0000 7f5075a2d700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50700b38a0 con 0x7f50700cd460 2023-09-13T08:25:32.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.797+0000 7f506effd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50700cd080 0x7f50700c7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:32.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.797+0000 7f506effd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50700cd080 0x7f50700c7070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44794/0 (socket says 172.21.15.84:44794) 2023-09-13T08:25:32.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.797+0000 7f506effd700 1 -- 172.21.15.84:0/3238452487 learned_addr learned my addr 172.21.15.84:0/3238452487 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:32.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.797+0000 7f506e7fc700 1 --2- 172.21.15.84:0/3238452487 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f50700cd460 0x7f50700c8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:32.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.797+0000 7f506f7fe700 1 --2- 172.21.15.84:0/3238452487 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f50700b4380 0x7f5070145f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:32.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.797+0000 7f506effd700 1 -- 172.21.15.84:0/3238452487 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f50700cd460 msgr2=0x7f50700c8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:32.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.797+0000 7f506effd700 1 --2- 172.21.15.84:0/3238452487 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f50700cd460 0x7f50700c8840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:32.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.797+0000 7f506effd700 1 -- 172.21.15.84:0/3238452487 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f50700b4380 msgr2=0x7f5070145f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:32.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.797+0000 7f506effd700 1 --2- 172.21.15.84:0/3238452487 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f50700b4380 0x7f5070145f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:32.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.797+0000 7f506effd700 1 -- 172.21.15.84:0/3238452487 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50700b3b80 con 0x7f50700cd080 2023-09-13T08:25:32.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.797+0000 7f506e7fc700 1 --2- 172.21.15.84:0/3238452487 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f50700cd460 0x7f50700c8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T08:25:32.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.797+0000 7f506f7fe700 1 --2- 172.21.15.84:0/3238452487 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f50700b4380 0x7f5070145f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T08:25:32.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.797+0000 7f506effd700 1 --2- 172.21.15.84:0/3238452487 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50700cd080 0x7f50700c7070 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f5060007320 tx=0x7f50600076e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:32.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.797+0000 7f5057fff700 1 -- 172.21.15.84:0/3238452487 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f506000f850 con 0x7f50700cd080 2023-09-13T08:25:32.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.797+0000 7f5057fff700 1 -- 172.21.15.84:0/3238452487 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f506000f9b0 con 0x7f50700cd080 2023-09-13T08:25:32.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.797+0000 7f5057fff700 1 -- 172.21.15.84:0/3238452487 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f506000fd60 con 0x7f50700cd080 2023-09-13T08:25:32.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.797+0000 7f5075a2d700 1 -- 172.21.15.84:0/3238452487 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50700b3e60 con 0x7f50700cd080 2023-09-13T08:25:32.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.797+0000 7f5075a2d700 1 -- 172.21.15.84:0/3238452487 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50700b4800 con 0x7f50700cd080 2023-09-13T08:25:32.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.798+0000 7f5075a2d700 1 -- 172.21.15.84:0/3238452487 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50700b4a20 con 0x7f50700cd080 2023-09-13T08:25:32.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.799+0000 7f5057fff700 1 -- 172.21.15.84:0/3238452487 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f506001d460 con 0x7f50700cd080 2023-09-13T08:25:32.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.799+0000 7f5057fff700 1 --2- 172.21.15.84:0/3238452487 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f505c06a5a0 0x7f505c06ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:32.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.799+0000 7f5057fff700 1 -- 172.21.15.84:0/3238452487 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f5060089050 con 0x7f50700cd080 2023-09-13T08:25:32.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.799+0000 7f506e7fc700 1 --2- 172.21.15.84:0/3238452487 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f505c06a5a0 0x7f505c06ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:32.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.799+0000 7f506e7fc700 1 --2- 172.21.15.84:0/3238452487 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f505c06a5a0 0x7f505c06ca60 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f50700c5100 tx=0x7f5064008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:32.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.803+0000 7f5057fff700 1 -- 172.21.15.84:0/3238452487 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f5060054160 con 0x7f50700cd080 2023-09-13T08:25:32.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.993+0000 7f5075a2d700 1 -- 172.21.15.84:0/3238452487 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f507004f200 con 0x7f50700cd080 2023-09-13T08:25:32.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.993+0000 7f5057fff700 1 -- 172.21.15.84:0/3238452487 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5060057780 con 0x7f50700cd080 2023-09-13T08:25:32.994 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-09-13T08:25:32.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.995+0000 7f5075a2d700 1 -- 172.21.15.84:0/3238452487 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f505c06a5a0 msgr2=0x7f505c06ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:32.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.995+0000 7f5075a2d700 1 --2- 172.21.15.84:0/3238452487 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f505c06a5a0 0x7f505c06ca60 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f50700c5100 tx=0x7f5064008040 comp rx=0 tx=0).stop 2023-09-13T08:25:32.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.995+0000 7f5075a2d700 1 -- 172.21.15.84:0/3238452487 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50700cd080 msgr2=0x7f50700c7070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:32.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.995+0000 7f5075a2d700 1 --2- 172.21.15.84:0/3238452487 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50700cd080 0x7f50700c7070 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f5060007320 tx=0x7f50600076e0 comp rx=0 tx=0).stop 2023-09-13T08:25:32.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.995+0000 7f5075a2d700 1 -- 172.21.15.84:0/3238452487 shutdown_connections 2023-09-13T08:25:32.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.995+0000 7f5075a2d700 1 --2- 172.21.15.84:0/3238452487 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f505c06a5a0 0x7f505c06ca60 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:32.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.995+0000 7f5075a2d700 1 --2- 172.21.15.84:0/3238452487 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f50700b4380 0x7f5070145f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:32.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.995+0000 7f5075a2d700 1 --2- 172.21.15.84:0/3238452487 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50700cd080 0x7f50700c7070 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:32.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.995+0000 7f5075a2d700 1 --2- 172.21.15.84:0/3238452487 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f50700cd460 0x7f50700c8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:32.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.995+0000 7f5075a2d700 1 -- 172.21.15.84:0/3238452487 >> 172.21.15.84:0/3238452487 conn(0x7f50700b0a20 msgr2=0x7f5070072070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:32.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.995+0000 7f5075a2d700 1 -- 172.21.15.84:0/3238452487 shutdown_connections 2023-09-13T08:25:32.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:32.995+0000 7f5075a2d700 1 -- 172.21.15.84:0/3238452487 wait complete. 2023-09-13T08:25:33.007 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-13T08:25:33.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.130+0000 7f643d564700 1 Processor -- start 2023-09-13T08:25:33.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.130+0000 7f643d564700 1 -- start start 2023-09-13T08:25:33.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.130+0000 7f643d564700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f643815d570 0x7f64380b8d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:33.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.130+0000 7f643d564700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6438160ff0 0x7f64380cfc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:33.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.131+0000 7f643d564700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f643815d950 con 0x7f64380d0170 2023-09-13T08:25:33.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.131+0000 7f643d564700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64380d05e0 con 0x7f643815d570 2023-09-13T08:25:33.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.131+0000 7f643d564700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6438161450 con 0x7f6438160ff0 2023-09-13T08:25:33.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.131+0000 7f64367fc700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6438160ff0 0x7f64380cfc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:33.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.131+0000 7f6436ffd700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f643815d570 0x7f64380b8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:33.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.131+0000 7f64367fc700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6438160ff0 0x7f64380cfc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.84:54668/0 (socket says 172.21.15.84:54668) 2023-09-13T08:25:33.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.131+0000 7f64377fe700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f64380d0170 0x7f64380b4d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.84:33622/0 (socket says 172.21.15.84:33622) 2023-09-13T08:25:33.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.131+0000 7f64367fc700 1 -- 172.21.15.84:0/2897070897 learned_addr learned my addr 172.21.15.84:0/2897070897 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:33.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.131+0000 7f64367fc700 1 -- 172.21.15.84:0/2897070897 >> v2:172.21.15.161:3300/0 conn(0x7f643815d570 msgr2=0x7f64380b8d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:33.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.131+0000 7f64367fc700 1 --2- 172.21.15.84:0/2897070897 >> v2:172.21.15.161:3300/0 conn(0x7f643815d570 0x7f64380b8d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:33.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.131+0000 7f64367fc700 1 -- 172.21.15.84:0/2897070897 >> v1:172.21.15.161:6789/0 conn(0x7f64380d0170 legacy=0x7f64380b4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:33.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.131+0000 7f6435ffb700 1 -- 172.21.15.84:0/2897070897 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 198715380 0 0) 0x7f6430001490 con 0x7f64380d0170 2023-09-13T08:25:33.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.131+0000 7f64367fc700 1 -- 172.21.15.84:0/2897070897 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64381616f0 con 0x7f6438160ff0 2023-09-13T08:25:33.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.131+0000 7f6436ffd700 1 --2- 172.21.15.84:0/2897070897 >> v2:172.21.15.161:3300/0 conn(0x7f643815d570 0x7f64380b8d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T08:25:33.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.131+0000 7f64367fc700 1 --2- 172.21.15.84:0/2897070897 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6438160ff0 0x7f64380cfc30 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f642c0098f0 tx=0x7f642c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf9fdd1c325e517d server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:33.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.132+0000 7f6435ffb700 1 -- 172.21.15.84:0/2897070897 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f642c011830 con 0x7f6438160ff0 2023-09-13T08:25:33.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.132+0000 7f6435ffb700 1 -- 172.21.15.84:0/2897070897 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f642c011990 con 0x7f6438160ff0 2023-09-13T08:25:33.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.132+0000 7f6435ffb700 1 -- 172.21.15.84:0/2897070897 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f642c011d20 con 0x7f6438160ff0 2023-09-13T08:25:33.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.132+0000 7f643d564700 1 -- 172.21.15.84:0/2897070897 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6438160ff0 msgr2=0x7f64380cfc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:33.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.132+0000 7f643d564700 1 --2- 172.21.15.84:0/2897070897 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6438160ff0 0x7f64380cfc30 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f642c0098f0 tx=0x7f642c009c00 comp rx=0 tx=0).stop 2023-09-13T08:25:33.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.132+0000 7f643d564700 1 -- 172.21.15.84:0/2897070897 shutdown_connections 2023-09-13T08:25:33.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.132+0000 7f643d564700 1 --2- 172.21.15.84:0/2897070897 >> v2:172.21.15.161:3300/0 conn(0x7f643815d570 0x7f64380b8d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:33.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.132+0000 7f643d564700 1 --2- 172.21.15.84:0/2897070897 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6438160ff0 0x7f64380cfc30 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:33.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.132+0000 7f643d564700 1 -- 172.21.15.84:0/2897070897 >> 172.21.15.84:0/2897070897 conn(0x7f643806b0d0 msgr2=0x7f643806b4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:33.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.132+0000 7f643d564700 1 -- 172.21.15.84:0/2897070897 shutdown_connections 2023-09-13T08:25:33.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.132+0000 7f643d564700 1 -- 172.21.15.84:0/2897070897 wait complete. 2023-09-13T08:25:33.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.134+0000 7f643d564700 1 Processor -- start 2023-09-13T08:25:33.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.134+0000 7f643d564700 1 -- start start 2023-09-13T08:25:33.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.135+0000 7f643d564700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f64380d0170 0x7f643815f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:33.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.135+0000 7f643d564700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f643815d570 0x7f64381594c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:33.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.135+0000 7f643d564700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6438160ff0 0x7f6438159a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:33.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.135+0000 7f643d564700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64380b8020 con 0x7f643815d570 2023-09-13T08:25:33.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.135+0000 7f643d564700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64380b8300 con 0x7f64380d0170 2023-09-13T08:25:33.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.135+0000 7f643d564700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64380b85e0 con 0x7f6438160ff0 2023-09-13T08:25:33.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.135+0000 7f64367fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f643815d570 0x7f64381594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:33.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.135+0000 7f64367fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f643815d570 0x7f64381594c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44810/0 (socket says 172.21.15.84:44810) 2023-09-13T08:25:33.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.135+0000 7f64367fc700 1 -- 172.21.15.84:0/2229793008 learned_addr learned my addr 172.21.15.84:0/2229793008 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:33.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.135+0000 7f6436ffd700 1 --2- 172.21.15.84:0/2229793008 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f64380d0170 0x7f643815f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:33.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.135+0000 7f64377fe700 1 --2- 172.21.15.84:0/2229793008 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6438160ff0 0x7f6438159a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:33.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.135+0000 7f64367fc700 1 -- 172.21.15.84:0/2229793008 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6438160ff0 msgr2=0x7f6438159a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:33.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.135+0000 7f64367fc700 1 --2- 172.21.15.84:0/2229793008 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6438160ff0 0x7f6438159a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:33.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.135+0000 7f64367fc700 1 -- 172.21.15.84:0/2229793008 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f64380d0170 msgr2=0x7f643815f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:33.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.135+0000 7f64367fc700 1 --2- 172.21.15.84:0/2229793008 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f64380d0170 0x7f643815f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:33.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.135+0000 7f64367fc700 1 -- 172.21.15.84:0/2229793008 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64280094a0 con 0x7f643815d570 2023-09-13T08:25:33.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.135+0000 7f64377fe700 1 --2- 172.21.15.84:0/2229793008 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6438160ff0 0x7f6438159a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T08:25:33.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.136+0000 7f64367fc700 1 --2- 172.21.15.84:0/2229793008 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f643815d570 0x7f64381594c0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f642c009c40 tx=0x7f642c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:33.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.136+0000 7f641f7fe700 1 -- 172.21.15.84:0/2229793008 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f642c0044d0 con 0x7f643815d570 2023-09-13T08:25:33.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.136+0000 7f641f7fe700 1 -- 172.21.15.84:0/2229793008 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f642c01e070 con 0x7f643815d570 2023-09-13T08:25:33.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.136+0000 7f643d564700 1 -- 172.21.15.84:0/2229793008 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f642c009550 con 0x7f643815d570 2023-09-13T08:25:33.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.136+0000 7f641f7fe700 1 -- 172.21.15.84:0/2229793008 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f642c0038c0 con 0x7f643815d570 2023-09-13T08:25:33.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.136+0000 7f643d564700 1 -- 172.21.15.84:0/2229793008 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6438154900 con 0x7f643815d570 2023-09-13T08:25:33.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.137+0000 7f643d564700 1 -- 172.21.15.84:0/2229793008 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6438068150 con 0x7f643815d570 2023-09-13T08:25:33.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.137+0000 7f641f7fe700 1 -- 172.21.15.84:0/2229793008 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f642c003a20 con 0x7f643815d570 2023-09-13T08:25:33.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.137+0000 7f641f7fe700 1 --2- 172.21.15.84:0/2229793008 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f642406a5b0 0x7f642406ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:33.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.138+0000 7f641f7fe700 1 -- 172.21.15.84:0/2229793008 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f642c089d20 con 0x7f643815d570 2023-09-13T08:25:33.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.138+0000 7f6436ffd700 1 --2- 172.21.15.84:0/2229793008 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f642406a5b0 0x7f642406ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:33.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.138+0000 7f6436ffd700 1 --2- 172.21.15.84:0/2229793008 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f642406a5b0 0x7f642406ca70 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6428009d70 tx=0x7f6428009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:33.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.142+0000 7f641f7fe700 1 -- 172.21.15.84:0/2229793008 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f642c054eb0 con 0x7f643815d570 2023-09-13T08:25:33.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.329+0000 7f643d564700 1 -- 172.21.15.84:0/2229793008 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f643804f200 con 0x7f643815d570 2023-09-13T08:25:33.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.329+0000 7f641f7fe700 1 -- 172.21.15.84:0/2229793008 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f642c0200a0 con 0x7f643815d570 2023-09-13T08:25:33.330 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-09-13T08:25:33.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.331+0000 7f643d564700 1 -- 172.21.15.84:0/2229793008 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f642406a5b0 msgr2=0x7f642406ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:33.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.331+0000 7f643d564700 1 --2- 172.21.15.84:0/2229793008 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f642406a5b0 0x7f642406ca70 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6428009d70 tx=0x7f6428009210 comp rx=0 tx=0).stop 2023-09-13T08:25:33.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.331+0000 7f643d564700 1 -- 172.21.15.84:0/2229793008 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f643815d570 msgr2=0x7f64381594c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:33.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.331+0000 7f643d564700 1 --2- 172.21.15.84:0/2229793008 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f643815d570 0x7f64381594c0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f642c009c40 tx=0x7f642c004750 comp rx=0 tx=0).stop 2023-09-13T08:25:33.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.331+0000 7f643d564700 1 -- 172.21.15.84:0/2229793008 shutdown_connections 2023-09-13T08:25:33.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.331+0000 7f643d564700 1 --2- 172.21.15.84:0/2229793008 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6438160ff0 0x7f6438159a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:33.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.331+0000 7f643d564700 1 --2- 172.21.15.84:0/2229793008 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f642406a5b0 0x7f642406ca70 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:33.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.331+0000 7f643d564700 1 --2- 172.21.15.84:0/2229793008 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f64380d0170 0x7f643815f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:33.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.331+0000 7f643d564700 1 --2- 172.21.15.84:0/2229793008 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f643815d570 0x7f64381594c0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:33.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.331+0000 7f643d564700 1 -- 172.21.15.84:0/2229793008 >> 172.21.15.84:0/2229793008 conn(0x7f643806b0d0 msgr2=0x7f643815ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:33.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.331+0000 7f643d564700 1 -- 172.21.15.84:0/2229793008 shutdown_connections 2023-09-13T08:25:33.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.331+0000 7f643d564700 1 -- 172.21.15.84:0/2229793008 wait complete. 2023-09-13T08:25:33.346 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-09-13T08:25:33.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.469+0000 7f40f1fd5700 1 Processor -- start 2023-09-13T08:25:33.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.469+0000 7f40f1fd5700 1 -- start start 2023-09-13T08:25:33.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.470+0000 7f40f1fd5700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f40ec06bc00 0x7f40ec0b4850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:33.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.470+0000 7f40f1fd5700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f40ec0ac9d0 0x7f40ec15e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:33.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.470+0000 7f40f1fd5700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40ec0b43c0 con 0x7f40ec0ad2c0 2023-09-13T08:25:33.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.470+0000 7f40f1fd5700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40ec06bfe0 con 0x7f40ec06bc00 2023-09-13T08:25:33.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.470+0000 7f40f1fd5700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40ec15e8b0 con 0x7f40ec0ac9d0 2023-09-13T08:25:33.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.470+0000 7f40eb7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f40ec06bc00 0x7f40ec0b4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:33.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.470+0000 7f40eb7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f40ec06bc00 0x7f40ec0b4850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44816/0 (socket says 172.21.15.84:44816) 2023-09-13T08:25:33.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.470+0000 7f40eb7fe700 1 -- 172.21.15.84:0/782105292 learned_addr learned my addr 172.21.15.84:0/782105292 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:33.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.470+0000 7f40eaffd700 1 --2- 172.21.15.84:0/782105292 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f40ec0ac9d0 0x7f40ec15e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:33.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.471+0000 7f40eb7fe700 1 -- 172.21.15.84:0/782105292 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f40ec0ac9d0 msgr2=0x7f40ec15e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:33.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.471+0000 7f40eb7fe700 1 --2- 172.21.15.84:0/782105292 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f40ec0ac9d0 0x7f40ec15e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:33.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.471+0000 7f40eb7fe700 1 -- 172.21.15.84:0/782105292 >> v1:172.21.15.161:6789/0 conn(0x7f40ec0ad2c0 legacy=0x7f40ec06a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:33.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.471+0000 7f40eb7fe700 1 -- 172.21.15.84:0/782105292 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40ec0b37b0 con 0x7f40ec06bc00 2023-09-13T08:25:33.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.471+0000 7f40eaffd700 1 --2- 172.21.15.84:0/782105292 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f40ec0ac9d0 0x7f40ec15e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T08:25:33.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.471+0000 7f40eb7fe700 1 --2- 172.21.15.84:0/782105292 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40ec06bc00 0x7f40ec0b4850 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f40e00098f0 tx=0x7f40e0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=604becd4b024ddf2 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:33.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.471+0000 7f40ea7fc700 1 -- 172.21.15.84:0/782105292 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e000b8a0 con 0x7f40ec06bc00 2023-09-13T08:25:33.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.471+0000 7f40ea7fc700 1 -- 172.21.15.84:0/782105292 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40e000ba00 con 0x7f40ec06bc00 2023-09-13T08:25:33.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.471+0000 7f40ea7fc700 1 -- 172.21.15.84:0/782105292 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e000bd90 con 0x7f40ec06bc00 2023-09-13T08:25:33.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.471+0000 7f40f1fd5700 1 -- 172.21.15.84:0/782105292 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40ec06bc00 msgr2=0x7f40ec0b4850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:33.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.471+0000 7f40f1fd5700 1 --2- 172.21.15.84:0/782105292 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40ec06bc00 0x7f40ec0b4850 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f40e00098f0 tx=0x7f40e0009c00 comp rx=0 tx=0).stop 2023-09-13T08:25:33.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.471+0000 7f40f1fd5700 1 -- 172.21.15.84:0/782105292 shutdown_connections 2023-09-13T08:25:33.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.471+0000 7f40f1fd5700 1 --2- 172.21.15.84:0/782105292 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40ec06bc00 0x7f40ec0b4850 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:33.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.471+0000 7f40f1fd5700 1 --2- 172.21.15.84:0/782105292 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f40ec0ac9d0 0x7f40ec15e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:33.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.471+0000 7f40f1fd5700 1 -- 172.21.15.84:0/782105292 >> 172.21.15.84:0/782105292 conn(0x7f40ec0cf8f0 msgr2=0x7f40ec0cfd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:33.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.471+0000 7f40f1fd5700 1 -- 172.21.15.84:0/782105292 shutdown_connections 2023-09-13T08:25:33.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.471+0000 7f40f1fd5700 1 -- 172.21.15.84:0/782105292 wait complete. 2023-09-13T08:25:33.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.473+0000 7f40f1fd5700 1 Processor -- start 2023-09-13T08:25:33.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.473+0000 7f40f1fd5700 1 -- start start 2023-09-13T08:25:33.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.473+0000 7f40f1fd5700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f40ec06bc00 0x7f40ec153620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:33.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.473+0000 7f40f1fd5700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40ec0ac9d0 0x7f40ec15faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:33.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.474+0000 7f40f1fd5700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f40ec0ad2c0 0x7f40ec15ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:33.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.474+0000 7f40f1fd5700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40ec1f2d40 con 0x7f40ec0ac9d0 2023-09-13T08:25:33.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.474+0000 7f40f1fd5700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40ec1f7300 con 0x7f40ec06bc00 2023-09-13T08:25:33.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.474+0000 7f40f1fd5700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40ec1f7020 con 0x7f40ec0ad2c0 2023-09-13T08:25:33.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.474+0000 7f40eaffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40ec0ac9d0 0x7f40ec15faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:33.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.474+0000 7f40eaffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40ec0ac9d0 0x7f40ec15faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44824/0 (socket says 172.21.15.84:44824) 2023-09-13T08:25:33.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.474+0000 7f40eaffd700 1 -- 172.21.15.84:0/1280001889 learned_addr learned my addr 172.21.15.84:0/1280001889 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:33.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.474+0000 7f40eb7fe700 1 --2- 172.21.15.84:0/1280001889 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f40ec06bc00 0x7f40ec153620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:33.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.474+0000 7f40ebfff700 1 --2- 172.21.15.84:0/1280001889 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f40ec0ad2c0 0x7f40ec15ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:33.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.474+0000 7f40eaffd700 1 -- 172.21.15.84:0/1280001889 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f40ec0ad2c0 msgr2=0x7f40ec15ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:33.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.474+0000 7f40eaffd700 1 --2- 172.21.15.84:0/1280001889 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f40ec0ad2c0 0x7f40ec15ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:33.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.474+0000 7f40eaffd700 1 -- 172.21.15.84:0/1280001889 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f40ec06bc00 msgr2=0x7f40ec153620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:33.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.474+0000 7f40eaffd700 1 --2- 172.21.15.84:0/1280001889 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f40ec06bc00 0x7f40ec153620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:33.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.474+0000 7f40eaffd700 1 -- 172.21.15.84:0/1280001889 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40e0009550 con 0x7f40ec0ac9d0 2023-09-13T08:25:33.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.474+0000 7f40ebfff700 1 --2- 172.21.15.84:0/1280001889 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f40ec0ad2c0 0x7f40ec15ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T08:25:33.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.474+0000 7f40eaffd700 1 --2- 172.21.15.84:0/1280001889 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40ec0ac9d0 0x7f40ec15faa0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f40dc00e7e0 tx=0x7f40dc00eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:33.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.474+0000 7f40d3fff700 1 -- 172.21.15.84:0/1280001889 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40dc013610 con 0x7f40ec0ac9d0 2023-09-13T08:25:33.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.474+0000 7f40d3fff700 1 -- 172.21.15.84:0/1280001889 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40dc013770 con 0x7f40ec0ac9d0 2023-09-13T08:25:33.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.474+0000 7f40f1fd5700 1 -- 172.21.15.84:0/1280001889 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40ec1f2f30 con 0x7f40ec0ac9d0 2023-09-13T08:25:33.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.474+0000 7f40d3fff700 1 -- 172.21.15.84:0/1280001889 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40dc013b00 con 0x7f40ec0ac9d0 2023-09-13T08:25:33.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.474+0000 7f40f1fd5700 1 -- 172.21.15.84:0/1280001889 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40ec1f34f0 con 0x7f40ec0ac9d0 2023-09-13T08:25:33.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.475+0000 7f40f1fd5700 1 -- 172.21.15.84:0/1280001889 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40ec04f200 con 0x7f40ec0ac9d0 2023-09-13T08:25:33.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.476+0000 7f40d3fff700 1 -- 172.21.15.84:0/1280001889 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f40dc013c60 con 0x7f40ec0ac9d0 2023-09-13T08:25:33.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.476+0000 7f40d3fff700 1 --2- 172.21.15.84:0/1280001889 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f40d806a580 0x7f40d806ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:33.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.476+0000 7f40d3fff700 1 -- 172.21.15.84:0/1280001889 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f40dc0888f0 con 0x7f40ec0ac9d0 2023-09-13T08:25:33.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.476+0000 7f40eb7fe700 1 --2- 172.21.15.84:0/1280001889 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f40d806a580 0x7f40d806ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:33.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.476+0000 7f40eb7fe700 1 --2- 172.21.15.84:0/1280001889 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f40d806a580 0x7f40d806ca40 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f40e0009c40 tx=0x7f40e0008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:33.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.480+0000 7f40d3fff700 1 -- 172.21.15.84:0/1280001889 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f40dc053b20 con 0x7f40ec0ac9d0 2023-09-13T08:25:33.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.671+0000 7f40f1fd5700 1 -- 172.21.15.84:0/1280001889 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f40ec159d00 con 0x7f40ec0ac9d0 2023-09-13T08:25:33.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.671+0000 7f40d3fff700 1 -- 172.21.15.84:0/1280001889 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f40dc057140 con 0x7f40ec0ac9d0 2023-09-13T08:25:33.672 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-09-13T08:25:33.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.673+0000 7f40f1fd5700 1 -- 172.21.15.84:0/1280001889 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f40d806a580 msgr2=0x7f40d806ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:33.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.673+0000 7f40f1fd5700 1 --2- 172.21.15.84:0/1280001889 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f40d806a580 0x7f40d806ca40 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f40e0009c40 tx=0x7f40e0008030 comp rx=0 tx=0).stop 2023-09-13T08:25:33.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.673+0000 7f40f1fd5700 1 -- 172.21.15.84:0/1280001889 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40ec0ac9d0 msgr2=0x7f40ec15faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:33.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.673+0000 7f40f1fd5700 1 --2- 172.21.15.84:0/1280001889 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40ec0ac9d0 0x7f40ec15faa0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f40dc00e7e0 tx=0x7f40dc00eaf0 comp rx=0 tx=0).stop 2023-09-13T08:25:33.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.673+0000 7f40f1fd5700 1 -- 172.21.15.84:0/1280001889 shutdown_connections 2023-09-13T08:25:33.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.673+0000 7f40f1fd5700 1 --2- 172.21.15.84:0/1280001889 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f40ec0ad2c0 0x7f40ec15ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:33.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.673+0000 7f40f1fd5700 1 --2- 172.21.15.84:0/1280001889 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f40d806a580 0x7f40d806ca40 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:33.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.673+0000 7f40f1fd5700 1 --2- 172.21.15.84:0/1280001889 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f40ec06bc00 0x7f40ec153620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:33.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.673+0000 7f40f1fd5700 1 --2- 172.21.15.84:0/1280001889 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40ec0ac9d0 0x7f40ec15faa0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:33.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.673+0000 7f40f1fd5700 1 -- 172.21.15.84:0/1280001889 >> 172.21.15.84:0/1280001889 conn(0x7f40ec0cf8f0 msgr2=0x7f40ec15f280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:33.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.673+0000 7f40f1fd5700 1 -- 172.21.15.84:0/1280001889 shutdown_connections 2023-09-13T08:25:33.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.673+0000 7f40f1fd5700 1 -- 172.21.15.84:0/1280001889 wait complete. 2023-09-13T08:25:33.727 INFO:tasks.cephfs_test_runner:Starting test: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-09-13T08:25:33.729 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T08:25:33.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.849+0000 7f0a48d48700 1 Processor -- start 2023-09-13T08:25:33.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.849+0000 7f0a48d48700 1 -- start start 2023-09-13T08:25:33.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.850+0000 7f0a48d48700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0a44160b10 0x7f0a4406ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:33.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.850+0000 7f0a48d48700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0a440cb140 0x7f0a4406cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:33.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.850+0000 7f0a48d48700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a4406b750 con 0x7f0a4406bd10 2023-09-13T08:25:33.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.850+0000 7f0a48d48700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a4406a620 con 0x7f0a440cb140 2023-09-13T08:25:33.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.850+0000 7f0a48d48700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4406ddc0 con 0x7f0a44160b10 2023-09-13T08:25:33.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.850+0000 7f0a41d9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0a440cb140 0x7f0a4406cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:33.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.850+0000 7f0a41d9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0a440cb140 0x7f0a4406cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44832/0 (socket says 172.21.15.84:44832) 2023-09-13T08:25:33.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.850+0000 7f0a41d9b700 1 -- 172.21.15.84:0/3261530703 learned_addr learned my addr 172.21.15.84:0/3261530703 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:33.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.850+0000 7f0a42d9d700 1 --1- 172.21.15.84:0/3261530703 >> v1:172.21.15.84:6789/0 conn(0x7f0a4406bd10 0x7f0a440ad1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:47480/0 (socket says 172.21.15.84:47480) 2023-09-13T08:25:33.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.851+0000 7f0a41d9b700 1 -- 172.21.15.84:0/3261530703 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0a44160b10 msgr2=0x7f0a4406ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:33.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.851+0000 7f0a41d9b700 1 --2- 172.21.15.84:0/3261530703 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0a44160b10 0x7f0a4406ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:33.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.851+0000 7f0a41d9b700 1 -- 172.21.15.84:0/3261530703 >> v1:172.21.15.84:6789/0 conn(0x7f0a4406bd10 legacy=0x7f0a440ad1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:33.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.851+0000 7f0a4159a700 1 -- 172.21.15.84:0/3261530703 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3217147361 0 0) 0x7f0a4406b750 con 0x7f0a4406bd10 2023-09-13T08:25:33.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.851+0000 7f0a41d9b700 1 -- 172.21.15.84:0/3261530703 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a4406b9a0 con 0x7f0a440cb140 2023-09-13T08:25:33.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.851+0000 7f0a41d9b700 1 --2- 172.21.15.84:0/3261530703 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a440cb140 0x7f0a4406cc50 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f0a340098f0 tx=0x7f0a34009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39c6d60372fe6613 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:33.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.851+0000 7f0a4159a700 1 -- 172.21.15.84:0/3261530703 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a3400b8a0 con 0x7f0a440cb140 2023-09-13T08:25:33.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.851+0000 7f0a4159a700 1 -- 172.21.15.84:0/3261530703 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a3400ba00 con 0x7f0a440cb140 2023-09-13T08:25:33.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.851+0000 7f0a4159a700 1 -- 172.21.15.84:0/3261530703 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a3400bd90 con 0x7f0a440cb140 2023-09-13T08:25:33.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.852+0000 7f0a48d48700 1 -- 172.21.15.84:0/3261530703 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a440cb140 msgr2=0x7f0a4406cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:33.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.852+0000 7f0a48d48700 1 --2- 172.21.15.84:0/3261530703 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a440cb140 0x7f0a4406cc50 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f0a340098f0 tx=0x7f0a34009c00 comp rx=0 tx=0).stop 2023-09-13T08:25:33.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.852+0000 7f0a48d48700 1 -- 172.21.15.84:0/3261530703 shutdown_connections 2023-09-13T08:25:33.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.852+0000 7f0a48d48700 1 --2- 172.21.15.84:0/3261530703 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0a44160b10 0x7f0a4406ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:33.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.852+0000 7f0a48d48700 1 --2- 172.21.15.84:0/3261530703 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a440cb140 0x7f0a4406cc50 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:33.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.852+0000 7f0a48d48700 1 -- 172.21.15.84:0/3261530703 >> 172.21.15.84:0/3261530703 conn(0x7f0a440cc230 msgr2=0x7f0a440cc640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:33.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.852+0000 7f0a48d48700 1 -- 172.21.15.84:0/3261530703 shutdown_connections 2023-09-13T08:25:33.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.852+0000 7f0a48d48700 1 -- 172.21.15.84:0/3261530703 wait complete. 2023-09-13T08:25:33.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.853+0000 7f0a48d48700 1 Processor -- start 2023-09-13T08:25:33.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.853+0000 7f0a48d48700 1 -- start start 2023-09-13T08:25:33.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.854+0000 7f0a48d48700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a4406bd10 0x7f0a4415c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:33.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.854+0000 7f0a48d48700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0a440cb140 0x7f0a440c5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:33.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.854+0000 7f0a48d48700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0a44160b10 0x7f0a441f32c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:33.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.854+0000 7f0a48d48700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a441f4320 con 0x7f0a4406bd10 2023-09-13T08:25:33.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.854+0000 7f0a48d48700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a441f3800 con 0x7f0a440cb140 2023-09-13T08:25:33.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.854+0000 7f0a48d48700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a441f3a80 con 0x7f0a44160b10 2023-09-13T08:25:33.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.854+0000 7f0a4259c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a4406bd10 0x7f0a4415c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:33.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.854+0000 7f0a4259c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a4406bd10 0x7f0a4415c550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44836/0 (socket says 172.21.15.84:44836) 2023-09-13T08:25:33.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.854+0000 7f0a4259c700 1 -- 172.21.15.84:0/1383979453 learned_addr learned my addr 172.21.15.84:0/1383979453 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:33.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.854+0000 7f0a42d9d700 1 --2- 172.21.15.84:0/1383979453 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0a44160b10 0x7f0a441f32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:33.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.854+0000 7f0a41d9b700 1 --2- 172.21.15.84:0/1383979453 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0a440cb140 0x7f0a440c5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:33.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.854+0000 7f0a4259c700 1 -- 172.21.15.84:0/1383979453 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0a44160b10 msgr2=0x7f0a441f32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:33.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.854+0000 7f0a4259c700 1 --2- 172.21.15.84:0/1383979453 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0a44160b10 0x7f0a441f32c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:33.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.854+0000 7f0a4259c700 1 -- 172.21.15.84:0/1383979453 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0a440cb140 msgr2=0x7f0a440c5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:33.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.854+0000 7f0a4259c700 1 --2- 172.21.15.84:0/1383979453 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0a440cb140 0x7f0a440c5390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:33.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.854+0000 7f0a4259c700 1 -- 172.21.15.84:0/1383979453 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a34009550 con 0x7f0a4406bd10 2023-09-13T08:25:33.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.854+0000 7f0a41d9b700 1 --2- 172.21.15.84:0/1383979453 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0a440cb140 0x7f0a440c5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T08:25:33.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.854+0000 7f0a4259c700 1 --2- 172.21.15.84:0/1383979453 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a4406bd10 0x7f0a4415c550 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f0a3800b4d0 tx=0x7f0a3800b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:33.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.855+0000 7f0a32ffd700 1 -- 172.21.15.84:0/1383979453 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a38011830 con 0x7f0a4406bd10 2023-09-13T08:25:33.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.855+0000 7f0a32ffd700 1 -- 172.21.15.84:0/1383979453 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a38011990 con 0x7f0a4406bd10 2023-09-13T08:25:33.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.855+0000 7f0a32ffd700 1 -- 172.21.15.84:0/1383979453 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a38011d40 con 0x7f0a4406bd10 2023-09-13T08:25:33.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.855+0000 7f0a48d48700 1 -- 172.21.15.84:0/1383979453 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a441f3d60 con 0x7f0a4406bd10 2023-09-13T08:25:33.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.855+0000 7f0a48d48700 1 -- 172.21.15.84:0/1383979453 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a4415ad20 con 0x7f0a4406bd10 2023-09-13T08:25:33.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.855+0000 7f0a48d48700 1 -- 172.21.15.84:0/1383979453 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a440af0a0 con 0x7f0a4406bd10 2023-09-13T08:25:33.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.856+0000 7f0a32ffd700 1 -- 172.21.15.84:0/1383979453 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f0a3801a400 con 0x7f0a4406bd10 2023-09-13T08:25:33.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.856+0000 7f0a32ffd700 1 --2- 172.21.15.84:0/1383979453 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f0a2406a580 0x7f0a2406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:33.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.856+0000 7f0a32ffd700 1 -- 172.21.15.84:0/1383979453 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f0a38088e10 con 0x7f0a4406bd10 2023-09-13T08:25:33.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.856+0000 7f0a41d9b700 1 --2- 172.21.15.84:0/1383979453 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f0a2406a580 0x7f0a2406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:33.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.857+0000 7f0a41d9b700 1 --2- 172.21.15.84:0/1383979453 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f0a2406a580 0x7f0a2406ca40 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0a34000c00 tx=0x7f0a34008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:33.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:33.861+0000 7f0a32ffd700 1 -- 172.21.15.84:0/1383979453 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f0a38053fc0 con 0x7f0a4406bd10 2023-09-13T08:25:34.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.055+0000 7f0a48d48700 1 -- 172.21.15.84:0/1383979453 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0a4415ab80 con 0x7f0a4406bd10 2023-09-13T08:25:34.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.056+0000 7f0a32ffd700 1 -- 172.21.15.84:0/1383979453 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18757 (secure 0 0 0) 0x7f0a4415ab80 con 0x7f0a4406bd10 2023-09-13T08:25:34.056 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:25:34.056 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":26,"fsid":"0107440b-b634-42c5-a643-5d31ea826116","created":"2023-09-13T08:24:16.931917+0000","modified":"2023-09-13T08:25:23.878460+0000","last_up_change":"2023-09-13T08:24:28.422631+0000","last_in_change":"2023-09-13T08:24:19.425578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T08:24:28.583720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-13T08:24:39.862832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-13T08:24:41.145511+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-13T08:24:44.775160+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4a53ec12-1469-4356-b4e1-2b8fc9b7c0f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6817","nonce":1599532366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6819","nonce":1599532366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6823","nonce":1599532366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6821","nonce":1599532366}]},"public_addr":"172.21.15.84:6817/1599532366","cluster_addr":"172.21.15.84:6819/1599532366","heartbeat_back_addr":"172.21.15.84:6823/1599532366","heartbeat_front_addr":"172.21.15.84:6821/1599532366","state":["exists","up"]},{"osd":1,"uuid":"11e964a0-b80c-4afc-bfbf-e2067969db29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6825","nonce":461860977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6827","nonce":461860977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6831","nonce":461860977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6829","nonce":461860977}]},"public_addr":"172.21.15.84:6825/461860977","cluster_addr":"172.21.15.84:6827/461860977","heartbeat_back_addr":"172.21.15.84:6831/461860977","heartbeat_front_addr":"172.21.15.84:6829/461860977","state":["exists","up"]},{"osd":2,"uuid":"3ce74529-4dd1-44c7-9576-968f5fdc0c25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6809","nonce":1168316165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6811","nonce":1168316165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6815","nonce":1168316165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6813","nonce":1168316165}]},"public_addr":"172.21.15.84:6809/1168316165","cluster_addr":"172.21.15.84:6811/1168316165","heartbeat_back_addr":"172.21.15.84:6815/1168316165","heartbeat_front_addr":"172.21.15.84:6813/1168316165","state":["exists","up"]},{"osd":3,"uuid":"460cb5c5-590a-4d06-a4d9-5bac2fdf33b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6801","nonce":1661609810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6803","nonce":1661609810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6807","nonce":1661609810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6805","nonce":1661609810}]},"public_addr":"172.21.15.84:6801/1661609810","cluster_addr":"172.21.15.84:6803/1661609810","heartbeat_back_addr":"172.21.15.84:6807/1661609810","heartbeat_front_addr":"172.21.15.84:6805/1661609810","state":["exists","up"]},{"osd":4,"uuid":"bf237dd0-3ebd-44b5-8078-24a63e00d792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6801","nonce":1303562374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6803","nonce":1303562374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6807","nonce":1303562374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6805","nonce":1303562374}]},"public_addr":"172.21.15.161:6801/1303562374","cluster_addr":"172.21.15.161:6803/1303562374","heartbeat_back_addr":"172.21.15.161:6807/1303562374","heartbeat_front_addr":"172.21.15.161:6805/1303562374","state":["exists","up"]},{"osd":5,"uuid":"e1e538e0-5844-456b-8c6e-434d3a914af1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6818","nonce":961120854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6822","nonce":961120854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6830","nonce":961120854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6826","nonce":961120854}]},"public_addr":"172.21.15.161:6818/961120854","cluster_addr":"172.21.15.161:6822/961120854","heartbeat_back_addr":"172.21.15.161:6830/961120854","heartbeat_front_addr":"172.21.15.161:6826/961120854","state":["exists","up"]},{"osd":6,"uuid":"5cb1785e-960f-4dd4-b295-9e21b2c3f875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6809","nonce":980533466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6811","nonce":980533466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6815","nonce":980533466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6813","nonce":980533466}]},"public_addr":"172.21.15.161:6809/980533466","cluster_addr":"172.21.15.161:6811/980533466","heartbeat_back_addr":"172.21.15.161:6815/980533466","heartbeat_front_addr":"172.21.15.161:6813/980533466","state":["exists","up"]},{"osd":7,"uuid":"5acb6619-e933-4b46-b1c2-60af30acb839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6817","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6819","nonce":2479691549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6821","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6823","nonce":2479691549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6829","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6831","nonce":2479691549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6825","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6827","nonce":2479691549}]},"public_addr":"172.21.15.161:6819/2479691549","cluster_addr":"172.21.15.161:6823/2479691549","heartbeat_back_addr":"172.21.15.161:6831/2479691549","heartbeat_front_addr":"172.21.15.161:6827/2479691549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.678857+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.685341+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.613603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.634940+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.564387+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.697347+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.637437+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.619397+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":1}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T08:25:34.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.058+0000 7f0a48d48700 1 -- 172.21.15.84:0/1383979453 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f0a2406a580 msgr2=0x7f0a2406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:34.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.058+0000 7f0a48d48700 1 --2- 172.21.15.84:0/1383979453 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f0a2406a580 0x7f0a2406ca40 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0a34000c00 tx=0x7f0a34008030 comp rx=0 tx=0).stop 2023-09-13T08:25:34.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.058+0000 7f0a48d48700 1 -- 172.21.15.84:0/1383979453 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a4406bd10 msgr2=0x7f0a4415c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:34.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.058+0000 7f0a48d48700 1 --2- 172.21.15.84:0/1383979453 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a4406bd10 0x7f0a4415c550 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f0a3800b4d0 tx=0x7f0a3800b890 comp rx=0 tx=0).stop 2023-09-13T08:25:34.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.058+0000 7f0a48d48700 1 -- 172.21.15.84:0/1383979453 shutdown_connections 2023-09-13T08:25:34.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.058+0000 7f0a48d48700 1 --2- 172.21.15.84:0/1383979453 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0a44160b10 0x7f0a441f32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:34.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.058+0000 7f0a48d48700 1 --2- 172.21.15.84:0/1383979453 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a4406bd10 0x7f0a4415c550 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:34.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.058+0000 7f0a48d48700 1 --2- 172.21.15.84:0/1383979453 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f0a2406a580 0x7f0a2406ca40 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:34.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.058+0000 7f0a48d48700 1 --2- 172.21.15.84:0/1383979453 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0a440cb140 0x7f0a440c5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:34.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.058+0000 7f0a48d48700 1 -- 172.21.15.84:0/1383979453 >> 172.21.15.84:0/1383979453 conn(0x7f0a440cc230 msgr2=0x7f0a4406ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:34.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.058+0000 7f0a48d48700 1 -- 172.21.15.84:0/1383979453 shutdown_connections 2023-09-13T08:25:34.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.058+0000 7f0a48d48700 1 -- 172.21.15.84:0/1383979453 wait complete. 2023-09-13T08:25:34.070 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T08:24:28.583720+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-13T08:24:39.862832+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-13T08:24:41.145511+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-09-13T08:24:44.775160+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-13T08:25:34.071 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T08:25:34.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.194+0000 7f53c7bcd700 1 Processor -- start 2023-09-13T08:25:34.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.195+0000 7f53c7bcd700 1 -- start start 2023-09-13T08:25:34.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.196+0000 7f53c7bcd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f53c00cf910 0x7f53c006ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:34.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.196+0000 7f53c7bcd700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f53c00ca640 0x7f53c00caaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:34.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.196+0000 7f53c7bcd700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53c00cfe40 con 0x7f53c015a170 2023-09-13T08:25:34.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.196+0000 7f53c7bcd700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53c015a550 con 0x7f53c00cf910 2023-09-13T08:25:34.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.196+0000 7f53c7bcd700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53c00cf4c0 con 0x7f53c00ca640 2023-09-13T08:25:34.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.196+0000 7f53c5168700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f53c00cf910 0x7f53c006ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:34.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.196+0000 7f53c5168700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f53c00cf910 0x7f53c006ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44846/0 (socket says 172.21.15.84:44846) 2023-09-13T08:25:34.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.196+0000 7f53c5168700 1 -- 172.21.15.84:0/883610287 learned_addr learned my addr 172.21.15.84:0/883610287 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:34.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.196+0000 7f53c616a700 1 --2- 172.21.15.84:0/883610287 >> v2:172.21.15.161:3300/0 conn(0x7f53c00ca640 0x7f53c00caaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:34.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.196+0000 7f53c5168700 1 -- 172.21.15.84:0/883610287 >> v2:172.21.15.161:3300/0 conn(0x7f53c00ca640 msgr2=0x7f53c00caaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:34.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.196+0000 7f53c5168700 1 --2- 172.21.15.84:0/883610287 >> v2:172.21.15.161:3300/0 conn(0x7f53c00ca640 0x7f53c00caaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:34.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.196+0000 7f53c5168700 1 -- 172.21.15.84:0/883610287 >> v1:172.21.15.161:6789/0 conn(0x7f53c015a170 legacy=0x7f53c006e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:34.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.196+0000 7f53c5168700 1 -- 172.21.15.84:0/883610287 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53c00ce700 con 0x7f53c00cf910 2023-09-13T08:25:34.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.196+0000 7f53c5168700 1 --2- 172.21.15.84:0/883610287 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f53c00cf910 0x7f53c006ee50 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f53c006fed0 tx=0x7f53bc00be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a658b5e7fabd04e2 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:34.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.196+0000 7f53c4967700 1 -- 172.21.15.84:0/883610287 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53bc00dc70 con 0x7f53c00cf910 2023-09-13T08:25:34.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.196+0000 7f53c4967700 1 -- 172.21.15.84:0/883610287 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53bc00ddd0 con 0x7f53c00cf910 2023-09-13T08:25:34.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.196+0000 7f53c4967700 1 -- 172.21.15.84:0/883610287 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53bc010690 con 0x7f53c00cf910 2023-09-13T08:25:34.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.197+0000 7f53c7bcd700 1 -- 172.21.15.84:0/883610287 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f53c00cf910 msgr2=0x7f53c006ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:34.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.197+0000 7f53c7bcd700 1 --2- 172.21.15.84:0/883610287 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f53c00cf910 0x7f53c006ee50 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f53c006fed0 tx=0x7f53bc00be70 comp rx=0 tx=0).stop 2023-09-13T08:25:34.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.197+0000 7f53c7bcd700 1 -- 172.21.15.84:0/883610287 shutdown_connections 2023-09-13T08:25:34.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.197+0000 7f53c7bcd700 1 --2- 172.21.15.84:0/883610287 >> v2:172.21.15.161:3300/0 conn(0x7f53c00ca640 0x7f53c00caaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:34.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.197+0000 7f53c7bcd700 1 --2- 172.21.15.84:0/883610287 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f53c00cf910 0x7f53c006ee50 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:34.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.197+0000 7f53c7bcd700 1 -- 172.21.15.84:0/883610287 >> 172.21.15.84:0/883610287 conn(0x7f53c00cca70 msgr2=0x7f53c00cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:34.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.197+0000 7f53c7bcd700 1 -- 172.21.15.84:0/883610287 shutdown_connections 2023-09-13T08:25:34.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.197+0000 7f53c7bcd700 1 -- 172.21.15.84:0/883610287 wait complete. 2023-09-13T08:25:34.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.198+0000 7f53c7bcd700 1 Processor -- start 2023-09-13T08:25:34.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.198+0000 7f53c7bcd700 1 -- start start 2023-09-13T08:25:34.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.199+0000 7f53c7bcd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f53c00ca640 0x7f53c01edf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:34.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.199+0000 7f53c7bcd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f53c00cf910 0x7f53c00c9390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:34.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.199+0000 7f53c7bcd700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f53c015a170 0x7f53c00c4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:34.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.199+0000 7f53c7bcd700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53c00c4060 con 0x7f53c00ca640 2023-09-13T08:25:34.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.199+0000 7f53c7bcd700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53c00ca410 con 0x7f53c00cf910 2023-09-13T08:25:34.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.199+0000 7f53c7bcd700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53c00c9e50 con 0x7f53c015a170 2023-09-13T08:25:34.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.199+0000 7f53c5969700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f53c00ca640 0x7f53c01edf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:34.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.199+0000 7f53c5969700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f53c00ca640 0x7f53c01edf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44850/0 (socket says 172.21.15.84:44850) 2023-09-13T08:25:34.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.199+0000 7f53c5969700 1 -- 172.21.15.84:0/3920132978 learned_addr learned my addr 172.21.15.84:0/3920132978 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:34.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.199+0000 7f53c5168700 1 --2- 172.21.15.84:0/3920132978 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f53c00cf910 0x7f53c00c9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:34.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.199+0000 7f53c616a700 1 --2- 172.21.15.84:0/3920132978 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f53c015a170 0x7f53c00c4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:34.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.199+0000 7f53c5969700 1 -- 172.21.15.84:0/3920132978 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f53c015a170 msgr2=0x7f53c00c4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:34.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.199+0000 7f53c5969700 1 --2- 172.21.15.84:0/3920132978 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f53c015a170 0x7f53c00c4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:34.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.199+0000 7f53c5969700 1 -- 172.21.15.84:0/3920132978 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f53c00cf910 msgr2=0x7f53c00c9390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:34.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.199+0000 7f53c5969700 1 --2- 172.21.15.84:0/3920132978 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f53c00cf910 0x7f53c00c9390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:34.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.199+0000 7f53c5969700 1 -- 172.21.15.84:0/3920132978 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53bc00b7f0 con 0x7f53c00ca640 2023-09-13T08:25:34.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.200+0000 7f53c5969700 1 --2- 172.21.15.84:0/3920132978 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f53c00ca640 0x7f53c01edf80 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f53b000c450 tx=0x7f53b000c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:34.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.200+0000 7f53b67fc700 1 -- 172.21.15.84:0/3920132978 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b00052d0 con 0x7f53c00ca640 2023-09-13T08:25:34.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.200+0000 7f53b67fc700 1 -- 172.21.15.84:0/3920132978 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53b0005430 con 0x7f53c00ca640 2023-09-13T08:25:34.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.200+0000 7f53c7bcd700 1 -- 172.21.15.84:0/3920132978 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53c00ca130 con 0x7f53c00ca640 2023-09-13T08:25:34.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.200+0000 7f53b67fc700 1 -- 172.21.15.84:0/3920132978 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b00038c0 con 0x7f53c00ca640 2023-09-13T08:25:34.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.200+0000 7f53c7bcd700 1 -- 172.21.15.84:0/3920132978 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53c00c6560 con 0x7f53c00ca640 2023-09-13T08:25:34.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.201+0000 7f53c7bcd700 1 -- 172.21.15.84:0/3920132978 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53c00c41a0 con 0x7f53c00ca640 2023-09-13T08:25:34.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.201+0000 7f53b67fc700 1 -- 172.21.15.84:0/3920132978 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f53b0003a20 con 0x7f53c00ca640 2023-09-13T08:25:34.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.201+0000 7f53b67fc700 1 --2- 172.21.15.84:0/3920132978 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f53a406a580 0x7f53a406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:34.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.202+0000 7f53b67fc700 1 -- 172.21.15.84:0/3920132978 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f53b0088150 con 0x7f53c00ca640 2023-09-13T08:25:34.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.202+0000 7f53c5168700 1 --2- 172.21.15.84:0/3920132978 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f53a406a580 0x7f53a406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:34.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.202+0000 7f53c5168700 1 --2- 172.21.15.84:0/3920132978 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f53a406a580 0x7f53a406ca40 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f53c006fed0 tx=0x7f53bc013000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:34.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.206+0000 7f53b67fc700 1 -- 172.21.15.84:0/3920132978 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f53c00c41a0 con 0x7f53c00ca640 2023-09-13T08:25:34.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.392+0000 7f53c7bcd700 1 -- 172.21.15.84:0/3920132978 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f53c00c41a0 con 0x7f53c00ca640 2023-09-13T08:25:34.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.392+0000 7f53b67fc700 1 -- 172.21.15.84:0/3920132978 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f53c00c41a0 con 0x7f53c00ca640 2023-09-13T08:25:34.393 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-09-13T08:25:34.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.395+0000 7f53c7bcd700 1 -- 172.21.15.84:0/3920132978 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f53a406a580 msgr2=0x7f53a406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:34.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.395+0000 7f53c7bcd700 1 --2- 172.21.15.84:0/3920132978 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f53a406a580 0x7f53a406ca40 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f53c006fed0 tx=0x7f53bc013000 comp rx=0 tx=0).stop 2023-09-13T08:25:34.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.395+0000 7f53c7bcd700 1 -- 172.21.15.84:0/3920132978 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f53c00ca640 msgr2=0x7f53c01edf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:34.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.395+0000 7f53c7bcd700 1 --2- 172.21.15.84:0/3920132978 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f53c00ca640 0x7f53c01edf80 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f53b000c450 tx=0x7f53b000c760 comp rx=0 tx=0).stop 2023-09-13T08:25:34.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.395+0000 7f53c7bcd700 1 -- 172.21.15.84:0/3920132978 shutdown_connections 2023-09-13T08:25:34.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.395+0000 7f53c7bcd700 1 --2- 172.21.15.84:0/3920132978 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f53c015a170 0x7f53c00c4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:34.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.395+0000 7f53c7bcd700 1 --2- 172.21.15.84:0/3920132978 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f53c00ca640 0x7f53c01edf80 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:34.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.395+0000 7f53c7bcd700 1 --2- 172.21.15.84:0/3920132978 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f53a406a580 0x7f53a406ca40 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:34.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.395+0000 7f53c7bcd700 1 --2- 172.21.15.84:0/3920132978 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f53c00cf910 0x7f53c00c9390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:34.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.395+0000 7f53c7bcd700 1 -- 172.21.15.84:0/3920132978 >> 172.21.15.84:0/3920132978 conn(0x7f53c00cca70 msgr2=0x7f53c00b0ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:34.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.395+0000 7f53c7bcd700 1 -- 172.21.15.84:0/3920132978 shutdown_connections 2023-09-13T08:25:34.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.395+0000 7f53c7bcd700 1 -- 172.21.15.84:0/3920132978 wait complete. 2023-09-13T08:25:34.406 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-13T08:25:34.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.529+0000 7f8a29b87700 1 Processor -- start 2023-09-13T08:25:34.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.529+0000 7f8a29b87700 1 -- start start 2023-09-13T08:25:34.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.530+0000 7f8a29b87700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8a2415ea00 0x7f8a240cbd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:34.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.530+0000 7f8a29b87700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f8a240ced40 0x7f8a240cc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:34.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.530+0000 7f8a29b87700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8a240cda40 0x7f8a240cdef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:34.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.530+0000 7f8a29b87700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a240ce430 con 0x7f8a2415ea00 2023-09-13T08:25:34.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.530+0000 7f8a29b87700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a240cd170 con 0x7f8a240ced40 2023-09-13T08:25:34.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.530+0000 7f8a29b87700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a240cc8d0 con 0x7f8a240cda40 2023-09-13T08:25:34.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.530+0000 7f8a237fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8a2415ea00 0x7f8a240cbd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:34.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.530+0000 7f8a237fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8a2415ea00 0x7f8a240cbd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44858/0 (socket says 172.21.15.84:44858) 2023-09-13T08:25:34.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.530+0000 7f8a237fe700 1 -- 172.21.15.84:0/3624793049 learned_addr learned my addr 172.21.15.84:0/3624793049 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:34.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.531+0000 7f8a23fff700 1 --2- 172.21.15.84:0/3624793049 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8a240cda40 0x7f8a240cdef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:34.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.531+0000 7f8a22ffd700 1 --2- 172.21.15.84:0/3624793049 >> v2:172.21.15.161:3300/0 conn(0x7f8a240ced40 0x7f8a240cc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:34.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.531+0000 7f8a237fe700 1 -- 172.21.15.84:0/3624793049 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8a240cda40 msgr2=0x7f8a240cdef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:34.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.531+0000 7f8a237fe700 1 --2- 172.21.15.84:0/3624793049 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8a240cda40 0x7f8a240cdef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:34.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.531+0000 7f8a237fe700 1 -- 172.21.15.84:0/3624793049 >> v2:172.21.15.161:3300/0 conn(0x7f8a240ced40 msgr2=0x7f8a240cc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:34.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.531+0000 7f8a237fe700 1 --2- 172.21.15.84:0/3624793049 >> v2:172.21.15.161:3300/0 conn(0x7f8a240ced40 0x7f8a240cc2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:34.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.531+0000 7f8a237fe700 1 -- 172.21.15.84:0/3624793049 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a240ccbb0 con 0x7f8a2415ea00 2023-09-13T08:25:34.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.531+0000 7f8a22ffd700 1 --2- 172.21.15.84:0/3624793049 >> v2:172.21.15.161:3300/0 conn(0x7f8a240ced40 0x7f8a240cc2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T08:25:34.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.531+0000 7f8a237fe700 1 --2- 172.21.15.84:0/3624793049 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a2415ea00 0x7f8a240cbd80 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f8a2408b990 tx=0x7f8a0c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f208271c227838a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:34.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.531+0000 7f8a227fc700 1 -- 172.21.15.84:0/3624793049 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a0c005e30 con 0x7f8a2415ea00 2023-09-13T08:25:34.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.531+0000 7f8a227fc700 1 -- 172.21.15.84:0/3624793049 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a0c004030 con 0x7f8a2415ea00 2023-09-13T08:25:34.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.531+0000 7f8a227fc700 1 -- 172.21.15.84:0/3624793049 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a0c0043e0 con 0x7f8a2415ea00 2023-09-13T08:25:34.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.531+0000 7f8a29b87700 1 -- 172.21.15.84:0/3624793049 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a2415ea00 msgr2=0x7f8a240cbd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:34.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.531+0000 7f8a29b87700 1 --2- 172.21.15.84:0/3624793049 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a2415ea00 0x7f8a240cbd80 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f8a2408b990 tx=0x7f8a0c009bd0 comp rx=0 tx=0).stop 2023-09-13T08:25:34.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.532+0000 7f8a29b87700 1 -- 172.21.15.84:0/3624793049 shutdown_connections 2023-09-13T08:25:34.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.532+0000 7f8a29b87700 1 --2- 172.21.15.84:0/3624793049 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8a240cda40 0x7f8a240cdef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:34.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.532+0000 7f8a29b87700 1 --2- 172.21.15.84:0/3624793049 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a2415ea00 0x7f8a240cbd80 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:34.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.532+0000 7f8a29b87700 1 --2- 172.21.15.84:0/3624793049 >> v2:172.21.15.161:3300/0 conn(0x7f8a240ced40 0x7f8a240cc2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:34.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.532+0000 7f8a29b87700 1 -- 172.21.15.84:0/3624793049 >> 172.21.15.84:0/3624793049 conn(0x7f8a2409a470 msgr2=0x7f8a240d1170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:34.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.532+0000 7f8a29b87700 1 -- 172.21.15.84:0/3624793049 shutdown_connections 2023-09-13T08:25:34.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.532+0000 7f8a29b87700 1 -- 172.21.15.84:0/3624793049 wait complete. 2023-09-13T08:25:34.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.533+0000 7f8a29b87700 1 Processor -- start 2023-09-13T08:25:34.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.533+0000 7f8a29b87700 1 -- start start 2023-09-13T08:25:34.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.534+0000 7f8a29b87700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8a240cda40 0x7f8a24157d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:34.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.534+0000 7f8a29b87700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8a240ced40 0x7f8a240b3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:34.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.534+0000 7f8a29b87700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a2415ea00 0x7f8a241f01d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:34.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.534+0000 7f8a29b87700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a24158270 con 0x7f8a2415ea00 2023-09-13T08:25:34.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.534+0000 7f8a29b87700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a241487f0 con 0x7f8a240ced40 2023-09-13T08:25:34.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.534+0000 7f8a29b87700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a24148ad0 con 0x7f8a240cda40 2023-09-13T08:25:34.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.534+0000 7f8a23fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a2415ea00 0x7f8a241f01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:34.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.534+0000 7f8a23fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a2415ea00 0x7f8a241f01d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44868/0 (socket says 172.21.15.84:44868) 2023-09-13T08:25:34.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.534+0000 7f8a23fff700 1 -- 172.21.15.84:0/742776008 learned_addr learned my addr 172.21.15.84:0/742776008 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:34.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.534+0000 7f8a237fe700 1 --2- 172.21.15.84:0/742776008 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8a240cda40 0x7f8a24157d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:34.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.534+0000 7f8a22ffd700 1 --2- 172.21.15.84:0/742776008 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8a240ced40 0x7f8a240b3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:34.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.534+0000 7f8a23fff700 1 -- 172.21.15.84:0/742776008 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8a240cda40 msgr2=0x7f8a24157d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:34.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.534+0000 7f8a23fff700 1 --2- 172.21.15.84:0/742776008 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8a240cda40 0x7f8a24157d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:34.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.534+0000 7f8a23fff700 1 -- 172.21.15.84:0/742776008 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8a240ced40 msgr2=0x7f8a240b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:34.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.534+0000 7f8a23fff700 1 --2- 172.21.15.84:0/742776008 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8a240ced40 0x7f8a240b3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:34.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.534+0000 7f8a23fff700 1 -- 172.21.15.84:0/742776008 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a0c009500 con 0x7f8a2415ea00 2023-09-13T08:25:34.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.534+0000 7f8a23fff700 1 --2- 172.21.15.84:0/742776008 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a2415ea00 0x7f8a241f01d0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c00cc30 tx=0x7f8a1c00cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:34.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.534+0000 7f8a1bfff700 1 -- 172.21.15.84:0/742776008 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c00aa50 con 0x7f8a2415ea00 2023-09-13T08:25:34.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.534+0000 7f8a1bfff700 1 -- 172.21.15.84:0/742776008 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a1c00abb0 con 0x7f8a2415ea00 2023-09-13T08:25:34.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.534+0000 7f8a29b87700 1 -- 172.21.15.84:0/742776008 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a24148db0 con 0x7f8a2415ea00 2023-09-13T08:25:34.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.534+0000 7f8a1bfff700 1 -- 172.21.15.84:0/742776008 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c003a20 con 0x7f8a2415ea00 2023-09-13T08:25:34.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.534+0000 7f8a29b87700 1 -- 172.21.15.84:0/742776008 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a24149370 con 0x7f8a2415ea00 2023-09-13T08:25:34.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.535+0000 7f8a29b87700 1 -- 172.21.15.84:0/742776008 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a2404f200 con 0x7f8a2415ea00 2023-09-13T08:25:34.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.536+0000 7f8a1bfff700 1 -- 172.21.15.84:0/742776008 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f8a1c00f3f0 con 0x7f8a2415ea00 2023-09-13T08:25:34.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.536+0000 7f8a1bfff700 1 --2- 172.21.15.84:0/742776008 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f8a0406a580 0x7f8a0406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:34.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.536+0000 7f8a1bfff700 1 -- 172.21.15.84:0/742776008 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f8a1c088e90 con 0x7f8a2415ea00 2023-09-13T08:25:34.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.536+0000 7f8a237fe700 1 --2- 172.21.15.84:0/742776008 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f8a0406a580 0x7f8a0406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:34.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.537+0000 7f8a237fe700 1 --2- 172.21.15.84:0/742776008 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f8a0406a580 0x7f8a0406ca40 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8a2408b990 tx=0x7f8a0c008070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:34.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.541+0000 7f8a1bfff700 1 -- 172.21.15.84:0/742776008 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f8a1c054030 con 0x7f8a2415ea00 2023-09-13T08:25:34.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.729+0000 7f8a29b87700 1 -- 172.21.15.84:0/742776008 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8a240d2080 con 0x7f8a2415ea00 2023-09-13T08:25:34.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.730+0000 7f8a1bfff700 1 -- 172.21.15.84:0/742776008 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8a1c01d020 con 0x7f8a2415ea00 2023-09-13T08:25:34.730 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-09-13T08:25:34.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.732+0000 7f8a29b87700 1 -- 172.21.15.84:0/742776008 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f8a0406a580 msgr2=0x7f8a0406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:34.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.732+0000 7f8a29b87700 1 --2- 172.21.15.84:0/742776008 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f8a0406a580 0x7f8a0406ca40 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8a2408b990 tx=0x7f8a0c008070 comp rx=0 tx=0).stop 2023-09-13T08:25:34.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.732+0000 7f8a29b87700 1 -- 172.21.15.84:0/742776008 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a2415ea00 msgr2=0x7f8a241f01d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:34.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.732+0000 7f8a29b87700 1 --2- 172.21.15.84:0/742776008 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a2415ea00 0x7f8a241f01d0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c00cc30 tx=0x7f8a1c00cf40 comp rx=0 tx=0).stop 2023-09-13T08:25:34.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.732+0000 7f8a29b87700 1 -- 172.21.15.84:0/742776008 shutdown_connections 2023-09-13T08:25:34.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.732+0000 7f8a29b87700 1 --2- 172.21.15.84:0/742776008 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a2415ea00 0x7f8a241f01d0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:34.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.732+0000 7f8a29b87700 1 --2- 172.21.15.84:0/742776008 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8a240cda40 0x7f8a24157d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:34.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.732+0000 7f8a29b87700 1 --2- 172.21.15.84:0/742776008 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f8a0406a580 0x7f8a0406ca40 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:34.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.732+0000 7f8a29b87700 1 --2- 172.21.15.84:0/742776008 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8a240ced40 0x7f8a240b3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:34.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.732+0000 7f8a29b87700 1 -- 172.21.15.84:0/742776008 >> 172.21.15.84:0/742776008 conn(0x7f8a2409a470 msgr2=0x7f8a2415f080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:34.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.732+0000 7f8a29b87700 1 -- 172.21.15.84:0/742776008 shutdown_connections 2023-09-13T08:25:34.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.732+0000 7f8a29b87700 1 -- 172.21.15.84:0/742776008 wait complete. 2023-09-13T08:25:34.744 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-13T08:25:34.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.874+0000 7f711f8d0700 1 Processor -- start 2023-09-13T08:25:34.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.874+0000 7f711f8d0700 1 -- start start 2023-09-13T08:25:34.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.875+0000 7f711f8d0700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f711815b4b0 0x7f71180ca640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:34.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.875+0000 7f711f8d0700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f711806a620 0x7f711806aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:34.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.875+0000 7f711f8d0700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f711806af70 con 0x7f711806f700 2023-09-13T08:25:34.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.875+0000 7f711f8d0700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71180cc460 con 0x7f711815b4b0 2023-09-13T08:25:34.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.875+0000 7f711f8d0700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71180cacb0 con 0x7f711806a620 2023-09-13T08:25:34.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.875+0000 7f711d66c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f711815b4b0 0x7f71180ca640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:34.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.875+0000 7f711d66c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f711815b4b0 0x7f71180ca640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44872/0 (socket says 172.21.15.84:44872) 2023-09-13T08:25:34.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.875+0000 7f711d66c700 1 -- 172.21.15.84:0/1949938450 learned_addr learned my addr 172.21.15.84:0/1949938450 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:34.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.875+0000 7f711de6d700 1 --2- 172.21.15.84:0/1949938450 >> v2:172.21.15.161:3300/0 conn(0x7f711806a620 0x7f711806aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:34.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.875+0000 7f711d66c700 1 -- 172.21.15.84:0/1949938450 >> v2:172.21.15.161:3300/0 conn(0x7f711806a620 msgr2=0x7f711806aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:34.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.875+0000 7f711d66c700 1 --2- 172.21.15.84:0/1949938450 >> v2:172.21.15.161:3300/0 conn(0x7f711806a620 0x7f711806aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:34.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.875+0000 7f711d66c700 1 -- 172.21.15.84:0/1949938450 >> v1:172.21.15.161:6789/0 conn(0x7f711806f700 legacy=0x7f71180cbd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:34.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.875+0000 7f711d66c700 1 -- 172.21.15.84:0/1949938450 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71180caf90 con 0x7f711815b4b0 2023-09-13T08:25:34.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.876+0000 7f711d66c700 1 --2- 172.21.15.84:0/1949938450 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f711815b4b0 0x7f71180ca640 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f711815ff60 tx=0x7f7108009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c5cd3e27343eec8 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:34.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.876+0000 7f710ffff700 1 -- 172.21.15.84:0/1949938450 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7108004230 con 0x7f711815b4b0 2023-09-13T08:25:34.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.876+0000 7f710ffff700 1 -- 172.21.15.84:0/1949938450 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7108004390 con 0x7f711815b4b0 2023-09-13T08:25:34.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.876+0000 7f710ffff700 1 -- 172.21.15.84:0/1949938450 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71080036a0 con 0x7f711815b4b0 2023-09-13T08:25:34.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.876+0000 7f711f8d0700 1 -- 172.21.15.84:0/1949938450 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f711815b4b0 msgr2=0x7f71180ca640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:34.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.876+0000 7f711f8d0700 1 --2- 172.21.15.84:0/1949938450 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f711815b4b0 0x7f71180ca640 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f711815ff60 tx=0x7f7108009bd0 comp rx=0 tx=0).stop 2023-09-13T08:25:34.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.876+0000 7f711f8d0700 1 -- 172.21.15.84:0/1949938450 shutdown_connections 2023-09-13T08:25:34.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.876+0000 7f711f8d0700 1 --2- 172.21.15.84:0/1949938450 >> v2:172.21.15.161:3300/0 conn(0x7f711806a620 0x7f711806aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:34.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.876+0000 7f711f8d0700 1 --2- 172.21.15.84:0/1949938450 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f711815b4b0 0x7f71180ca640 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:34.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.876+0000 7f711f8d0700 1 -- 172.21.15.84:0/1949938450 >> 172.21.15.84:0/1949938450 conn(0x7f71180cca70 msgr2=0x7f71180cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:34.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.876+0000 7f711f8d0700 1 -- 172.21.15.84:0/1949938450 shutdown_connections 2023-09-13T08:25:34.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.876+0000 7f711f8d0700 1 -- 172.21.15.84:0/1949938450 wait complete. 2023-09-13T08:25:34.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.878+0000 7f711f8d0700 1 Processor -- start 2023-09-13T08:25:34.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.878+0000 7f711f8d0700 1 -- start start 2023-09-13T08:25:34.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.879+0000 7f711f8d0700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f711806a620 0x7f7118153f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:34.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.879+0000 7f711f8d0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f711806f700 0x7f71181f05a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:34.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.879+0000 7f711f8d0700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f711815b4b0 0x7f71180c5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:34.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.879+0000 7f711f8d0700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7118157e30 con 0x7f711806f700 2023-09-13T08:25:34.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.879+0000 7f711f8d0700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71181544c0 con 0x7f711815b4b0 2023-09-13T08:25:34.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.879+0000 7f711f8d0700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7118154760 con 0x7f711806a620 2023-09-13T08:25:34.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.879+0000 7f711ce6b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f711806f700 0x7f71181f05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:34.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.879+0000 7f711ce6b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f711806f700 0x7f71181f05a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44878/0 (socket says 172.21.15.84:44878) 2023-09-13T08:25:34.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.879+0000 7f711ce6b700 1 -- 172.21.15.84:0/2564652069 learned_addr learned my addr 172.21.15.84:0/2564652069 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:34.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.879+0000 7f711de6d700 1 --2- 172.21.15.84:0/2564652069 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f711815b4b0 0x7f71180c5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:34.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.879+0000 7f711d66c700 1 --2- 172.21.15.84:0/2564652069 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f711806a620 0x7f7118153f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:34.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.879+0000 7f711ce6b700 1 -- 172.21.15.84:0/2564652069 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f711806a620 msgr2=0x7f7118153f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:34.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.879+0000 7f711ce6b700 1 --2- 172.21.15.84:0/2564652069 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f711806a620 0x7f7118153f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:34.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.879+0000 7f711ce6b700 1 -- 172.21.15.84:0/2564652069 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f711815b4b0 msgr2=0x7f71180c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:34.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.879+0000 7f711ce6b700 1 --2- 172.21.15.84:0/2564652069 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f711815b4b0 0x7f71180c5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:34.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.879+0000 7f711ce6b700 1 -- 172.21.15.84:0/2564652069 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7108009550 con 0x7f711806f700 2023-09-13T08:25:34.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.879+0000 7f711ce6b700 1 --2- 172.21.15.84:0/2564652069 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f711806f700 0x7f71181f05a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f711400c4d0 tx=0x7f711400c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:34.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.879+0000 7f710dffb700 1 -- 172.21.15.84:0/2564652069 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7114011790 con 0x7f711806f700 2023-09-13T08:25:34.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.880+0000 7f710dffb700 1 -- 172.21.15.84:0/2564652069 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71140118f0 con 0x7f711806f700 2023-09-13T08:25:34.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.880+0000 7f711f8d0700 1 -- 172.21.15.84:0/2564652069 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7118154a40 con 0x7f711806f700 2023-09-13T08:25:34.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.880+0000 7f710dffb700 1 -- 172.21.15.84:0/2564652069 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7114011ca0 con 0x7f711806f700 2023-09-13T08:25:34.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.880+0000 7f711f8d0700 1 -- 172.21.15.84:0/2564652069 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7118157a90 con 0x7f711806f700 2023-09-13T08:25:34.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.881+0000 7f711f8d0700 1 -- 172.21.15.84:0/2564652069 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7118157fa0 con 0x7f711806f700 2023-09-13T08:25:34.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.881+0000 7f710dffb700 1 -- 172.21.15.84:0/2564652069 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f711401c460 con 0x7f711806f700 2023-09-13T08:25:34.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.882+0000 7f710dffb700 1 --2- 172.21.15.84:0/2564652069 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f70fc06a580 0x7f70fc06ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:34.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.882+0000 7f710dffb700 1 -- 172.21.15.84:0/2564652069 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f7114088ae0 con 0x7f711806f700 2023-09-13T08:25:34.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.882+0000 7f711d66c700 1 --2- 172.21.15.84:0/2564652069 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f70fc06a580 0x7f70fc06ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:34.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.882+0000 7f711d66c700 1 --2- 172.21.15.84:0/2564652069 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f70fc06a580 0x7f70fc06ca40 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7108009130 tx=0x7f7108008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:34.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:34.886+0000 7f710dffb700 1 -- 172.21.15.84:0/2564652069 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f7114053c80 con 0x7f711806f700 2023-09-13T08:25:35.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.077+0000 7f711f8d0700 1 -- 172.21.15.84:0/2564652069 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f711804f200 con 0x7f711806f700 2023-09-13T08:25:35.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.078+0000 7f710dffb700 1 -- 172.21.15.84:0/2564652069 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f71140572a0 con 0x7f711806f700 2023-09-13T08:25:35.078 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-09-13T08:25:35.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.080+0000 7f711f8d0700 1 -- 172.21.15.84:0/2564652069 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f70fc06a580 msgr2=0x7f70fc06ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:35.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.080+0000 7f711f8d0700 1 --2- 172.21.15.84:0/2564652069 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f70fc06a580 0x7f70fc06ca40 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7108009130 tx=0x7f7108008030 comp rx=0 tx=0).stop 2023-09-13T08:25:35.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.080+0000 7f711f8d0700 1 -- 172.21.15.84:0/2564652069 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f711806f700 msgr2=0x7f71181f05a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:35.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.080+0000 7f711f8d0700 1 --2- 172.21.15.84:0/2564652069 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f711806f700 0x7f71181f05a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f711400c4d0 tx=0x7f711400c7e0 comp rx=0 tx=0).stop 2023-09-13T08:25:35.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.080+0000 7f711f8d0700 1 -- 172.21.15.84:0/2564652069 shutdown_connections 2023-09-13T08:25:35.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.080+0000 7f711f8d0700 1 --2- 172.21.15.84:0/2564652069 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f70fc06a580 0x7f70fc06ca40 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:35.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.080+0000 7f711f8d0700 1 --2- 172.21.15.84:0/2564652069 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f711815b4b0 0x7f71180c5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:35.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.080+0000 7f711f8d0700 1 --2- 172.21.15.84:0/2564652069 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f711806a620 0x7f7118153f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:35.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.080+0000 7f711f8d0700 1 --2- 172.21.15.84:0/2564652069 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f711806f700 0x7f71181f05a0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:35.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.080+0000 7f711f8d0700 1 -- 172.21.15.84:0/2564652069 >> 172.21.15.84:0/2564652069 conn(0x7f71180cca70 msgr2=0x7f71180cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:35.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.080+0000 7f711f8d0700 1 -- 172.21.15.84:0/2564652069 shutdown_connections 2023-09-13T08:25:35.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.080+0000 7f711f8d0700 1 -- 172.21.15.84:0/2564652069 wait complete. 2023-09-13T08:25:35.091 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-09-13T08:25:35.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.215+0000 7f41d0a14700 1 Processor -- start 2023-09-13T08:25:35.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.215+0000 7f41d0a14700 1 -- start start 2023-09-13T08:25:35.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.216+0000 7f41d0a14700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f41cc0ca8e0 0x7f41cc0cf570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:35.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.216+0000 7f41d0a14700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f41cc15e910 0x7f41cc0cacc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:35.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.216+0000 7f41d0a14700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f41cc0cd590 0x7f41cc161150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:35.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.216+0000 7f41d0a14700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41cc15e480 con 0x7f41cc0cd590 2023-09-13T08:25:35.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.216+0000 7f41d0a14700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41cc0cb200 con 0x7f41cc0ca8e0 2023-09-13T08:25:35.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.216+0000 7f41d0a14700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41cc0cfbe0 con 0x7f41cc15e910 2023-09-13T08:25:35.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.216+0000 7f41cad9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f41cc0cd590 0x7f41cc161150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:35.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.216+0000 7f41cad9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f41cc0cd590 0x7f41cc161150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44888/0 (socket says 172.21.15.84:44888) 2023-09-13T08:25:35.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.216+0000 7f41cad9d700 1 -- 172.21.15.84:0/2470668237 learned_addr learned my addr 172.21.15.84:0/2470668237 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:35.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.216+0000 7f41c9d9b700 1 --2- 172.21.15.84:0/2470668237 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f41cc15e910 0x7f41cc0cacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:35.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.216+0000 7f41ca59c700 1 --2- 172.21.15.84:0/2470668237 >> v2:172.21.15.161:3300/0 conn(0x7f41cc0ca8e0 0x7f41cc0cf570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:35.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.216+0000 7f41cad9d700 1 -- 172.21.15.84:0/2470668237 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f41cc15e910 msgr2=0x7f41cc0cacc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:35.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.216+0000 7f41cad9d700 1 --2- 172.21.15.84:0/2470668237 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f41cc15e910 0x7f41cc0cacc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:35.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.217+0000 7f41cad9d700 1 -- 172.21.15.84:0/2470668237 >> v2:172.21.15.161:3300/0 conn(0x7f41cc0ca8e0 msgr2=0x7f41cc0cf570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:35.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.217+0000 7f41cad9d700 1 --2- 172.21.15.84:0/2470668237 >> v2:172.21.15.161:3300/0 conn(0x7f41cc0ca8e0 0x7f41cc0cf570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:35.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.217+0000 7f41cad9d700 1 -- 172.21.15.84:0/2470668237 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41cc15de30 con 0x7f41cc0cd590 2023-09-13T08:25:35.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.217+0000 7f41ca59c700 1 --2- 172.21.15.84:0/2470668237 >> v2:172.21.15.161:3300/0 conn(0x7f41cc0ca8e0 0x7f41cc0cf570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T08:25:35.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.217+0000 7f41cad9d700 1 --2- 172.21.15.84:0/2470668237 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41cc0cd590 0x7f41cc161150 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f41cc069150 tx=0x7f41c400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbef4bd906ff69d0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:35.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.217+0000 7f41c959a700 1 -- 172.21.15.84:0/2470668237 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c400e070 con 0x7f41cc0cd590 2023-09-13T08:25:35.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.217+0000 7f41c959a700 1 -- 172.21.15.84:0/2470668237 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41c400b9c0 con 0x7f41cc0cd590 2023-09-13T08:25:35.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.217+0000 7f41c959a700 1 -- 172.21.15.84:0/2470668237 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c400bd70 con 0x7f41cc0cd590 2023-09-13T08:25:35.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.217+0000 7f41d0a14700 1 -- 172.21.15.84:0/2470668237 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41cc0cd590 msgr2=0x7f41cc161150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:35.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.217+0000 7f41d0a14700 1 --2- 172.21.15.84:0/2470668237 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41cc0cd590 0x7f41cc161150 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f41cc069150 tx=0x7f41c400b330 comp rx=0 tx=0).stop 2023-09-13T08:25:35.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.217+0000 7f41d0a14700 1 -- 172.21.15.84:0/2470668237 shutdown_connections 2023-09-13T08:25:35.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.217+0000 7f41d0a14700 1 --2- 172.21.15.84:0/2470668237 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41cc0cd590 0x7f41cc161150 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:35.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.217+0000 7f41d0a14700 1 --2- 172.21.15.84:0/2470668237 >> v2:172.21.15.161:3300/0 conn(0x7f41cc0ca8e0 0x7f41cc0cf570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:35.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.217+0000 7f41d0a14700 1 --2- 172.21.15.84:0/2470668237 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f41cc15e910 0x7f41cc0cacc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:35.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.217+0000 7f41d0a14700 1 -- 172.21.15.84:0/2470668237 >> 172.21.15.84:0/2470668237 conn(0x7f41cc0cca70 msgr2=0x7f41cc0cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:35.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.218+0000 7f41d0a14700 1 -- 172.21.15.84:0/2470668237 shutdown_connections 2023-09-13T08:25:35.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.218+0000 7f41d0a14700 1 -- 172.21.15.84:0/2470668237 wait complete. 2023-09-13T08:25:35.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.219+0000 7f41d0a14700 1 Processor -- start 2023-09-13T08:25:35.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.219+0000 7f41d0a14700 1 -- start start 2023-09-13T08:25:35.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.220+0000 7f41d0a14700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41cc0ca8e0 0x7f41cc156b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:35.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.220+0000 7f41d0a14700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41cc0cd590 0x7f41cc15b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:35.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.220+0000 7f41d0a14700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f41cc15e910 0x7f41cc15bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:35.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.220+0000 7f41d0a14700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41cc0b2cf0 con 0x7f41cc0cd590 2023-09-13T08:25:35.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.220+0000 7f41d0a14700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41cc0b2fd0 con 0x7f41cc0ca8e0 2023-09-13T08:25:35.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.220+0000 7f41d0a14700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41cc0b32b0 con 0x7f41cc15e910 2023-09-13T08:25:35.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.220+0000 7f41c9d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41cc0cd590 0x7f41cc15b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:35.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.220+0000 7f41c9d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41cc0cd590 0x7f41cc15b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44892/0 (socket says 172.21.15.84:44892) 2023-09-13T08:25:35.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.220+0000 7f41c9d9b700 1 -- 172.21.15.84:0/1453728755 learned_addr learned my addr 172.21.15.84:0/1453728755 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:35.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.220+0000 7f41ca59c700 1 --2- 172.21.15.84:0/1453728755 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41cc0ca8e0 0x7f41cc156b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:35.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.220+0000 7f41cad9d700 1 --2- 172.21.15.84:0/1453728755 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f41cc15e910 0x7f41cc15bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:35.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.220+0000 7f41c9d9b700 1 -- 172.21.15.84:0/1453728755 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f41cc15e910 msgr2=0x7f41cc15bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:35.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.220+0000 7f41c9d9b700 1 --2- 172.21.15.84:0/1453728755 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f41cc15e910 0x7f41cc15bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:35.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.220+0000 7f41c9d9b700 1 -- 172.21.15.84:0/1453728755 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41cc0ca8e0 msgr2=0x7f41cc156b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:35.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.220+0000 7f41c9d9b700 1 --2- 172.21.15.84:0/1453728755 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41cc0ca8e0 0x7f41cc156b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:35.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.220+0000 7f41c9d9b700 1 -- 172.21.15.84:0/1453728755 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41c4009b30 con 0x7f41cc0cd590 2023-09-13T08:25:35.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.220+0000 7f41c9d9b700 1 --2- 172.21.15.84:0/1453728755 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41cc0cd590 0x7f41cc15b6c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f41bc00d800 tx=0x7f41bc00db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:35.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.220+0000 7f41baffd700 1 -- 172.21.15.84:0/1453728755 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41bc0125f0 con 0x7f41cc0cd590 2023-09-13T08:25:35.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.220+0000 7f41baffd700 1 -- 172.21.15.84:0/1453728755 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41bc012750 con 0x7f41cc0cd590 2023-09-13T08:25:35.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.220+0000 7f41baffd700 1 -- 172.21.15.84:0/1453728755 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41bc012b00 con 0x7f41cc0cd590 2023-09-13T08:25:35.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.220+0000 7f41d0a14700 1 -- 172.21.15.84:0/1453728755 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41cc0b3590 con 0x7f41cc0cd590 2023-09-13T08:25:35.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.220+0000 7f41d0a14700 1 -- 172.21.15.84:0/1453728755 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41cc0b3d90 con 0x7f41cc0cd590 2023-09-13T08:25:35.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.221+0000 7f41d0a14700 1 -- 172.21.15.84:0/1453728755 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41cc04f200 con 0x7f41cc0cd590 2023-09-13T08:25:35.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.222+0000 7f41baffd700 1 -- 172.21.15.84:0/1453728755 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f41bc012c60 con 0x7f41cc0cd590 2023-09-13T08:25:35.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.222+0000 7f41baffd700 1 --2- 172.21.15.84:0/1453728755 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f41ac06a580 0x7f41ac06ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:35.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.222+0000 7f41baffd700 1 -- 172.21.15.84:0/1453728755 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f41bc088db0 con 0x7f41cc0cd590 2023-09-13T08:25:35.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.222+0000 7f41ca59c700 1 --2- 172.21.15.84:0/1453728755 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f41ac06a580 0x7f41ac06ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:35.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.222+0000 7f41ca59c700 1 --2- 172.21.15.84:0/1453728755 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f41ac06a580 0x7f41ac06ca40 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f41c0006ba0 tx=0x7f41c0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:35.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.226+0000 7f41baffd700 1 -- 172.21.15.84:0/1453728755 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f41bc053f50 con 0x7f41cc0cd590 2023-09-13T08:25:35.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.414+0000 7f41d0a14700 1 -- 172.21.15.84:0/1453728755 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f41cc0b0f30 con 0x7f41cc0cd590 2023-09-13T08:25:35.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.414+0000 7f41baffd700 1 -- 172.21.15.84:0/1453728755 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f41bc057570 con 0x7f41cc0cd590 2023-09-13T08:25:35.415 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-09-13T08:25:35.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.417+0000 7f41d0a14700 1 -- 172.21.15.84:0/1453728755 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f41ac06a580 msgr2=0x7f41ac06ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:35.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.417+0000 7f41d0a14700 1 --2- 172.21.15.84:0/1453728755 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f41ac06a580 0x7f41ac06ca40 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f41c0006ba0 tx=0x7f41c0008040 comp rx=0 tx=0).stop 2023-09-13T08:25:35.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.417+0000 7f41d0a14700 1 -- 172.21.15.84:0/1453728755 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41cc0cd590 msgr2=0x7f41cc15b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:35.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.417+0000 7f41d0a14700 1 --2- 172.21.15.84:0/1453728755 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41cc0cd590 0x7f41cc15b6c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f41bc00d800 tx=0x7f41bc00db10 comp rx=0 tx=0).stop 2023-09-13T08:25:35.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.417+0000 7f41d0a14700 1 -- 172.21.15.84:0/1453728755 shutdown_connections 2023-09-13T08:25:35.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.417+0000 7f41d0a14700 1 --2- 172.21.15.84:0/1453728755 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f41cc15e910 0x7f41cc15bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:35.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.417+0000 7f41d0a14700 1 --2- 172.21.15.84:0/1453728755 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f41ac06a580 0x7f41ac06ca40 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:35.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.417+0000 7f41d0a14700 1 --2- 172.21.15.84:0/1453728755 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41cc0ca8e0 0x7f41cc156b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:35.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.417+0000 7f41d0a14700 1 --2- 172.21.15.84:0/1453728755 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41cc0cd590 0x7f41cc15b6c0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:35.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.417+0000 7f41d0a14700 1 -- 172.21.15.84:0/1453728755 >> 172.21.15.84:0/1453728755 conn(0x7f41cc0cca70 msgr2=0x7f41cc0cdbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:35.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.417+0000 7f41d0a14700 1 -- 172.21.15.84:0/1453728755 shutdown_connections 2023-09-13T08:25:35.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.417+0000 7f41d0a14700 1 -- 172.21.15.84:0/1453728755 wait complete. 2023-09-13T08:25:35.429 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2023-09-13T08:25:35.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.549+0000 7f9a0780c700 1 Processor -- start 2023-09-13T08:25:35.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.550+0000 7f9a0780c700 1 -- start start 2023-09-13T08:25:35.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.550+0000 7f9a0780c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9a000718f0 0x7f9a000aefd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:35.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.550+0000 7f9a0780c700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9a0006a620 0x7f9a0006aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:35.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.550+0000 7f9a0780c700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a0006afb0 con 0x7f9a0015d7b0 2023-09-13T08:25:35.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.550+0000 7f9a0780c700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a000ad4b0 con 0x7f9a000718f0 2023-09-13T08:25:35.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.550+0000 7f9a0780c700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a000ca680 con 0x7f9a0006a620 2023-09-13T08:25:35.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.550+0000 7f9a04da7700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9a000718f0 0x7f9a000aefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:35.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.551+0000 7f9a055a8700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f9a0015d7b0 0x7f9a000acda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:47544/0 (socket says 172.21.15.84:47544) 2023-09-13T08:25:35.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.551+0000 7f9a055a8700 1 -- 172.21.15.84:0/2073753709 learned_addr learned my addr 172.21.15.84:0/2073753709 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:25:35.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.551+0000 7f9a05da9700 1 --2- 172.21.15.84:0/2073753709 >> v2:172.21.15.161:3300/0 conn(0x7f9a0006a620 0x7f9a0006aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:35.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.551+0000 7f9a04da7700 1 -- 172.21.15.84:0/2073753709 >> v2:172.21.15.161:3300/0 conn(0x7f9a0006a620 msgr2=0x7f9a0006aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:35.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.551+0000 7f9a04da7700 1 --2- 172.21.15.84:0/2073753709 >> v2:172.21.15.161:3300/0 conn(0x7f9a0006a620 0x7f9a0006aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:35.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.551+0000 7f9a04da7700 1 -- 172.21.15.84:0/2073753709 >> v1:172.21.15.84:6789/0 conn(0x7f9a0015d7b0 legacy=0x7f9a000acda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:35.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.551+0000 7f9a04da7700 1 -- 172.21.15.84:0/2073753709 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a000721c0 con 0x7f9a000718f0 2023-09-13T08:25:35.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.551+0000 7f99f7fff700 1 -- 172.21.15.84:0/2073753709 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1222993484 0 0) 0x7f99f0001110 con 0x7f9a0015d7b0 2023-09-13T08:25:35.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.551+0000 7f9a05da9700 1 --2- 172.21.15.84:0/2073753709 >> v2:172.21.15.161:3300/0 conn(0x7f9a0006a620 0x7f9a0006aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T08:25:35.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.551+0000 7f9a04da7700 1 --2- 172.21.15.84:0/2073753709 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a000718f0 0x7f9a000aefd0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f9a00071240 tx=0x7f99fc009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f48348d35c3b1495 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:35.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.551+0000 7f99f7fff700 1 -- 172.21.15.84:0/2073753709 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99fc011830 con 0x7f9a000718f0 2023-09-13T08:25:35.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.551+0000 7f99f7fff700 1 -- 172.21.15.84:0/2073753709 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99fc011990 con 0x7f9a000718f0 2023-09-13T08:25:35.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.551+0000 7f99f7fff700 1 -- 172.21.15.84:0/2073753709 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99fc011d20 con 0x7f9a000718f0 2023-09-13T08:25:35.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.552+0000 7f9a0780c700 1 -- 172.21.15.84:0/2073753709 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a000718f0 msgr2=0x7f9a000aefd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:35.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.552+0000 7f9a0780c700 1 --2- 172.21.15.84:0/2073753709 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a000718f0 0x7f9a000aefd0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f9a00071240 tx=0x7f99fc009b20 comp rx=0 tx=0).stop 2023-09-13T08:25:35.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.552+0000 7f9a0780c700 1 -- 172.21.15.84:0/2073753709 shutdown_connections 2023-09-13T08:25:35.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.552+0000 7f9a0780c700 1 --2- 172.21.15.84:0/2073753709 >> v2:172.21.15.161:3300/0 conn(0x7f9a0006a620 0x7f9a0006aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:35.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.552+0000 7f9a0780c700 1 --2- 172.21.15.84:0/2073753709 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a000718f0 0x7f9a000aefd0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:35.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.552+0000 7f9a0780c700 1 -- 172.21.15.84:0/2073753709 >> 172.21.15.84:0/2073753709 conn(0x7f9a000ccab0 msgr2=0x7f9a000ccec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:35.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.552+0000 7f9a0780c700 1 -- 172.21.15.84:0/2073753709 shutdown_connections 2023-09-13T08:25:35.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.552+0000 7f9a0780c700 1 -- 172.21.15.84:0/2073753709 wait complete. 2023-09-13T08:25:35.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.553+0000 7f9a0780c700 1 Processor -- start 2023-09-13T08:25:35.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.553+0000 7f9a0780c700 1 -- start start 2023-09-13T08:25:35.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.554+0000 7f9a0780c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a0006a620 0x7f9a000c7c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:35.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.554+0000 7f9a0780c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a000718f0 0x7f9a0014f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:35.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.554+0000 7f9a0780c700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a0015d7b0 0x7f9a0006e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:35.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.554+0000 7f9a0780c700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a00160a50 con 0x7f9a000718f0 2023-09-13T08:25:35.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.554+0000 7f9a0780c700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a001f3da0 con 0x7f9a0006a620 2023-09-13T08:25:35.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.554+0000 7f9a0780c700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a001f3ac0 con 0x7f9a0015d7b0 2023-09-13T08:25:35.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.554+0000 7f9a04da7700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a000718f0 0x7f9a0014f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:35.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.554+0000 7f9a04da7700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a000718f0 0x7f9a0014f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44906/0 (socket says 172.21.15.84:44906) 2023-09-13T08:25:35.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.554+0000 7f9a04da7700 1 -- 172.21.15.84:0/3332110816 learned_addr learned my addr 172.21.15.84:0/3332110816 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:35.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.554+0000 7f9a055a8700 1 --2- 172.21.15.84:0/3332110816 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a0006a620 0x7f9a000c7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:35.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.554+0000 7f9a05da9700 1 --2- 172.21.15.84:0/3332110816 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a0015d7b0 0x7f9a0006e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:35.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.554+0000 7f9a04da7700 1 -- 172.21.15.84:0/3332110816 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a0015d7b0 msgr2=0x7f9a0006e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:35.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.554+0000 7f9a04da7700 1 --2- 172.21.15.84:0/3332110816 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a0015d7b0 0x7f9a0006e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:35.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.554+0000 7f9a04da7700 1 -- 172.21.15.84:0/3332110816 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a0006a620 msgr2=0x7f9a000c7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:35.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.554+0000 7f9a04da7700 1 --2- 172.21.15.84:0/3332110816 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a0006a620 0x7f9a000c7c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:35.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.554+0000 7f9a04da7700 1 -- 172.21.15.84:0/3332110816 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99fc0094a0 con 0x7f9a000718f0 2023-09-13T08:25:35.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.554+0000 7f9a05da9700 1 --2- 172.21.15.84:0/3332110816 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a0015d7b0 0x7f9a0006e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T08:25:35.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.554+0000 7f9a04da7700 1 --2- 172.21.15.84:0/3332110816 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a000718f0 0x7f9a0014f5d0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f99fc000c00 tx=0x7f99fc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:35.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.554+0000 7f99f5ffb700 1 -- 172.21.15.84:0/3332110816 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99fc0036a0 con 0x7f9a000718f0 2023-09-13T08:25:35.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.554+0000 7f99f5ffb700 1 -- 172.21.15.84:0/3332110816 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99fc01f070 con 0x7f9a000718f0 2023-09-13T08:25:35.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.554+0000 7f9a0780c700 1 -- 172.21.15.84:0/3332110816 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a000c71a0 con 0x7f9a000718f0 2023-09-13T08:25:35.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.555+0000 7f99f5ffb700 1 -- 172.21.15.84:0/3332110816 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99fc003a20 con 0x7f9a000718f0 2023-09-13T08:25:35.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.555+0000 7f9a0780c700 1 -- 172.21.15.84:0/3332110816 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a000c7760 con 0x7f9a000718f0 2023-09-13T08:25:35.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.556+0000 7f9a0780c700 1 -- 172.21.15.84:0/3332110816 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a000cfe10 con 0x7f9a000718f0 2023-09-13T08:25:35.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.556+0000 7f99f5ffb700 1 -- 172.21.15.84:0/3332110816 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f99fc003b80 con 0x7f9a000718f0 2023-09-13T08:25:35.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.556+0000 7f99f5ffb700 1 --2- 172.21.15.84:0/3332110816 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f99e406a580 0x7f99e406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:35.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.556+0000 7f99f5ffb700 1 -- 172.21.15.84:0/3332110816 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f99fc021070 con 0x7f9a000718f0 2023-09-13T08:25:35.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.557+0000 7f9a055a8700 1 --2- 172.21.15.84:0/3332110816 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f99e406a580 0x7f99e406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:35.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.557+0000 7f9a055a8700 1 --2- 172.21.15.84:0/3332110816 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f99e406a580 0x7f99e406ca40 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f99f0000f60 tx=0x7f99f0007c20 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:35.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.561+0000 7f99f5ffb700 1 -- 172.21.15.84:0/3332110816 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f99fc0559f0 con 0x7f9a000718f0 2023-09-13T08:25:35.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.830+0000 7f9a0780c700 1 -- 172.21.15.84:0/3332110816 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) v1 -- 0x7f9a0004e9b0 con 0x7f9a000718f0 2023-09-13T08:25:35.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.922+0000 7f99f5ffb700 1 -- 172.21.15.84:0/3332110816 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v69) v1 ==== 147+0+0 (secure 0 0 0) 0x7f99fc059010 con 0x7f9a000718f0 2023-09-13T08:25:35.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.924+0000 7f9a0780c700 1 -- 172.21.15.84:0/3332110816 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f99e406a580 msgr2=0x7f99e406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:35.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.924+0000 7f9a0780c700 1 --2- 172.21.15.84:0/3332110816 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f99e406a580 0x7f99e406ca40 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f99f0000f60 tx=0x7f99f0007c20 comp rx=0 tx=0).stop 2023-09-13T08:25:35.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.924+0000 7f9a0780c700 1 -- 172.21.15.84:0/3332110816 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a000718f0 msgr2=0x7f9a0014f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:35.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.924+0000 7f9a0780c700 1 --2- 172.21.15.84:0/3332110816 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a000718f0 0x7f9a0014f5d0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f99fc000c00 tx=0x7f99fc004750 comp rx=0 tx=0).stop 2023-09-13T08:25:35.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.924+0000 7f9a0780c700 1 -- 172.21.15.84:0/3332110816 shutdown_connections 2023-09-13T08:25:35.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.924+0000 7f9a0780c700 1 --2- 172.21.15.84:0/3332110816 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a0015d7b0 0x7f9a0006e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:35.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.924+0000 7f9a0780c700 1 --2- 172.21.15.84:0/3332110816 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f99e406a580 0x7f99e406ca40 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:35.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.924+0000 7f9a0780c700 1 --2- 172.21.15.84:0/3332110816 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a0006a620 0x7f9a000c7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:35.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.924+0000 7f9a0780c700 1 --2- 172.21.15.84:0/3332110816 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a000718f0 0x7f9a0014f5d0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:35.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.925+0000 7f9a0780c700 1 -- 172.21.15.84:0/3332110816 >> 172.21.15.84:0/3332110816 conn(0x7f9a000ccab0 msgr2=0x7f9a000b1f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:35.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.925+0000 7f9a0780c700 1 -- 172.21.15.84:0/3332110816 shutdown_connections 2023-09-13T08:25:35.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:35.925+0000 7f9a0780c700 1 -- 172.21.15.84:0/3332110816 wait complete. 2023-09-13T08:25:35.937 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-09-13T08:25:36.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.060+0000 7f70d7323700 1 Processor -- start 2023-09-13T08:25:36.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.061+0000 7f70d7323700 1 -- start start 2023-09-13T08:25:36.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.061+0000 7f70d7323700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f70d00ced40 0x7f70d00cda40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:36.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.061+0000 7f70d7323700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f70d00cdf80 0x7f70d015f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:36.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.061+0000 7f70d7323700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70d00cd170 con 0x7f70d015ea00 2023-09-13T08:25:36.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.061+0000 7f70d7323700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70d00ce410 con 0x7f70d00cdf80 2023-09-13T08:25:36.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.061+0000 7f70d7323700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70d00cc8d0 con 0x7f70d00ced40 2023-09-13T08:25:36.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.062+0000 7f70d58c0700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f70d00cdf80 0x7f70d015f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:36.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.062+0000 7f70d58c0700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f70d00cdf80 0x7f70d015f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44916/0 (socket says 172.21.15.84:44916) 2023-09-13T08:25:36.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.062+0000 7f70d58c0700 1 -- 172.21.15.84:0/3709543404 learned_addr learned my addr 172.21.15.84:0/3709543404 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:36.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.062+0000 7f70d48be700 1 --2- 172.21.15.84:0/3709543404 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f70d00ced40 0x7f70d00cda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:36.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.062+0000 7f70d58c0700 1 -- 172.21.15.84:0/3709543404 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f70d00ced40 msgr2=0x7f70d00cda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:36.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.062+0000 7f70d58c0700 1 --2- 172.21.15.84:0/3709543404 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f70d00ced40 0x7f70d00cda40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:36.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.062+0000 7f70d58c0700 1 -- 172.21.15.84:0/3709543404 >> v1:172.21.15.161:6789/0 conn(0x7f70d015ea00 legacy=0x7f70d00cbd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:36.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.062+0000 7f70d58c0700 1 -- 172.21.15.84:0/3709543404 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70d00ccbb0 con 0x7f70d00cdf80 2023-09-13T08:25:36.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.062+0000 7f70d58c0700 1 --2- 172.21.15.84:0/3709543404 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70d00cdf80 0x7f70d015f0f0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f70c8009e50 tx=0x7f70c800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=169ad461436fa186 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:36.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.062+0000 7f70c3fff700 1 -- 172.21.15.84:0/3709543404 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c800e070 con 0x7f70d00cdf80 2023-09-13T08:25:36.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.062+0000 7f70c3fff700 1 -- 172.21.15.84:0/3709543404 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70c800b910 con 0x7f70d00cdf80 2023-09-13T08:25:36.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.062+0000 7f70c3fff700 1 -- 172.21.15.84:0/3709543404 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c800bcc0 con 0x7f70d00cdf80 2023-09-13T08:25:36.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.063+0000 7f70d7323700 1 -- 172.21.15.84:0/3709543404 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70d00cdf80 msgr2=0x7f70d015f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:36.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.063+0000 7f70d7323700 1 --2- 172.21.15.84:0/3709543404 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70d00cdf80 0x7f70d015f0f0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f70c8009e50 tx=0x7f70c800b330 comp rx=0 tx=0).stop 2023-09-13T08:25:36.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.063+0000 7f70d7323700 1 -- 172.21.15.84:0/3709543404 shutdown_connections 2023-09-13T08:25:36.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.063+0000 7f70d7323700 1 --2- 172.21.15.84:0/3709543404 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70d00cdf80 0x7f70d015f0f0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:36.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.063+0000 7f70d7323700 1 --2- 172.21.15.84:0/3709543404 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f70d00ced40 0x7f70d00cda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:36.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.063+0000 7f70d7323700 1 -- 172.21.15.84:0/3709543404 >> 172.21.15.84:0/3709543404 conn(0x7f70d009a470 msgr2=0x7f70d00d1170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:36.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.063+0000 7f70d7323700 1 -- 172.21.15.84:0/3709543404 shutdown_connections 2023-09-13T08:25:36.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.063+0000 7f70d7323700 1 -- 172.21.15.84:0/3709543404 wait complete. 2023-09-13T08:25:36.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.064+0000 7f70d7323700 1 Processor -- start 2023-09-13T08:25:36.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.064+0000 7f70d7323700 1 -- start start 2023-09-13T08:25:36.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.065+0000 7f70d7323700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70d00cdf80 0x7f70d006d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:36.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.065+0000 7f70d7323700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f70d00ced40 0x7f70d01565d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:36.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.065+0000 7f70d7323700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f70d015ea00 0x7f70d0158470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:36.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.065+0000 7f70d7323700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d00c9d40 con 0x7f70d00cdf80 2023-09-13T08:25:36.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.065+0000 7f70d7323700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d00c90c0 con 0x7f70d00ced40 2023-09-13T08:25:36.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.065+0000 7f70d7323700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70d00c93a0 con 0x7f70d015ea00 2023-09-13T08:25:36.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.065+0000 7f70d50bf700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70d00cdf80 0x7f70d006d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:36.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.065+0000 7f70d50bf700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70d00cdf80 0x7f70d006d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44918/0 (socket says 172.21.15.84:44918) 2023-09-13T08:25:36.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.065+0000 7f70d50bf700 1 -- 172.21.15.84:0/3525739691 learned_addr learned my addr 172.21.15.84:0/3525739691 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:36.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.066+0000 7f70d48be700 1 --2- 172.21.15.84:0/3525739691 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f70d00ced40 0x7f70d01565d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:36.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.066+0000 7f70d58c0700 1 --2- 172.21.15.84:0/3525739691 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f70d015ea00 0x7f70d0158470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:36.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.066+0000 7f70d50bf700 1 -- 172.21.15.84:0/3525739691 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f70d015ea00 msgr2=0x7f70d0158470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:36.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.066+0000 7f70d50bf700 1 --2- 172.21.15.84:0/3525739691 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f70d015ea00 0x7f70d0158470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:36.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.066+0000 7f70d50bf700 1 -- 172.21.15.84:0/3525739691 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f70d00ced40 msgr2=0x7f70d01565d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:36.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.066+0000 7f70d50bf700 1 --2- 172.21.15.84:0/3525739691 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f70d00ced40 0x7f70d01565d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:36.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.066+0000 7f70d50bf700 1 -- 172.21.15.84:0/3525739691 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70c8009b30 con 0x7f70d00cdf80 2023-09-13T08:25:36.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.066+0000 7f70d58c0700 1 --2- 172.21.15.84:0/3525739691 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f70d015ea00 0x7f70d0158470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T08:25:36.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.066+0000 7f70d50bf700 1 --2- 172.21.15.84:0/3525739691 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70d00cdf80 0x7f70d006d2b0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f70c400c4d0 tx=0x7f70c400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:36.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.066+0000 7f70c1ffb700 1 -- 172.21.15.84:0/3525739691 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c40052d0 con 0x7f70d00cdf80 2023-09-13T08:25:36.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.066+0000 7f70c1ffb700 1 -- 172.21.15.84:0/3525739691 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70c4005430 con 0x7f70d00cdf80 2023-09-13T08:25:36.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.066+0000 7f70d7323700 1 -- 172.21.15.84:0/3525739691 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70d00c9680 con 0x7f70d00cdf80 2023-09-13T08:25:36.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.066+0000 7f70c1ffb700 1 -- 172.21.15.84:0/3525739691 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c40038f0 con 0x7f70d00cdf80 2023-09-13T08:25:36.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.066+0000 7f70d7323700 1 -- 172.21.15.84:0/3525739691 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70d006c990 con 0x7f70d00cdf80 2023-09-13T08:25:36.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.067+0000 7f70d7323700 1 -- 172.21.15.84:0/3525739691 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70d004f200 con 0x7f70d00cdf80 2023-09-13T08:25:36.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.067+0000 7f70c1ffb700 1 -- 172.21.15.84:0/3525739691 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f70c4003a50 con 0x7f70d00cdf80 2023-09-13T08:25:36.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.068+0000 7f70c1ffb700 1 --2- 172.21.15.84:0/3525739691 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f70b406a580 0x7f70b406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:36.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.068+0000 7f70c1ffb700 1 -- 172.21.15.84:0/3525739691 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f70c40882a0 con 0x7f70d00cdf80 2023-09-13T08:25:36.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.068+0000 7f70d48be700 1 --2- 172.21.15.84:0/3525739691 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f70b406a580 0x7f70b406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:36.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.068+0000 7f70d48be700 1 --2- 172.21.15.84:0/3525739691 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f70b406a580 0x7f70b406ca40 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f70d0159e00 tx=0x7f70cc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:36.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.072+0000 7f70c1ffb700 1 -- 172.21.15.84:0/3525739691 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f70c40534d0 con 0x7f70d00cdf80 2023-09-13T08:25:36.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.262+0000 7f70d7323700 1 -- 172.21.15.84:0/3525739691 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f70d00cc610 con 0x7f70d00cdf80 2023-09-13T08:25:36.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.266+0000 7f70c1ffb700 1 -- 172.21.15.84:0/3525739691 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f70c4056af0 con 0x7f70d00cdf80 2023-09-13T08:25:36.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.268+0000 7f70d7323700 1 -- 172.21.15.84:0/3525739691 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f70b406a580 msgr2=0x7f70b406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:36.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.268+0000 7f70d7323700 1 --2- 172.21.15.84:0/3525739691 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f70b406a580 0x7f70b406ca40 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f70d0159e00 tx=0x7f70cc008040 comp rx=0 tx=0).stop 2023-09-13T08:25:36.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.268+0000 7f70d7323700 1 -- 172.21.15.84:0/3525739691 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70d00cdf80 msgr2=0x7f70d006d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:36.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.268+0000 7f70d7323700 1 --2- 172.21.15.84:0/3525739691 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70d00cdf80 0x7f70d006d2b0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f70c400c4d0 tx=0x7f70c400c890 comp rx=0 tx=0).stop 2023-09-13T08:25:36.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.268+0000 7f70d7323700 1 -- 172.21.15.84:0/3525739691 shutdown_connections 2023-09-13T08:25:36.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.268+0000 7f70d7323700 1 --2- 172.21.15.84:0/3525739691 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f70d015ea00 0x7f70d0158470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:36.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.268+0000 7f70d7323700 1 --2- 172.21.15.84:0/3525739691 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70d00cdf80 0x7f70d006d2b0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:36.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.268+0000 7f70d7323700 1 --2- 172.21.15.84:0/3525739691 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f70b406a580 0x7f70b406ca40 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:36.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.268+0000 7f70d7323700 1 --2- 172.21.15.84:0/3525739691 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f70d00ced40 0x7f70d01565d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:36.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.268+0000 7f70d7323700 1 -- 172.21.15.84:0/3525739691 >> 172.21.15.84:0/3525739691 conn(0x7f70d009a470 msgr2=0x7f70d00b29e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:36.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.268+0000 7f70d7323700 1 -- 172.21.15.84:0/3525739691 shutdown_connections 2023-09-13T08:25:36.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.268+0000 7f70d7323700 1 -- 172.21.15.84:0/3525739691 wait complete. 2023-09-13T08:25:36.280 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-09-13T08:25:36.281 DEBUG:teuthology.orchestra.run.smithi084:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-13T08:25:36.319 DEBUG:teuthology.orchestra.run.smithi161:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-13T08:25:36.370 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-09-13T08:25:36.371 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-09-13T08:25:36.371 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T08:25:36.389 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-09-13T08:25:36.389 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T08:25:36.447 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-09-13T08:25:36.448 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T08:25:36.510 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T08:25:36.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.677+0000 7fe3858d4700 1 Processor -- start 2023-09-13T08:25:36.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.677+0000 7fe3858d4700 1 -- start start 2023-09-13T08:25:36.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.677+0000 7fe3858d4700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe3800cdb50 0x7fe3800cdf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:36.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.677+0000 7fe3858d4700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe380161980 0x7fe3800712d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:36.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.677+0000 7fe3858d4700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3800ce470 con 0x7fe38006d880 2023-09-13T08:25:36.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.677+0000 7fe3858d4700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3800cd8a0 con 0x7fe3800cdb50 2023-09-13T08:25:36.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.677+0000 7fe3858d4700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe380161ee0 con 0x7fe380161980 2023-09-13T08:25:36.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.678+0000 7fe37effd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe3800cdb50 0x7fe3800cdf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:36.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.678+0000 7fe37effd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe3800cdb50 0x7fe3800cdf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44926/0 (socket says 172.21.15.84:44926) 2023-09-13T08:25:36.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.678+0000 7fe37effd700 1 -- 172.21.15.84:0/4144490916 learned_addr learned my addr 172.21.15.84:0/4144490916 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:36.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.678+0000 7fe37e7fc700 1 --2- 172.21.15.84:0/4144490916 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe380161980 0x7fe3800712d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:36.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.678+0000 7fe37effd700 1 -- 172.21.15.84:0/4144490916 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe380161980 msgr2=0x7fe3800712d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:36.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.678+0000 7fe37effd700 1 --2- 172.21.15.84:0/4144490916 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe380161980 0x7fe3800712d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:36.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.678+0000 7fe37effd700 1 -- 172.21.15.84:0/4144490916 >> v1:172.21.15.161:6789/0 conn(0x7fe38006d880 legacy=0x7fe38015de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:36.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.678+0000 7fe37effd700 1 -- 172.21.15.84:0/4144490916 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3800cd000 con 0x7fe3800cdb50 2023-09-13T08:25:36.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.678+0000 7fe37effd700 1 --2- 172.21.15.84:0/4144490916 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3800cdb50 0x7fe3800cdf30 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fe3700098f0 tx=0x7fe370009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0d3b314b1d8a81e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:36.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.678+0000 7fe37dffb700 1 -- 172.21.15.84:0/4144490916 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe37000b8a0 con 0x7fe3800cdb50 2023-09-13T08:25:36.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.678+0000 7fe37dffb700 1 -- 172.21.15.84:0/4144490916 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe37000ba00 con 0x7fe3800cdb50 2023-09-13T08:25:36.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.678+0000 7fe37dffb700 1 -- 172.21.15.84:0/4144490916 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe37000bd90 con 0x7fe3800cdb50 2023-09-13T08:25:36.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.679+0000 7fe3858d4700 1 -- 172.21.15.84:0/4144490916 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3800cdb50 msgr2=0x7fe3800cdf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:36.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.679+0000 7fe3858d4700 1 --2- 172.21.15.84:0/4144490916 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3800cdb50 0x7fe3800cdf30 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fe3700098f0 tx=0x7fe370009c00 comp rx=0 tx=0).stop 2023-09-13T08:25:36.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.679+0000 7fe3858d4700 1 -- 172.21.15.84:0/4144490916 shutdown_connections 2023-09-13T08:25:36.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.679+0000 7fe3858d4700 1 --2- 172.21.15.84:0/4144490916 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3800cdb50 0x7fe3800cdf30 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:36.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.679+0000 7fe3858d4700 1 --2- 172.21.15.84:0/4144490916 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe380161980 0x7fe3800712d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:36.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.679+0000 7fe3858d4700 1 -- 172.21.15.84:0/4144490916 >> 172.21.15.84:0/4144490916 conn(0x7fe38006bb20 msgr2=0x7fe38006bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:36.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.679+0000 7fe3858d4700 1 -- 172.21.15.84:0/4144490916 shutdown_connections 2023-09-13T08:25:36.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.679+0000 7fe3858d4700 1 -- 172.21.15.84:0/4144490916 wait complete. 2023-09-13T08:25:36.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.680+0000 7fe3858d4700 1 Processor -- start 2023-09-13T08:25:36.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.680+0000 7fe3858d4700 1 -- start start 2023-09-13T08:25:36.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.681+0000 7fe3858d4700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe38006d880 0x7fe38015c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:36.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.681+0000 7fe3858d4700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe3800cdb50 0x7fe3801584a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:36.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.681+0000 7fe3858d4700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe380161980 0x7fe38015f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:36.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.681+0000 7fe3858d4700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3800c6100 con 0x7fe380161980 2023-09-13T08:25:36.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.681+0000 7fe3858d4700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3800c54f0 con 0x7fe38006d880 2023-09-13T08:25:36.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.681+0000 7fe3858d4700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3800c57d0 con 0x7fe3800cdb50 2023-09-13T08:25:36.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.681+0000 7fe37f7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe380161980 0x7fe38015f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:36.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.681+0000 7fe37f7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe380161980 0x7fe38015f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44934/0 (socket says 172.21.15.84:44934) 2023-09-13T08:25:36.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.681+0000 7fe37f7fe700 1 -- 172.21.15.84:0/3975646198 learned_addr learned my addr 172.21.15.84:0/3975646198 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:36.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.681+0000 7fe37effd700 1 --2- 172.21.15.84:0/3975646198 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe38006d880 0x7fe38015c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:36.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.681+0000 7fe37e7fc700 1 --2- 172.21.15.84:0/3975646198 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe3800cdb50 0x7fe3801584a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:36.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.681+0000 7fe37f7fe700 1 -- 172.21.15.84:0/3975646198 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe3800cdb50 msgr2=0x7fe3801584a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:36.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.681+0000 7fe37f7fe700 1 --2- 172.21.15.84:0/3975646198 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe3800cdb50 0x7fe3801584a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:36.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.681+0000 7fe37f7fe700 1 -- 172.21.15.84:0/3975646198 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe38006d880 msgr2=0x7fe38015c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:36.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.681+0000 7fe37f7fe700 1 --2- 172.21.15.84:0/3975646198 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe38006d880 0x7fe38015c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:36.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.681+0000 7fe37f7fe700 1 -- 172.21.15.84:0/3975646198 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe370009550 con 0x7fe380161980 2023-09-13T08:25:36.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.681+0000 7fe37effd700 1 --2- 172.21.15.84:0/3975646198 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe38006d880 0x7fe38015c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T08:25:36.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.681+0000 7fe37f7fe700 1 --2- 172.21.15.84:0/3975646198 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe380161980 0x7fe38015f910 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fe37800cc50 tx=0x7fe37800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:36.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.682+0000 7fe367fff700 1 -- 172.21.15.84:0/3975646198 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe378003c00 con 0x7fe380161980 2023-09-13T08:25:36.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.682+0000 7fe367fff700 1 -- 172.21.15.84:0/3975646198 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe378003d60 con 0x7fe380161980 2023-09-13T08:25:36.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.682+0000 7fe3858d4700 1 -- 172.21.15.84:0/3975646198 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3800c5ab0 con 0x7fe380161980 2023-09-13T08:25:36.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.682+0000 7fe367fff700 1 -- 172.21.15.84:0/3975646198 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe37800ab60 con 0x7fe380161980 2023-09-13T08:25:36.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.682+0000 7fe3858d4700 1 -- 172.21.15.84:0/3975646198 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe380160c00 con 0x7fe380161980 2023-09-13T08:25:36.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.683+0000 7fe3858d4700 1 -- 172.21.15.84:0/3975646198 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3800c62b0 con 0x7fe380161980 2023-09-13T08:25:36.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.683+0000 7fe367fff700 1 -- 172.21.15.84:0/3975646198 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fe37800acc0 con 0x7fe380161980 2023-09-13T08:25:36.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.683+0000 7fe367fff700 1 --2- 172.21.15.84:0/3975646198 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fe36c06a580 0x7fe36c06ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:36.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.683+0000 7fe367fff700 1 -- 172.21.15.84:0/3975646198 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fe378088e40 con 0x7fe380161980 2023-09-13T08:25:36.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.683+0000 7fe37effd700 1 --2- 172.21.15.84:0/3975646198 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fe36c06a580 0x7fe36c06ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:36.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.684+0000 7fe37effd700 1 --2- 172.21.15.84:0/3975646198 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fe36c06a580 0x7fe36c06ca40 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe370009c40 tx=0x7fe370008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:36.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.688+0000 7fe367fff700 1 -- 172.21.15.84:0/3975646198 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fe3800c62b0 con 0x7fe380161980 2023-09-13T08:25:36.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.880+0000 7fe3858d4700 1 -- 172.21.15.84:0/3975646198 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe3800c6490 con 0x7fe380161980 2023-09-13T08:25:36.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.881+0000 7fe367fff700 1 -- 172.21.15.84:0/3975646198 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18757 (secure 0 0 0) 0x7fe378053fe0 con 0x7fe380161980 2023-09-13T08:25:36.883 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:25:36.883 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":26,"fsid":"0107440b-b634-42c5-a643-5d31ea826116","created":"2023-09-13T08:24:16.931917+0000","modified":"2023-09-13T08:25:23.878460+0000","last_up_change":"2023-09-13T08:24:28.422631+0000","last_in_change":"2023-09-13T08:24:19.425578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T08:24:28.583720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-13T08:24:39.862832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-13T08:24:41.145511+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-13T08:24:44.775160+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4a53ec12-1469-4356-b4e1-2b8fc9b7c0f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6817","nonce":1599532366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6819","nonce":1599532366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6823","nonce":1599532366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6821","nonce":1599532366}]},"public_addr":"172.21.15.84:6817/1599532366","cluster_addr":"172.21.15.84:6819/1599532366","heartbeat_back_addr":"172.21.15.84:6823/1599532366","heartbeat_front_addr":"172.21.15.84:6821/1599532366","state":["exists","up"]},{"osd":1,"uuid":"11e964a0-b80c-4afc-bfbf-e2067969db29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6825","nonce":461860977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6827","nonce":461860977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6831","nonce":461860977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6829","nonce":461860977}]},"public_addr":"172.21.15.84:6825/461860977","cluster_addr":"172.21.15.84:6827/461860977","heartbeat_back_addr":"172.21.15.84:6831/461860977","heartbeat_front_addr":"172.21.15.84:6829/461860977","state":["exists","up"]},{"osd":2,"uuid":"3ce74529-4dd1-44c7-9576-968f5fdc0c25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6809","nonce":1168316165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6811","nonce":1168316165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6815","nonce":1168316165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6813","nonce":1168316165}]},"public_addr":"172.21.15.84:6809/1168316165","cluster_addr":"172.21.15.84:6811/1168316165","heartbeat_back_addr":"172.21.15.84:6815/1168316165","heartbeat_front_addr":"172.21.15.84:6813/1168316165","state":["exists","up"]},{"osd":3,"uuid":"460cb5c5-590a-4d06-a4d9-5bac2fdf33b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6801","nonce":1661609810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6803","nonce":1661609810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6807","nonce":1661609810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6805","nonce":1661609810}]},"public_addr":"172.21.15.84:6801/1661609810","cluster_addr":"172.21.15.84:6803/1661609810","heartbeat_back_addr":"172.21.15.84:6807/1661609810","heartbeat_front_addr":"172.21.15.84:6805/1661609810","state":["exists","up"]},{"osd":4,"uuid":"bf237dd0-3ebd-44b5-8078-24a63e00d792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6801","nonce":1303562374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6803","nonce":1303562374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6807","nonce":1303562374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6805","nonce":1303562374}]},"public_addr":"172.21.15.161:6801/1303562374","cluster_addr":"172.21.15.161:6803/1303562374","heartbeat_back_addr":"172.21.15.161:6807/1303562374","heartbeat_front_addr":"172.21.15.161:6805/1303562374","state":["exists","up"]},{"osd":5,"uuid":"e1e538e0-5844-456b-8c6e-434d3a914af1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6818","nonce":961120854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6822","nonce":961120854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6830","nonce":961120854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6826","nonce":961120854}]},"public_addr":"172.21.15.161:6818/961120854","cluster_addr":"172.21.15.161:6822/961120854","heartbeat_back_addr":"172.21.15.161:6830/961120854","heartbeat_front_addr":"172.21.15.161:6826/961120854","state":["exists","up"]},{"osd":6,"uuid":"5cb1785e-960f-4dd4-b295-9e21b2c3f875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6809","nonce":980533466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6811","nonce":980533466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6815","nonce":980533466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6813","nonce":980533466}]},"public_addr":"172.21.15.161:6809/980533466","cluster_addr":"172.21.15.161:6811/980533466","heartbeat_back_addr":"172.21.15.161:6815/980533466","heartbeat_front_addr":"172.21.15.161:6813/980533466","state":["exists","up"]},{"osd":7,"uuid":"5acb6619-e933-4b46-b1c2-60af30acb839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6817","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6819","nonce":2479691549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6821","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6823","nonce":2479691549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6829","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6831","nonce":2479691549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6825","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6827","nonce":2479691549}]},"public_addr":"172.21.15.161:6819/2479691549","cluster_addr":"172.21.15.161:6823/2479691549","heartbeat_back_addr":"172.21.15.161:6831/2479691549","heartbeat_front_addr":"172.21.15.161:6827/2479691549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.678857+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.685341+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.613603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.634940+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.564387+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.697347+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.637437+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.619397+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":1}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T08:25:36.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.883+0000 7fe3858d4700 1 -- 172.21.15.84:0/3975646198 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fe36c06a580 msgr2=0x7fe36c06ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:36.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.883+0000 7fe3858d4700 1 --2- 172.21.15.84:0/3975646198 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fe36c06a580 0x7fe36c06ca40 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe370009c40 tx=0x7fe370008030 comp rx=0 tx=0).stop 2023-09-13T08:25:36.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.883+0000 7fe3858d4700 1 -- 172.21.15.84:0/3975646198 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe380161980 msgr2=0x7fe38015f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:36.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.883+0000 7fe3858d4700 1 --2- 172.21.15.84:0/3975646198 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe380161980 0x7fe38015f910 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fe37800cc50 tx=0x7fe37800cf60 comp rx=0 tx=0).stop 2023-09-13T08:25:36.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.883+0000 7fe3858d4700 1 -- 172.21.15.84:0/3975646198 shutdown_connections 2023-09-13T08:25:36.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.883+0000 7fe3858d4700 1 --2- 172.21.15.84:0/3975646198 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe380161980 0x7fe38015f910 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:36.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.883+0000 7fe3858d4700 1 --2- 172.21.15.84:0/3975646198 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fe36c06a580 0x7fe36c06ca40 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:36.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.883+0000 7fe3858d4700 1 --2- 172.21.15.84:0/3975646198 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe38006d880 0x7fe38015c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:36.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.883+0000 7fe3858d4700 1 --2- 172.21.15.84:0/3975646198 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe3800cdb50 0x7fe3801584a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:36.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.884+0000 7fe3858d4700 1 -- 172.21.15.84:0/3975646198 >> 172.21.15.84:0/3975646198 conn(0x7fe38006bb20 msgr2=0x7fe3800c7f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:36.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.884+0000 7fe3858d4700 1 -- 172.21.15.84:0/3975646198 shutdown_connections 2023-09-13T08:25:36.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:36.884+0000 7fe3858d4700 1 -- 172.21.15.84:0/3975646198 wait complete. 2023-09-13T08:25:36.896 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T08:24:28.583720+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-13T08:24:39.862832+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-13T08:24:41.145511+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-09-13T08:24:44.775160+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-13T08:25:36.898 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T08:25:37.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.024+0000 7f50a673e700 1 Processor -- start 2023-09-13T08:25:37.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.024+0000 7f50a673e700 1 -- start start 2023-09-13T08:25:37.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.024+0000 7f50a673e700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f50a0140360 0x7f50a006a620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:37.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.024+0000 7f50a673e700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f50a006ab60 0x7f50a00ceb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:37.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.024+0000 7f50a673e700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50a00ccc50 con 0x7f50a00cf060 2023-09-13T08:25:37.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.024+0000 7f50a673e700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50a00cf4d0 con 0x7f50a006ab60 2023-09-13T08:25:37.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.025+0000 7f50a673e700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50a00ce080 con 0x7f50a0140360 2023-09-13T08:25:37.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.025+0000 7f509f7fe700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f50a006ab60 0x7f50a00ceb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:37.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.025+0000 7f509ffff700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f50a0140360 0x7f50a006a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:37.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.025+0000 7f509ffff700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f50a0140360 0x7f50a006a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.84:54802/0 (socket says 172.21.15.84:54802) 2023-09-13T08:25:37.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.025+0000 7f50a4cdb700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f50a00cf060 0x7f50a0140740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.84:33756/0 (socket says 172.21.15.84:33756) 2023-09-13T08:25:37.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.025+0000 7f509ffff700 1 -- 172.21.15.84:0/2259546111 learned_addr learned my addr 172.21.15.84:0/2259546111 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:37.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.025+0000 7f509f7fe700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f50a006ab60 0x7f50a00ceb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.84:40712/0 (socket says 172.21.15.84:40712) 2023-09-13T08:25:37.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.025+0000 7f509ffff700 1 -- 172.21.15.84:0/2259546111 >> v2:172.21.15.161:3300/0 conn(0x7f50a006ab60 msgr2=0x7f50a00ceb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:37.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.025+0000 7f509ffff700 1 --2- 172.21.15.84:0/2259546111 >> v2:172.21.15.161:3300/0 conn(0x7f50a006ab60 0x7f50a00ceb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:37.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.025+0000 7f509ffff700 1 -- 172.21.15.84:0/2259546111 >> v1:172.21.15.161:6789/0 conn(0x7f50a00cf060 legacy=0x7f50a0140740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:37.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.025+0000 7f509ffff700 1 -- 172.21.15.84:0/2259546111 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50a00cc690 con 0x7f50a0140360 2023-09-13T08:25:37.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.025+0000 7f509f7fe700 1 --2- 172.21.15.84:0/2259546111 >> v2:172.21.15.161:3300/0 conn(0x7f50a006ab60 0x7f50a00ceb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T08:25:37.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.025+0000 7f509ffff700 1 --2- 172.21.15.84:0/2259546111 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f50a0140360 0x7f50a006a620 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f50900098f0 tx=0x7f5090009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d795dc440121f31 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:37.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.026+0000 7f509effd700 1 -- 172.21.15.84:0/2259546111 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5090011830 con 0x7f50a0140360 2023-09-13T08:25:37.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.026+0000 7f509effd700 1 -- 172.21.15.84:0/2259546111 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5090011990 con 0x7f50a0140360 2023-09-13T08:25:37.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.026+0000 7f509effd700 1 -- 172.21.15.84:0/2259546111 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5090011d20 con 0x7f50a0140360 2023-09-13T08:25:37.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.026+0000 7f50a673e700 1 -- 172.21.15.84:0/2259546111 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f50a0140360 msgr2=0x7f50a006a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:37.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.026+0000 7f50a673e700 1 --2- 172.21.15.84:0/2259546111 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f50a0140360 0x7f50a006a620 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f50900098f0 tx=0x7f5090009c00 comp rx=0 tx=0).stop 2023-09-13T08:25:37.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.026+0000 7f50a673e700 1 -- 172.21.15.84:0/2259546111 shutdown_connections 2023-09-13T08:25:37.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.026+0000 7f50a673e700 1 --2- 172.21.15.84:0/2259546111 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f50a0140360 0x7f50a006a620 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:37.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.026+0000 7f50a673e700 1 --2- 172.21.15.84:0/2259546111 >> v2:172.21.15.161:3300/0 conn(0x7f50a006ab60 0x7f50a00ceb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:37.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.026+0000 7f50a673e700 1 -- 172.21.15.84:0/2259546111 >> 172.21.15.84:0/2259546111 conn(0x7f50a00cf8f0 msgr2=0x7f50a00cfd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:37.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.026+0000 7f50a673e700 1 -- 172.21.15.84:0/2259546111 shutdown_connections 2023-09-13T08:25:37.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.026+0000 7f50a673e700 1 -- 172.21.15.84:0/2259546111 wait complete. 2023-09-13T08:25:37.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.027+0000 7f50a673e700 1 Processor -- start 2023-09-13T08:25:37.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.028+0000 7f50a673e700 1 -- start start 2023-09-13T08:25:37.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.028+0000 7f50a673e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50a006ab60 0x7f50a01f02d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:37.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.028+0000 7f50a673e700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f50a00cf060 0x7f50a015b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:37.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.028+0000 7f50a673e700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f50a0140360 0x7f50a015bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:37.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.028+0000 7f50a673e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50a01580f0 con 0x7f50a006ab60 2023-09-13T08:25:37.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.028+0000 7f50a673e700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50a01560f0 con 0x7f50a00cf060 2023-09-13T08:25:37.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.028+0000 7f50a673e700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50a015c310 con 0x7f50a0140360 2023-09-13T08:25:37.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.028+0000 7f509ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50a006ab60 0x7f50a01f02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:37.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.028+0000 7f509ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50a006ab60 0x7f50a01f02d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44942/0 (socket says 172.21.15.84:44942) 2023-09-13T08:25:37.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.028+0000 7f509ffff700 1 -- 172.21.15.84:0/4042873072 learned_addr learned my addr 172.21.15.84:0/4042873072 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:37.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.029+0000 7f509f7fe700 1 --2- 172.21.15.84:0/4042873072 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f50a00cf060 0x7f50a015b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:37.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.029+0000 7f50a4cdb700 1 --2- 172.21.15.84:0/4042873072 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f50a0140360 0x7f50a015bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:37.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.029+0000 7f509ffff700 1 -- 172.21.15.84:0/4042873072 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f50a0140360 msgr2=0x7f50a015bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:37.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.029+0000 7f509ffff700 1 --2- 172.21.15.84:0/4042873072 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f50a0140360 0x7f50a015bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:37.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.029+0000 7f509ffff700 1 -- 172.21.15.84:0/4042873072 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f50a00cf060 msgr2=0x7f50a015b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:37.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.029+0000 7f509ffff700 1 --2- 172.21.15.84:0/4042873072 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f50a00cf060 0x7f50a015b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:37.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.029+0000 7f509ffff700 1 -- 172.21.15.84:0/4042873072 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50940094a0 con 0x7f50a006ab60 2023-09-13T08:25:37.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.029+0000 7f509ffff700 1 --2- 172.21.15.84:0/4042873072 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50a006ab60 0x7f50a01f02d0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f5090000c00 tx=0x7f5090004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:37.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.029+0000 7f509cff9700 1 -- 172.21.15.84:0/4042873072 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5090004530 con 0x7f50a006ab60 2023-09-13T08:25:37.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.029+0000 7f509cff9700 1 -- 172.21.15.84:0/4042873072 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f509001f070 con 0x7f50a006ab60 2023-09-13T08:25:37.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.029+0000 7f509cff9700 1 -- 172.21.15.84:0/4042873072 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50900038e0 con 0x7f50a006ab60 2023-09-13T08:25:37.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.029+0000 7f50a673e700 1 -- 172.21.15.84:0/4042873072 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5090009550 con 0x7f50a006ab60 2023-09-13T08:25:37.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.029+0000 7f50a673e700 1 -- 172.21.15.84:0/4042873072 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50a0158370 con 0x7f50a006ab60 2023-09-13T08:25:37.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.030+0000 7f50a673e700 1 -- 172.21.15.84:0/4042873072 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50a015c830 con 0x7f50a006ab60 2023-09-13T08:25:37.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.031+0000 7f509cff9700 1 -- 172.21.15.84:0/4042873072 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f5090021030 con 0x7f50a006ab60 2023-09-13T08:25:37.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.031+0000 7f509cff9700 1 --2- 172.21.15.84:0/4042873072 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f508c06a580 0x7f508c06ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:37.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.031+0000 7f509cff9700 1 -- 172.21.15.84:0/4042873072 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f509008a250 con 0x7f50a006ab60 2023-09-13T08:25:37.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.031+0000 7f509f7fe700 1 --2- 172.21.15.84:0/4042873072 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f508c06a580 0x7f508c06ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:37.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.031+0000 7f509f7fe700 1 --2- 172.21.15.84:0/4042873072 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f508c06a580 0x7f508c06ca40 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f50a006afa0 tx=0x7f5094008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:37.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.035+0000 7f509cff9700 1 -- 172.21.15.84:0/4042873072 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f5090055400 con 0x7f50a006ab60 2023-09-13T08:25:37.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.222+0000 7f50a673e700 1 -- 172.21.15.84:0/4042873072 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f50a004f200 con 0x7f50a006ab60 2023-09-13T08:25:37.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.222+0000 7f509cff9700 1 -- 172.21.15.84:0/4042873072 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5090058a20 con 0x7f50a006ab60 2023-09-13T08:25:37.223 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-09-13T08:25:37.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.224+0000 7f50a673e700 1 -- 172.21.15.84:0/4042873072 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f508c06a580 msgr2=0x7f508c06ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:37.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.224+0000 7f50a673e700 1 --2- 172.21.15.84:0/4042873072 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f508c06a580 0x7f508c06ca40 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f50a006afa0 tx=0x7f5094008040 comp rx=0 tx=0).stop 2023-09-13T08:25:37.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.224+0000 7f50a673e700 1 -- 172.21.15.84:0/4042873072 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50a006ab60 msgr2=0x7f50a01f02d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:37.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.224+0000 7f50a673e700 1 --2- 172.21.15.84:0/4042873072 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50a006ab60 0x7f50a01f02d0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f5090000c00 tx=0x7f5090004750 comp rx=0 tx=0).stop 2023-09-13T08:25:37.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.224+0000 7f50a673e700 1 -- 172.21.15.84:0/4042873072 shutdown_connections 2023-09-13T08:25:37.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.224+0000 7f50a673e700 1 --2- 172.21.15.84:0/4042873072 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f50a0140360 0x7f50a015bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:37.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.224+0000 7f50a673e700 1 --2- 172.21.15.84:0/4042873072 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50a006ab60 0x7f50a01f02d0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:37.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.224+0000 7f50a673e700 1 --2- 172.21.15.84:0/4042873072 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f508c06a580 0x7f508c06ca40 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:37.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.224+0000 7f50a673e700 1 --2- 172.21.15.84:0/4042873072 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f50a00cf060 0x7f50a015b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:37.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.224+0000 7f50a673e700 1 -- 172.21.15.84:0/4042873072 >> 172.21.15.84:0/4042873072 conn(0x7f50a00cf8f0 msgr2=0x7f50a013f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:37.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.224+0000 7f50a673e700 1 -- 172.21.15.84:0/4042873072 shutdown_connections 2023-09-13T08:25:37.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.224+0000 7f50a673e700 1 -- 172.21.15.84:0/4042873072 wait complete. 2023-09-13T08:25:37.237 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-13T08:25:37.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.372+0000 7f78c6924700 1 Processor -- start 2023-09-13T08:25:37.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.372+0000 7f78c6924700 1 -- start start 2023-09-13T08:25:37.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.373+0000 7f78c6924700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f78c00cd590 0x7f78c00cf570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:37.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.373+0000 7f78c6924700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78c015e480 con 0x7f78c00ca8e0 2023-09-13T08:25:37.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.373+0000 7f78c6924700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78c00cfbe0 con 0x7f78c015e910 2023-09-13T08:25:37.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.373+0000 7f78c6924700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78c015de30 con 0x7f78c00cd590 2023-09-13T08:25:37.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.373+0000 7f78bffff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f78c00ca8e0 0x7f78c00cacc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:47594/0 (socket says 172.21.15.84:47594) 2023-09-13T08:25:37.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.373+0000 7f78bffff700 1 -- 172.21.15.84:0/3958582305 learned_addr learned my addr 172.21.15.84:0/3958582305 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:25:37.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.373+0000 7f78c4ec1700 1 --2- 172.21.15.84:0/3958582305 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f78c00cd590 0x7f78c00cf570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:37.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.373+0000 7f78beffd700 1 -- 172.21.15.84:0/3958582305 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4115972288 0 0) 0x7f78c015e480 con 0x7f78c00ca8e0 2023-09-13T08:25:37.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.373+0000 7f78beffd700 1 -- 172.21.15.84:0/3958582305 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78a80035b0 con 0x7f78c00ca8e0 2023-09-13T08:25:37.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.373+0000 7f78beffd700 1 -- 172.21.15.84:0/3958582305 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3810735283 0 0) 0x7f78c00cfbe0 con 0x7f78c015e910 2023-09-13T08:25:37.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.373+0000 7f78beffd700 1 -- 172.21.15.84:0/3958582305 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78c015e480 con 0x7f78c015e910 2023-09-13T08:25:37.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.373+0000 7f78c4ec1700 1 -- 172.21.15.84:0/3958582305 >> v1:172.21.15.161:6789/0 conn(0x7f78c015e910 legacy=0x7f78c00cdbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:37.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.373+0000 7f78c4ec1700 1 -- 172.21.15.84:0/3958582305 >> v1:172.21.15.84:6789/0 conn(0x7f78c00ca8e0 legacy=0x7f78c00cacc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:37.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.373+0000 7f78c4ec1700 1 -- 172.21.15.84:0/3958582305 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78c015e110 con 0x7f78c00cd590 2023-09-13T08:25:37.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.374+0000 7f78c4ec1700 1 --2- 172.21.15.84:0/3958582305 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f78c00cd590 0x7f78c00cf570 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f78b8009dc0 tx=0x7f78b800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e784613aaa08ca06 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:37.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.374+0000 7f78beffd700 1 -- 172.21.15.84:0/3958582305 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b800e070 con 0x7f78c00cd590 2023-09-13T08:25:37.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.374+0000 7f78beffd700 1 -- 172.21.15.84:0/3958582305 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78b800bb20 con 0x7f78c00cd590 2023-09-13T08:25:37.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.374+0000 7f78beffd700 1 -- 172.21.15.84:0/3958582305 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b8012430 con 0x7f78c00cd590 2023-09-13T08:25:37.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.374+0000 7f78c6924700 1 -- 172.21.15.84:0/3958582305 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f78c00cd590 msgr2=0x7f78c00cf570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:37.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.374+0000 7f78c6924700 1 --2- 172.21.15.84:0/3958582305 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f78c00cd590 0x7f78c00cf570 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f78b8009dc0 tx=0x7f78b800b330 comp rx=0 tx=0).stop 2023-09-13T08:25:37.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.374+0000 7f78c6924700 1 -- 172.21.15.84:0/3958582305 shutdown_connections 2023-09-13T08:25:37.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.374+0000 7f78c6924700 1 --2- 172.21.15.84:0/3958582305 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f78c00cd590 0x7f78c00cf570 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:37.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.374+0000 7f78c6924700 1 -- 172.21.15.84:0/3958582305 >> 172.21.15.84:0/3958582305 conn(0x7f78c00cca70 msgr2=0x7f78c00cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:37.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.374+0000 7f78c6924700 1 -- 172.21.15.84:0/3958582305 shutdown_connections 2023-09-13T08:25:37.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.374+0000 7f78c6924700 1 -- 172.21.15.84:0/3958582305 wait complete. 2023-09-13T08:25:37.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.375+0000 7f78c6924700 1 Processor -- start 2023-09-13T08:25:37.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.376+0000 7f78c6924700 1 -- start start 2023-09-13T08:25:37.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.376+0000 7f78c6924700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78c00ca8e0 0x7f78c01f5e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:37.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.376+0000 7f78c6924700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f78c00cd590 0x7f78c01f4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:37.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.376+0000 7f78c6924700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f78c015e910 0x7f78c01f6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:37.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.376+0000 7f78c6924700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78c01f63a0 con 0x7f78c00ca8e0 2023-09-13T08:25:37.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.376+0000 7f78c6924700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78c00b2df0 con 0x7f78c00cd590 2023-09-13T08:25:37.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.376+0000 7f78c6924700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78c00b30d0 con 0x7f78c015e910 2023-09-13T08:25:37.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.376+0000 7f78bffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78c00ca8e0 0x7f78c01f5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:37.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.376+0000 7f78bffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78c00ca8e0 0x7f78c01f5e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44954/0 (socket says 172.21.15.84:44954) 2023-09-13T08:25:37.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.376+0000 7f78bffff700 1 -- 172.21.15.84:0/666450547 learned_addr learned my addr 172.21.15.84:0/666450547 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:37.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.377+0000 7f78c4ec1700 1 --2- 172.21.15.84:0/666450547 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f78c015e910 0x7f78c01f6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:37.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.377+0000 7f78bf7fe700 1 --2- 172.21.15.84:0/666450547 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f78c00cd590 0x7f78c01f4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:37.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.377+0000 7f78bffff700 1 -- 172.21.15.84:0/666450547 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f78c015e910 msgr2=0x7f78c01f6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:37.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.377+0000 7f78bffff700 1 --2- 172.21.15.84:0/666450547 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f78c015e910 0x7f78c01f6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:37.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.377+0000 7f78bffff700 1 -- 172.21.15.84:0/666450547 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f78c00cd590 msgr2=0x7f78c01f4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:37.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.377+0000 7f78bffff700 1 --2- 172.21.15.84:0/666450547 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f78c00cd590 0x7f78c01f4160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:37.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.377+0000 7f78bffff700 1 -- 172.21.15.84:0/666450547 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78b8009a70 con 0x7f78c00ca8e0 2023-09-13T08:25:37.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.377+0000 7f78bffff700 1 --2- 172.21.15.84:0/666450547 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78c00ca8e0 0x7f78c01f5e60 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f78b4001eb0 tx=0x7f78b400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:37.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.377+0000 7f78bcff9700 1 -- 172.21.15.84:0/666450547 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b4005d70 con 0x7f78c00ca8e0 2023-09-13T08:25:37.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.377+0000 7f78bcff9700 1 -- 172.21.15.84:0/666450547 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78b40070d0 con 0x7f78c00ca8e0 2023-09-13T08:25:37.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.377+0000 7f78c6924700 1 -- 172.21.15.84:0/666450547 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78c00b33b0 con 0x7f78c00ca8e0 2023-09-13T08:25:37.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.377+0000 7f78bcff9700 1 -- 172.21.15.84:0/666450547 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b4007480 con 0x7f78c00ca8e0 2023-09-13T08:25:37.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.377+0000 7f78c6924700 1 -- 172.21.15.84:0/666450547 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78c00b3970 con 0x7f78c00ca8e0 2023-09-13T08:25:37.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.378+0000 7f78c6924700 1 -- 172.21.15.84:0/666450547 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78c004f200 con 0x7f78c00ca8e0 2023-09-13T08:25:37.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.379+0000 7f78bcff9700 1 -- 172.21.15.84:0/666450547 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f78b40075e0 con 0x7f78c00ca8e0 2023-09-13T08:25:37.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.379+0000 7f78bcff9700 1 --2- 172.21.15.84:0/666450547 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f78ac06a580 0x7f78ac06ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:37.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.379+0000 7f78bcff9700 1 -- 172.21.15.84:0/666450547 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f78b4088260 con 0x7f78c00ca8e0 2023-09-13T08:25:37.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.379+0000 7f78bf7fe700 1 --2- 172.21.15.84:0/666450547 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f78ac06a580 0x7f78ac06ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:37.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.379+0000 7f78bf7fe700 1 --2- 172.21.15.84:0/666450547 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f78ac06a580 0x7f78ac06ca40 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f78c00b54b0 tx=0x7f78b0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:37.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.383+0000 7f78bcff9700 1 -- 172.21.15.84:0/666450547 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f78b4053490 con 0x7f78c00ca8e0 2023-09-13T08:25:37.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.573+0000 7f78c6924700 1 -- 172.21.15.84:0/666450547 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f78c00c3600 con 0x7f78c00ca8e0 2023-09-13T08:25:37.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.573+0000 7f78bcff9700 1 -- 172.21.15.84:0/666450547 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f78b4056ab0 con 0x7f78c00ca8e0 2023-09-13T08:25:37.574 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-09-13T08:25:37.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.575+0000 7f78c6924700 1 -- 172.21.15.84:0/666450547 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f78ac06a580 msgr2=0x7f78ac06ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:37.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.575+0000 7f78c6924700 1 --2- 172.21.15.84:0/666450547 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f78ac06a580 0x7f78ac06ca40 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f78c00b54b0 tx=0x7f78b0009040 comp rx=0 tx=0).stop 2023-09-13T08:25:37.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.575+0000 7f78c6924700 1 -- 172.21.15.84:0/666450547 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78c00ca8e0 msgr2=0x7f78c01f5e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:37.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.575+0000 7f78c6924700 1 --2- 172.21.15.84:0/666450547 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78c00ca8e0 0x7f78c01f5e60 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f78b4001eb0 tx=0x7f78b400c860 comp rx=0 tx=0).stop 2023-09-13T08:25:37.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.575+0000 7f78c6924700 1 -- 172.21.15.84:0/666450547 shutdown_connections 2023-09-13T08:25:37.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.575+0000 7f78c6924700 1 --2- 172.21.15.84:0/666450547 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f78c015e910 0x7f78c01f6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:37.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.575+0000 7f78c6924700 1 --2- 172.21.15.84:0/666450547 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78c00ca8e0 0x7f78c01f5e60 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:37.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.575+0000 7f78c6924700 1 --2- 172.21.15.84:0/666450547 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f78ac06a580 0x7f78ac06ca40 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:37.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.575+0000 7f78c6924700 1 --2- 172.21.15.84:0/666450547 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f78c00cd590 0x7f78c01f4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:37.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.575+0000 7f78c6924700 1 -- 172.21.15.84:0/666450547 >> 172.21.15.84:0/666450547 conn(0x7f78c00cca70 msgr2=0x7f78c01588b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:37.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.575+0000 7f78c6924700 1 -- 172.21.15.84:0/666450547 shutdown_connections 2023-09-13T08:25:37.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.575+0000 7f78c6924700 1 -- 172.21.15.84:0/666450547 wait complete. 2023-09-13T08:25:37.587 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-13T08:25:37.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.712+0000 7f57361a7700 1 Processor -- start 2023-09-13T08:25:37.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.712+0000 7f57361a7700 1 -- start start 2023-09-13T08:25:37.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.712+0000 7f57361a7700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f573006bc00 0x7f57300b4850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:37.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.713+0000 7f57361a7700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f57300ad2c0 0x7f57300ad750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:37.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.713+0000 7f57361a7700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57300b43c0 con 0x7f57300ac9d0 2023-09-13T08:25:37.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.713+0000 7f57361a7700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57300adc90 con 0x7f573006bc00 2023-09-13T08:25:37.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.713+0000 7f57361a7700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f573006bfe0 con 0x7f57300ad2c0 2023-09-13T08:25:37.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.713+0000 7f572f7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f573006bc00 0x7f57300b4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:37.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.713+0000 7f572f7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f573006bc00 0x7f57300b4850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44962/0 (socket says 172.21.15.84:44962) 2023-09-13T08:25:37.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.713+0000 7f572f7fe700 1 -- 172.21.15.84:0/1758244361 learned_addr learned my addr 172.21.15.84:0/1758244361 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:37.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.713+0000 7f572f7fe700 1 -- 172.21.15.84:0/1758244361 >> v2:172.21.15.161:3300/0 conn(0x7f57300ad2c0 msgr2=0x7f57300ad750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:37.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.713+0000 7f572f7fe700 1 --2- 172.21.15.84:0/1758244361 >> v2:172.21.15.161:3300/0 conn(0x7f57300ad2c0 0x7f57300ad750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:37.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.713+0000 7f572f7fe700 1 -- 172.21.15.84:0/1758244361 >> v1:172.21.15.161:6789/0 conn(0x7f57300ac9d0 legacy=0x7f573015e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:37.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.713+0000 7f572f7fe700 1 -- 172.21.15.84:0/1758244361 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57300b37b0 con 0x7f573006bc00 2023-09-13T08:25:37.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.713+0000 7f572f7fe700 1 --2- 172.21.15.84:0/1758244361 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f573006bc00 0x7f57300b4850 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f57300aded0 tx=0x7f5718009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5180133818dc9062 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:37.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.713+0000 7f572e7fc700 1 -- 172.21.15.84:0/1758244361 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5718004230 con 0x7f573006bc00 2023-09-13T08:25:37.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.713+0000 7f572e7fc700 1 -- 172.21.15.84:0/1758244361 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5718004390 con 0x7f573006bc00 2023-09-13T08:25:37.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.713+0000 7f572e7fc700 1 -- 172.21.15.84:0/1758244361 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57180036a0 con 0x7f573006bc00 2023-09-13T08:25:37.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.714+0000 7f57361a7700 1 -- 172.21.15.84:0/1758244361 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f573006bc00 msgr2=0x7f57300b4850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:37.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.714+0000 7f57361a7700 1 --2- 172.21.15.84:0/1758244361 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f573006bc00 0x7f57300b4850 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f57300aded0 tx=0x7f5718009c00 comp rx=0 tx=0).stop 2023-09-13T08:25:37.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.714+0000 7f57361a7700 1 -- 172.21.15.84:0/1758244361 shutdown_connections 2023-09-13T08:25:37.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.714+0000 7f57361a7700 1 --2- 172.21.15.84:0/1758244361 >> v2:172.21.15.161:3300/0 conn(0x7f57300ad2c0 0x7f57300ad750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:37.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.714+0000 7f57361a7700 1 --2- 172.21.15.84:0/1758244361 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f573006bc00 0x7f57300b4850 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:37.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.714+0000 7f57361a7700 1 -- 172.21.15.84:0/1758244361 >> 172.21.15.84:0/1758244361 conn(0x7f57300cf8f0 msgr2=0x7f57300cfd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:37.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.714+0000 7f57361a7700 1 -- 172.21.15.84:0/1758244361 shutdown_connections 2023-09-13T08:25:37.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.714+0000 7f57361a7700 1 -- 172.21.15.84:0/1758244361 wait complete. 2023-09-13T08:25:37.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.715+0000 7f57361a7700 1 Processor -- start 2023-09-13T08:25:37.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.715+0000 7f57361a7700 1 -- start start 2023-09-13T08:25:37.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.716+0000 7f57361a7700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f573006bc00 0x7f5730156270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:37.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.716+0000 7f57361a7700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57300ac9d0 0x7f5730141570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:37.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.716+0000 7f57361a7700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57300ad2c0 0x7f57300b0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:37.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.716+0000 7f57361a7700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57301576b0 con 0x7f57300ad2c0 2023-09-13T08:25:37.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.716+0000 7f57361a7700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5730156aa0 con 0x7f57300ac9d0 2023-09-13T08:25:37.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.716+0000 7f57361a7700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5730156d80 con 0x7f573006bc00 2023-09-13T08:25:37.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.716+0000 7f572ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57300ad2c0 0x7f57300b0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:37.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.716+0000 7f572ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57300ad2c0 0x7f57300b0410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44970/0 (socket says 172.21.15.84:44970) 2023-09-13T08:25:37.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.716+0000 7f572ffff700 1 -- 172.21.15.84:0/3439770715 learned_addr learned my addr 172.21.15.84:0/3439770715 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:37.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.716+0000 7f572effd700 1 --2- 172.21.15.84:0/3439770715 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57300ac9d0 0x7f5730141570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:37.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.716+0000 7f572f7fe700 1 --2- 172.21.15.84:0/3439770715 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f573006bc00 0x7f5730156270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:37.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.716+0000 7f572ffff700 1 -- 172.21.15.84:0/3439770715 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f573006bc00 msgr2=0x7f5730156270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:37.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.716+0000 7f572ffff700 1 --2- 172.21.15.84:0/3439770715 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f573006bc00 0x7f5730156270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:37.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.716+0000 7f572ffff700 1 -- 172.21.15.84:0/3439770715 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57300ac9d0 msgr2=0x7f5730141570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:37.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.716+0000 7f572ffff700 1 --2- 172.21.15.84:0/3439770715 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57300ac9d0 0x7f5730141570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:37.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.716+0000 7f572ffff700 1 -- 172.21.15.84:0/3439770715 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5718009550 con 0x7f57300ad2c0 2023-09-13T08:25:37.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.716+0000 7f572effd700 1 --2- 172.21.15.84:0/3439770715 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57300ac9d0 0x7f5730141570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T08:25:37.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.716+0000 7f572f7fe700 1 --2- 172.21.15.84:0/3439770715 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f573006bc00 0x7f5730156270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T08:25:37.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.716+0000 7f572ffff700 1 --2- 172.21.15.84:0/3439770715 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57300ad2c0 0x7f57300b0410 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f572800b970 tx=0x7f572800bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:37.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.716+0000 7f5727fff700 1 -- 172.21.15.84:0/3439770715 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f572800c9b0 con 0x7f57300ad2c0 2023-09-13T08:25:37.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.717+0000 7f5727fff700 1 -- 172.21.15.84:0/3439770715 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f572800cb30 con 0x7f57300ad2c0 2023-09-13T08:25:37.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.717+0000 7f57361a7700 1 -- 172.21.15.84:0/3439770715 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5730157060 con 0x7f57300ad2c0 2023-09-13T08:25:37.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.717+0000 7f5727fff700 1 -- 172.21.15.84:0/3439770715 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5728014440 con 0x7f57300ad2c0 2023-09-13T08:25:37.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.717+0000 7f57361a7700 1 -- 172.21.15.84:0/3439770715 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57301567b0 con 0x7f57300ad2c0 2023-09-13T08:25:37.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.718+0000 7f57361a7700 1 -- 172.21.15.84:0/3439770715 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57300b3480 con 0x7f57300ad2c0 2023-09-13T08:25:37.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.718+0000 7f5727fff700 1 -- 172.21.15.84:0/3439770715 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f572801d3b0 con 0x7f57300ad2c0 2023-09-13T08:25:37.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.718+0000 7f5727fff700 1 --2- 172.21.15.84:0/3439770715 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f571006a580 0x7f571006ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:37.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.718+0000 7f5727fff700 1 -- 172.21.15.84:0/3439770715 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f5728088c00 con 0x7f57300ad2c0 2023-09-13T08:25:37.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.718+0000 7f572f7fe700 1 --2- 172.21.15.84:0/3439770715 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f571006a580 0x7f571006ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:37.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.719+0000 7f572f7fe700 1 --2- 172.21.15.84:0/3439770715 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f571006a580 0x7f571006ca40 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5718009c40 tx=0x7f5718008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:37.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.723+0000 7f5727fff700 1 -- 172.21.15.84:0/3439770715 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f572808f080 con 0x7f57300ad2c0 2023-09-13T08:25:37.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.913+0000 7f57361a7700 1 -- 172.21.15.84:0/3439770715 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f573015b300 con 0x7f57300ad2c0 2023-09-13T08:25:37.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.913+0000 7f5727fff700 1 -- 172.21.15.84:0/3439770715 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5728019070 con 0x7f57300ad2c0 2023-09-13T08:25:37.914 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-09-13T08:25:37.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.915+0000 7f57361a7700 1 -- 172.21.15.84:0/3439770715 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f571006a580 msgr2=0x7f571006ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:37.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.915+0000 7f57361a7700 1 --2- 172.21.15.84:0/3439770715 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f571006a580 0x7f571006ca40 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5718009c40 tx=0x7f5718008030 comp rx=0 tx=0).stop 2023-09-13T08:25:37.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.915+0000 7f57361a7700 1 -- 172.21.15.84:0/3439770715 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57300ad2c0 msgr2=0x7f57300b0410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:37.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.915+0000 7f57361a7700 1 --2- 172.21.15.84:0/3439770715 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57300ad2c0 0x7f57300b0410 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f572800b970 tx=0x7f572800bd30 comp rx=0 tx=0).stop 2023-09-13T08:25:37.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.915+0000 7f57361a7700 1 -- 172.21.15.84:0/3439770715 shutdown_connections 2023-09-13T08:25:37.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.915+0000 7f57361a7700 1 --2- 172.21.15.84:0/3439770715 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57300ad2c0 0x7f57300b0410 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:37.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.915+0000 7f57361a7700 1 --2- 172.21.15.84:0/3439770715 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f573006bc00 0x7f5730156270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:37.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.915+0000 7f57361a7700 1 --2- 172.21.15.84:0/3439770715 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f571006a580 0x7f571006ca40 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:37.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.915+0000 7f57361a7700 1 --2- 172.21.15.84:0/3439770715 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57300ac9d0 0x7f5730141570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:37.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.915+0000 7f57361a7700 1 -- 172.21.15.84:0/3439770715 >> 172.21.15.84:0/3439770715 conn(0x7f57300cf8f0 msgr2=0x7f5730152db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:37.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.916+0000 7f57361a7700 1 -- 172.21.15.84:0/3439770715 shutdown_connections 2023-09-13T08:25:37.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:37.916+0000 7f57361a7700 1 -- 172.21.15.84:0/3439770715 wait complete. 2023-09-13T08:25:37.928 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-09-13T08:25:38.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.051+0000 7fd59ece6700 1 Processor -- start 2023-09-13T08:25:38.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.051+0000 7fd59ece6700 1 -- start start 2023-09-13T08:25:38.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.052+0000 7fd59ece6700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd59815a170 0x7fd59806e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:38.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.052+0000 7fd59ece6700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd5980cf910 0x7fd59806ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:38.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.052+0000 7fd59ece6700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5980cfe40 con 0x7fd59806f1c0 2023-09-13T08:25:38.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.052+0000 7fd59ece6700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd59815a550 con 0x7fd5980cf910 2023-09-13T08:25:38.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.052+0000 7fd59ece6700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5980cf4c0 con 0x7fd59815a170 2023-09-13T08:25:38.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.052+0000 7fd59d283700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fd59806f1c0 0x7fd59815dc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:47624/0 (socket says 172.21.15.84:47624) 2023-09-13T08:25:38.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.052+0000 7fd59d283700 1 -- 172.21.15.84:0/2985864871 learned_addr learned my addr 172.21.15.84:0/2985864871 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:25:38.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.052+0000 7fd597fff700 1 --2- 172.21.15.84:0/2985864871 >> v2:172.21.15.161:3300/0 conn(0x7fd5980cf910 0x7fd59806ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:38.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.052+0000 7fd59ca82700 1 --2- 172.21.15.84:0/2985864871 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd59815a170 0x7fd59806e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:38.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.052+0000 7fd5977fe700 1 -- 172.21.15.84:0/2985864871 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2118842260 0 0) 0x7fd5980cfe40 con 0x7fd59806f1c0 2023-09-13T08:25:38.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.052+0000 7fd5977fe700 1 -- 172.21.15.84:0/2985864871 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5880035b0 con 0x7fd59806f1c0 2023-09-13T08:25:38.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.052+0000 7fd5977fe700 1 -- 172.21.15.84:0/2985864871 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2321394994 0 0) 0x7fd5880035b0 con 0x7fd59806f1c0 2023-09-13T08:25:38.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.052+0000 7fd5977fe700 1 -- 172.21.15.84:0/2985864871 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd59815a170 msgr2=0x7fd59806e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:38.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.052+0000 7fd5977fe700 1 --2- 172.21.15.84:0/2985864871 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd59815a170 0x7fd59806e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:38.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.052+0000 7fd5977fe700 1 -- 172.21.15.84:0/2985864871 >> v2:172.21.15.161:3300/0 conn(0x7fd5980cf910 msgr2=0x7fd59806ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:38.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.052+0000 7fd5977fe700 1 --2- 172.21.15.84:0/2985864871 >> v2:172.21.15.161:3300/0 conn(0x7fd5980cf910 0x7fd59806ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:38.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.052+0000 7fd5977fe700 1 -- 172.21.15.84:0/2985864871 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5980ce700 con 0x7fd59806f1c0 2023-09-13T08:25:38.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.052+0000 7fd5977fe700 1 -- 172.21.15.84:0/2985864871 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2302733408 0 0) 0x7fd5900019f0 con 0x7fd59806f1c0 2023-09-13T08:25:38.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.053+0000 7fd5977fe700 1 -- 172.21.15.84:0/2985864871 >> v1:172.21.15.84:6789/0 conn(0x7fd59806f1c0 legacy=0x7fd59815dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:38.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.053+0000 7fd5977fe700 1 --2- 172.21.15.84:0/2985864871 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd588003a00 0x7fd588003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:38.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.053+0000 7fd5977fe700 1 --2- 172.21.15.84:0/2985864871 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd588004850 0x7fd588004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:38.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.053+0000 7fd5977fe700 1 --2- 172.21.15.84:0/2985864871 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd59815a170 0x7fd588005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:38.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.053+0000 7fd5977fe700 1 -- 172.21.15.84:0/2985864871 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd59815a550 con 0x7fd588004850 2023-09-13T08:25:38.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.053+0000 7fd5977fe700 1 -- 172.21.15.84:0/2985864871 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5980cf4c0 con 0x7fd588003a00 2023-09-13T08:25:38.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.053+0000 7fd5977fe700 1 -- 172.21.15.84:0/2985864871 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd58800ba10 con 0x7fd59815a170 2023-09-13T08:25:38.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.053+0000 7fd597fff700 1 --2- 172.21.15.84:0/2985864871 >> v2:172.21.15.161:3300/0 conn(0x7fd5980cf910 0x7fd59806ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T08:25:38.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.053+0000 7fd59ca82700 1 --2- 172.21.15.84:0/2985864871 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd588003a00 0x7fd588003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:38.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.053+0000 7fd597fff700 1 --2- 172.21.15.84:0/2985864871 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd588004850 0x7fd588004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:38.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.053+0000 7fd59d283700 1 --2- 172.21.15.84:0/2985864871 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd59815a170 0x7fd588005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:38.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.053+0000 7fd597fff700 1 -- 172.21.15.84:0/2985864871 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd59815a170 msgr2=0x7fd588005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:38.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.053+0000 7fd597fff700 1 --2- 172.21.15.84:0/2985864871 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd59815a170 0x7fd588005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:38.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.053+0000 7fd597fff700 1 -- 172.21.15.84:0/2985864871 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd588003a00 msgr2=0x7fd588003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:38.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.053+0000 7fd597fff700 1 --2- 172.21.15.84:0/2985864871 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd588003a00 0x7fd588003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:38.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.053+0000 7fd597fff700 1 -- 172.21.15.84:0/2985864871 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5880035b0 con 0x7fd588004850 2023-09-13T08:25:38.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.053+0000 7fd59ca82700 1 --2- 172.21.15.84:0/2985864871 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd588003a00 0x7fd588003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T08:25:38.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.053+0000 7fd597fff700 1 --2- 172.21.15.84:0/2985864871 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd588004850 0x7fd588004cd0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fd5840098c0 tx=0x7fd588005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cc0d6783d81bf7 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:38.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.053+0000 7fd5977fe700 1 -- 172.21.15.84:0/2985864871 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd584004030 con 0x7fd588004850 2023-09-13T08:25:38.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.053+0000 7fd5977fe700 1 -- 172.21.15.84:0/2985864871 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd584004190 con 0x7fd588004850 2023-09-13T08:25:38.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.053+0000 7fd5977fe700 1 -- 172.21.15.84:0/2985864871 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd584004540 con 0x7fd588004850 2023-09-13T08:25:38.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.054+0000 7fd59ece6700 1 -- 172.21.15.84:0/2985864871 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd588004850 msgr2=0x7fd588004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:38.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.054+0000 7fd59ece6700 1 --2- 172.21.15.84:0/2985864871 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd588004850 0x7fd588004cd0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fd5840098c0 tx=0x7fd588005880 comp rx=0 tx=0).stop 2023-09-13T08:25:38.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.054+0000 7fd59d283700 1 -- 172.21.15.84:0/2985864871 reap_dead start 2023-09-13T08:25:38.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.054+0000 7fd59ece6700 1 -- 172.21.15.84:0/2985864871 shutdown_connections 2023-09-13T08:25:38.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.054+0000 7fd59ece6700 1 -- 172.21.15.84:0/2985864871 >> 172.21.15.84:0/2985864871 conn(0x7fd5980cca70 msgr2=0x7fd5980cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:38.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.054+0000 7fd59ece6700 1 -- 172.21.15.84:0/2985864871 shutdown_connections 2023-09-13T08:25:38.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.054+0000 7fd59ece6700 1 -- 172.21.15.84:0/2985864871 wait complete. 2023-09-13T08:25:38.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.055+0000 7fd59ece6700 1 Processor -- start 2023-09-13T08:25:38.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.055+0000 7fd59ece6700 1 -- start start 2023-09-13T08:25:38.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.056+0000 7fd59ece6700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd588004850 0x7fd5981e4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:38.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.056+0000 7fd59ece6700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd5980c51d0 0x7fd5980c5650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:38.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.056+0000 7fd59ece6700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd5980b4da0 0x7fd5980b5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:38.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.056+0000 7fd59ece6700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5980b5770 con 0x7fd588004850 2023-09-13T08:25:38.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.056+0000 7fd59ece6700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd598141360 con 0x7fd5980b4da0 2023-09-13T08:25:38.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.056+0000 7fd59ece6700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5981557d0 con 0x7fd5980c51d0 2023-09-13T08:25:38.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.056+0000 7fd59ca82700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd588004850 0x7fd5981e4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:38.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.056+0000 7fd59ca82700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd588004850 0x7fd5981e4e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44986/0 (socket says 172.21.15.84:44986) 2023-09-13T08:25:38.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.056+0000 7fd59ca82700 1 -- 172.21.15.84:0/1703171793 learned_addr learned my addr 172.21.15.84:0/1703171793 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:38.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.056+0000 7fd597fff700 1 --2- 172.21.15.84:0/1703171793 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd5980c51d0 0x7fd5980c5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:38.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.056+0000 7fd59ca82700 1 -- 172.21.15.84:0/1703171793 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd5980c51d0 msgr2=0x7fd5980c5650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:38.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.056+0000 7fd59ca82700 1 --2- 172.21.15.84:0/1703171793 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd5980c51d0 0x7fd5980c5650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:38.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.056+0000 7fd59ca82700 1 -- 172.21.15.84:0/1703171793 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd5980b4da0 msgr2=0x7fd5980b5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:38.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.056+0000 7fd59ca82700 1 --2- 172.21.15.84:0/1703171793 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd5980b4da0 0x7fd5980b5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:38.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.056+0000 7fd59ca82700 1 -- 172.21.15.84:0/1703171793 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5980c5d40 con 0x7fd588004850 2023-09-13T08:25:38.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.057+0000 7fd59ca82700 1 --2- 172.21.15.84:0/1703171793 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd588004850 0x7fd5981e4e40 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fd58c011d00 tx=0x7fd58c00f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:38.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.057+0000 7fd5957fa700 1 -- 172.21.15.84:0/1703171793 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd58c00fab0 con 0x7fd588004850 2023-09-13T08:25:38.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.057+0000 7fd5957fa700 1 -- 172.21.15.84:0/1703171793 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd58c00fc10 con 0x7fd588004850 2023-09-13T08:25:38.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.057+0000 7fd59ece6700 1 -- 172.21.15.84:0/1703171793 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5980c6020 con 0x7fd588004850 2023-09-13T08:25:38.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.057+0000 7fd5957fa700 1 -- 172.21.15.84:0/1703171793 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd58c004020 con 0x7fd588004850 2023-09-13T08:25:38.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.057+0000 7fd59ece6700 1 -- 172.21.15.84:0/1703171793 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5981e5380 con 0x7fd588004850 2023-09-13T08:25:38.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.058+0000 7fd59ece6700 1 -- 172.21.15.84:0/1703171793 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5980c6240 con 0x7fd588004850 2023-09-13T08:25:38.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.058+0000 7fd5957fa700 1 -- 172.21.15.84:0/1703171793 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fd58c004180 con 0x7fd588004850 2023-09-13T08:25:38.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.059+0000 7fd5957fa700 1 --2- 172.21.15.84:0/1703171793 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fd57c06a580 0x7fd57c06ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:38.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.059+0000 7fd597fff700 1 --2- 172.21.15.84:0/1703171793 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fd57c06a580 0x7fd57c06ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:38.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.059+0000 7fd5957fa700 1 -- 172.21.15.84:0/1703171793 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fd58c089310 con 0x7fd588004850 2023-09-13T08:25:38.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.059+0000 7fd597fff700 1 --2- 172.21.15.84:0/1703171793 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fd57c06a580 0x7fd57c06ca40 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd58401b040 tx=0x7fd584015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:38.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.063+0000 7fd5957fa700 1 -- 172.21.15.84:0/1703171793 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fd58c0544b0 con 0x7fd588004850 2023-09-13T08:25:38.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.253+0000 7fd59ece6700 1 -- 172.21.15.84:0/1703171793 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fd59804f200 con 0x7fd588004850 2023-09-13T08:25:38.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.253+0000 7fd5957fa700 1 -- 172.21.15.84:0/1703171793 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd58c022020 con 0x7fd588004850 2023-09-13T08:25:38.253 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-09-13T08:25:38.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.255+0000 7fd59ece6700 1 -- 172.21.15.84:0/1703171793 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fd57c06a580 msgr2=0x7fd57c06ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:38.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.255+0000 7fd59ece6700 1 --2- 172.21.15.84:0/1703171793 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fd57c06a580 0x7fd57c06ca40 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd58401b040 tx=0x7fd584015000 comp rx=0 tx=0).stop 2023-09-13T08:25:38.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.255+0000 7fd59ece6700 1 -- 172.21.15.84:0/1703171793 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd588004850 msgr2=0x7fd5981e4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:38.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.255+0000 7fd59ece6700 1 --2- 172.21.15.84:0/1703171793 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd588004850 0x7fd5981e4e40 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fd58c011d00 tx=0x7fd58c00f520 comp rx=0 tx=0).stop 2023-09-13T08:25:38.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.255+0000 7fd59ece6700 1 -- 172.21.15.84:0/1703171793 shutdown_connections 2023-09-13T08:25:38.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.255+0000 7fd59ece6700 1 --2- 172.21.15.84:0/1703171793 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fd57c06a580 0x7fd57c06ca40 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:38.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.255+0000 7fd59ece6700 1 --2- 172.21.15.84:0/1703171793 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd5980b4da0 0x7fd5980b5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:38.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.255+0000 7fd59ece6700 1 --2- 172.21.15.84:0/1703171793 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd588004850 0x7fd5981e4e40 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:38.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.255+0000 7fd59ece6700 1 --2- 172.21.15.84:0/1703171793 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd5980c51d0 0x7fd5980c5650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:38.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.255+0000 7fd59ece6700 1 -- 172.21.15.84:0/1703171793 >> 172.21.15.84:0/1703171793 conn(0x7fd5980cca70 msgr2=0x7fd5980b3f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:38.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.255+0000 7fd59ece6700 1 -- 172.21.15.84:0/1703171793 shutdown_connections 2023-09-13T08:25:38.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.255+0000 7fd59ece6700 1 -- 172.21.15.84:0/1703171793 wait complete. 2023-09-13T08:25:38.268 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-09-13T08:25:38.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.389+0000 7f7ecd51e700 1 Processor -- start 2023-09-13T08:25:38.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.389+0000 7f7ecd51e700 1 -- start start 2023-09-13T08:25:38.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.390+0000 7f7ecd51e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7ec815d550 0x7f7ec80cef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:38.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.390+0000 7f7ecd51e700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f7ec80d0c70 0x7f7ec80b2b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:38.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.390+0000 7f7ecd51e700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ec815dc60 con 0x7f7ec80b3060 2023-09-13T08:25:38.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.390+0000 7f7ecd51e700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ec8070da0 con 0x7f7ec815d550 2023-09-13T08:25:38.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.390+0000 7f7ecd51e700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ec80b34d0 con 0x7f7ec80d0c70 2023-09-13T08:25:38.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.390+0000 7f7ec6ffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7ec815d550 0x7f7ec80cef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:38.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.390+0000 7f7ec77fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f7ec80b3060 0x7f7ec8142d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:47644/0 (socket says 172.21.15.84:47644) 2023-09-13T08:25:38.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.390+0000 7f7ec6ffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7ec815d550 0x7f7ec80cef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44994/0 (socket says 172.21.15.84:44994) 2023-09-13T08:25:38.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.390+0000 7f7ec77fe700 1 -- 172.21.15.84:0/1265320839 learned_addr learned my addr 172.21.15.84:0/1265320839 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:25:38.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.390+0000 7f7ec67fc700 1 --2- 172.21.15.84:0/1265320839 >> v2:172.21.15.161:3300/0 conn(0x7f7ec80d0c70 0x7f7ec80b2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:38.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.390+0000 7f7ec6ffd700 1 -- 172.21.15.84:0/1265320839 >> v2:172.21.15.161:3300/0 conn(0x7f7ec80d0c70 msgr2=0x7f7ec80b2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:38.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.390+0000 7f7ec6ffd700 1 --2- 172.21.15.84:0/1265320839 >> v2:172.21.15.161:3300/0 conn(0x7f7ec80d0c70 0x7f7ec80b2b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:38.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.390+0000 7f7ec6ffd700 1 -- 172.21.15.84:0/1265320839 >> v1:172.21.15.84:6789/0 conn(0x7f7ec80b3060 legacy=0x7f7ec8142d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:38.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.390+0000 7f7ec6ffd700 1 -- 172.21.15.84:0/1265320839 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ec815df40 con 0x7f7ec815d550 2023-09-13T08:25:38.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.390+0000 7f7ec5ffb700 1 -- 172.21.15.84:0/1265320839 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1857550641 0 0) 0x7f7ec815dc60 con 0x7f7ec80b3060 2023-09-13T08:25:38.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.390+0000 7f7ec67fc700 1 --2- 172.21.15.84:0/1265320839 >> v2:172.21.15.161:3300/0 conn(0x7f7ec80d0c70 0x7f7ec80b2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T08:25:38.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.391+0000 7f7ec6ffd700 1 --2- 172.21.15.84:0/1265320839 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ec815d550 0x7f7ec80cef20 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f7ec8067c80 tx=0x7f7ebc009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3b706c1fb60f5cb server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:38.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.391+0000 7f7ec5ffb700 1 -- 172.21.15.84:0/1265320839 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ebc011830 con 0x7f7ec815d550 2023-09-13T08:25:38.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.391+0000 7f7ec5ffb700 1 -- 172.21.15.84:0/1265320839 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ebc011990 con 0x7f7ec815d550 2023-09-13T08:25:38.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.391+0000 7f7ec5ffb700 1 -- 172.21.15.84:0/1265320839 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ebc011d20 con 0x7f7ec815d550 2023-09-13T08:25:38.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.391+0000 7f7ecd51e700 1 -- 172.21.15.84:0/1265320839 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ec815d550 msgr2=0x7f7ec80cef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:38.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.391+0000 7f7ecd51e700 1 --2- 172.21.15.84:0/1265320839 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ec815d550 0x7f7ec80cef20 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f7ec8067c80 tx=0x7f7ebc009b20 comp rx=0 tx=0).stop 2023-09-13T08:25:38.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.391+0000 7f7ecd51e700 1 -- 172.21.15.84:0/1265320839 shutdown_connections 2023-09-13T08:25:38.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.391+0000 7f7ecd51e700 1 --2- 172.21.15.84:0/1265320839 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ec815d550 0x7f7ec80cef20 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:38.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.391+0000 7f7ecd51e700 1 --2- 172.21.15.84:0/1265320839 >> v2:172.21.15.161:3300/0 conn(0x7f7ec80d0c70 0x7f7ec80b2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:38.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.391+0000 7f7ecd51e700 1 -- 172.21.15.84:0/1265320839 >> 172.21.15.84:0/1265320839 conn(0x7f7ec80cdb20 msgr2=0x7f7ec80cdf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:38.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.391+0000 7f7ecd51e700 1 -- 172.21.15.84:0/1265320839 shutdown_connections 2023-09-13T08:25:38.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.391+0000 7f7ecd51e700 1 -- 172.21.15.84:0/1265320839 wait complete. 2023-09-13T08:25:38.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.393+0000 7f7ecd51e700 1 Processor -- start 2023-09-13T08:25:38.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.393+0000 7f7ecd51e700 1 -- start start 2023-09-13T08:25:38.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.393+0000 7f7ecd51e700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7ec80b3060 0x7f7ec80c4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:38.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.393+0000 7f7ecd51e700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7ec80d0c70 0x7f7ec815ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:38.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.393+0000 7f7ecd51e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ec815d550 0x7f7ec8158d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:38.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.393+0000 7f7ecd51e700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec815f120 con 0x7f7ec815d550 2023-09-13T08:25:38.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.393+0000 7f7ecd51e700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec8161a90 con 0x7f7ec80d0c70 2023-09-13T08:25:38.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.393+0000 7f7ecd51e700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec80c54e0 con 0x7f7ec80b3060 2023-09-13T08:25:38.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.393+0000 7f7ec77fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ec815d550 0x7f7ec8158d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:38.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.393+0000 7f7ec77fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ec815d550 0x7f7ec8158d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45004/0 (socket says 172.21.15.84:45004) 2023-09-13T08:25:38.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.393+0000 7f7ec77fe700 1 -- 172.21.15.84:0/3648688175 learned_addr learned my addr 172.21.15.84:0/3648688175 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:38.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.394+0000 7f7ec67fc700 1 --2- 172.21.15.84:0/3648688175 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7ec80d0c70 0x7f7ec815ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:38.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.394+0000 7f7ec6ffd700 1 --2- 172.21.15.84:0/3648688175 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7ec80b3060 0x7f7ec80c4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:38.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.394+0000 7f7ec77fe700 1 -- 172.21.15.84:0/3648688175 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7ec80b3060 msgr2=0x7f7ec80c4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:38.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.394+0000 7f7ec77fe700 1 --2- 172.21.15.84:0/3648688175 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7ec80b3060 0x7f7ec80c4de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:38.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.394+0000 7f7ec77fe700 1 -- 172.21.15.84:0/3648688175 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7ec80d0c70 msgr2=0x7f7ec815ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:38.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.394+0000 7f7ec77fe700 1 --2- 172.21.15.84:0/3648688175 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7ec80d0c70 0x7f7ec815ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:38.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.394+0000 7f7ec77fe700 1 -- 172.21.15.84:0/3648688175 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ebc0094a0 con 0x7f7ec815d550 2023-09-13T08:25:38.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.394+0000 7f7ec77fe700 1 --2- 172.21.15.84:0/3648688175 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ec815d550 0x7f7ec8158d40 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f7ec000cb90 tx=0x7f7ec000cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:38.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.394+0000 7f7eaf7fe700 1 -- 172.21.15.84:0/3648688175 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec000ab70 con 0x7f7ec815d550 2023-09-13T08:25:38.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.394+0000 7f7eaf7fe700 1 -- 172.21.15.84:0/3648688175 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ec000acf0 con 0x7f7ec815d550 2023-09-13T08:25:38.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.394+0000 7f7ecd51e700 1 -- 172.21.15.84:0/3648688175 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ec8161160 con 0x7f7ec815d550 2023-09-13T08:25:38.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.394+0000 7f7eaf7fe700 1 -- 172.21.15.84:0/3648688175 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec0007310 con 0x7f7ec815d550 2023-09-13T08:25:38.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.394+0000 7f7ecd51e700 1 -- 172.21.15.84:0/3648688175 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ec8161720 con 0x7f7ec815d550 2023-09-13T08:25:38.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.395+0000 7f7ecd51e700 1 -- 172.21.15.84:0/3648688175 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ec804e9b0 con 0x7f7ec815d550 2023-09-13T08:25:38.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.396+0000 7f7eaf7fe700 1 -- 172.21.15.84:0/3648688175 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f7ec0007470 con 0x7f7ec815d550 2023-09-13T08:25:38.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.396+0000 7f7eaf7fe700 1 --2- 172.21.15.84:0/3648688175 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f7eb406a580 0x7f7eb406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:38.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.396+0000 7f7ec6ffd700 1 --2- 172.21.15.84:0/3648688175 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f7eb406a580 0x7f7eb406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:38.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.396+0000 7f7eaf7fe700 1 -- 172.21.15.84:0/3648688175 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f7ec0088c60 con 0x7f7ec815d550 2023-09-13T08:25:38.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.396+0000 7f7ec6ffd700 1 --2- 172.21.15.84:0/3648688175 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f7eb406a580 0x7f7eb406ca40 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc0090b0 tx=0x7f7ebc01c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:38.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.401+0000 7f7eaf7fe700 1 -- 172.21.15.84:0/3648688175 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f7ec0053e00 con 0x7f7ec815d550 2023-09-13T08:25:38.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.608+0000 7f7ecd51e700 1 -- 172.21.15.84:0/3648688175 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7ec80728d0 con 0x7f7ec815d550 2023-09-13T08:25:38.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.609+0000 7f7eaf7fe700 1 -- 172.21.15.84:0/3648688175 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7ec0018020 con 0x7f7ec815d550 2023-09-13T08:25:38.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.611+0000 7f7ecd51e700 1 -- 172.21.15.84:0/3648688175 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f7eb406a580 msgr2=0x7f7eb406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:38.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.611+0000 7f7ecd51e700 1 --2- 172.21.15.84:0/3648688175 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f7eb406a580 0x7f7eb406ca40 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc0090b0 tx=0x7f7ebc01c040 comp rx=0 tx=0).stop 2023-09-13T08:25:38.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.611+0000 7f7ecd51e700 1 -- 172.21.15.84:0/3648688175 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ec815d550 msgr2=0x7f7ec8158d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:38.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.611+0000 7f7ecd51e700 1 --2- 172.21.15.84:0/3648688175 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ec815d550 0x7f7ec8158d40 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f7ec000cb90 tx=0x7f7ec000cf50 comp rx=0 tx=0).stop 2023-09-13T08:25:38.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.611+0000 7f7ecd51e700 1 -- 172.21.15.84:0/3648688175 shutdown_connections 2023-09-13T08:25:38.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.611+0000 7f7ecd51e700 1 --2- 172.21.15.84:0/3648688175 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ec815d550 0x7f7ec8158d40 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:38.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.611+0000 7f7ecd51e700 1 --2- 172.21.15.84:0/3648688175 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7ec80b3060 0x7f7ec80c4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:38.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.611+0000 7f7ecd51e700 1 --2- 172.21.15.84:0/3648688175 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f7eb406a580 0x7f7eb406ca40 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:38.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.611+0000 7f7ecd51e700 1 --2- 172.21.15.84:0/3648688175 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7ec80d0c70 0x7f7ec815ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:38.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.611+0000 7f7ecd51e700 1 -- 172.21.15.84:0/3648688175 >> 172.21.15.84:0/3648688175 conn(0x7f7ec80cdb20 msgr2=0x7f7ec806d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:38.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.611+0000 7f7ecd51e700 1 -- 172.21.15.84:0/3648688175 shutdown_connections 2023-09-13T08:25:38.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.611+0000 7f7ecd51e700 1 -- 172.21.15.84:0/3648688175 wait complete. 2023-09-13T08:25:38.614 INFO:teuthology.orchestra.run.smithi084.stderr:listed 0 entries 2023-09-13T08:25:38.623 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-09-13T08:25:38.623 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:25:38.623 DEBUG:teuthology.orchestra.run.smithi084:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-09-13T08:25:38.678 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi084.front.sepia.ceph.com 2023-09-13T08:25:38.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:25:38.679 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-09-13T08:25:38.696 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-09-13T08:25:38.697 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T08:25:38.719 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-09-13T08:25:38.719 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T08:25:38.780 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-09-13T08:25:38.781 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T08:25:38.840 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T08:25:38.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.961+0000 7fc6edeec700 1 Processor -- start 2023-09-13T08:25:38.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.961+0000 7fc6edeec700 1 -- start start 2023-09-13T08:25:38.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.962+0000 7fc6edeec700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc6e815b130 0x7fc6e806d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:38.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.962+0000 7fc6edeec700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc6e806a620 0x7fc6e806aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:38.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.962+0000 7fc6edeec700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6e806afa0 con 0x7fc6e815da70 2023-09-13T08:25:38.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.962+0000 7fc6edeec700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6e80cfe50 con 0x7fc6e815b130 2023-09-13T08:25:38.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.962+0000 7fc6edeec700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e8072880 con 0x7fc6e806a620 2023-09-13T08:25:38.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.962+0000 7fc6e77fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc6e815b130 0x7fc6e806d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:38.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.962+0000 7fc6e77fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc6e815b130 0x7fc6e806d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45008/0 (socket says 172.21.15.84:45008) 2023-09-13T08:25:38.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.962+0000 7fc6e77fe700 1 -- 172.21.15.84:0/3486800735 learned_addr learned my addr 172.21.15.84:0/3486800735 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:38.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.963+0000 7fc6e7fff700 1 --2- 172.21.15.84:0/3486800735 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc6e806a620 0x7fc6e806aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:38.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.963+0000 7fc6e77fe700 1 -- 172.21.15.84:0/3486800735 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc6e806a620 msgr2=0x7fc6e806aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:38.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.963+0000 7fc6e77fe700 1 --2- 172.21.15.84:0/3486800735 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc6e806a620 0x7fc6e806aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:38.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.963+0000 7fc6e77fe700 1 -- 172.21.15.84:0/3486800735 >> v1:172.21.15.84:6789/0 conn(0x7fc6e815da70 legacy=0x7fc6e80713f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:38.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.963+0000 7fc6e77fe700 1 -- 172.21.15.84:0/3486800735 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6e806db60 con 0x7fc6e815b130 2023-09-13T08:25:38.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.963+0000 7fc6e77fe700 1 --2- 172.21.15.84:0/3486800735 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6e815b130 0x7fc6e806d620 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fc6d80098f0 tx=0x7fc6d8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6a85c07b3c61efd server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:38.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.963+0000 7fc6e67fc700 1 -- 172.21.15.84:0/3486800735 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d800b8a0 con 0x7fc6e815b130 2023-09-13T08:25:38.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.963+0000 7fc6e67fc700 1 -- 172.21.15.84:0/3486800735 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6d800ba00 con 0x7fc6e815b130 2023-09-13T08:25:38.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.963+0000 7fc6e67fc700 1 -- 172.21.15.84:0/3486800735 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d800bd90 con 0x7fc6e815b130 2023-09-13T08:25:38.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.963+0000 7fc6edeec700 1 -- 172.21.15.84:0/3486800735 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6e815b130 msgr2=0x7fc6e806d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:38.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.963+0000 7fc6edeec700 1 --2- 172.21.15.84:0/3486800735 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6e815b130 0x7fc6e806d620 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fc6d80098f0 tx=0x7fc6d8009c00 comp rx=0 tx=0).stop 2023-09-13T08:25:38.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.963+0000 7fc6edeec700 1 -- 172.21.15.84:0/3486800735 shutdown_connections 2023-09-13T08:25:38.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.963+0000 7fc6edeec700 1 --2- 172.21.15.84:0/3486800735 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc6e806a620 0x7fc6e806aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:38.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.963+0000 7fc6edeec700 1 --2- 172.21.15.84:0/3486800735 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6e815b130 0x7fc6e806d620 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:38.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.963+0000 7fc6edeec700 1 -- 172.21.15.84:0/3486800735 >> 172.21.15.84:0/3486800735 conn(0x7fc6e80b1b80 msgr2=0x7fc6e80b1f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:38.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.964+0000 7fc6edeec700 1 -- 172.21.15.84:0/3486800735 shutdown_connections 2023-09-13T08:25:38.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.964+0000 7fc6edeec700 1 -- 172.21.15.84:0/3486800735 wait complete. 2023-09-13T08:25:38.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.965+0000 7fc6edeec700 1 Processor -- start 2023-09-13T08:25:38.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.965+0000 7fc6edeec700 1 -- start start 2023-09-13T08:25:38.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.966+0000 7fc6edeec700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6e806a620 0x7fc6e8158c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:38.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.966+0000 7fc6edeec700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc6e815b130 0x7fc6e80ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:38.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.966+0000 7fc6edeec700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc6e815da70 0x7fc6e80ace20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:38.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.966+0000 7fc6edeec700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e81591b0 con 0x7fc6e806a620 2023-09-13T08:25:38.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.966+0000 7fc6edeec700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e80b4940 con 0x7fc6e815da70 2023-09-13T08:25:38.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.966+0000 7fc6edeec700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e80b4c20 con 0x7fc6e815b130 2023-09-13T08:25:38.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.966+0000 7fc6e77fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6e806a620 0x7fc6e8158c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:38.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.966+0000 7fc6e77fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6e806a620 0x7fc6e8158c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45014/0 (socket says 172.21.15.84:45014) 2023-09-13T08:25:38.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.966+0000 7fc6e77fe700 1 -- 172.21.15.84:0/2994385542 learned_addr learned my addr 172.21.15.84:0/2994385542 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:38.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.966+0000 7fc6e77fe700 1 -- 172.21.15.84:0/2994385542 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc6e815b130 msgr2=0x7fc6e80ac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:38.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.966+0000 7fc6e6ffd700 1 --2- 172.21.15.84:0/2994385542 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc6e815b130 0x7fc6e80ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:38.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.966+0000 7fc6e7fff700 1 --2- 172.21.15.84:0/2994385542 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc6e815da70 0x7fc6e80ace20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:38.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.966+0000 7fc6e77fe700 1 --2- 172.21.15.84:0/2994385542 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc6e815b130 0x7fc6e80ac8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:38.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.966+0000 7fc6e77fe700 1 -- 172.21.15.84:0/2994385542 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc6e815da70 msgr2=0x7fc6e80ace20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:38.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.966+0000 7fc6e77fe700 1 --2- 172.21.15.84:0/2994385542 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc6e815da70 0x7fc6e80ace20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:38.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.966+0000 7fc6e77fe700 1 -- 172.21.15.84:0/2994385542 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6d8009550 con 0x7fc6e806a620 2023-09-13T08:25:38.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.966+0000 7fc6e6ffd700 1 --2- 172.21.15.84:0/2994385542 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc6e815b130 0x7fc6e80ac8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T08:25:38.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.966+0000 7fc6e7fff700 1 --2- 172.21.15.84:0/2994385542 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc6e815da70 0x7fc6e80ace20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T08:25:38.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.967+0000 7fc6e77fe700 1 --2- 172.21.15.84:0/2994385542 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6e806a620 0x7fc6e8158c70 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fc6d8009c40 tx=0x7fc6d8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:38.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.967+0000 7fc6dffff700 1 -- 172.21.15.84:0/2994385542 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d80036a0 con 0x7fc6e806a620 2023-09-13T08:25:38.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.967+0000 7fc6dffff700 1 -- 172.21.15.84:0/2994385542 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6d801f070 con 0x7fc6e806a620 2023-09-13T08:25:38.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.967+0000 7fc6edeec700 1 -- 172.21.15.84:0/2994385542 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6e80b4f00 con 0x7fc6e806a620 2023-09-13T08:25:38.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.967+0000 7fc6dffff700 1 -- 172.21.15.84:0/2994385542 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d8003a60 con 0x7fc6e806a620 2023-09-13T08:25:38.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.967+0000 7fc6edeec700 1 -- 172.21.15.84:0/2994385542 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6e80b54c0 con 0x7fc6e806a620 2023-09-13T08:25:38.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.968+0000 7fc6edeec700 1 -- 172.21.15.84:0/2994385542 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6e804e9b0 con 0x7fc6e806a620 2023-09-13T08:25:38.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.968+0000 7fc6dffff700 1 -- 172.21.15.84:0/2994385542 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fc6d8003bc0 con 0x7fc6e806a620 2023-09-13T08:25:38.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.968+0000 7fc6dffff700 1 --2- 172.21.15.84:0/2994385542 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fc6c806a580 0x7fc6c806ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:38.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.969+0000 7fc6dffff700 1 -- 172.21.15.84:0/2994385542 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fc6d8021070 con 0x7fc6e806a620 2023-09-13T08:25:38.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.969+0000 7fc6e6ffd700 1 --2- 172.21.15.84:0/2994385542 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fc6c806a580 0x7fc6c806ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:38.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.969+0000 7fc6e6ffd700 1 --2- 172.21.15.84:0/2994385542 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fc6c806a580 0x7fc6c806ca40 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc6e8072130 tx=0x7fc6d0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:38.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:38.973+0000 7fc6dffff700 1 -- 172.21.15.84:0/2994385542 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fc6d8055930 con 0x7fc6e806a620 2023-09-13T08:25:39.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.162+0000 7fc6edeec700 1 -- 172.21.15.84:0/2994385542 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc6e80b5fb0 con 0x7fc6e806a620 2023-09-13T08:25:39.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.163+0000 7fc6dffff700 1 -- 172.21.15.84:0/2994385542 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18757 (secure 0 0 0) 0x7fc6d8058f50 con 0x7fc6e806a620 2023-09-13T08:25:39.164 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:25:39.164 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":26,"fsid":"0107440b-b634-42c5-a643-5d31ea826116","created":"2023-09-13T08:24:16.931917+0000","modified":"2023-09-13T08:25:23.878460+0000","last_up_change":"2023-09-13T08:24:28.422631+0000","last_in_change":"2023-09-13T08:24:19.425578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T08:24:28.583720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-13T08:24:39.862832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-13T08:24:41.145511+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-13T08:24:44.775160+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4a53ec12-1469-4356-b4e1-2b8fc9b7c0f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6817","nonce":1599532366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6819","nonce":1599532366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6823","nonce":1599532366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6821","nonce":1599532366}]},"public_addr":"172.21.15.84:6817/1599532366","cluster_addr":"172.21.15.84:6819/1599532366","heartbeat_back_addr":"172.21.15.84:6823/1599532366","heartbeat_front_addr":"172.21.15.84:6821/1599532366","state":["exists","up"]},{"osd":1,"uuid":"11e964a0-b80c-4afc-bfbf-e2067969db29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6825","nonce":461860977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6827","nonce":461860977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6831","nonce":461860977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6829","nonce":461860977}]},"public_addr":"172.21.15.84:6825/461860977","cluster_addr":"172.21.15.84:6827/461860977","heartbeat_back_addr":"172.21.15.84:6831/461860977","heartbeat_front_addr":"172.21.15.84:6829/461860977","state":["exists","up"]},{"osd":2,"uuid":"3ce74529-4dd1-44c7-9576-968f5fdc0c25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6809","nonce":1168316165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6811","nonce":1168316165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6815","nonce":1168316165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6813","nonce":1168316165}]},"public_addr":"172.21.15.84:6809/1168316165","cluster_addr":"172.21.15.84:6811/1168316165","heartbeat_back_addr":"172.21.15.84:6815/1168316165","heartbeat_front_addr":"172.21.15.84:6813/1168316165","state":["exists","up"]},{"osd":3,"uuid":"460cb5c5-590a-4d06-a4d9-5bac2fdf33b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6801","nonce":1661609810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6803","nonce":1661609810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6807","nonce":1661609810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6805","nonce":1661609810}]},"public_addr":"172.21.15.84:6801/1661609810","cluster_addr":"172.21.15.84:6803/1661609810","heartbeat_back_addr":"172.21.15.84:6807/1661609810","heartbeat_front_addr":"172.21.15.84:6805/1661609810","state":["exists","up"]},{"osd":4,"uuid":"bf237dd0-3ebd-44b5-8078-24a63e00d792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6801","nonce":1303562374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6803","nonce":1303562374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6807","nonce":1303562374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6805","nonce":1303562374}]},"public_addr":"172.21.15.161:6801/1303562374","cluster_addr":"172.21.15.161:6803/1303562374","heartbeat_back_addr":"172.21.15.161:6807/1303562374","heartbeat_front_addr":"172.21.15.161:6805/1303562374","state":["exists","up"]},{"osd":5,"uuid":"e1e538e0-5844-456b-8c6e-434d3a914af1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6818","nonce":961120854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6822","nonce":961120854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6830","nonce":961120854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6826","nonce":961120854}]},"public_addr":"172.21.15.161:6818/961120854","cluster_addr":"172.21.15.161:6822/961120854","heartbeat_back_addr":"172.21.15.161:6830/961120854","heartbeat_front_addr":"172.21.15.161:6826/961120854","state":["exists","up"]},{"osd":6,"uuid":"5cb1785e-960f-4dd4-b295-9e21b2c3f875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6809","nonce":980533466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6811","nonce":980533466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6815","nonce":980533466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6813","nonce":980533466}]},"public_addr":"172.21.15.161:6809/980533466","cluster_addr":"172.21.15.161:6811/980533466","heartbeat_back_addr":"172.21.15.161:6815/980533466","heartbeat_front_addr":"172.21.15.161:6813/980533466","state":["exists","up"]},{"osd":7,"uuid":"5acb6619-e933-4b46-b1c2-60af30acb839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6817","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6819","nonce":2479691549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6821","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6823","nonce":2479691549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6829","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6831","nonce":2479691549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6825","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6827","nonce":2479691549}]},"public_addr":"172.21.15.161:6819/2479691549","cluster_addr":"172.21.15.161:6823/2479691549","heartbeat_back_addr":"172.21.15.161:6831/2479691549","heartbeat_front_addr":"172.21.15.161:6827/2479691549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.678857+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.685341+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.613603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.634940+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.564387+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.697347+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.637437+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.619397+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":1}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T08:25:39.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.165+0000 7fc6edeec700 1 -- 172.21.15.84:0/2994385542 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fc6c806a580 msgr2=0x7fc6c806ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:39.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.165+0000 7fc6edeec700 1 --2- 172.21.15.84:0/2994385542 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fc6c806a580 0x7fc6c806ca40 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc6e8072130 tx=0x7fc6d0009040 comp rx=0 tx=0).stop 2023-09-13T08:25:39.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.165+0000 7fc6edeec700 1 -- 172.21.15.84:0/2994385542 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6e806a620 msgr2=0x7fc6e8158c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:39.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.165+0000 7fc6edeec700 1 --2- 172.21.15.84:0/2994385542 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6e806a620 0x7fc6e8158c70 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fc6d8009c40 tx=0x7fc6d8004750 comp rx=0 tx=0).stop 2023-09-13T08:25:39.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.165+0000 7fc6edeec700 1 -- 172.21.15.84:0/2994385542 shutdown_connections 2023-09-13T08:25:39.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.165+0000 7fc6edeec700 1 --2- 172.21.15.84:0/2994385542 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fc6c806a580 0x7fc6c806ca40 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:39.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.165+0000 7fc6edeec700 1 --2- 172.21.15.84:0/2994385542 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc6e815da70 0x7fc6e80ace20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:39.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.166+0000 7fc6edeec700 1 --2- 172.21.15.84:0/2994385542 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6e806a620 0x7fc6e8158c70 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:39.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.166+0000 7fc6edeec700 1 --2- 172.21.15.84:0/2994385542 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc6e815b130 0x7fc6e80ac8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:39.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.166+0000 7fc6edeec700 1 -- 172.21.15.84:0/2994385542 >> 172.21.15.84:0/2994385542 conn(0x7fc6e80b1b80 msgr2=0x7fc6e80b1f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:39.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.166+0000 7fc6edeec700 1 -- 172.21.15.84:0/2994385542 shutdown_connections 2023-09-13T08:25:39.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.166+0000 7fc6edeec700 1 -- 172.21.15.84:0/2994385542 wait complete. 2023-09-13T08:25:39.178 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T08:24:28.583720+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-13T08:24:39.862832+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-13T08:24:41.145511+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-09-13T08:24:44.775160+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-13T08:25:39.180 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T08:25:39.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.303+0000 7fe4026c7700 1 Processor -- start 2023-09-13T08:25:39.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.303+0000 7fe4026c7700 1 -- start start 2023-09-13T08:25:39.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.304+0000 7fe4026c7700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe3fc0cf910 0x7fe3fc06ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:39.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.304+0000 7fe4026c7700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe3fc0ca640 0x7fe3fc0caaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:39.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.304+0000 7fe4026c7700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3fc0cfe40 con 0x7fe3fc15a170 2023-09-13T08:25:39.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.304+0000 7fe4026c7700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3fc15a550 con 0x7fe3fc0cf910 2023-09-13T08:25:39.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.304+0000 7fe4026c7700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3fc0cf4c0 con 0x7fe3fc0ca640 2023-09-13T08:25:39.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.304+0000 7fe3fb7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe3fc0cf910 0x7fe3fc06ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:39.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.305+0000 7fe3fb7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe3fc0cf910 0x7fe3fc06ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45022/0 (socket says 172.21.15.84:45022) 2023-09-13T08:25:39.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.305+0000 7fe3fb7fe700 1 -- 172.21.15.84:0/1453694800 learned_addr learned my addr 172.21.15.84:0/1453694800 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:39.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.305+0000 7fe400c64700 1 --2- 172.21.15.84:0/1453694800 >> v2:172.21.15.161:3300/0 conn(0x7fe3fc0ca640 0x7fe3fc0caaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:39.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.305+0000 7fe3fb7fe700 1 -- 172.21.15.84:0/1453694800 >> v2:172.21.15.161:3300/0 conn(0x7fe3fc0ca640 msgr2=0x7fe3fc0caaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:39.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.305+0000 7fe3fb7fe700 1 --2- 172.21.15.84:0/1453694800 >> v2:172.21.15.161:3300/0 conn(0x7fe3fc0ca640 0x7fe3fc0caaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:39.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.305+0000 7fe3fb7fe700 1 -- 172.21.15.84:0/1453694800 >> v1:172.21.15.161:6789/0 conn(0x7fe3fc15a170 legacy=0x7fe3fc06e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:39.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.305+0000 7fe3fb7fe700 1 -- 172.21.15.84:0/1453694800 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3fc0ce700 con 0x7fe3fc0cf910 2023-09-13T08:25:39.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.305+0000 7fe3fb7fe700 1 --2- 172.21.15.84:0/1453694800 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3fc0cf910 0x7fe3fc06ee50 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fe3fc06fed0 tx=0x7fe3ec00be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2db7d10d471cc6f3 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:39.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.305+0000 7fe3faffd700 1 -- 172.21.15.84:0/1453694800 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3ec00dcf0 con 0x7fe3fc0cf910 2023-09-13T08:25:39.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.305+0000 7fe3faffd700 1 -- 172.21.15.84:0/1453694800 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3ec00de50 con 0x7fe3fc0cf910 2023-09-13T08:25:39.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.305+0000 7fe3faffd700 1 -- 172.21.15.84:0/1453694800 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3ec004250 con 0x7fe3fc0cf910 2023-09-13T08:25:39.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.306+0000 7fe4026c7700 1 -- 172.21.15.84:0/1453694800 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3fc0cf910 msgr2=0x7fe3fc06ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:39.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.306+0000 7fe4026c7700 1 --2- 172.21.15.84:0/1453694800 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3fc0cf910 0x7fe3fc06ee50 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fe3fc06fed0 tx=0x7fe3ec00be70 comp rx=0 tx=0).stop 2023-09-13T08:25:39.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.306+0000 7fe4026c7700 1 -- 172.21.15.84:0/1453694800 shutdown_connections 2023-09-13T08:25:39.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.306+0000 7fe4026c7700 1 --2- 172.21.15.84:0/1453694800 >> v2:172.21.15.161:3300/0 conn(0x7fe3fc0ca640 0x7fe3fc0caaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:39.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.306+0000 7fe4026c7700 1 --2- 172.21.15.84:0/1453694800 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3fc0cf910 0x7fe3fc06ee50 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:39.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.306+0000 7fe4026c7700 1 -- 172.21.15.84:0/1453694800 >> 172.21.15.84:0/1453694800 conn(0x7fe3fc0cca70 msgr2=0x7fe3fc0cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:39.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.306+0000 7fe4026c7700 1 -- 172.21.15.84:0/1453694800 shutdown_connections 2023-09-13T08:25:39.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.306+0000 7fe4026c7700 1 -- 172.21.15.84:0/1453694800 wait complete. 2023-09-13T08:25:39.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.307+0000 7fe4026c7700 1 Processor -- start 2023-09-13T08:25:39.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.307+0000 7fe4026c7700 1 -- start start 2023-09-13T08:25:39.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.308+0000 7fe4026c7700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe3fc0ca640 0x7fe3fc0b5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:39.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.308+0000 7fe4026c7700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3fc0cf910 0x7fe3fc14c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:39.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.308+0000 7fe4026c7700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3fc15a170 0x7fe3fc1ee7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:39.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.308+0000 7fe4026c7700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3fc0c5560 con 0x7fe3fc15a170 2023-09-13T08:25:39.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.308+0000 7fe4026c7700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3fc0c6500 con 0x7fe3fc0cf910 2023-09-13T08:25:39.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.308+0000 7fe4026c7700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3fc14c540 con 0x7fe3fc0ca640 2023-09-13T08:25:39.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.308+0000 7fe400c64700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3fc15a170 0x7fe3fc1ee7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:39.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.308+0000 7fe400c64700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3fc15a170 0x7fe3fc1ee7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45030/0 (socket says 172.21.15.84:45030) 2023-09-13T08:25:39.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.308+0000 7fe400c64700 1 -- 172.21.15.84:0/2515113884 learned_addr learned my addr 172.21.15.84:0/2515113884 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:39.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.308+0000 7fe3fbfff700 1 --2- 172.21.15.84:0/2515113884 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe3fc0ca640 0x7fe3fc0b5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:39.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.308+0000 7fe3fb7fe700 1 --2- 172.21.15.84:0/2515113884 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3fc0cf910 0x7fe3fc14c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:39.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.308+0000 7fe400c64700 1 -- 172.21.15.84:0/2515113884 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe3fc0ca640 msgr2=0x7fe3fc0b5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:39.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.308+0000 7fe400c64700 1 --2- 172.21.15.84:0/2515113884 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe3fc0ca640 0x7fe3fc0b5980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:39.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.308+0000 7fe400c64700 1 -- 172.21.15.84:0/2515113884 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3fc0cf910 msgr2=0x7fe3fc14c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:39.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.308+0000 7fe400c64700 1 --2- 172.21.15.84:0/2515113884 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3fc0cf910 0x7fe3fc14c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:39.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.308+0000 7fe400c64700 1 -- 172.21.15.84:0/2515113884 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3ec00b7f0 con 0x7fe3fc15a170 2023-09-13T08:25:39.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.308+0000 7fe400c64700 1 --2- 172.21.15.84:0/2515113884 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3fc15a170 0x7fe3fc1ee7f0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fe3f400cc30 tx=0x7fe3f400cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:39.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.308+0000 7fe3f8ff9700 1 -- 172.21.15.84:0/2515113884 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f400aa50 con 0x7fe3fc15a170 2023-09-13T08:25:39.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.308+0000 7fe3f8ff9700 1 -- 172.21.15.84:0/2515113884 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3f400abb0 con 0x7fe3fc15a170 2023-09-13T08:25:39.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.308+0000 7fe3f8ff9700 1 -- 172.21.15.84:0/2515113884 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f4003a20 con 0x7fe3fc15a170 2023-09-13T08:25:39.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.308+0000 7fe4026c7700 1 -- 172.21.15.84:0/2515113884 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3fc14ca20 con 0x7fe3fc15a170 2023-09-13T08:25:39.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.309+0000 7fe4026c7700 1 -- 172.21.15.84:0/2515113884 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3fc0c5a20 con 0x7fe3fc15a170 2023-09-13T08:25:39.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.310+0000 7fe4026c7700 1 -- 172.21.15.84:0/2515113884 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3fc04f200 con 0x7fe3fc15a170 2023-09-13T08:25:39.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.310+0000 7fe3f8ff9700 1 -- 172.21.15.84:0/2515113884 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fe3f400f3f0 con 0x7fe3fc15a170 2023-09-13T08:25:39.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.310+0000 7fe3f8ff9700 1 --2- 172.21.15.84:0/2515113884 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fe3e806a580 0x7fe3e806ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:39.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.310+0000 7fe3f8ff9700 1 -- 172.21.15.84:0/2515113884 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fe3f4088eb0 con 0x7fe3fc15a170 2023-09-13T08:25:39.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.310+0000 7fe3fbfff700 1 --2- 172.21.15.84:0/2515113884 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fe3e806a580 0x7fe3e806ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:39.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.311+0000 7fe3fbfff700 1 --2- 172.21.15.84:0/2515113884 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fe3e806a580 0x7fe3e806ca40 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe3f0009960 tx=0x7fe3f00090e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:39.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.315+0000 7fe3f8ff9700 1 -- 172.21.15.84:0/2515113884 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fe3f4054050 con 0x7fe3fc15a170 2023-09-13T08:25:39.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.503+0000 7fe4026c7700 1 -- 172.21.15.84:0/2515113884 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe3fc0cc850 con 0x7fe3fc15a170 2023-09-13T08:25:39.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.503+0000 7fe3f8ff9700 1 -- 172.21.15.84:0/2515113884 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe3f401d070 con 0x7fe3fc15a170 2023-09-13T08:25:39.504 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-09-13T08:25:39.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.505+0000 7fe4026c7700 1 -- 172.21.15.84:0/2515113884 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fe3e806a580 msgr2=0x7fe3e806ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:39.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.505+0000 7fe4026c7700 1 --2- 172.21.15.84:0/2515113884 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fe3e806a580 0x7fe3e806ca40 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe3f0009960 tx=0x7fe3f00090e0 comp rx=0 tx=0).stop 2023-09-13T08:25:39.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.505+0000 7fe4026c7700 1 -- 172.21.15.84:0/2515113884 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3fc15a170 msgr2=0x7fe3fc1ee7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:39.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.505+0000 7fe4026c7700 1 --2- 172.21.15.84:0/2515113884 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3fc15a170 0x7fe3fc1ee7f0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fe3f400cc30 tx=0x7fe3f400cf40 comp rx=0 tx=0).stop 2023-09-13T08:25:39.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.505+0000 7fe4026c7700 1 -- 172.21.15.84:0/2515113884 shutdown_connections 2023-09-13T08:25:39.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.505+0000 7fe4026c7700 1 --2- 172.21.15.84:0/2515113884 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3fc15a170 0x7fe3fc1ee7f0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:39.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.505+0000 7fe4026c7700 1 --2- 172.21.15.84:0/2515113884 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe3fc0ca640 0x7fe3fc0b5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:39.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.505+0000 7fe4026c7700 1 --2- 172.21.15.84:0/2515113884 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fe3e806a580 0x7fe3e806ca40 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:39.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.505+0000 7fe4026c7700 1 --2- 172.21.15.84:0/2515113884 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3fc0cf910 0x7fe3fc14c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:39.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.505+0000 7fe4026c7700 1 -- 172.21.15.84:0/2515113884 >> 172.21.15.84:0/2515113884 conn(0x7fe3fc0cca70 msgr2=0x7fe3fc0b0950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:39.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.505+0000 7fe4026c7700 1 -- 172.21.15.84:0/2515113884 shutdown_connections 2023-09-13T08:25:39.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.505+0000 7fe4026c7700 1 -- 172.21.15.84:0/2515113884 wait complete. 2023-09-13T08:25:39.517 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-13T08:25:39.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.641+0000 7faa56c81700 1 Processor -- start 2023-09-13T08:25:39.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.641+0000 7faa56c81700 1 -- start start 2023-09-13T08:25:39.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.641+0000 7faa56c81700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faa5015a170 0x7faa5006e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:39.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.641+0000 7faa56c81700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7faa500cf910 0x7faa5006ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:39.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.641+0000 7faa56c81700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa500cfe40 con 0x7faa5006f1c0 2023-09-13T08:25:39.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.641+0000 7faa56c81700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa5015a550 con 0x7faa500cf910 2023-09-13T08:25:39.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.641+0000 7faa56c81700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa500cf4c0 con 0x7faa5015a170 2023-09-13T08:25:39.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.642+0000 7faa4ffff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7faa500cf910 0x7faa5006ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:39.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.642+0000 7faa4ffff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7faa500cf910 0x7faa5006ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45034/0 (socket says 172.21.15.84:45034) 2023-09-13T08:25:39.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.642+0000 7faa4ffff700 1 -- 172.21.15.84:0/2512263351 learned_addr learned my addr 172.21.15.84:0/2512263351 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:39.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.642+0000 7faa54a1d700 1 --2- 172.21.15.84:0/2512263351 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faa5015a170 0x7faa5006e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:39.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.642+0000 7faa4ffff700 1 -- 172.21.15.84:0/2512263351 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faa5015a170 msgr2=0x7faa5006e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:39.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.642+0000 7faa4ffff700 1 --2- 172.21.15.84:0/2512263351 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faa5015a170 0x7faa5006e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:39.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.642+0000 7faa4ffff700 1 -- 172.21.15.84:0/2512263351 >> v1:172.21.15.161:6789/0 conn(0x7faa5006f1c0 legacy=0x7faa5015dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:39.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.642+0000 7faa4ffff700 1 -- 172.21.15.84:0/2512263351 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa500ce700 con 0x7faa500cf910 2023-09-13T08:25:39.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.642+0000 7faa4ffff700 1 --2- 172.21.15.84:0/2512263351 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa500cf910 0x7faa5006ec80 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7faa3c0098f0 tx=0x7faa3c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44d6ddbfd9966510 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:39.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.642+0000 7faa4f7fe700 1 -- 172.21.15.84:0/2512263351 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3c004230 con 0x7faa500cf910 2023-09-13T08:25:39.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.642+0000 7faa4f7fe700 1 -- 172.21.15.84:0/2512263351 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa3c004390 con 0x7faa500cf910 2023-09-13T08:25:39.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.642+0000 7faa4f7fe700 1 -- 172.21.15.84:0/2512263351 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3c0036a0 con 0x7faa500cf910 2023-09-13T08:25:39.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.643+0000 7faa56c81700 1 -- 172.21.15.84:0/2512263351 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa500cf910 msgr2=0x7faa5006ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:39.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.643+0000 7faa56c81700 1 --2- 172.21.15.84:0/2512263351 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa500cf910 0x7faa5006ec80 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7faa3c0098f0 tx=0x7faa3c009c00 comp rx=0 tx=0).stop 2023-09-13T08:25:39.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.643+0000 7faa56c81700 1 -- 172.21.15.84:0/2512263351 shutdown_connections 2023-09-13T08:25:39.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.643+0000 7faa56c81700 1 --2- 172.21.15.84:0/2512263351 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faa5015a170 0x7faa5006e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:39.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.643+0000 7faa56c81700 1 --2- 172.21.15.84:0/2512263351 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa500cf910 0x7faa5006ec80 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:39.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.643+0000 7faa56c81700 1 -- 172.21.15.84:0/2512263351 >> 172.21.15.84:0/2512263351 conn(0x7faa500cca70 msgr2=0x7faa500cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:39.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.643+0000 7faa56c81700 1 -- 172.21.15.84:0/2512263351 shutdown_connections 2023-09-13T08:25:39.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.643+0000 7faa56c81700 1 -- 172.21.15.84:0/2512263351 wait complete. 2023-09-13T08:25:39.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.644+0000 7faa56c81700 1 Processor -- start 2023-09-13T08:25:39.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.644+0000 7faa56c81700 1 -- start start 2023-09-13T08:25:39.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.645+0000 7faa56c81700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faa5006f1c0 0x7faa501f0870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:39.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.645+0000 7faa56c81700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faa500cf910 0x7faa500a84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:39.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.645+0000 7faa56c81700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa5015a170 0x7faa5014c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:39.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.645+0000 7faa56c81700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa500a8a10 con 0x7faa5015a170 2023-09-13T08:25:39.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.645+0000 7faa56c81700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa5014ca00 con 0x7faa500cf910 2023-09-13T08:25:39.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.645+0000 7faa56c81700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa500a8c20 con 0x7faa5006f1c0 2023-09-13T08:25:39.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.645+0000 7faa5521e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa5015a170 0x7faa5014c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:39.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.645+0000 7faa5521e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa5015a170 0x7faa5014c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45042/0 (socket says 172.21.15.84:45042) 2023-09-13T08:25:39.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.645+0000 7faa5521e700 1 -- 172.21.15.84:0/2705653755 learned_addr learned my addr 172.21.15.84:0/2705653755 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:39.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.645+0000 7faa54a1d700 1 --2- 172.21.15.84:0/2705653755 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faa5006f1c0 0x7faa501f0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:39.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.645+0000 7faa4ffff700 1 --2- 172.21.15.84:0/2705653755 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faa500cf910 0x7faa500a84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:39.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.645+0000 7faa5521e700 1 -- 172.21.15.84:0/2705653755 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faa5006f1c0 msgr2=0x7faa501f0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:39.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.645+0000 7faa5521e700 1 --2- 172.21.15.84:0/2705653755 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faa5006f1c0 0x7faa501f0870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:39.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.645+0000 7faa5521e700 1 -- 172.21.15.84:0/2705653755 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faa500cf910 msgr2=0x7faa500a84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:39.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.645+0000 7faa5521e700 1 --2- 172.21.15.84:0/2705653755 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faa500cf910 0x7faa500a84d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:39.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.645+0000 7faa5521e700 1 -- 172.21.15.84:0/2705653755 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa3c009550 con 0x7faa5015a170 2023-09-13T08:25:39.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.645+0000 7faa4ffff700 1 --2- 172.21.15.84:0/2705653755 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faa500cf910 0x7faa500a84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T08:25:39.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.645+0000 7faa5521e700 1 --2- 172.21.15.84:0/2705653755 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa5015a170 0x7faa5014c4c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7faa4800b970 tx=0x7faa4800bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:39.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.646+0000 7faa4d7fa700 1 -- 172.21.15.84:0/2705653755 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa4800c9b0 con 0x7faa5015a170 2023-09-13T08:25:39.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.646+0000 7faa4d7fa700 1 -- 172.21.15.84:0/2705653755 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa4800cb10 con 0x7faa5015a170 2023-09-13T08:25:39.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.646+0000 7faa4d7fa700 1 -- 172.21.15.84:0/2705653755 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa48014440 con 0x7faa5015a170 2023-09-13T08:25:39.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.646+0000 7faa56c81700 1 -- 172.21.15.84:0/2705653755 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa501f0f60 con 0x7faa5015a170 2023-09-13T08:25:39.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.646+0000 7faa56c81700 1 -- 172.21.15.84:0/2705653755 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa501f1520 con 0x7faa5015a170 2023-09-13T08:25:39.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.647+0000 7faa56c81700 1 -- 172.21.15.84:0/2705653755 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa5004f200 con 0x7faa5015a170 2023-09-13T08:25:39.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.647+0000 7faa4d7fa700 1 -- 172.21.15.84:0/2705653755 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7faa4801d3b0 con 0x7faa5015a170 2023-09-13T08:25:39.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.647+0000 7faa4d7fa700 1 --2- 172.21.15.84:0/2705653755 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7faa3406a580 0x7faa3406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:39.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.647+0000 7faa4d7fa700 1 -- 172.21.15.84:0/2705653755 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7faa48088a20 con 0x7faa5015a170 2023-09-13T08:25:39.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.647+0000 7faa54a1d700 1 --2- 172.21.15.84:0/2705653755 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7faa3406a580 0x7faa3406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:39.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.648+0000 7faa54a1d700 1 --2- 172.21.15.84:0/2705653755 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7faa3406a580 0x7faa3406ca40 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7faa500c8780 tx=0x7faa44008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:39.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.652+0000 7faa4d7fa700 1 -- 172.21.15.84:0/2705653755 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7faa48053c50 con 0x7faa5015a170 2023-09-13T08:25:39.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.839+0000 7faa56c81700 1 -- 172.21.15.84:0/2705653755 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7faa500cc850 con 0x7faa5015a170 2023-09-13T08:25:39.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.839+0000 7faa4d7fa700 1 -- 172.21.15.84:0/2705653755 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7faa48057270 con 0x7faa5015a170 2023-09-13T08:25:39.840 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-09-13T08:25:39.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.841+0000 7faa56c81700 1 -- 172.21.15.84:0/2705653755 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7faa3406a580 msgr2=0x7faa3406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:39.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.841+0000 7faa56c81700 1 --2- 172.21.15.84:0/2705653755 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7faa3406a580 0x7faa3406ca40 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7faa500c8780 tx=0x7faa44008040 comp rx=0 tx=0).stop 2023-09-13T08:25:39.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.841+0000 7faa56c81700 1 -- 172.21.15.84:0/2705653755 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa5015a170 msgr2=0x7faa5014c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:39.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.841+0000 7faa56c81700 1 --2- 172.21.15.84:0/2705653755 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa5015a170 0x7faa5014c4c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7faa4800b970 tx=0x7faa4800bd30 comp rx=0 tx=0).stop 2023-09-13T08:25:39.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.842+0000 7faa56c81700 1 -- 172.21.15.84:0/2705653755 shutdown_connections 2023-09-13T08:25:39.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.842+0000 7faa56c81700 1 --2- 172.21.15.84:0/2705653755 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faa5015a170 0x7faa5014c4c0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:39.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.842+0000 7faa56c81700 1 --2- 172.21.15.84:0/2705653755 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faa5006f1c0 0x7faa501f0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:39.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.842+0000 7faa56c81700 1 --2- 172.21.15.84:0/2705653755 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7faa3406a580 0x7faa3406ca40 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:39.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.842+0000 7faa56c81700 1 --2- 172.21.15.84:0/2705653755 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faa500cf910 0x7faa500a84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:39.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.842+0000 7faa56c81700 1 -- 172.21.15.84:0/2705653755 >> 172.21.15.84:0/2705653755 conn(0x7faa500cca70 msgr2=0x7faa500b47b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:39.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.842+0000 7faa56c81700 1 -- 172.21.15.84:0/2705653755 shutdown_connections 2023-09-13T08:25:39.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.842+0000 7faa56c81700 1 -- 172.21.15.84:0/2705653755 wait complete. 2023-09-13T08:25:39.854 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-13T08:25:39.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.977+0000 7f7ab0c84700 1 Processor -- start 2023-09-13T08:25:39.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.977+0000 7f7ab0c84700 1 -- start start 2023-09-13T08:25:39.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.978+0000 7f7ab0c84700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7aac15a170 0x7f7aac06e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:39.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.978+0000 7f7ab0c84700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7aac0cf910 0x7f7aac06ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:39.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.978+0000 7f7ab0c84700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f7aac06f1c0 0x7f7aac15dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:39.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.978+0000 7f7ab0c84700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7aac0cfe40 con 0x7f7aac15a170 2023-09-13T08:25:39.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.978+0000 7f7ab0c84700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7aac15a550 con 0x7f7aac06f1c0 2023-09-13T08:25:39.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.978+0000 7f7ab0c84700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7aac0cf4c0 con 0x7f7aac0cf910 2023-09-13T08:25:39.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.978+0000 7f7aaa59c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7aac15a170 0x7f7aac06e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:39.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.978+0000 7f7aaa59c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7aac15a170 0x7f7aac06e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45046/0 (socket says 172.21.15.84:45046) 2023-09-13T08:25:39.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.978+0000 7f7aaa59c700 1 -- 172.21.15.84:0/4107598741 learned_addr learned my addr 172.21.15.84:0/4107598741 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:39.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.979+0000 7f7aaad9d700 1 --2- 172.21.15.84:0/4107598741 >> v2:172.21.15.161:3300/0 conn(0x7f7aac06f1c0 0x7f7aac15dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:39.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.979+0000 7f7aa9d9b700 1 --2- 172.21.15.84:0/4107598741 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7aac0cf910 0x7f7aac06ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:39.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.979+0000 7f7aaa59c700 1 -- 172.21.15.84:0/4107598741 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7aac0cf910 msgr2=0x7f7aac06ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:39.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.979+0000 7f7aaa59c700 1 --2- 172.21.15.84:0/4107598741 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7aac0cf910 0x7f7aac06ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:39.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.979+0000 7f7aaa59c700 1 -- 172.21.15.84:0/4107598741 >> v2:172.21.15.161:3300/0 conn(0x7f7aac06f1c0 msgr2=0x7f7aac15dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:39.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.979+0000 7f7aaa59c700 1 --2- 172.21.15.84:0/4107598741 >> v2:172.21.15.161:3300/0 conn(0x7f7aac06f1c0 0x7f7aac15dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:39.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.979+0000 7f7aaa59c700 1 -- 172.21.15.84:0/4107598741 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aac0ce700 con 0x7f7aac15a170 2023-09-13T08:25:39.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.979+0000 7f7aaad9d700 1 --2- 172.21.15.84:0/4107598741 >> v2:172.21.15.161:3300/0 conn(0x7f7aac06f1c0 0x7f7aac15dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T08:25:39.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.979+0000 7f7aaa59c700 1 --2- 172.21.15.84:0/4107598741 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7aac15a170 0x7f7aac06e740 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f7aac15dbb0 tx=0x7f7aa400be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb72656018f53165 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:39.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.979+0000 7f7aa959a700 1 -- 172.21.15.84:0/4107598741 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa400dd30 con 0x7f7aac15a170 2023-09-13T08:25:39.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.979+0000 7f7aa959a700 1 -- 172.21.15.84:0/4107598741 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aa400de90 con 0x7f7aac15a170 2023-09-13T08:25:39.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.979+0000 7f7aa959a700 1 -- 172.21.15.84:0/4107598741 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa4010690 con 0x7f7aac15a170 2023-09-13T08:25:39.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.980+0000 7f7ab0c84700 1 -- 172.21.15.84:0/4107598741 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7aac15a170 msgr2=0x7f7aac06e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:39.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.980+0000 7f7ab0c84700 1 --2- 172.21.15.84:0/4107598741 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7aac15a170 0x7f7aac06e740 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f7aac15dbb0 tx=0x7f7aa400be70 comp rx=0 tx=0).stop 2023-09-13T08:25:39.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.980+0000 7f7ab0c84700 1 -- 172.21.15.84:0/4107598741 shutdown_connections 2023-09-13T08:25:39.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.980+0000 7f7ab0c84700 1 --2- 172.21.15.84:0/4107598741 >> v2:172.21.15.161:3300/0 conn(0x7f7aac06f1c0 0x7f7aac15dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:39.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.980+0000 7f7ab0c84700 1 --2- 172.21.15.84:0/4107598741 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7aac15a170 0x7f7aac06e740 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:39.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.980+0000 7f7ab0c84700 1 --2- 172.21.15.84:0/4107598741 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7aac0cf910 0x7f7aac06ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:39.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.980+0000 7f7ab0c84700 1 -- 172.21.15.84:0/4107598741 >> 172.21.15.84:0/4107598741 conn(0x7f7aac0cca70 msgr2=0x7f7aac0cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:39.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.980+0000 7f7ab0c84700 1 -- 172.21.15.84:0/4107598741 shutdown_connections 2023-09-13T08:25:39.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.980+0000 7f7ab0c84700 1 -- 172.21.15.84:0/4107598741 wait complete. 2023-09-13T08:25:39.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.981+0000 7f7ab0c84700 1 Processor -- start 2023-09-13T08:25:39.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.981+0000 7f7ab0c84700 1 -- start start 2023-09-13T08:25:39.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.982+0000 7f7ab0c84700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7aac06f1c0 0x7f7aac0c4b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:39.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.982+0000 7f7ab0c84700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7aac0cf910 0x7f7aac14bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:39.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.982+0000 7f7ab0c84700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7aac15a170 0x7f7aac1eeaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:39.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.982+0000 7f7ab0c84700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aac0ca1b0 con 0x7f7aac06f1c0 2023-09-13T08:25:39.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.982+0000 7f7ab0c84700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aac0c54f0 con 0x7f7aac0cf910 2023-09-13T08:25:39.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.982+0000 7f7ab0c84700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7aac0c57d0 con 0x7f7aac15a170 2023-09-13T08:25:39.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.982+0000 7f7aaa59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7aac06f1c0 0x7f7aac0c4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:39.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.982+0000 7f7aaa59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7aac06f1c0 0x7f7aac0c4b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45052/0 (socket says 172.21.15.84:45052) 2023-09-13T08:25:39.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.982+0000 7f7aaa59c700 1 -- 172.21.15.84:0/2354447959 learned_addr learned my addr 172.21.15.84:0/2354447959 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:39.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.982+0000 7f7aa9d9b700 1 --2- 172.21.15.84:0/2354447959 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7aac0cf910 0x7f7aac14bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:39.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.982+0000 7f7aaa59c700 1 -- 172.21.15.84:0/2354447959 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7aac15a170 msgr2=0x7f7aac1eeaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:39.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.982+0000 7f7aaad9d700 1 --2- 172.21.15.84:0/2354447959 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7aac15a170 0x7f7aac1eeaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:39.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.982+0000 7f7aaa59c700 1 --2- 172.21.15.84:0/2354447959 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7aac15a170 0x7f7aac1eeaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:39.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.982+0000 7f7aaa59c700 1 -- 172.21.15.84:0/2354447959 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7aac0cf910 msgr2=0x7f7aac14bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:39.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.982+0000 7f7aaa59c700 1 --2- 172.21.15.84:0/2354447959 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7aac0cf910 0x7f7aac14bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:39.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.982+0000 7f7aaa59c700 1 -- 172.21.15.84:0/2354447959 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aa400b7f0 con 0x7f7aac06f1c0 2023-09-13T08:25:39.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.982+0000 7f7aa9d9b700 1 --2- 172.21.15.84:0/2354447959 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7aac0cf910 0x7f7aac14bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T08:25:39.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.982+0000 7f7aaa59c700 1 --2- 172.21.15.84:0/2354447959 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7aac06f1c0 0x7f7aac0c4b10 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f7aa400beb0 tx=0x7f7aa4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:39.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.982+0000 7f7a9affd700 1 -- 172.21.15.84:0/2354447959 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa401f070 con 0x7f7aac06f1c0 2023-09-13T08:25:39.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.982+0000 7f7a9affd700 1 -- 172.21.15.84:0/2354447959 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aa4003b20 con 0x7f7aac06f1c0 2023-09-13T08:25:39.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.982+0000 7f7ab0c84700 1 -- 172.21.15.84:0/2354447959 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7aac0c5ab0 con 0x7f7aac06f1c0 2023-09-13T08:25:39.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.982+0000 7f7a9affd700 1 -- 172.21.15.84:0/2354447959 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa4010470 con 0x7f7aac06f1c0 2023-09-13T08:25:39.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.983+0000 7f7ab0c84700 1 -- 172.21.15.84:0/2354447959 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7aac0c6070 con 0x7f7aac06f1c0 2023-09-13T08:25:39.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.983+0000 7f7ab0c84700 1 -- 172.21.15.84:0/2354447959 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7aac0cf730 con 0x7f7aac06f1c0 2023-09-13T08:25:39.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.984+0000 7f7a9affd700 1 -- 172.21.15.84:0/2354447959 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f7aa4019400 con 0x7f7aac06f1c0 2023-09-13T08:25:39.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.984+0000 7f7a9affd700 1 --2- 172.21.15.84:0/2354447959 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f7a8c06a580 0x7f7a8c06ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:39.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.984+0000 7f7a9affd700 1 -- 172.21.15.84:0/2354447959 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f7aa408c1c0 con 0x7f7aac06f1c0 2023-09-13T08:25:39.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.984+0000 7f7aa9d9b700 1 --2- 172.21.15.84:0/2354447959 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f7a8c06a580 0x7f7a8c06ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:39.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.985+0000 7f7aa9d9b700 1 --2- 172.21.15.84:0/2354447959 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f7a8c06a580 0x7f7a8c06ca40 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7aac0b3f10 tx=0x7f7aa0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:39.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:39.989+0000 7f7a9affd700 1 -- 172.21.15.84:0/2354447959 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f7aa40573f0 con 0x7f7aac06f1c0 2023-09-13T08:25:40.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.177+0000 7f7ab0c84700 1 -- 172.21.15.84:0/2354447959 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7aac04f200 con 0x7f7aac06f1c0 2023-09-13T08:25:40.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.177+0000 7f7a9affd700 1 -- 172.21.15.84:0/2354447959 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7aa405aa10 con 0x7f7aac06f1c0 2023-09-13T08:25:40.178 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-09-13T08:25:40.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.179+0000 7f7ab0c84700 1 -- 172.21.15.84:0/2354447959 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f7a8c06a580 msgr2=0x7f7a8c06ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:40.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.179+0000 7f7ab0c84700 1 --2- 172.21.15.84:0/2354447959 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f7a8c06a580 0x7f7a8c06ca40 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7aac0b3f10 tx=0x7f7aa0008040 comp rx=0 tx=0).stop 2023-09-13T08:25:40.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.179+0000 7f7ab0c84700 1 -- 172.21.15.84:0/2354447959 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7aac06f1c0 msgr2=0x7f7aac0c4b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:40.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.179+0000 7f7ab0c84700 1 --2- 172.21.15.84:0/2354447959 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7aac06f1c0 0x7f7aac0c4b10 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f7aa400beb0 tx=0x7f7aa4004750 comp rx=0 tx=0).stop 2023-09-13T08:25:40.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.179+0000 7f7ab0c84700 1 -- 172.21.15.84:0/2354447959 shutdown_connections 2023-09-13T08:25:40.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.179+0000 7f7ab0c84700 1 --2- 172.21.15.84:0/2354447959 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7aac15a170 0x7f7aac1eeaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:40.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.179+0000 7f7ab0c84700 1 --2- 172.21.15.84:0/2354447959 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7aac06f1c0 0x7f7aac0c4b10 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:40.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.179+0000 7f7ab0c84700 1 --2- 172.21.15.84:0/2354447959 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f7a8c06a580 0x7f7a8c06ca40 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:40.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.179+0000 7f7ab0c84700 1 --2- 172.21.15.84:0/2354447959 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7aac0cf910 0x7f7aac14bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:40.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.179+0000 7f7ab0c84700 1 -- 172.21.15.84:0/2354447959 >> 172.21.15.84:0/2354447959 conn(0x7f7aac0cca70 msgr2=0x7f7aac06e520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:40.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.180+0000 7f7ab0c84700 1 -- 172.21.15.84:0/2354447959 shutdown_connections 2023-09-13T08:25:40.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.180+0000 7f7ab0c84700 1 -- 172.21.15.84:0/2354447959 wait complete. 2023-09-13T08:25:40.191 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-09-13T08:25:40.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.315+0000 7fe313e5a700 1 Processor -- start 2023-09-13T08:25:40.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.315+0000 7fe313e5a700 1 -- start start 2023-09-13T08:25:40.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.316+0000 7fe313e5a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe30c15d570 0x7fe30c0b8d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:40.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.316+0000 7fe313e5a700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe30c0d0340 0x7fe30c0d1c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:40.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.316+0000 7fe313e5a700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe30c15d950 con 0x7fe30c160ff0 2023-09-13T08:25:40.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.316+0000 7fe313e5a700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe30c161480 con 0x7fe30c15d570 2023-09-13T08:25:40.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.316+0000 7fe313e5a700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe30c1616f0 con 0x7fe30c0d0340 2023-09-13T08:25:40.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.316+0000 7fe311bf6700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe30c15d570 0x7fe30c0b8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:40.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.316+0000 7fe311bf6700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe30c15d570 0x7fe30c0b8d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45060/0 (socket says 172.21.15.84:45060) 2023-09-13T08:25:40.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.316+0000 7fe311bf6700 1 -- 172.21.15.84:0/2679180351 learned_addr learned my addr 172.21.15.84:0/2679180351 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:40.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.316+0000 7fe3113f5700 1 --1- 172.21.15.84:0/2679180351 >> v1:172.21.15.84:6789/0 conn(0x7fe30c160ff0 0x7fe30c0cfc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:47706/0 (socket says 172.21.15.84:47706) 2023-09-13T08:25:40.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.316+0000 7fe311bf6700 1 -- 172.21.15.84:0/2679180351 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe30c0d0340 msgr2=0x7fe30c0d1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:40.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.316+0000 7fe3123f7700 1 --2- 172.21.15.84:0/2679180351 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe30c0d0340 0x7fe30c0d1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:40.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.316+0000 7fe311bf6700 1 --2- 172.21.15.84:0/2679180351 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe30c0d0340 0x7fe30c0d1c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:40.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.316+0000 7fe311bf6700 1 -- 172.21.15.84:0/2679180351 >> v1:172.21.15.84:6789/0 conn(0x7fe30c160ff0 legacy=0x7fe30c0cfc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:40.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.316+0000 7fe311bf6700 1 -- 172.21.15.84:0/2679180351 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe30c1619d0 con 0x7fe30c15d570 2023-09-13T08:25:40.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.316+0000 7fe3123f7700 1 --2- 172.21.15.84:0/2679180351 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe30c0d0340 0x7fe30c0d1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T08:25:40.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.316+0000 7fe311bf6700 1 --2- 172.21.15.84:0/2679180351 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe30c15d570 0x7fe30c0b8d50 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc0098f0 tx=0x7fe2fc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22e63cf967c1b212 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:40.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.316+0000 7fe310bf4700 1 -- 172.21.15.84:0/2679180351 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2fc00b8a0 con 0x7fe30c15d570 2023-09-13T08:25:40.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.316+0000 7fe310bf4700 1 -- 172.21.15.84:0/2679180351 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2fc00ba00 con 0x7fe30c15d570 2023-09-13T08:25:40.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.316+0000 7fe310bf4700 1 -- 172.21.15.84:0/2679180351 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2fc00bd90 con 0x7fe30c15d570 2023-09-13T08:25:40.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.317+0000 7fe313e5a700 1 -- 172.21.15.84:0/2679180351 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe30c15d570 msgr2=0x7fe30c0b8d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:40.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.317+0000 7fe313e5a700 1 --2- 172.21.15.84:0/2679180351 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe30c15d570 0x7fe30c0b8d50 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc0098f0 tx=0x7fe2fc009c00 comp rx=0 tx=0).stop 2023-09-13T08:25:40.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.317+0000 7fe313e5a700 1 -- 172.21.15.84:0/2679180351 shutdown_connections 2023-09-13T08:25:40.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.317+0000 7fe313e5a700 1 --2- 172.21.15.84:0/2679180351 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe30c0d0340 0x7fe30c0d1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:40.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.317+0000 7fe313e5a700 1 --2- 172.21.15.84:0/2679180351 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe30c15d570 0x7fe30c0b8d50 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:40.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.317+0000 7fe313e5a700 1 -- 172.21.15.84:0/2679180351 >> 172.21.15.84:0/2679180351 conn(0x7fe30c06b0d0 msgr2=0x7fe30c06b4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:40.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.317+0000 7fe313e5a700 1 -- 172.21.15.84:0/2679180351 shutdown_connections 2023-09-13T08:25:40.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.317+0000 7fe313e5a700 1 -- 172.21.15.84:0/2679180351 wait complete. 2023-09-13T08:25:40.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.318+0000 7fe313e5a700 1 Processor -- start 2023-09-13T08:25:40.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.318+0000 7fe313e5a700 1 -- start start 2023-09-13T08:25:40.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.319+0000 7fe313e5a700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe30c0d0340 0x7fe30c0c9730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:40.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.319+0000 7fe313e5a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe30c15d570 0x7fe30c0c6f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:40.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.319+0000 7fe313e5a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe30c160ff0 0x7fe30c0cc200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:40.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.319+0000 7fe313e5a700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe30c0c9c70 con 0x7fe30c15d570 2023-09-13T08:25:40.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.319+0000 7fe313e5a700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe30c0cb440 con 0x7fe30c160ff0 2023-09-13T08:25:40.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.319+0000 7fe313e5a700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe30c0cb720 con 0x7fe30c0d0340 2023-09-13T08:25:40.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.319+0000 7fe3113f5700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe30c15d570 0x7fe30c0c6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:40.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.319+0000 7fe3113f5700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe30c15d570 0x7fe30c0c6f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45068/0 (socket says 172.21.15.84:45068) 2023-09-13T08:25:40.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.319+0000 7fe3113f5700 1 -- 172.21.15.84:0/673313281 learned_addr learned my addr 172.21.15.84:0/673313281 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:40.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.319+0000 7fe311bf6700 1 --2- 172.21.15.84:0/673313281 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe30c0d0340 0x7fe30c0c9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:40.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.319+0000 7fe3123f7700 1 --2- 172.21.15.84:0/673313281 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe30c160ff0 0x7fe30c0cc200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:40.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.319+0000 7fe3113f5700 1 -- 172.21.15.84:0/673313281 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe30c0d0340 msgr2=0x7fe30c0c9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:40.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.319+0000 7fe3113f5700 1 --2- 172.21.15.84:0/673313281 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe30c0d0340 0x7fe30c0c9730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:40.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.319+0000 7fe3113f5700 1 -- 172.21.15.84:0/673313281 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe30c160ff0 msgr2=0x7fe30c0cc200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:40.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.319+0000 7fe3113f5700 1 --2- 172.21.15.84:0/673313281 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe30c160ff0 0x7fe30c0cc200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:40.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.319+0000 7fe3113f5700 1 -- 172.21.15.84:0/673313281 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2fc009550 con 0x7fe30c15d570 2023-09-13T08:25:40.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.320+0000 7fe3113f5700 1 --2- 172.21.15.84:0/673313281 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe30c15d570 0x7fe30c0c6f80 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fe30800c500 tx=0x7fe30800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:40.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.320+0000 7fe3027fc700 1 -- 172.21.15.84:0/673313281 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe308005cb0 con 0x7fe30c15d570 2023-09-13T08:25:40.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.320+0000 7fe3027fc700 1 -- 172.21.15.84:0/673313281 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe308005e10 con 0x7fe30c15d570 2023-09-13T08:25:40.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.320+0000 7fe313e5a700 1 -- 172.21.15.84:0/673313281 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe30c0cba00 con 0x7fe30c15d570 2023-09-13T08:25:40.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.320+0000 7fe3027fc700 1 -- 172.21.15.84:0/673313281 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3080072d0 con 0x7fe30c15d570 2023-09-13T08:25:40.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.320+0000 7fe313e5a700 1 -- 172.21.15.84:0/673313281 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe30c0c74c0 con 0x7fe30c15d570 2023-09-13T08:25:40.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.321+0000 7fe313e5a700 1 -- 172.21.15.84:0/673313281 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe30c0d1740 con 0x7fe30c15d570 2023-09-13T08:25:40.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.321+0000 7fe3027fc700 1 -- 172.21.15.84:0/673313281 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fe308007430 con 0x7fe30c15d570 2023-09-13T08:25:40.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.321+0000 7fe3027fc700 1 --2- 172.21.15.84:0/673313281 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fe2f006a580 0x7fe2f006ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:40.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.322+0000 7fe3027fc700 1 -- 172.21.15.84:0/673313281 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fe308087f30 con 0x7fe30c15d570 2023-09-13T08:25:40.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.322+0000 7fe311bf6700 1 --2- 172.21.15.84:0/673313281 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fe2f006a580 0x7fe2f006ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:40.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.322+0000 7fe311bf6700 1 --2- 172.21.15.84:0/673313281 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fe2f006a580 0x7fe2f006ca40 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc009840 tx=0x7fe2fc008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:40.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.326+0000 7fe3027fc700 1 -- 172.21.15.84:0/673313281 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fe30c0d1740 con 0x7fe30c15d570 2023-09-13T08:25:40.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.512+0000 7fe313e5a700 1 -- 172.21.15.84:0/673313281 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fe30c0cbf20 con 0x7fe30c15d570 2023-09-13T08:25:40.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.513+0000 7fe3027fc700 1 -- 172.21.15.84:0/673313281 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe30c0cbf20 con 0x7fe30c15d570 2023-09-13T08:25:40.513 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-09-13T08:25:40.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.515+0000 7fe313e5a700 1 -- 172.21.15.84:0/673313281 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fe2f006a580 msgr2=0x7fe2f006ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:40.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.515+0000 7fe313e5a700 1 --2- 172.21.15.84:0/673313281 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fe2f006a580 0x7fe2f006ca40 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc009840 tx=0x7fe2fc008030 comp rx=0 tx=0).stop 2023-09-13T08:25:40.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.515+0000 7fe313e5a700 1 -- 172.21.15.84:0/673313281 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe30c15d570 msgr2=0x7fe30c0c6f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:40.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.515+0000 7fe313e5a700 1 --2- 172.21.15.84:0/673313281 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe30c15d570 0x7fe30c0c6f80 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fe30800c500 tx=0x7fe30800c8c0 comp rx=0 tx=0).stop 2023-09-13T08:25:40.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.515+0000 7fe313e5a700 1 -- 172.21.15.84:0/673313281 shutdown_connections 2023-09-13T08:25:40.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.515+0000 7fe313e5a700 1 --2- 172.21.15.84:0/673313281 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fe2f006a580 0x7fe2f006ca40 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:40.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.515+0000 7fe313e5a700 1 --2- 172.21.15.84:0/673313281 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe30c160ff0 0x7fe30c0cc200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:40.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.515+0000 7fe313e5a700 1 --2- 172.21.15.84:0/673313281 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe30c0d0340 0x7fe30c0c9730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:40.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.515+0000 7fe313e5a700 1 --2- 172.21.15.84:0/673313281 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe30c15d570 0x7fe30c0c6f80 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:40.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.515+0000 7fe313e5a700 1 -- 172.21.15.84:0/673313281 >> 172.21.15.84:0/673313281 conn(0x7fe30c06b0d0 msgr2=0x7fe30c15db80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:40.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.515+0000 7fe313e5a700 1 -- 172.21.15.84:0/673313281 shutdown_connections 2023-09-13T08:25:40.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.515+0000 7fe313e5a700 1 -- 172.21.15.84:0/673313281 wait complete. 2023-09-13T08:25:40.527 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-09-13T08:25:40.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.648+0000 7fd0d3dd5700 1 Processor -- start 2023-09-13T08:25:40.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.649+0000 7fd0d3dd5700 1 -- start start 2023-09-13T08:25:40.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.649+0000 7fd0d3dd5700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd0cc0d1ce0 0x7fd0cc0cf4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:40.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.649+0000 7fd0d3dd5700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd0cc0b0630 0x7fd0cc0ae160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:40.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.649+0000 7fd0d3dd5700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0cc15b940 con 0x7fd0cc15b560 2023-09-13T08:25:40.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.649+0000 7fd0d3dd5700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0cc0d2170 con 0x7fd0cc0b0630 2023-09-13T08:25:40.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.649+0000 7fd0d3dd5700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0cc0cc980 con 0x7fd0cc0d1ce0 2023-09-13T08:25:40.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.649+0000 7fd0d2372700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd0cc0b0630 0x7fd0cc0ae160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:40.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.650+0000 7fd0d2372700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd0cc0b0630 0x7fd0cc0ae160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45078/0 (socket says 172.21.15.84:45078) 2023-09-13T08:25:40.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.650+0000 7fd0d2372700 1 -- 172.21.15.84:0/342749440 learned_addr learned my addr 172.21.15.84:0/342749440 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:40.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.650+0000 7fd0d1370700 1 --2- 172.21.15.84:0/342749440 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd0cc0d1ce0 0x7fd0cc0cf4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:40.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.650+0000 7fd0d2372700 1 -- 172.21.15.84:0/342749440 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd0cc0d1ce0 msgr2=0x7fd0cc0cf4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:40.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.650+0000 7fd0d2372700 1 --2- 172.21.15.84:0/342749440 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd0cc0d1ce0 0x7fd0cc0cf4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:40.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.650+0000 7fd0d2372700 1 -- 172.21.15.84:0/342749440 >> v1:172.21.15.84:6789/0 conn(0x7fd0cc15b560 legacy=0x7fd0cc0ced90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:40.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.650+0000 7fd0d2372700 1 -- 172.21.15.84:0/342749440 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0cc0ccc20 con 0x7fd0cc0b0630 2023-09-13T08:25:40.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.650+0000 7fd0d2372700 1 --2- 172.21.15.84:0/342749440 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0cc0b0630 0x7fd0cc0ae160 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fd0c4009e50 tx=0x7fd0c400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0e115faef52e03e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:40.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.650+0000 7fd0d0b6f700 1 -- 172.21.15.84:0/342749440 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c400e070 con 0x7fd0cc0b0630 2023-09-13T08:25:40.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.650+0000 7fd0d0b6f700 1 -- 172.21.15.84:0/342749440 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0c400b9c0 con 0x7fd0cc0b0630 2023-09-13T08:25:40.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.650+0000 7fd0d0b6f700 1 -- 172.21.15.84:0/342749440 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c400bd70 con 0x7fd0cc0b0630 2023-09-13T08:25:40.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.651+0000 7fd0d3dd5700 1 -- 172.21.15.84:0/342749440 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0cc0b0630 msgr2=0x7fd0cc0ae160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:40.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.651+0000 7fd0d3dd5700 1 --2- 172.21.15.84:0/342749440 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0cc0b0630 0x7fd0cc0ae160 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fd0c4009e50 tx=0x7fd0c400b330 comp rx=0 tx=0).stop 2023-09-13T08:25:40.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.651+0000 7fd0d3dd5700 1 -- 172.21.15.84:0/342749440 shutdown_connections 2023-09-13T08:25:40.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.651+0000 7fd0d3dd5700 1 --2- 172.21.15.84:0/342749440 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0cc0b0630 0x7fd0cc0ae160 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:40.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.651+0000 7fd0d3dd5700 1 --2- 172.21.15.84:0/342749440 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd0cc0d1ce0 0x7fd0cc0cf4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:40.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.651+0000 7fd0d3dd5700 1 -- 172.21.15.84:0/342749440 >> 172.21.15.84:0/342749440 conn(0x7fd0cc0d11c0 msgr2=0x7fd0cc0d15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:40.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.651+0000 7fd0d3dd5700 1 -- 172.21.15.84:0/342749440 shutdown_connections 2023-09-13T08:25:40.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.651+0000 7fd0d3dd5700 1 -- 172.21.15.84:0/342749440 wait complete. 2023-09-13T08:25:40.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.652+0000 7fd0d3dd5700 1 Processor -- start 2023-09-13T08:25:40.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.652+0000 7fd0d3dd5700 1 -- start start 2023-09-13T08:25:40.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.653+0000 7fd0d3dd5700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0cc0b0630 0x7fd0cc1f21b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:40.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.653+0000 7fd0d3dd5700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd0cc15b560 0x7fd0cc0c7470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:40.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.653+0000 7fd0d3dd5700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd0cc06b730 0x7fd0cc0ae060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:40.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.653+0000 7fd0d3dd5700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0cc0c4cf0 con 0x7fd0cc0b0630 2023-09-13T08:25:40.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.653+0000 7fd0d3dd5700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0cc0c5500 con 0x7fd0cc15b560 2023-09-13T08:25:40.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.653+0000 7fd0d3dd5700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0cc0c4f40 con 0x7fd0cc06b730 2023-09-13T08:25:40.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.653+0000 7fd0d1b71700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0cc0b0630 0x7fd0cc1f21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:40.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.653+0000 7fd0d1b71700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0cc0b0630 0x7fd0cc1f21b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45080/0 (socket says 172.21.15.84:45080) 2023-09-13T08:25:40.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.653+0000 7fd0d1b71700 1 -- 172.21.15.84:0/3193982468 learned_addr learned my addr 172.21.15.84:0/3193982468 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:40.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.653+0000 7fd0d1370700 1 --2- 172.21.15.84:0/3193982468 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd0cc15b560 0x7fd0cc0c7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:40.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.653+0000 7fd0d2372700 1 --2- 172.21.15.84:0/3193982468 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd0cc06b730 0x7fd0cc0ae060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:40.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.653+0000 7fd0d1b71700 1 -- 172.21.15.84:0/3193982468 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd0cc06b730 msgr2=0x7fd0cc0ae060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:40.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.653+0000 7fd0d1b71700 1 --2- 172.21.15.84:0/3193982468 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd0cc06b730 0x7fd0cc0ae060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:40.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.653+0000 7fd0d1b71700 1 -- 172.21.15.84:0/3193982468 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd0cc15b560 msgr2=0x7fd0cc0c7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:40.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.653+0000 7fd0d1b71700 1 --2- 172.21.15.84:0/3193982468 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd0cc15b560 0x7fd0cc0c7470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:40.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.653+0000 7fd0d1b71700 1 -- 172.21.15.84:0/3193982468 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0c4009b30 con 0x7fd0cc0b0630 2023-09-13T08:25:40.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.653+0000 7fd0d1b71700 1 --2- 172.21.15.84:0/3193982468 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0cc0b0630 0x7fd0cc1f21b0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc00c480 tx=0x7fd0bc00c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:40.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.653+0000 7fd0c27fc700 1 -- 172.21.15.84:0/3193982468 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0bc0052d0 con 0x7fd0cc0b0630 2023-09-13T08:25:40.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.653+0000 7fd0c27fc700 1 -- 172.21.15.84:0/3193982468 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0bc005430 con 0x7fd0cc0b0630 2023-09-13T08:25:40.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.653+0000 7fd0c27fc700 1 -- 172.21.15.84:0/3193982468 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0bc0038c0 con 0x7fd0cc0b0630 2023-09-13T08:25:40.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.653+0000 7fd0d3dd5700 1 -- 172.21.15.84:0/3193982468 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0cc0c5220 con 0x7fd0cc0b0630 2023-09-13T08:25:40.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.653+0000 7fd0d3dd5700 1 -- 172.21.15.84:0/3193982468 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0cc06ea60 con 0x7fd0cc0b0630 2023-09-13T08:25:40.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.654+0000 7fd0d3dd5700 1 -- 172.21.15.84:0/3193982468 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0cc06e5e0 con 0x7fd0cc0b0630 2023-09-13T08:25:40.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.655+0000 7fd0c27fc700 1 -- 172.21.15.84:0/3193982468 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fd0bc003a20 con 0x7fd0cc0b0630 2023-09-13T08:25:40.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.655+0000 7fd0c27fc700 1 --2- 172.21.15.84:0/3193982468 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fd0b006a580 0x7fd0b006ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:40.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.655+0000 7fd0c27fc700 1 -- 172.21.15.84:0/3193982468 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fd0bc0880f0 con 0x7fd0cc0b0630 2023-09-13T08:25:40.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.655+0000 7fd0d1370700 1 --2- 172.21.15.84:0/3193982468 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fd0b006a580 0x7fd0b006ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:40.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.656+0000 7fd0d1370700 1 --2- 172.21.15.84:0/3193982468 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fd0b006a580 0x7fd0b006ca40 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc0c3fd0 tx=0x7fd0c8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:40.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.659+0000 7fd0c27fc700 1 -- 172.21.15.84:0/3193982468 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fd0cc06e5e0 con 0x7fd0cc0b0630 2023-09-13T08:25:40.859 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:25:40.862 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:25:40.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.865+0000 7fd0d3dd5700 1 -- 172.21.15.84:0/3193982468 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd0cc06e5e0 con 0x7fd0cc0b0630 2023-09-13T08:25:40.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.866+0000 7fd0c27fc700 1 -- 172.21.15.84:0/3193982468 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd0cc06e5e0 con 0x7fd0cc0b0630 2023-09-13T08:25:40.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.868+0000 7fd0d3dd5700 1 -- 172.21.15.84:0/3193982468 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fd0b006a580 msgr2=0x7fd0b006ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:40.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.868+0000 7fd0d3dd5700 1 --2- 172.21.15.84:0/3193982468 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fd0b006a580 0x7fd0b006ca40 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc0c3fd0 tx=0x7fd0c8008040 comp rx=0 tx=0).stop 2023-09-13T08:25:40.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.868+0000 7fd0d3dd5700 1 -- 172.21.15.84:0/3193982468 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0cc0b0630 msgr2=0x7fd0cc1f21b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:40.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.868+0000 7fd0d3dd5700 1 --2- 172.21.15.84:0/3193982468 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0cc0b0630 0x7fd0cc1f21b0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc00c480 tx=0x7fd0bc00c790 comp rx=0 tx=0).stop 2023-09-13T08:25:40.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.868+0000 7fd0d3dd5700 1 -- 172.21.15.84:0/3193982468 shutdown_connections 2023-09-13T08:25:40.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.868+0000 7fd0d3dd5700 1 --2- 172.21.15.84:0/3193982468 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd0cc06b730 0x7fd0cc0ae060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:40.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.868+0000 7fd0d3dd5700 1 --2- 172.21.15.84:0/3193982468 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0cc0b0630 0x7fd0cc1f21b0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:40.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.868+0000 7fd0d3dd5700 1 --2- 172.21.15.84:0/3193982468 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fd0b006a580 0x7fd0b006ca40 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:40.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.868+0000 7fd0d3dd5700 1 --2- 172.21.15.84:0/3193982468 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd0cc15b560 0x7fd0cc0c7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:40.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.868+0000 7fd0d3dd5700 1 -- 172.21.15.84:0/3193982468 >> 172.21.15.84:0/3193982468 conn(0x7fd0cc0d11c0 msgr2=0x7fd0cc0b0a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:40.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.868+0000 7fd0d3dd5700 1 -- 172.21.15.84:0/3193982468 shutdown_connections 2023-09-13T08:25:40.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:40.868+0000 7fd0d3dd5700 1 -- 172.21.15.84:0/3193982468 wait complete. 2023-09-13T08:25:40.871 INFO:teuthology.orchestra.run.smithi084.stderr:listed 0 entries 2023-09-13T08:25:40.881 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-09-13T08:25:40.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:25:40.882 DEBUG:teuthology.orchestra.run.smithi161:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-09-13T08:25:40.968 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi161.front.sepia.ceph.com 2023-09-13T08:25:40.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:25:40.969 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-09-13T08:25:41.034 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-09-13T08:25:41.035 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T08:25:41.053 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-09-13T08:25:41.053 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T08:25:41.112 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-09-13T08:25:41.113 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T08:25:41.169 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T08:25:41.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.329+0000 7f419fa53700 1 Processor -- start 2023-09-13T08:25:41.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.329+0000 7f419fa53700 1 -- start start 2023-09-13T08:25:41.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.330+0000 7f419fa53700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f419815d520 0x7f419815d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:41.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.330+0000 7f419fa53700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4198159e30 con 0x7f4198159a50 2023-09-13T08:25:41.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.330+0000 7f419fa53700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f419815e090 con 0x7f41980cb020 2023-09-13T08:25:41.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.330+0000 7f419fa53700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41980b0560 con 0x7f419815d520 2023-09-13T08:25:41.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.330+0000 7f419d7ef700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f4198159a50 0x7f41980b1040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:47734/0 (socket says 172.21.15.84:47734) 2023-09-13T08:25:41.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.330+0000 7f419d7ef700 1 -- 172.21.15.84:0/1334520746 learned_addr learned my addr 172.21.15.84:0/1334520746 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:25:41.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.331+0000 7f4197fff700 1 -- 172.21.15.84:0/1334520746 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1769818994 0 0) 0x7f4198159e30 con 0x7f4198159a50 2023-09-13T08:25:41.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.331+0000 7f419cfee700 1 --2- 172.21.15.84:0/1334520746 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f419815d520 0x7f419815d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:41.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.331+0000 7f4197fff700 1 -- 172.21.15.84:0/1334520746 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41800035b0 con 0x7f4198159a50 2023-09-13T08:25:41.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.331+0000 7f4197fff700 1 -- 172.21.15.84:0/1334520746 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1735985790 0 0) 0x7f41800035b0 con 0x7f4198159a50 2023-09-13T08:25:41.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.331+0000 7f4197fff700 1 -- 172.21.15.84:0/1334520746 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f419815d520 msgr2=0x7f419815d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:41.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.331+0000 7f4197fff700 1 --2- 172.21.15.84:0/1334520746 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f419815d520 0x7f419815d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:41.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.331+0000 7f4197fff700 1 -- 172.21.15.84:0/1334520746 >> v1:172.21.15.161:6789/0 conn(0x7f41980cb020 legacy=0x7f419806a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:41.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.331+0000 7f4197fff700 1 -- 172.21.15.84:0/1334520746 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41980b0840 con 0x7f4198159a50 2023-09-13T08:25:41.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.331+0000 7f4197fff700 1 -- 172.21.15.84:0/1334520746 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2302733408 0 0) 0x7f41900019f0 con 0x7f4198159a50 2023-09-13T08:25:41.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.331+0000 7f4197fff700 1 -- 172.21.15.84:0/1334520746 >> v1:172.21.15.84:6789/0 conn(0x7f4198159a50 legacy=0x7f41980b1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:41.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.331+0000 7f4197fff700 1 --2- 172.21.15.84:0/1334520746 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4180003a30 0x7f4180003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:41.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.331+0000 7f4197fff700 1 --2- 172.21.15.84:0/1334520746 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f419815d520 0x7f4180004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:41.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.331+0000 7f4197fff700 1 --2- 172.21.15.84:0/1334520746 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4180004d90 0x7f4180005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:41.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.331+0000 7f4197fff700 1 -- 172.21.15.84:0/1334520746 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41980b0560 con 0x7f4180004d90 2023-09-13T08:25:41.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.331+0000 7f4197fff700 1 -- 172.21.15.84:0/1334520746 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f418000bba0 con 0x7f4180003a30 2023-09-13T08:25:41.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.331+0000 7f4197fff700 1 -- 172.21.15.84:0/1334520746 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f418000bd30 con 0x7f419815d520 2023-09-13T08:25:41.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.331+0000 7f419dff0700 1 --2- 172.21.15.84:0/1334520746 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4180004d90 0x7f4180005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:41.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.331+0000 7f419d7ef700 1 --2- 172.21.15.84:0/1334520746 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4180003a30 0x7f4180003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:41.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.331+0000 7f419cfee700 1 --2- 172.21.15.84:0/1334520746 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f419815d520 0x7f4180004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:41.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.331+0000 7f419dff0700 1 -- 172.21.15.84:0/1334520746 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f419815d520 msgr2=0x7f4180004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:41.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.331+0000 7f419dff0700 1 --2- 172.21.15.84:0/1334520746 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f419815d520 0x7f4180004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:41.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.331+0000 7f419dff0700 1 -- 172.21.15.84:0/1334520746 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4180003a30 msgr2=0x7f4180003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:41.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.331+0000 7f419dff0700 1 --2- 172.21.15.84:0/1334520746 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4180003a30 0x7f4180003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:41.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.331+0000 7f419dff0700 1 -- 172.21.15.84:0/1334520746 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41800035b0 con 0x7f4180004d90 2023-09-13T08:25:41.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.331+0000 7f419dff0700 1 --2- 172.21.15.84:0/1334520746 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4180004d90 0x7f4180005210 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f4188001830 tx=0x7f4180005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=884a0db0ca6b9ddc server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:41.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.332+0000 7f4197fff700 1 -- 172.21.15.84:0/1334520746 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41880012f0 con 0x7f4180004d90 2023-09-13T08:25:41.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.332+0000 7f4197fff700 1 -- 172.21.15.84:0/1334520746 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41880052f0 con 0x7f4180004d90 2023-09-13T08:25:41.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.332+0000 7f4197fff700 1 -- 172.21.15.84:0/1334520746 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4188006860 con 0x7f4180004d90 2023-09-13T08:25:41.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.332+0000 7f419fa53700 1 -- 172.21.15.84:0/1334520746 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4180004d90 msgr2=0x7f4180005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:41.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.332+0000 7f419fa53700 1 --2- 172.21.15.84:0/1334520746 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4180004d90 0x7f4180005210 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f4188001830 tx=0x7f4180005880 comp rx=0 tx=0).stop 2023-09-13T08:25:41.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.332+0000 7f419dff0700 1 -- 172.21.15.84:0/1334520746 reap_dead start 2023-09-13T08:25:41.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.332+0000 7f419fa53700 1 -- 172.21.15.84:0/1334520746 shutdown_connections 2023-09-13T08:25:41.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.332+0000 7f419fa53700 1 -- 172.21.15.84:0/1334520746 >> 172.21.15.84:0/1334520746 conn(0x7f41980cc230 msgr2=0x7f41980cc640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:41.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.332+0000 7f419fa53700 1 -- 172.21.15.84:0/1334520746 shutdown_connections 2023-09-13T08:25:41.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.332+0000 7f419fa53700 1 -- 172.21.15.84:0/1334520746 wait complete. 2023-09-13T08:25:41.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.334+0000 7f419fa53700 1 Processor -- start 2023-09-13T08:25:41.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.334+0000 7f419fa53700 1 -- start start 2023-09-13T08:25:41.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.334+0000 7f419fa53700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4180004d90 0x7f4198157c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:41.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.334+0000 7f419fa53700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41981e54d0 0x7f41980c9360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:41.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.334+0000 7f419fa53700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41981e3ca0 0x7f41980c52f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:41.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.334+0000 7f419fa53700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41981e45f0 con 0x7f41981e3ca0 2023-09-13T08:25:41.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.334+0000 7f419fa53700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4198157800 con 0x7f41981e54d0 2023-09-13T08:25:41.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.334+0000 7f419fa53700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41980c98a0 con 0x7f4180004d90 2023-09-13T08:25:41.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.334+0000 7f419dff0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41981e3ca0 0x7f41980c52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:41.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.334+0000 7f419dff0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41981e3ca0 0x7f41980c52f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45104/0 (socket says 172.21.15.84:45104) 2023-09-13T08:25:41.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.334+0000 7f419dff0700 1 -- 172.21.15.84:0/3128536214 learned_addr learned my addr 172.21.15.84:0/3128536214 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:41.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.334+0000 7f419d7ef700 1 --2- 172.21.15.84:0/3128536214 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4180004d90 0x7f4198157c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:41.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.335+0000 7f419cfee700 1 --2- 172.21.15.84:0/3128536214 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41981e54d0 0x7f41980c9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:41.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.335+0000 7f419dff0700 1 -- 172.21.15.84:0/3128536214 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4180004d90 msgr2=0x7f4198157c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:41.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.335+0000 7f419dff0700 1 --2- 172.21.15.84:0/3128536214 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4180004d90 0x7f4198157c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:41.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.335+0000 7f419dff0700 1 -- 172.21.15.84:0/3128536214 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41981e54d0 msgr2=0x7f41980c9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:41.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.335+0000 7f419dff0700 1 --2- 172.21.15.84:0/3128536214 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41981e54d0 0x7f41980c9360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:41.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.335+0000 7f419dff0700 1 -- 172.21.15.84:0/3128536214 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4198156f10 con 0x7f41981e3ca0 2023-09-13T08:25:41.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.335+0000 7f419dff0700 1 --2- 172.21.15.84:0/3128536214 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41981e3ca0 0x7f41980c52f0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f4188004000 tx=0x7f4188001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:41.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.335+0000 7f4195ffb700 1 -- 172.21.15.84:0/3128536214 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4188006a60 con 0x7f41981e3ca0 2023-09-13T08:25:41.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.335+0000 7f4195ffb700 1 -- 172.21.15.84:0/3128536214 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4188006bc0 con 0x7f41981e3ca0 2023-09-13T08:25:41.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.335+0000 7f419fa53700 1 -- 172.21.15.84:0/3128536214 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41981571b0 con 0x7f41981e3ca0 2023-09-13T08:25:41.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.335+0000 7f4195ffb700 1 -- 172.21.15.84:0/3128536214 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4188003680 con 0x7f41981e3ca0 2023-09-13T08:25:41.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.335+0000 7f419fa53700 1 -- 172.21.15.84:0/3128536214 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41981e4130 con 0x7f41981e3ca0 2023-09-13T08:25:41.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.336+0000 7f419fa53700 1 -- 172.21.15.84:0/3128536214 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41981e43b0 con 0x7f41981e3ca0 2023-09-13T08:25:41.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.337+0000 7f4195ffb700 1 -- 172.21.15.84:0/3128536214 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f41880037e0 con 0x7f41981e3ca0 2023-09-13T08:25:41.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.337+0000 7f4195ffb700 1 --2- 172.21.15.84:0/3128536214 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f418406a580 0x7f418406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:41.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.337+0000 7f4195ffb700 1 -- 172.21.15.84:0/3128536214 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f4188089930 con 0x7f41981e3ca0 2023-09-13T08:25:41.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.337+0000 7f419d7ef700 1 --2- 172.21.15.84:0/3128536214 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f418406a580 0x7f418406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:41.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.337+0000 7f419d7ef700 1 --2- 172.21.15.84:0/3128536214 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f418406a580 0x7f418406ca40 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f41900013d0 tx=0x7f4190006040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:41.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.342+0000 7f4195ffb700 1 -- 172.21.15.84:0/3128536214 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f41981e43b0 con 0x7f41981e3ca0 2023-09-13T08:25:41.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.533+0000 7f419fa53700 1 -- 172.21.15.84:0/3128536214 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f41981e43b0 con 0x7f41981e3ca0 2023-09-13T08:25:41.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.534+0000 7f4195ffb700 1 -- 172.21.15.84:0/3128536214 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18757 (secure 0 0 0) 0x7f41981e43b0 con 0x7f41981e3ca0 2023-09-13T08:25:41.534 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:25:41.535 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":26,"fsid":"0107440b-b634-42c5-a643-5d31ea826116","created":"2023-09-13T08:24:16.931917+0000","modified":"2023-09-13T08:25:23.878460+0000","last_up_change":"2023-09-13T08:24:28.422631+0000","last_in_change":"2023-09-13T08:24:19.425578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T08:24:28.583720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-13T08:24:39.862832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-13T08:24:41.145511+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-13T08:24:44.775160+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4a53ec12-1469-4356-b4e1-2b8fc9b7c0f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6817","nonce":1599532366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6819","nonce":1599532366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6823","nonce":1599532366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6821","nonce":1599532366}]},"public_addr":"172.21.15.84:6817/1599532366","cluster_addr":"172.21.15.84:6819/1599532366","heartbeat_back_addr":"172.21.15.84:6823/1599532366","heartbeat_front_addr":"172.21.15.84:6821/1599532366","state":["exists","up"]},{"osd":1,"uuid":"11e964a0-b80c-4afc-bfbf-e2067969db29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6825","nonce":461860977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6827","nonce":461860977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6831","nonce":461860977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6829","nonce":461860977}]},"public_addr":"172.21.15.84:6825/461860977","cluster_addr":"172.21.15.84:6827/461860977","heartbeat_back_addr":"172.21.15.84:6831/461860977","heartbeat_front_addr":"172.21.15.84:6829/461860977","state":["exists","up"]},{"osd":2,"uuid":"3ce74529-4dd1-44c7-9576-968f5fdc0c25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6809","nonce":1168316165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6811","nonce":1168316165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6815","nonce":1168316165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6813","nonce":1168316165}]},"public_addr":"172.21.15.84:6809/1168316165","cluster_addr":"172.21.15.84:6811/1168316165","heartbeat_back_addr":"172.21.15.84:6815/1168316165","heartbeat_front_addr":"172.21.15.84:6813/1168316165","state":["exists","up"]},{"osd":3,"uuid":"460cb5c5-590a-4d06-a4d9-5bac2fdf33b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6801","nonce":1661609810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6803","nonce":1661609810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6807","nonce":1661609810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6805","nonce":1661609810}]},"public_addr":"172.21.15.84:6801/1661609810","cluster_addr":"172.21.15.84:6803/1661609810","heartbeat_back_addr":"172.21.15.84:6807/1661609810","heartbeat_front_addr":"172.21.15.84:6805/1661609810","state":["exists","up"]},{"osd":4,"uuid":"bf237dd0-3ebd-44b5-8078-24a63e00d792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6801","nonce":1303562374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6803","nonce":1303562374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6807","nonce":1303562374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6805","nonce":1303562374}]},"public_addr":"172.21.15.161:6801/1303562374","cluster_addr":"172.21.15.161:6803/1303562374","heartbeat_back_addr":"172.21.15.161:6807/1303562374","heartbeat_front_addr":"172.21.15.161:6805/1303562374","state":["exists","up"]},{"osd":5,"uuid":"e1e538e0-5844-456b-8c6e-434d3a914af1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6818","nonce":961120854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6822","nonce":961120854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6830","nonce":961120854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6826","nonce":961120854}]},"public_addr":"172.21.15.161:6818/961120854","cluster_addr":"172.21.15.161:6822/961120854","heartbeat_back_addr":"172.21.15.161:6830/961120854","heartbeat_front_addr":"172.21.15.161:6826/961120854","state":["exists","up"]},{"osd":6,"uuid":"5cb1785e-960f-4dd4-b295-9e21b2c3f875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6809","nonce":980533466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6811","nonce":980533466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6815","nonce":980533466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6813","nonce":980533466}]},"public_addr":"172.21.15.161:6809/980533466","cluster_addr":"172.21.15.161:6811/980533466","heartbeat_back_addr":"172.21.15.161:6815/980533466","heartbeat_front_addr":"172.21.15.161:6813/980533466","state":["exists","up"]},{"osd":7,"uuid":"5acb6619-e933-4b46-b1c2-60af30acb839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6817","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6819","nonce":2479691549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6821","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6823","nonce":2479691549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6829","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6831","nonce":2479691549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6825","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6827","nonce":2479691549}]},"public_addr":"172.21.15.161:6819/2479691549","cluster_addr":"172.21.15.161:6823/2479691549","heartbeat_back_addr":"172.21.15.161:6831/2479691549","heartbeat_front_addr":"172.21.15.161:6827/2479691549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.678857+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.685341+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.613603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.634940+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.564387+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.697347+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.637437+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.619397+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":1}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T08:25:41.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.536+0000 7f419fa53700 1 -- 172.21.15.84:0/3128536214 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f418406a580 msgr2=0x7f418406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:41.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.536+0000 7f419fa53700 1 --2- 172.21.15.84:0/3128536214 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f418406a580 0x7f418406ca40 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f41900013d0 tx=0x7f4190006040 comp rx=0 tx=0).stop 2023-09-13T08:25:41.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.536+0000 7f419fa53700 1 -- 172.21.15.84:0/3128536214 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41981e3ca0 msgr2=0x7f41980c52f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:41.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.536+0000 7f419fa53700 1 --2- 172.21.15.84:0/3128536214 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41981e3ca0 0x7f41980c52f0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f4188004000 tx=0x7f4188001120 comp rx=0 tx=0).stop 2023-09-13T08:25:41.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.536+0000 7f419fa53700 1 -- 172.21.15.84:0/3128536214 shutdown_connections 2023-09-13T08:25:41.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.536+0000 7f419fa53700 1 --2- 172.21.15.84:0/3128536214 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41981e3ca0 0x7f41980c52f0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:41.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.536+0000 7f419fa53700 1 --2- 172.21.15.84:0/3128536214 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4180004d90 0x7f4198157c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:41.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.536+0000 7f419fa53700 1 --2- 172.21.15.84:0/3128536214 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f418406a580 0x7f418406ca40 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:41.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.536+0000 7f419fa53700 1 --2- 172.21.15.84:0/3128536214 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41981e54d0 0x7f41980c9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:41.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.536+0000 7f419fa53700 1 -- 172.21.15.84:0/3128536214 >> 172.21.15.84:0/3128536214 conn(0x7f41980cc230 msgr2=0x7f41980cb490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:41.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.536+0000 7f419fa53700 1 -- 172.21.15.84:0/3128536214 shutdown_connections 2023-09-13T08:25:41.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.537+0000 7f419fa53700 1 -- 172.21.15.84:0/3128536214 wait complete. 2023-09-13T08:25:41.549 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T08:24:28.583720+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-13T08:24:39.862832+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-13T08:24:41.145511+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-09-13T08:24:44.775160+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-13T08:25:41.550 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T08:25:41.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.674+0000 7f1cc84ac700 1 Processor -- start 2023-09-13T08:25:41.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.674+0000 7f1cc84ac700 1 -- start start 2023-09-13T08:25:41.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.675+0000 7f1cc84ac700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1cc00cf910 0x7f1cc006ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:41.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.675+0000 7f1cc84ac700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f1cc00ca640 0x7f1cc00caaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:41.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.675+0000 7f1cc84ac700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cc00cfe40 con 0x7f1cc015a170 2023-09-13T08:25:41.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.675+0000 7f1cc84ac700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cc015a550 con 0x7f1cc00cf910 2023-09-13T08:25:41.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.675+0000 7f1cc84ac700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cc00cf4c0 con 0x7f1cc00ca640 2023-09-13T08:25:41.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.675+0000 7f1cc5a47700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1cc00cf910 0x7f1cc006ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:41.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.675+0000 7f1cc5a47700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1cc00cf910 0x7f1cc006ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45108/0 (socket says 172.21.15.84:45108) 2023-09-13T08:25:41.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.675+0000 7f1cc5a47700 1 -- 172.21.15.84:0/3541874823 learned_addr learned my addr 172.21.15.84:0/3541874823 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:41.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.675+0000 7f1cc6a49700 1 --2- 172.21.15.84:0/3541874823 >> v2:172.21.15.161:3300/0 conn(0x7f1cc00ca640 0x7f1cc00caaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:41.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.675+0000 7f1cc5a47700 1 -- 172.21.15.84:0/3541874823 >> v2:172.21.15.161:3300/0 conn(0x7f1cc00ca640 msgr2=0x7f1cc00caaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:41.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.675+0000 7f1cc5a47700 1 --2- 172.21.15.84:0/3541874823 >> v2:172.21.15.161:3300/0 conn(0x7f1cc00ca640 0x7f1cc00caaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:41.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.675+0000 7f1cc5a47700 1 -- 172.21.15.84:0/3541874823 >> v1:172.21.15.161:6789/0 conn(0x7f1cc015a170 legacy=0x7f1cc006e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:41.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.675+0000 7f1cc5a47700 1 -- 172.21.15.84:0/3541874823 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cc00ce700 con 0x7f1cc00cf910 2023-09-13T08:25:41.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.676+0000 7f1cc5a47700 1 --2- 172.21.15.84:0/3541874823 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1cc00cf910 0x7f1cc006ee50 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f1cc006fed0 tx=0x7f1cb0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4589659ae8b6bc15 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:41.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.676+0000 7f1cc5246700 1 -- 172.21.15.84:0/3541874823 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb000b870 con 0x7f1cc00cf910 2023-09-13T08:25:41.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.676+0000 7f1cc5246700 1 -- 172.21.15.84:0/3541874823 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cb000b9d0 con 0x7f1cc00cf910 2023-09-13T08:25:41.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.676+0000 7f1cc5246700 1 -- 172.21.15.84:0/3541874823 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb000bd60 con 0x7f1cc00cf910 2023-09-13T08:25:41.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.676+0000 7f1cc84ac700 1 -- 172.21.15.84:0/3541874823 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1cc00cf910 msgr2=0x7f1cc006ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:41.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.676+0000 7f1cc84ac700 1 --2- 172.21.15.84:0/3541874823 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1cc00cf910 0x7f1cc006ee50 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f1cc006fed0 tx=0x7f1cb0009bd0 comp rx=0 tx=0).stop 2023-09-13T08:25:41.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.676+0000 7f1cc84ac700 1 -- 172.21.15.84:0/3541874823 shutdown_connections 2023-09-13T08:25:41.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.676+0000 7f1cc84ac700 1 --2- 172.21.15.84:0/3541874823 >> v2:172.21.15.161:3300/0 conn(0x7f1cc00ca640 0x7f1cc00caaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:41.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.676+0000 7f1cc84ac700 1 --2- 172.21.15.84:0/3541874823 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1cc00cf910 0x7f1cc006ee50 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:41.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.676+0000 7f1cc84ac700 1 -- 172.21.15.84:0/3541874823 >> 172.21.15.84:0/3541874823 conn(0x7f1cc00cca70 msgr2=0x7f1cc00cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:41.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.676+0000 7f1cc84ac700 1 -- 172.21.15.84:0/3541874823 shutdown_connections 2023-09-13T08:25:41.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.676+0000 7f1cc84ac700 1 -- 172.21.15.84:0/3541874823 wait complete. 2023-09-13T08:25:41.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.678+0000 7f1cc84ac700 1 Processor -- start 2023-09-13T08:25:41.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.678+0000 7f1cc84ac700 1 -- start start 2023-09-13T08:25:41.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.679+0000 7f1cc84ac700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1cc00ca640 0x7f1cc01473b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:41.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.679+0000 7f1cc84ac700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1cc00cf910 0x7f1cc00caa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:41.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.679+0000 7f1cc84ac700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1cc015a170 0x7f1cc00caf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:41.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.679+0000 7f1cc84ac700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc014a1e0 con 0x7f1cc015a170 2023-09-13T08:25:41.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.679+0000 7f1cc84ac700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc00c8a00 con 0x7f1cc00ca640 2023-09-13T08:25:41.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.679+0000 7f1cc84ac700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc00c8ce0 con 0x7f1cc00cf910 2023-09-13T08:25:41.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.679+0000 7f1cc6a49700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1cc015a170 0x7f1cc00caf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:41.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.679+0000 7f1cc6a49700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1cc015a170 0x7f1cc00caf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45118/0 (socket says 172.21.15.84:45118) 2023-09-13T08:25:41.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.679+0000 7f1cc6a49700 1 -- 172.21.15.84:0/3163912261 learned_addr learned my addr 172.21.15.84:0/3163912261 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:41.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.679+0000 7f1cc5a47700 1 --2- 172.21.15.84:0/3163912261 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1cc00cf910 0x7f1cc00caa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:41.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.679+0000 7f1cc6248700 1 --2- 172.21.15.84:0/3163912261 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1cc00ca640 0x7f1cc01473b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:41.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.679+0000 7f1cc6a49700 1 -- 172.21.15.84:0/3163912261 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1cc00cf910 msgr2=0x7f1cc00caa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:41.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.679+0000 7f1cc6a49700 1 --2- 172.21.15.84:0/3163912261 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1cc00cf910 0x7f1cc00caa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:41.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.679+0000 7f1cc6a49700 1 -- 172.21.15.84:0/3163912261 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1cc00ca640 msgr2=0x7f1cc01473b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:41.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.679+0000 7f1cc6a49700 1 --2- 172.21.15.84:0/3163912261 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1cc00ca640 0x7f1cc01473b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:41.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.679+0000 7f1cc6a49700 1 -- 172.21.15.84:0/3163912261 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cb0009550 con 0x7f1cc015a170 2023-09-13T08:25:41.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.679+0000 7f1cc6a49700 1 --2- 172.21.15.84:0/3163912261 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1cc015a170 0x7f1cc00caf60 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f1cb8007e60 tx=0x7f1cb800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:41.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.680+0000 7f1cb6ffd700 1 -- 172.21.15.84:0/3163912261 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb800ed30 con 0x7f1cc015a170 2023-09-13T08:25:41.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.680+0000 7f1cb6ffd700 1 -- 172.21.15.84:0/3163912261 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cb8014420 con 0x7f1cc015a170 2023-09-13T08:25:41.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.680+0000 7f1cb6ffd700 1 -- 172.21.15.84:0/3163912261 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb80147d0 con 0x7f1cc015a170 2023-09-13T08:25:41.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.680+0000 7f1cc84ac700 1 -- 172.21.15.84:0/3163912261 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cc00c8fc0 con 0x7f1cc015a170 2023-09-13T08:25:41.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.680+0000 7f1cc84ac700 1 -- 172.21.15.84:0/3163912261 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cc00c94e0 con 0x7f1cc015a170 2023-09-13T08:25:41.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.681+0000 7f1cc84ac700 1 -- 172.21.15.84:0/3163912261 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cc00c91b0 con 0x7f1cc015a170 2023-09-13T08:25:41.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.681+0000 7f1cb6ffd700 1 -- 172.21.15.84:0/3163912261 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f1cb8014930 con 0x7f1cc015a170 2023-09-13T08:25:41.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.681+0000 7f1cb6ffd700 1 --2- 172.21.15.84:0/3163912261 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f1ca406a580 0x7f1ca406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:41.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.682+0000 7f1cc6248700 1 --2- 172.21.15.84:0/3163912261 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f1ca406a580 0x7f1ca406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:41.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.682+0000 7f1cb6ffd700 1 -- 172.21.15.84:0/3163912261 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f1cb8089450 con 0x7f1cc015a170 2023-09-13T08:25:41.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.682+0000 7f1cc6248700 1 --2- 172.21.15.84:0/3163912261 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f1ca406a580 0x7f1ca406ca40 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc007fd0 tx=0x7f1cbc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:41.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.686+0000 7f1cb6ffd700 1 -- 172.21.15.84:0/3163912261 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f1cb80546a0 con 0x7f1cc015a170 2023-09-13T08:25:41.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.876+0000 7f1cc84ac700 1 -- 172.21.15.84:0/3163912261 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1cc004f200 con 0x7f1cc015a170 2023-09-13T08:25:41.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.876+0000 7f1cb6ffd700 1 -- 172.21.15.84:0/3163912261 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1cb8057cc0 con 0x7f1cc015a170 2023-09-13T08:25:41.877 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-09-13T08:25:41.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.878+0000 7f1cc84ac700 1 -- 172.21.15.84:0/3163912261 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f1ca406a580 msgr2=0x7f1ca406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:41.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.878+0000 7f1cc84ac700 1 --2- 172.21.15.84:0/3163912261 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f1ca406a580 0x7f1ca406ca40 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc007fd0 tx=0x7f1cbc009040 comp rx=0 tx=0).stop 2023-09-13T08:25:41.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.878+0000 7f1cc84ac700 1 -- 172.21.15.84:0/3163912261 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1cc015a170 msgr2=0x7f1cc00caf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:41.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.878+0000 7f1cc84ac700 1 --2- 172.21.15.84:0/3163912261 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1cc015a170 0x7f1cc00caf60 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f1cb8007e60 tx=0x7f1cb800e3c0 comp rx=0 tx=0).stop 2023-09-13T08:25:41.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.878+0000 7f1cc84ac700 1 -- 172.21.15.84:0/3163912261 shutdown_connections 2023-09-13T08:25:41.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.878+0000 7f1cc84ac700 1 --2- 172.21.15.84:0/3163912261 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1cc015a170 0x7f1cc00caf60 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:41.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.878+0000 7f1cc84ac700 1 --2- 172.21.15.84:0/3163912261 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f1ca406a580 0x7f1ca406ca40 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:41.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.878+0000 7f1cc84ac700 1 --2- 172.21.15.84:0/3163912261 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1cc00ca640 0x7f1cc01473b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:41.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.878+0000 7f1cc84ac700 1 --2- 172.21.15.84:0/3163912261 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1cc00cf910 0x7f1cc00caa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:41.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.878+0000 7f1cc84ac700 1 -- 172.21.15.84:0/3163912261 >> 172.21.15.84:0/3163912261 conn(0x7f1cc00cca70 msgr2=0x7f1cc01578d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:41.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.878+0000 7f1cc84ac700 1 -- 172.21.15.84:0/3163912261 shutdown_connections 2023-09-13T08:25:41.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:41.878+0000 7f1cc84ac700 1 -- 172.21.15.84:0/3163912261 wait complete. 2023-09-13T08:25:41.890 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-13T08:25:42.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.013+0000 7f0078ea9700 1 Processor -- start 2023-09-13T08:25:42.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.013+0000 7f0078ea9700 1 -- start start 2023-09-13T08:25:42.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.014+0000 7f0078ea9700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f00740ced40 0x7f00740cda40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:42.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.014+0000 7f0078ea9700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00740cd170 con 0x7f00740cdf80 2023-09-13T08:25:42.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.014+0000 7f0078ea9700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00740cc8d0 con 0x7f007415ea00 2023-09-13T08:25:42.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.014+0000 7f0078ea9700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00740ce410 con 0x7f00740ced40 2023-09-13T08:25:42.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.014+0000 7f0072d9d700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f00740cdf80 0x7f007415f0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:47772/0 (socket says 172.21.15.84:47772) 2023-09-13T08:25:42.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.014+0000 7f0072d9d700 1 -- 172.21.15.84:0/3205936666 learned_addr learned my addr 172.21.15.84:0/3205936666 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:25:42.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.015+0000 7f007159a700 1 -- 172.21.15.84:0/3205936666 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1423583063 0 0) 0x7f00740cd170 con 0x7f00740cdf80 2023-09-13T08:25:42.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.015+0000 7f007159a700 1 -- 172.21.15.84:0/3205936666 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f005c0035b0 con 0x7f00740cdf80 2023-09-13T08:25:42.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.015+0000 7f0071d9b700 1 --2- 172.21.15.84:0/3205936666 >> v2:172.21.15.161:3300/0 conn(0x7f00740ced40 0x7f00740cda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:42.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.015+0000 7f007159a700 1 -- 172.21.15.84:0/3205936666 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 257959235 0 0) 0x7f005c0035b0 con 0x7f00740cdf80 2023-09-13T08:25:42.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.015+0000 7f007159a700 1 -- 172.21.15.84:0/3205936666 >> v2:172.21.15.161:3300/0 conn(0x7f00740ced40 msgr2=0x7f00740cda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:42.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.015+0000 7f007159a700 1 --2- 172.21.15.84:0/3205936666 >> v2:172.21.15.161:3300/0 conn(0x7f00740ced40 0x7f00740cda40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:42.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.015+0000 7f007159a700 1 -- 172.21.15.84:0/3205936666 >> v1:172.21.15.161:6789/0 conn(0x7f007415ea00 legacy=0x7f00740cbd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:42.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.015+0000 7f007159a700 1 -- 172.21.15.84:0/3205936666 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00740ccbb0 con 0x7f00740cdf80 2023-09-13T08:25:42.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.015+0000 7f007159a700 1 -- 172.21.15.84:0/3205936666 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2302733408 0 0) 0x7f006c0019f0 con 0x7f00740cdf80 2023-09-13T08:25:42.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.015+0000 7f007159a700 1 -- 172.21.15.84:0/3205936666 >> v1:172.21.15.84:6789/0 conn(0x7f00740cdf80 legacy=0x7f007415f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:42.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.015+0000 7f007159a700 1 --2- 172.21.15.84:0/3205936666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f005c003a50 0x7f005c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:42.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.015+0000 7f007159a700 1 --2- 172.21.15.84:0/3205936666 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f005c004850 0x7f005c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:42.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.015+0000 7f007159a700 1 --2- 172.21.15.84:0/3205936666 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f005c005260 0x7f005c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:42.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.015+0000 7f007159a700 1 -- 172.21.15.84:0/3205936666 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00740ce410 con 0x7f005c003a50 2023-09-13T08:25:42.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.015+0000 7f007159a700 1 -- 172.21.15.84:0/3205936666 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f005c00c1b0 con 0x7f005c004850 2023-09-13T08:25:42.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.015+0000 7f007159a700 1 -- 172.21.15.84:0/3205936666 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f005c00c370 con 0x7f005c005260 2023-09-13T08:25:42.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.015+0000 7f007259c700 1 --2- 172.21.15.84:0/3205936666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f005c003a50 0x7f005c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:42.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.015+0000 7f0071d9b700 1 --2- 172.21.15.84:0/3205936666 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f005c004850 0x7f005c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:42.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.015+0000 7f0072d9d700 1 --2- 172.21.15.84:0/3205936666 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f005c005260 0x7f005c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:42.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.015+0000 7f007259c700 1 -- 172.21.15.84:0/3205936666 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f005c005260 msgr2=0x7f005c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:42.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.016+0000 7f007259c700 1 --2- 172.21.15.84:0/3205936666 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f005c005260 0x7f005c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:42.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.016+0000 7f007259c700 1 -- 172.21.15.84:0/3205936666 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f005c004850 msgr2=0x7f005c004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:42.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.016+0000 7f007259c700 1 --2- 172.21.15.84:0/3205936666 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f005c004850 0x7f005c004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:42.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.016+0000 7f007259c700 1 -- 172.21.15.84:0/3205936666 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f005c0035b0 con 0x7f005c003a50 2023-09-13T08:25:42.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.016+0000 7f0071d9b700 1 --2- 172.21.15.84:0/3205936666 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f005c004850 0x7f005c004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T08:25:42.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.016+0000 7f0072d9d700 1 --2- 172.21.15.84:0/3205936666 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f005c005260 0x7f005c00ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T08:25:42.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.016+0000 7f0072d9d700 1 -- 172.21.15.84:0/3205936666 reap_dead start 2023-09-13T08:25:42.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.016+0000 7f007259c700 1 --2- 172.21.15.84:0/3205936666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f005c003a50 0x7f005c003e70 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f00680017f0 tx=0x7f005c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7f291edcccdc2ac server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:42.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.016+0000 7f007159a700 1 -- 172.21.15.84:0/3205936666 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00680012e0 con 0x7f005c003a50 2023-09-13T08:25:42.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.016+0000 7f007159a700 1 -- 172.21.15.84:0/3205936666 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00680052f0 con 0x7f005c003a50 2023-09-13T08:25:42.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.016+0000 7f007159a700 1 -- 172.21.15.84:0/3205936666 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00680036d0 con 0x7f005c003a50 2023-09-13T08:25:42.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.016+0000 7f0078ea9700 1 -- 172.21.15.84:0/3205936666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f005c003a50 msgr2=0x7f005c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:42.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.016+0000 7f0078ea9700 1 --2- 172.21.15.84:0/3205936666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f005c003a50 0x7f005c003e70 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f00680017f0 tx=0x7f005c005880 comp rx=0 tx=0).stop 2023-09-13T08:25:42.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.016+0000 7f0078ea9700 1 -- 172.21.15.84:0/3205936666 shutdown_connections 2023-09-13T08:25:42.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.016+0000 7f0078ea9700 1 --2- 172.21.15.84:0/3205936666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f005c003a50 0x7f005c003e70 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:42.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.016+0000 7f0078ea9700 1 -- 172.21.15.84:0/3205936666 >> 172.21.15.84:0/3205936666 conn(0x7f007409a470 msgr2=0x7f00740d1170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:42.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.016+0000 7f0078ea9700 1 -- 172.21.15.84:0/3205936666 shutdown_connections 2023-09-13T08:25:42.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.016+0000 7f0078ea9700 1 -- 172.21.15.84:0/3205936666 wait complete. 2023-09-13T08:25:42.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.018+0000 7f0078ea9700 1 Processor -- start 2023-09-13T08:25:42.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.018+0000 7f0078ea9700 1 -- start start 2023-09-13T08:25:42.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.019+0000 7f0078ea9700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f005c003a50 0x7f00740b3df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:42.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.019+0000 7f0078ea9700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f007414a7d0 0x7f00740b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:42.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.019+0000 7f0078ea9700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f007415f050 0x7f007415f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:42.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.019+0000 7f0078ea9700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f007415fa10 con 0x7f005c003a50 2023-09-13T08:25:42.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.019+0000 7f0078ea9700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0074148280 con 0x7f007415f050 2023-09-13T08:25:42.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.019+0000 7f0078ea9700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0074148840 con 0x7f007414a7d0 2023-09-13T08:25:42.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.019+0000 7f007259c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f005c003a50 0x7f00740b3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:42.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.019+0000 7f007259c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f005c003a50 0x7f00740b3df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45134/0 (socket says 172.21.15.84:45134) 2023-09-13T08:25:42.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.019+0000 7f007259c700 1 -- 172.21.15.84:0/1871158599 learned_addr learned my addr 172.21.15.84:0/1871158599 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:42.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.019+0000 7f0072d9d700 1 --2- 172.21.15.84:0/1871158599 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f007415f050 0x7f007415f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:42.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.019+0000 7f0071d9b700 1 --2- 172.21.15.84:0/1871158599 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f007414a7d0 0x7f00740b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:42.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.019+0000 7f007259c700 1 -- 172.21.15.84:0/1871158599 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f007414a7d0 msgr2=0x7f00740b6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:42.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.019+0000 7f007259c700 1 --2- 172.21.15.84:0/1871158599 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f007414a7d0 0x7f00740b6160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:42.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.019+0000 7f007259c700 1 -- 172.21.15.84:0/1871158599 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f007415f050 msgr2=0x7f007415f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:42.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.019+0000 7f007259c700 1 --2- 172.21.15.84:0/1871158599 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f007415f050 0x7f007415f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:42.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.019+0000 7f007259c700 1 -- 172.21.15.84:0/1871158599 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f007414ac50 con 0x7f005c003a50 2023-09-13T08:25:42.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.019+0000 7f007259c700 1 --2- 172.21.15.84:0/1871158599 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f005c003a50 0x7f00740b3df0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f0068000c00 tx=0x7f0068001170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:42.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.019+0000 7f0062ffd700 1 -- 172.21.15.84:0/1871158599 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0068006d40 con 0x7f005c003a50 2023-09-13T08:25:42.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.019+0000 7f0062ffd700 1 -- 172.21.15.84:0/1871158599 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0068007040 con 0x7f005c003a50 2023-09-13T08:25:42.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.019+0000 7f0078ea9700 1 -- 172.21.15.84:0/1871158599 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00740b69b0 con 0x7f005c003a50 2023-09-13T08:25:42.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.019+0000 7f0062ffd700 1 -- 172.21.15.84:0/1871158599 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0068006ea0 con 0x7f005c003a50 2023-09-13T08:25:42.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.019+0000 7f0078ea9700 1 -- 172.21.15.84:0/1871158599 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00741484d0 con 0x7f005c003a50 2023-09-13T08:25:42.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.020+0000 7f0078ea9700 1 -- 172.21.15.84:0/1871158599 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0074148b20 con 0x7f005c003a50 2023-09-13T08:25:42.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.021+0000 7f0062ffd700 1 -- 172.21.15.84:0/1871158599 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f00680073d0 con 0x7f005c003a50 2023-09-13T08:25:42.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.021+0000 7f0062ffd700 1 --2- 172.21.15.84:0/1871158599 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f005406a580 0x7f005406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:42.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.021+0000 7f0062ffd700 1 -- 172.21.15.84:0/1871158599 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f0068089940 con 0x7f005c003a50 2023-09-13T08:25:42.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.021+0000 7f0071d9b700 1 --2- 172.21.15.84:0/1871158599 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f005406a580 0x7f005406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:42.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.021+0000 7f0071d9b700 1 --2- 172.21.15.84:0/1871158599 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f005406a580 0x7f005406ca40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f00740cfda0 tx=0x7f0064008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:42.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.026+0000 7f0062ffd700 1 -- 172.21.15.84:0/1871158599 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f0068054c20 con 0x7f005c003a50 2023-09-13T08:25:42.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.211+0000 7f0078ea9700 1 -- 172.21.15.84:0/1871158599 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0074148660 con 0x7f005c003a50 2023-09-13T08:25:42.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.211+0000 7f0062ffd700 1 -- 172.21.15.84:0/1871158599 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f00680036d0 con 0x7f005c003a50 2023-09-13T08:25:42.212 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-09-13T08:25:42.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.213+0000 7f0078ea9700 1 -- 172.21.15.84:0/1871158599 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f005406a580 msgr2=0x7f005406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:42.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.213+0000 7f0078ea9700 1 --2- 172.21.15.84:0/1871158599 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f005406a580 0x7f005406ca40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f00740cfda0 tx=0x7f0064008040 comp rx=0 tx=0).stop 2023-09-13T08:25:42.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.213+0000 7f0078ea9700 1 -- 172.21.15.84:0/1871158599 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f005c003a50 msgr2=0x7f00740b3df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:42.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.213+0000 7f0078ea9700 1 --2- 172.21.15.84:0/1871158599 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f005c003a50 0x7f00740b3df0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f0068000c00 tx=0x7f0068001170 comp rx=0 tx=0).stop 2023-09-13T08:25:42.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.213+0000 7f0078ea9700 1 -- 172.21.15.84:0/1871158599 shutdown_connections 2023-09-13T08:25:42.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.213+0000 7f0078ea9700 1 --2- 172.21.15.84:0/1871158599 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f005406a580 0x7f005406ca40 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:42.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.213+0000 7f0078ea9700 1 --2- 172.21.15.84:0/1871158599 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f007415f050 0x7f007415f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:42.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.213+0000 7f0078ea9700 1 --2- 172.21.15.84:0/1871158599 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f005c003a50 0x7f00740b3df0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:42.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.213+0000 7f0078ea9700 1 --2- 172.21.15.84:0/1871158599 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f007414a7d0 0x7f00740b6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:42.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.213+0000 7f0078ea9700 1 -- 172.21.15.84:0/1871158599 >> 172.21.15.84:0/1871158599 conn(0x7f007409a470 msgr2=0x7f007406e9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:42.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.214+0000 7f0078ea9700 1 -- 172.21.15.84:0/1871158599 shutdown_connections 2023-09-13T08:25:42.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.214+0000 7f0078ea9700 1 -- 172.21.15.84:0/1871158599 wait complete. 2023-09-13T08:25:42.226 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-13T08:25:42.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.349+0000 7f3dd81e6700 1 Processor -- start 2023-09-13T08:25:42.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.349+0000 7f3dd81e6700 1 -- start start 2023-09-13T08:25:42.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.350+0000 7f3dd81e6700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3dd00ca8e0 0x7f3dd00cf570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:42.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.350+0000 7f3dd81e6700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dd015e480 con 0x7f3dd00cd590 2023-09-13T08:25:42.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.350+0000 7f3dd81e6700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dd00cfbe0 con 0x7f3dd015e910 2023-09-13T08:25:42.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.350+0000 7f3dd81e6700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dd015de30 con 0x7f3dd00ca8e0 2023-09-13T08:25:42.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.350+0000 7f3dd5f82700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3dd00ca8e0 0x7f3dd00cf570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:42.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.350+0000 7f3dd5f82700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3dd00ca8e0 0x7f3dd00cf570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45142/0 (socket says 172.21.15.84:45142) 2023-09-13T08:25:42.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.350+0000 7f3dd5f82700 1 -- 172.21.15.84:0/1577604177 learned_addr learned my addr 172.21.15.84:0/1577604177 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:42.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.350+0000 7f3dd5f82700 1 -- 172.21.15.84:0/1577604177 >> v1:172.21.15.161:6789/0 conn(0x7f3dd015e910 legacy=0x7f3dd00cacc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:42.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.350+0000 7f3dd5f82700 1 -- 172.21.15.84:0/1577604177 >> v1:172.21.15.84:6789/0 conn(0x7f3dd00cd590 legacy=0x7f3dd00cdbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:42.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.350+0000 7f3dd5f82700 1 -- 172.21.15.84:0/1577604177 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dd015e110 con 0x7f3dd00ca8e0 2023-09-13T08:25:42.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.350+0000 7f3dd5f82700 1 --2- 172.21.15.84:0/1577604177 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3dd00ca8e0 0x7f3dd00cf570 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc0098f0 tx=0x7f3dcc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ee78bddcb825fb5 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:42.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.350+0000 7f3dd4f80700 1 -- 172.21.15.84:0/1577604177 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dcc004230 con 0x7f3dd00ca8e0 2023-09-13T08:25:42.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.351+0000 7f3dd4f80700 1 -- 172.21.15.84:0/1577604177 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dcc004390 con 0x7f3dd00ca8e0 2023-09-13T08:25:42.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.351+0000 7f3dd4f80700 1 -- 172.21.15.84:0/1577604177 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dcc0036a0 con 0x7f3dd00ca8e0 2023-09-13T08:25:42.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.351+0000 7f3dd81e6700 1 -- 172.21.15.84:0/1577604177 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3dd00ca8e0 msgr2=0x7f3dd00cf570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:42.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.351+0000 7f3dd81e6700 1 --2- 172.21.15.84:0/1577604177 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3dd00ca8e0 0x7f3dd00cf570 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc0098f0 tx=0x7f3dcc009c00 comp rx=0 tx=0).stop 2023-09-13T08:25:42.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.351+0000 7f3dd81e6700 1 -- 172.21.15.84:0/1577604177 shutdown_connections 2023-09-13T08:25:42.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.351+0000 7f3dd81e6700 1 --2- 172.21.15.84:0/1577604177 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3dd00ca8e0 0x7f3dd00cf570 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:42.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.351+0000 7f3dd81e6700 1 -- 172.21.15.84:0/1577604177 >> 172.21.15.84:0/1577604177 conn(0x7f3dd00cca70 msgr2=0x7f3dd00cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:42.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.351+0000 7f3dd81e6700 1 -- 172.21.15.84:0/1577604177 shutdown_connections 2023-09-13T08:25:42.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.351+0000 7f3dd81e6700 1 -- 172.21.15.84:0/1577604177 wait complete. 2023-09-13T08:25:42.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.352+0000 7f3dd81e6700 1 Processor -- start 2023-09-13T08:25:42.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.352+0000 7f3dd81e6700 1 -- start start 2023-09-13T08:25:42.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.353+0000 7f3dd81e6700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3dd00ca8e0 0x7f3dd01492f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:42.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.353+0000 7f3dd81e6700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3dd00cd590 0x7f3dd00c72a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:42.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.353+0000 7f3dd81e6700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3dd015e910 0x7f3dd00b5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:42.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.353+0000 7f3dd81e6700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd00ac8e0 con 0x7f3dd00ca8e0 2023-09-13T08:25:42.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.353+0000 7f3dd81e6700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd00acbc0 con 0x7f3dd00cd590 2023-09-13T08:25:42.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.353+0000 7f3dd81e6700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd00acea0 con 0x7f3dd015e910 2023-09-13T08:25:42.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.353+0000 7f3dd5f82700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3dd00ca8e0 0x7f3dd01492f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:42.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.353+0000 7f3dd5f82700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3dd00ca8e0 0x7f3dd01492f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45148/0 (socket says 172.21.15.84:45148) 2023-09-13T08:25:42.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.353+0000 7f3dd5f82700 1 -- 172.21.15.84:0/3387487097 learned_addr learned my addr 172.21.15.84:0/3387487097 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:42.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.353+0000 7f3dd5781700 1 --2- 172.21.15.84:0/3387487097 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3dd00cd590 0x7f3dd00c72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:42.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.353+0000 7f3dd6783700 1 --2- 172.21.15.84:0/3387487097 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3dd015e910 0x7f3dd00b5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:42.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.353+0000 7f3dd5f82700 1 -- 172.21.15.84:0/3387487097 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3dd015e910 msgr2=0x7f3dd00b5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:42.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.353+0000 7f3dd5f82700 1 --2- 172.21.15.84:0/3387487097 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3dd015e910 0x7f3dd00b5250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:42.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.353+0000 7f3dd5f82700 1 -- 172.21.15.84:0/3387487097 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3dd00cd590 msgr2=0x7f3dd00c72a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:42.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.353+0000 7f3dd5f82700 1 --2- 172.21.15.84:0/3387487097 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3dd00cd590 0x7f3dd00c72a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:42.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.353+0000 7f3dd5f82700 1 -- 172.21.15.84:0/3387487097 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dcc009550 con 0x7f3dd00ca8e0 2023-09-13T08:25:42.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.353+0000 7f3dd6783700 1 --2- 172.21.15.84:0/3387487097 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3dd015e910 0x7f3dd00b5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T08:25:42.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.353+0000 7f3dd5781700 1 --2- 172.21.15.84:0/3387487097 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3dd00cd590 0x7f3dd00c72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T08:25:42.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.354+0000 7f3dd5f82700 1 --2- 172.21.15.84:0/3387487097 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3dd00ca8e0 0x7f3dd01492f0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f3dd00678f0 tx=0x7f3dcc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:42.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.354+0000 7f3dc67fc700 1 -- 172.21.15.84:0/3387487097 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dcc003dc0 con 0x7f3dd00ca8e0 2023-09-13T08:25:42.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.354+0000 7f3dc67fc700 1 -- 172.21.15.84:0/3387487097 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dcc01f070 con 0x7f3dd00ca8e0 2023-09-13T08:25:42.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.354+0000 7f3dd81e6700 1 -- 172.21.15.84:0/3387487097 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dd00ad180 con 0x7f3dd00ca8e0 2023-09-13T08:25:42.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.354+0000 7f3dc67fc700 1 -- 172.21.15.84:0/3387487097 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dcc00b8a0 con 0x7f3dd00ca8e0 2023-09-13T08:25:42.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.354+0000 7f3dd81e6700 1 -- 172.21.15.84:0/3387487097 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dd00ad740 con 0x7f3dd00ca8e0 2023-09-13T08:25:42.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.355+0000 7f3dd81e6700 1 -- 172.21.15.84:0/3387487097 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dd00666b0 con 0x7f3dd00ca8e0 2023-09-13T08:25:42.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.355+0000 7f3dc67fc700 1 -- 172.21.15.84:0/3387487097 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f3dcc021030 con 0x7f3dd00ca8e0 2023-09-13T08:25:42.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.355+0000 7f3dc67fc700 1 --2- 172.21.15.84:0/3387487097 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f3db406a5b0 0x7f3db406ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:42.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.356+0000 7f3dc67fc700 1 -- 172.21.15.84:0/3387487097 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f3dcc08a4c0 con 0x7f3dd00ca8e0 2023-09-13T08:25:42.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.356+0000 7f3dd5781700 1 --2- 172.21.15.84:0/3387487097 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f3db406a5b0 0x7f3db406ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:42.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.356+0000 7f3dd5781700 1 --2- 172.21.15.84:0/3387487097 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f3db406a5b0 0x7f3db406ca70 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3dd00c9fa0 tx=0x7f3dc0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:42.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.360+0000 7f3dc67fc700 1 -- 172.21.15.84:0/3387487097 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f3dcc0556f0 con 0x7f3dd00ca8e0 2023-09-13T08:25:42.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.550+0000 7f3dd81e6700 1 -- 172.21.15.84:0/3387487097 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3dd00666b0 con 0x7f3dd00ca8e0 2023-09-13T08:25:42.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.551+0000 7f3dc67fc700 1 -- 172.21.15.84:0/3387487097 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3dcc058d10 con 0x7f3dd00ca8e0 2023-09-13T08:25:42.551 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-09-13T08:25:42.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.553+0000 7f3dd81e6700 1 -- 172.21.15.84:0/3387487097 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f3db406a5b0 msgr2=0x7f3db406ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:42.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.553+0000 7f3dd81e6700 1 --2- 172.21.15.84:0/3387487097 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f3db406a5b0 0x7f3db406ca70 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3dd00c9fa0 tx=0x7f3dc0008040 comp rx=0 tx=0).stop 2023-09-13T08:25:42.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.553+0000 7f3dd81e6700 1 -- 172.21.15.84:0/3387487097 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3dd00ca8e0 msgr2=0x7f3dd01492f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:42.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.553+0000 7f3dd81e6700 1 --2- 172.21.15.84:0/3387487097 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3dd00ca8e0 0x7f3dd01492f0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f3dd00678f0 tx=0x7f3dcc004750 comp rx=0 tx=0).stop 2023-09-13T08:25:42.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.553+0000 7f3dd81e6700 1 -- 172.21.15.84:0/3387487097 shutdown_connections 2023-09-13T08:25:42.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.553+0000 7f3dd81e6700 1 --2- 172.21.15.84:0/3387487097 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3dd015e910 0x7f3dd00b5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:42.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.553+0000 7f3dd81e6700 1 --2- 172.21.15.84:0/3387487097 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3dd00ca8e0 0x7f3dd01492f0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:42.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.553+0000 7f3dd81e6700 1 --2- 172.21.15.84:0/3387487097 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f3db406a5b0 0x7f3db406ca70 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:42.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.553+0000 7f3dd81e6700 1 --2- 172.21.15.84:0/3387487097 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3dd00cd590 0x7f3dd00c72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:42.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.553+0000 7f3dd81e6700 1 -- 172.21.15.84:0/3387487097 >> 172.21.15.84:0/3387487097 conn(0x7f3dd00cca70 msgr2=0x7f3dd00ced90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:42.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.553+0000 7f3dd81e6700 1 -- 172.21.15.84:0/3387487097 shutdown_connections 2023-09-13T08:25:42.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.553+0000 7f3dd81e6700 1 -- 172.21.15.84:0/3387487097 wait complete. 2023-09-13T08:25:42.565 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-09-13T08:25:42.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.689+0000 7fc10ce56700 1 Processor -- start 2023-09-13T08:25:42.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.689+0000 7fc10ce56700 1 -- start start 2023-09-13T08:25:42.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.690+0000 7fc10ce56700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc1080ca8e0 0x7fc1080cf570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:42.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.690+0000 7fc10ce56700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc10815e910 0x7fc1080cacc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:42.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.690+0000 7fc10ce56700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc10815e480 con 0x7fc1080cd590 2023-09-13T08:25:42.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.690+0000 7fc10ce56700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1080cb200 con 0x7fc1080ca8e0 2023-09-13T08:25:42.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.690+0000 7fc10ce56700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1080cfbe0 con 0x7fc10815e910 2023-09-13T08:25:42.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.690+0000 7fc10659c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc1080ca8e0 0x7fc1080cf570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:42.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.690+0000 7fc10659c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc1080ca8e0 0x7fc1080cf570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45156/0 (socket says 172.21.15.84:45156) 2023-09-13T08:25:42.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.690+0000 7fc10659c700 1 -- 172.21.15.84:0/328969667 learned_addr learned my addr 172.21.15.84:0/328969667 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:42.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.690+0000 7fc105d9b700 1 --2- 172.21.15.84:0/328969667 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc10815e910 0x7fc1080cacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:42.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.690+0000 7fc10659c700 1 -- 172.21.15.84:0/328969667 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc10815e910 msgr2=0x7fc1080cacc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:42.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.690+0000 7fc10659c700 1 --2- 172.21.15.84:0/328969667 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc10815e910 0x7fc1080cacc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:42.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.690+0000 7fc10659c700 1 -- 172.21.15.84:0/328969667 >> v1:172.21.15.161:6789/0 conn(0x7fc1080cd590 legacy=0x7fc108161150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:42.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.690+0000 7fc10659c700 1 -- 172.21.15.84:0/328969667 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc10815de30 con 0x7fc1080ca8e0 2023-09-13T08:25:42.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.691+0000 7fc10659c700 1 --2- 172.21.15.84:0/328969667 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1080ca8e0 0x7fc1080cf570 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc0098f0 tx=0x7fc0fc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=320880e8d07048d server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:42.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.691+0000 7fc10559a700 1 -- 172.21.15.84:0/328969667 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0fc004230 con 0x7fc1080ca8e0 2023-09-13T08:25:42.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.691+0000 7fc10559a700 1 -- 172.21.15.84:0/328969667 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0fc004390 con 0x7fc1080ca8e0 2023-09-13T08:25:42.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.691+0000 7fc10559a700 1 -- 172.21.15.84:0/328969667 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0fc0036a0 con 0x7fc1080ca8e0 2023-09-13T08:25:42.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.691+0000 7fc10ce56700 1 -- 172.21.15.84:0/328969667 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1080ca8e0 msgr2=0x7fc1080cf570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:42.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.691+0000 7fc10ce56700 1 --2- 172.21.15.84:0/328969667 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1080ca8e0 0x7fc1080cf570 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc0098f0 tx=0x7fc0fc009c00 comp rx=0 tx=0).stop 2023-09-13T08:25:42.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.691+0000 7fc10ce56700 1 -- 172.21.15.84:0/328969667 shutdown_connections 2023-09-13T08:25:42.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.691+0000 7fc10ce56700 1 --2- 172.21.15.84:0/328969667 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1080ca8e0 0x7fc1080cf570 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:42.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.691+0000 7fc10ce56700 1 --2- 172.21.15.84:0/328969667 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc10815e910 0x7fc1080cacc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:42.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.691+0000 7fc10ce56700 1 -- 172.21.15.84:0/328969667 >> 172.21.15.84:0/328969667 conn(0x7fc1080cca70 msgr2=0x7fc1080cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:42.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.691+0000 7fc10ce56700 1 -- 172.21.15.84:0/328969667 shutdown_connections 2023-09-13T08:25:42.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.691+0000 7fc10ce56700 1 -- 172.21.15.84:0/328969667 wait complete. 2023-09-13T08:25:42.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.693+0000 7fc10ce56700 1 Processor -- start 2023-09-13T08:25:42.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.693+0000 7fc10ce56700 1 -- start start 2023-09-13T08:25:42.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.693+0000 7fc10ce56700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc1080ca8e0 0x7fc1080b2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:42.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.693+0000 7fc10ce56700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1080cd590 0x7fc1081565f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:42.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.693+0000 7fc10ce56700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc10815e910 0x7fc10815b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:42.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.693+0000 7fc10ce56700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1080b3110 con 0x7fc1080cd590 2023-09-13T08:25:42.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.693+0000 7fc10ce56700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1081f6a60 con 0x7fc10815e910 2023-09-13T08:25:42.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.693+0000 7fc10ce56700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1081f6d40 con 0x7fc1080ca8e0 2023-09-13T08:25:42.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.693+0000 7fc105d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1080cd590 0x7fc1081565f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:42.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.693+0000 7fc105d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1080cd590 0x7fc1081565f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45162/0 (socket says 172.21.15.84:45162) 2023-09-13T08:25:42.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.693+0000 7fc105d9b700 1 -- 172.21.15.84:0/1010009814 learned_addr learned my addr 172.21.15.84:0/1010009814 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:42.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.694+0000 7fc105d9b700 1 -- 172.21.15.84:0/1010009814 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc1080ca8e0 msgr2=0x7fc1080b2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:42.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.694+0000 7fc10659c700 1 --2- 172.21.15.84:0/1010009814 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc1080ca8e0 0x7fc1080b2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:42.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.694+0000 7fc106d9d700 1 --2- 172.21.15.84:0/1010009814 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc10815e910 0x7fc10815b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:42.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.694+0000 7fc105d9b700 1 --2- 172.21.15.84:0/1010009814 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc1080ca8e0 0x7fc1080b2bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:42.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.694+0000 7fc105d9b700 1 -- 172.21.15.84:0/1010009814 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc10815e910 msgr2=0x7fc10815b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:42.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.694+0000 7fc105d9b700 1 --2- 172.21.15.84:0/1010009814 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc10815e910 0x7fc10815b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:42.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.694+0000 7fc105d9b700 1 -- 172.21.15.84:0/1010009814 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0fc009550 con 0x7fc1080cd590 2023-09-13T08:25:42.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.694+0000 7fc10659c700 1 --2- 172.21.15.84:0/1010009814 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc1080ca8e0 0x7fc1080b2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T08:25:42.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.694+0000 7fc106d9d700 1 --2- 172.21.15.84:0/1010009814 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc10815e910 0x7fc10815b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T08:25:42.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.694+0000 7fc105d9b700 1 --2- 172.21.15.84:0/1010009814 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1080cd590 0x7fc1081565f0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fc0f800d800 tx=0x7fc0f800dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:42.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.694+0000 7fc0f6ffd700 1 -- 172.21.15.84:0/1010009814 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f80125f0 con 0x7fc1080cd590 2023-09-13T08:25:42.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.694+0000 7fc0f6ffd700 1 -- 172.21.15.84:0/1010009814 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0f8012750 con 0x7fc1080cd590 2023-09-13T08:25:42.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.694+0000 7fc10ce56700 1 -- 172.21.15.84:0/1010009814 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1081f7020 con 0x7fc1080cd590 2023-09-13T08:25:42.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.694+0000 7fc0f6ffd700 1 -- 172.21.15.84:0/1010009814 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f8012b00 con 0x7fc1080cd590 2023-09-13T08:25:42.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.694+0000 7fc10ce56700 1 -- 172.21.15.84:0/1010009814 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1080b3520 con 0x7fc1080cd590 2023-09-13T08:25:42.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.695+0000 7fc10ce56700 1 -- 172.21.15.84:0/1010009814 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc10804f200 con 0x7fc1080cd590 2023-09-13T08:25:42.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.695+0000 7fc0f6ffd700 1 -- 172.21.15.84:0/1010009814 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fc0f8012c60 con 0x7fc1080cd590 2023-09-13T08:25:42.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.696+0000 7fc0f6ffd700 1 --2- 172.21.15.84:0/1010009814 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fc0e806a580 0x7fc0e806ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:42.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.696+0000 7fc0f6ffd700 1 -- 172.21.15.84:0/1010009814 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fc0f8088ef0 con 0x7fc1080cd590 2023-09-13T08:25:42.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.696+0000 7fc10659c700 1 --2- 172.21.15.84:0/1010009814 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fc0e806a580 0x7fc0e806ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:42.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.696+0000 7fc10659c700 1 --2- 172.21.15.84:0/1010009814 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fc0e806a580 0x7fc0e806ca40 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc009c40 tx=0x7fc0fc008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:42.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.700+0000 7fc0f6ffd700 1 -- 172.21.15.84:0/1010009814 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fc0f8054120 con 0x7fc1080cd590 2023-09-13T08:25:42.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.892+0000 7fc10ce56700 1 -- 172.21.15.84:0/1010009814 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fc10806d7a0 con 0x7fc1080cd590 2023-09-13T08:25:42.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.893+0000 7fc0f6ffd700 1 -- 172.21.15.84:0/1010009814 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fc0f8057740 con 0x7fc1080cd590 2023-09-13T08:25:42.894 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-09-13T08:25:42.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.895+0000 7fc10ce56700 1 -- 172.21.15.84:0/1010009814 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fc0e806a580 msgr2=0x7fc0e806ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:42.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.895+0000 7fc10ce56700 1 --2- 172.21.15.84:0/1010009814 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fc0e806a580 0x7fc0e806ca40 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc009c40 tx=0x7fc0fc008030 comp rx=0 tx=0).stop 2023-09-13T08:25:42.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.895+0000 7fc10ce56700 1 -- 172.21.15.84:0/1010009814 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1080cd590 msgr2=0x7fc1081565f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:42.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.895+0000 7fc10ce56700 1 --2- 172.21.15.84:0/1010009814 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1080cd590 0x7fc1081565f0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fc0f800d800 tx=0x7fc0f800dbc0 comp rx=0 tx=0).stop 2023-09-13T08:25:42.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.895+0000 7fc10ce56700 1 -- 172.21.15.84:0/1010009814 shutdown_connections 2023-09-13T08:25:42.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.895+0000 7fc10ce56700 1 --2- 172.21.15.84:0/1010009814 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fc0e806a580 0x7fc0e806ca40 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:42.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.895+0000 7fc10ce56700 1 --2- 172.21.15.84:0/1010009814 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc10815e910 0x7fc10815b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:42.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.895+0000 7fc10ce56700 1 --2- 172.21.15.84:0/1010009814 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc1080ca8e0 0x7fc1080b2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:42.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.895+0000 7fc10ce56700 1 --2- 172.21.15.84:0/1010009814 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1080cd590 0x7fc1081565f0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:42.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.895+0000 7fc10ce56700 1 -- 172.21.15.84:0/1010009814 >> 172.21.15.84:0/1010009814 conn(0x7fc1080cca70 msgr2=0x7fc1080cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:42.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.895+0000 7fc10ce56700 1 -- 172.21.15.84:0/1010009814 shutdown_connections 2023-09-13T08:25:42.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:42.895+0000 7fc10ce56700 1 -- 172.21.15.84:0/1010009814 wait complete. 2023-09-13T08:25:42.907 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-09-13T08:25:43.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.029+0000 7f0224aaa700 1 Processor -- start 2023-09-13T08:25:43.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.029+0000 7f0224aaa700 1 -- start start 2023-09-13T08:25:43.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.030+0000 7f0224aaa700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f022006a620 0x7f022006aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:43.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.030+0000 7f0224aaa700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f022006af90 con 0x7f02200ca920 2023-09-13T08:25:43.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.030+0000 7f0224aaa700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02200cae50 con 0x7f022015d530 2023-09-13T08:25:43.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.030+0000 7f0224aaa700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02200cff20 con 0x7f022006a620 2023-09-13T08:25:43.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.030+0000 7f021dd9b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f02200ca920 0x7f022006d700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:47816/0 (socket says 172.21.15.84:47816) 2023-09-13T08:25:43.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.030+0000 7f021dd9b700 1 -- 172.21.15.84:0/3046917743 learned_addr learned my addr 172.21.15.84:0/3046917743 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:25:43.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.030+0000 7f021ed9d700 1 --2- 172.21.15.84:0/3046917743 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f022006a620 0x7f022006aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:43.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.030+0000 7f021d59a700 1 -- 172.21.15.84:0/3046917743 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 848325492 0 0) 0x7f022006af90 con 0x7f02200ca920 2023-09-13T08:25:43.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.030+0000 7f021d59a700 1 -- 172.21.15.84:0/3046917743 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02080035b0 con 0x7f02200ca920 2023-09-13T08:25:43.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.031+0000 7f021d59a700 1 -- 172.21.15.84:0/3046917743 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1849666832 0 0) 0x7f02080035b0 con 0x7f02200ca920 2023-09-13T08:25:43.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.031+0000 7f021d59a700 1 -- 172.21.15.84:0/3046917743 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f022006a620 msgr2=0x7f022006aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:43.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.031+0000 7f021d59a700 1 --2- 172.21.15.84:0/3046917743 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f022006a620 0x7f022006aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:43.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.031+0000 7f021d59a700 1 -- 172.21.15.84:0/3046917743 >> v1:172.21.15.161:6789/0 conn(0x7f022015d530 legacy=0x7f0220161bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:43.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.031+0000 7f021d59a700 1 -- 172.21.15.84:0/3046917743 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02200cb130 con 0x7f02200ca920 2023-09-13T08:25:43.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.031+0000 7f021d59a700 1 -- 172.21.15.84:0/3046917743 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2302733408 0 0) 0x7f0210001670 con 0x7f02200ca920 2023-09-13T08:25:43.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.031+0000 7f021d59a700 1 -- 172.21.15.84:0/3046917743 >> v1:172.21.15.84:6789/0 conn(0x7f02200ca920 legacy=0x7f022006d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:43.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.031+0000 7f021d59a700 1 --2- 172.21.15.84:0/3046917743 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0208003a30 0x7f0208003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:43.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.031+0000 7f021d59a700 1 --2- 172.21.15.84:0/3046917743 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0208004850 0x7f0208004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:43.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.031+0000 7f021d59a700 1 --2- 172.21.15.84:0/3046917743 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f022006a620 0x7f0208005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:43.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.031+0000 7f021d59a700 1 -- 172.21.15.84:0/3046917743 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f020800bac0 con 0x7f0208004850 2023-09-13T08:25:43.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.031+0000 7f021d59a700 1 -- 172.21.15.84:0/3046917743 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f020800bc30 con 0x7f0208003a30 2023-09-13T08:25:43.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.031+0000 7f021d59a700 1 -- 172.21.15.84:0/3046917743 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f020800bdf0 con 0x7f022006a620 2023-09-13T08:25:43.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.031+0000 7f021dd9b700 1 --2- 172.21.15.84:0/3046917743 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0208004850 0x7f0208004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:43.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.031+0000 7f021e59c700 1 --2- 172.21.15.84:0/3046917743 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0208003a30 0x7f0208003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:43.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.031+0000 7f021ed9d700 1 --2- 172.21.15.84:0/3046917743 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f022006a620 0x7f0208005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:43.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.031+0000 7f021dd9b700 1 -- 172.21.15.84:0/3046917743 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f022006a620 msgr2=0x7f0208005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:43.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.031+0000 7f021dd9b700 1 --2- 172.21.15.84:0/3046917743 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f022006a620 0x7f0208005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:43.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.031+0000 7f021dd9b700 1 -- 172.21.15.84:0/3046917743 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0208003a30 msgr2=0x7f0208003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:43.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.031+0000 7f021dd9b700 1 --2- 172.21.15.84:0/3046917743 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0208003a30 0x7f0208003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:43.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.031+0000 7f021dd9b700 1 -- 172.21.15.84:0/3046917743 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02080035b0 con 0x7f0208004850 2023-09-13T08:25:43.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.031+0000 7f021e59c700 1 --2- 172.21.15.84:0/3046917743 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0208003a30 0x7f0208003e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T08:25:43.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.031+0000 7f021dd9b700 1 --2- 172.21.15.84:0/3046917743 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0208004850 0x7f0208004cd0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f021000c210 tx=0x7f0208005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37a04df81c3d2e0b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:43.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.031+0000 7f021d59a700 1 -- 172.21.15.84:0/3046917743 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0210007c10 con 0x7f0208004850 2023-09-13T08:25:43.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.031+0000 7f021d59a700 1 -- 172.21.15.84:0/3046917743 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f021000cdb0 con 0x7f0208004850 2023-09-13T08:25:43.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.031+0000 7f021d59a700 1 -- 172.21.15.84:0/3046917743 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0210005ba0 con 0x7f0208004850 2023-09-13T08:25:43.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.032+0000 7f0224aaa700 1 -- 172.21.15.84:0/3046917743 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0208004850 msgr2=0x7f0208004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:43.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.032+0000 7f0224aaa700 1 --2- 172.21.15.84:0/3046917743 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0208004850 0x7f0208004cd0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f021000c210 tx=0x7f0208005880 comp rx=0 tx=0).stop 2023-09-13T08:25:43.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.032+0000 7f021ed9d700 1 -- 172.21.15.84:0/3046917743 reap_dead start 2023-09-13T08:25:43.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.032+0000 7f0224aaa700 1 -- 172.21.15.84:0/3046917743 shutdown_connections 2023-09-13T08:25:43.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.032+0000 7f0224aaa700 1 -- 172.21.15.84:0/3046917743 >> 172.21.15.84:0/3046917743 conn(0x7f02200d00c0 msgr2=0x7f02200d04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:43.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.032+0000 7f0224aaa700 1 -- 172.21.15.84:0/3046917743 shutdown_connections 2023-09-13T08:25:43.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.032+0000 7f0224aaa700 1 -- 172.21.15.84:0/3046917743 wait complete. 2023-09-13T08:25:43.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.033+0000 7f0224aaa700 1 Processor -- start 2023-09-13T08:25:43.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.033+0000 7f0224aaa700 1 -- start start 2023-09-13T08:25:43.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.034+0000 7f0224aaa700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0208004850 0x7f0220157530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:43.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.034+0000 7f0224aaa700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0220155390 0x7f02200ca050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:43.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.034+0000 7f0224aaa700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f02201547f0 0x7f0220154c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:43.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.034+0000 7f0224aaa700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02200c7560 con 0x7f0208004850 2023-09-13T08:25:43.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.034+0000 7f0224aaa700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0220155c30 con 0x7f02201547f0 2023-09-13T08:25:43.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.034+0000 7f0224aaa700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0220155190 con 0x7f0220155390 2023-09-13T08:25:43.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.034+0000 7f021e59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0208004850 0x7f0220157530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:43.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.034+0000 7f021e59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0208004850 0x7f0220157530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45182/0 (socket says 172.21.15.84:45182) 2023-09-13T08:25:43.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.034+0000 7f021e59c700 1 -- 172.21.15.84:0/1362497802 learned_addr learned my addr 172.21.15.84:0/1362497802 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:43.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.034+0000 7f021ed9d700 1 --2- 172.21.15.84:0/1362497802 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f02201547f0 0x7f0220154c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:43.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.034+0000 7f021dd9b700 1 --2- 172.21.15.84:0/1362497802 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0220155390 0x7f02200ca050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:43.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.034+0000 7f021e59c700 1 -- 172.21.15.84:0/1362497802 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0220155390 msgr2=0x7f02200ca050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:43.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.034+0000 7f021e59c700 1 --2- 172.21.15.84:0/1362497802 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0220155390 0x7f02200ca050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:43.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.034+0000 7f021e59c700 1 -- 172.21.15.84:0/1362497802 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f02201547f0 msgr2=0x7f0220154c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:43.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.034+0000 7f021e59c700 1 --2- 172.21.15.84:0/1362497802 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f02201547f0 0x7f0220154c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:43.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.034+0000 7f021e59c700 1 -- 172.21.15.84:0/1362497802 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0220157c10 con 0x7f0208004850 2023-09-13T08:25:43.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.035+0000 7f021e59c700 1 --2- 172.21.15.84:0/1362497802 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0208004850 0x7f0220157530 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f021400e580 tx=0x7f021400e940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:43.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.035+0000 7f020effd700 1 -- 172.21.15.84:0/1362497802 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02140052e0 con 0x7f0208004850 2023-09-13T08:25:43.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.035+0000 7f020effd700 1 -- 172.21.15.84:0/1362497802 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0214005440 con 0x7f0208004850 2023-09-13T08:25:43.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.035+0000 7f0224aaa700 1 -- 172.21.15.84:0/1362497802 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0220157ef0 con 0x7f0208004850 2023-09-13T08:25:43.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.035+0000 7f020effd700 1 -- 172.21.15.84:0/1362497802 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0214003880 con 0x7f0208004850 2023-09-13T08:25:43.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.035+0000 7f0224aaa700 1 -- 172.21.15.84:0/1362497802 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02201584b0 con 0x7f0208004850 2023-09-13T08:25:43.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.036+0000 7f0224aaa700 1 -- 172.21.15.84:0/1362497802 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f022004e9b0 con 0x7f0208004850 2023-09-13T08:25:43.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.036+0000 7f020effd700 1 -- 172.21.15.84:0/1362497802 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f02140039e0 con 0x7f0208004850 2023-09-13T08:25:43.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.036+0000 7f020effd700 1 --2- 172.21.15.84:0/1362497802 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f020006a580 0x7f020006ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:43.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.037+0000 7f020effd700 1 -- 172.21.15.84:0/1362497802 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f02140884d0 con 0x7f0208004850 2023-09-13T08:25:43.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.037+0000 7f021dd9b700 1 --2- 172.21.15.84:0/1362497802 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f020006a580 0x7f020006ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:43.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.037+0000 7f021dd9b700 1 --2- 172.21.15.84:0/1362497802 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f020006a580 0x7f020006ca40 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f02200b1b80 tx=0x7f0210007000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:43.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.041+0000 7f020effd700 1 -- 172.21.15.84:0/1362497802 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f02140537e0 con 0x7f0208004850 2023-09-13T08:25:43.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.247+0000 7f0224aaa700 1 -- 172.21.15.84:0/1362497802 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f02200b6040 con 0x7f0208004850 2023-09-13T08:25:43.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.247+0000 7f020effd700 1 -- 172.21.15.84:0/1362497802 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f0214056e00 con 0x7f0208004850 2023-09-13T08:25:43.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.249+0000 7f0224aaa700 1 -- 172.21.15.84:0/1362497802 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f020006a580 msgr2=0x7f020006ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:43.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.249+0000 7f0224aaa700 1 --2- 172.21.15.84:0/1362497802 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f020006a580 0x7f020006ca40 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f02200b1b80 tx=0x7f0210007000 comp rx=0 tx=0).stop 2023-09-13T08:25:43.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.249+0000 7f0224aaa700 1 -- 172.21.15.84:0/1362497802 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0208004850 msgr2=0x7f0220157530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:43.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.249+0000 7f0224aaa700 1 --2- 172.21.15.84:0/1362497802 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0208004850 0x7f0220157530 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f021400e580 tx=0x7f021400e940 comp rx=0 tx=0).stop 2023-09-13T08:25:43.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.249+0000 7f0224aaa700 1 -- 172.21.15.84:0/1362497802 shutdown_connections 2023-09-13T08:25:43.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.249+0000 7f0224aaa700 1 --2- 172.21.15.84:0/1362497802 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f020006a580 0x7f020006ca40 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:43.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.249+0000 7f0224aaa700 1 --2- 172.21.15.84:0/1362497802 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f02201547f0 0x7f0220154c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:43.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.249+0000 7f0224aaa700 1 --2- 172.21.15.84:0/1362497802 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0208004850 0x7f0220157530 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:43.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.249+0000 7f0224aaa700 1 --2- 172.21.15.84:0/1362497802 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0220155390 0x7f02200ca050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:43.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.249+0000 7f0224aaa700 1 -- 172.21.15.84:0/1362497802 >> 172.21.15.84:0/1362497802 conn(0x7f02200d00c0 msgr2=0x7f02200d04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:43.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.249+0000 7f0224aaa700 1 -- 172.21.15.84:0/1362497802 shutdown_connections 2023-09-13T08:25:43.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.249+0000 7f0224aaa700 1 -- 172.21.15.84:0/1362497802 wait complete. 2023-09-13T08:25:43.252 INFO:teuthology.orchestra.run.smithi084.stderr:listed 0 entries 2023-09-13T08:25:43.261 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-09-13T08:25:43.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:25:43.262 DEBUG:teuthology.orchestra.run.smithi084:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-09-13T08:25:43.301 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi084.front.sepia.ceph.com 2023-09-13T08:25:43.302 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:25:43.302 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-09-13T08:25:43.359 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-09-13T08:25:43.359 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T08:25:43.383 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-09-13T08:25:43.383 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T08:25:43.443 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-09-13T08:25:43.444 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T08:25:43.504 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T08:25:43.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.626+0000 7f6555d79700 1 Processor -- start 2023-09-13T08:25:43.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.626+0000 7f6555d79700 1 -- start start 2023-09-13T08:25:43.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.627+0000 7f6555d79700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f655006bad0 0x7f655006c040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:43.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.627+0000 7f6555d79700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f655006c580 0x7f65500adf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:43.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.627+0000 7f6555d79700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65500b1d80 con 0x7f6550160e30 2023-09-13T08:25:43.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.627+0000 7f6555d79700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f655006ca10 con 0x7f655006c580 2023-09-13T08:25:43.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.627+0000 7f6555d79700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65500b2060 con 0x7f655006bad0 2023-09-13T08:25:43.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.627+0000 7f654ffff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f655006c580 0x7f65500adf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:43.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.627+0000 7f654ffff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f655006c580 0x7f65500adf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45194/0 (socket says 172.21.15.84:45194) 2023-09-13T08:25:43.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.627+0000 7f654ffff700 1 -- 172.21.15.84:0/3153085035 learned_addr learned my addr 172.21.15.84:0/3153085035 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:43.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.627+0000 7f654effd700 1 --2- 172.21.15.84:0/3153085035 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f655006bad0 0x7f655006c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:43.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.627+0000 7f654ffff700 1 -- 172.21.15.84:0/3153085035 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f655006bad0 msgr2=0x7f655006c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:43.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.627+0000 7f654ffff700 1 --2- 172.21.15.84:0/3153085035 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f655006bad0 0x7f655006c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:43.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.627+0000 7f654ffff700 1 -- 172.21.15.84:0/3153085035 >> v1:172.21.15.161:6789/0 conn(0x7f6550160e30 legacy=0x7f65500b1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:43.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.627+0000 7f654ffff700 1 -- 172.21.15.84:0/3153085035 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65500b2340 con 0x7f655006c580 2023-09-13T08:25:43.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.628+0000 7f654ffff700 1 --2- 172.21.15.84:0/3153085035 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f655006c580 0x7f65500adf60 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f6548009e50 tx=0x7f654800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73281553cc81e4a6 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:43.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.628+0000 7f654e7fc700 1 -- 172.21.15.84:0/3153085035 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f654800e070 con 0x7f655006c580 2023-09-13T08:25:43.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.628+0000 7f654e7fc700 1 -- 172.21.15.84:0/3153085035 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6548003a20 con 0x7f655006c580 2023-09-13T08:25:43.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.628+0000 7f654e7fc700 1 -- 172.21.15.84:0/3153085035 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6548003dd0 con 0x7f655006c580 2023-09-13T08:25:43.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.628+0000 7f6555d79700 1 -- 172.21.15.84:0/3153085035 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f655006c580 msgr2=0x7f65500adf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:43.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.628+0000 7f6555d79700 1 --2- 172.21.15.84:0/3153085035 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f655006c580 0x7f65500adf60 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f6548009e50 tx=0x7f654800b330 comp rx=0 tx=0).stop 2023-09-13T08:25:43.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.628+0000 7f6555d79700 1 -- 172.21.15.84:0/3153085035 shutdown_connections 2023-09-13T08:25:43.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.628+0000 7f6555d79700 1 --2- 172.21.15.84:0/3153085035 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f655006c580 0x7f65500adf60 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:43.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.628+0000 7f6555d79700 1 --2- 172.21.15.84:0/3153085035 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f655006bad0 0x7f655006c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:43.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.628+0000 7f6555d79700 1 -- 172.21.15.84:0/3153085035 >> 172.21.15.84:0/3153085035 conn(0x7f65500d11c0 msgr2=0x7f65500d15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:43.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.628+0000 7f6555d79700 1 -- 172.21.15.84:0/3153085035 shutdown_connections 2023-09-13T08:25:43.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.628+0000 7f6555d79700 1 -- 172.21.15.84:0/3153085035 wait complete. 2023-09-13T08:25:43.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.630+0000 7f6555d79700 1 Processor -- start 2023-09-13T08:25:43.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.630+0000 7f6555d79700 1 -- start start 2023-09-13T08:25:43.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.630+0000 7f6555d79700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f655006bad0 0x7f655014f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:43.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.630+0000 7f6555d79700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f655006c580 0x7f655015faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:43.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.631+0000 7f6555d79700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6550160e30 0x7f6550160030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:43.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.631+0000 7f6555d79700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f655014bed0 con 0x7f6550160e30 2023-09-13T08:25:43.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.631+0000 7f6555d79700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f655009df30 con 0x7f655006bad0 2023-09-13T08:25:43.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.631+0000 7f6555d79700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f655009cab0 con 0x7f655006c580 2023-09-13T08:25:43.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.631+0000 7f654ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6550160e30 0x7f6550160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:43.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.631+0000 7f654ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6550160e30 0x7f6550160030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45200/0 (socket says 172.21.15.84:45200) 2023-09-13T08:25:43.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.631+0000 7f654ffff700 1 -- 172.21.15.84:0/3628876858 learned_addr learned my addr 172.21.15.84:0/3628876858 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:43.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.631+0000 7f654effd700 1 --2- 172.21.15.84:0/3628876858 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f655006c580 0x7f655015faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:43.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.631+0000 7f654f7fe700 1 --2- 172.21.15.84:0/3628876858 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f655006bad0 0x7f655014f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:43.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.631+0000 7f654ffff700 1 -- 172.21.15.84:0/3628876858 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f655006c580 msgr2=0x7f655015faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:43.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.631+0000 7f654ffff700 1 --2- 172.21.15.84:0/3628876858 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f655006c580 0x7f655015faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:43.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.631+0000 7f654ffff700 1 -- 172.21.15.84:0/3628876858 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f655006bad0 msgr2=0x7f655014f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:43.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.631+0000 7f654ffff700 1 --2- 172.21.15.84:0/3628876858 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f655006bad0 0x7f655014f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:43.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.631+0000 7f654ffff700 1 -- 172.21.15.84:0/3628876858 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6548009b30 con 0x7f6550160e30 2023-09-13T08:25:43.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.631+0000 7f654ffff700 1 --2- 172.21.15.84:0/3628876858 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6550160e30 0x7f6550160030 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f655008b5b0 tx=0x7f6548004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:43.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.631+0000 7f6537fff700 1 -- 172.21.15.84:0/3628876858 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6548004440 con 0x7f6550160e30 2023-09-13T08:25:43.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.631+0000 7f6537fff700 1 -- 172.21.15.84:0/3628876858 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65480045a0 con 0x7f6550160e30 2023-09-13T08:25:43.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.631+0000 7f6555d79700 1 -- 172.21.15.84:0/3628876858 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f655009cd90 con 0x7f6550160e30 2023-09-13T08:25:43.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.631+0000 7f6537fff700 1 -- 172.21.15.84:0/3628876858 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6548004950 con 0x7f6550160e30 2023-09-13T08:25:43.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.631+0000 7f6555d79700 1 -- 172.21.15.84:0/3628876858 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f655009d350 con 0x7f6550160e30 2023-09-13T08:25:43.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.632+0000 7f6555d79700 1 -- 172.21.15.84:0/3628876858 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f655004e9b0 con 0x7f6550160e30 2023-09-13T08:25:43.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.633+0000 7f6537fff700 1 -- 172.21.15.84:0/3628876858 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f6548012430 con 0x7f6550160e30 2023-09-13T08:25:43.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.633+0000 7f6537fff700 1 --2- 172.21.15.84:0/3628876858 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f653c06a580 0x7f653c06ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:43.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.633+0000 7f6537fff700 1 -- 172.21.15.84:0/3628876858 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f654808a2e0 con 0x7f6550160e30 2023-09-13T08:25:43.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.633+0000 7f654f7fe700 1 --2- 172.21.15.84:0/3628876858 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f653c06a580 0x7f653c06ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:43.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.634+0000 7f654f7fe700 1 --2- 172.21.15.84:0/3628876858 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f653c06a580 0x7f653c06ca40 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6544009870 tx=0x7f6544008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:43.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.638+0000 7f6537fff700 1 -- 172.21.15.84:0/3628876858 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f6548058f20 con 0x7f6550160e30 2023-09-13T08:25:43.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.829+0000 7f6555d79700 1 -- 172.21.15.84:0/3628876858 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f655015f5d0 con 0x7f6550160e30 2023-09-13T08:25:43.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.830+0000 7f6537fff700 1 -- 172.21.15.84:0/3628876858 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18757 (secure 0 0 0) 0x7f6548058ab0 con 0x7f6550160e30 2023-09-13T08:25:43.830 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:25:43.831 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":26,"fsid":"0107440b-b634-42c5-a643-5d31ea826116","created":"2023-09-13T08:24:16.931917+0000","modified":"2023-09-13T08:25:23.878460+0000","last_up_change":"2023-09-13T08:24:28.422631+0000","last_in_change":"2023-09-13T08:24:19.425578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T08:24:28.583720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-13T08:24:39.862832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-13T08:24:41.145511+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-13T08:24:44.775160+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4a53ec12-1469-4356-b4e1-2b8fc9b7c0f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6817","nonce":1599532366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6819","nonce":1599532366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6823","nonce":1599532366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6821","nonce":1599532366}]},"public_addr":"172.21.15.84:6817/1599532366","cluster_addr":"172.21.15.84:6819/1599532366","heartbeat_back_addr":"172.21.15.84:6823/1599532366","heartbeat_front_addr":"172.21.15.84:6821/1599532366","state":["exists","up"]},{"osd":1,"uuid":"11e964a0-b80c-4afc-bfbf-e2067969db29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6825","nonce":461860977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6827","nonce":461860977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6831","nonce":461860977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6829","nonce":461860977}]},"public_addr":"172.21.15.84:6825/461860977","cluster_addr":"172.21.15.84:6827/461860977","heartbeat_back_addr":"172.21.15.84:6831/461860977","heartbeat_front_addr":"172.21.15.84:6829/461860977","state":["exists","up"]},{"osd":2,"uuid":"3ce74529-4dd1-44c7-9576-968f5fdc0c25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6809","nonce":1168316165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6811","nonce":1168316165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6815","nonce":1168316165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6813","nonce":1168316165}]},"public_addr":"172.21.15.84:6809/1168316165","cluster_addr":"172.21.15.84:6811/1168316165","heartbeat_back_addr":"172.21.15.84:6815/1168316165","heartbeat_front_addr":"172.21.15.84:6813/1168316165","state":["exists","up"]},{"osd":3,"uuid":"460cb5c5-590a-4d06-a4d9-5bac2fdf33b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6801","nonce":1661609810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6803","nonce":1661609810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6807","nonce":1661609810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6805","nonce":1661609810}]},"public_addr":"172.21.15.84:6801/1661609810","cluster_addr":"172.21.15.84:6803/1661609810","heartbeat_back_addr":"172.21.15.84:6807/1661609810","heartbeat_front_addr":"172.21.15.84:6805/1661609810","state":["exists","up"]},{"osd":4,"uuid":"bf237dd0-3ebd-44b5-8078-24a63e00d792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6801","nonce":1303562374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6803","nonce":1303562374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6807","nonce":1303562374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6805","nonce":1303562374}]},"public_addr":"172.21.15.161:6801/1303562374","cluster_addr":"172.21.15.161:6803/1303562374","heartbeat_back_addr":"172.21.15.161:6807/1303562374","heartbeat_front_addr":"172.21.15.161:6805/1303562374","state":["exists","up"]},{"osd":5,"uuid":"e1e538e0-5844-456b-8c6e-434d3a914af1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6818","nonce":961120854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6822","nonce":961120854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6830","nonce":961120854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6826","nonce":961120854}]},"public_addr":"172.21.15.161:6818/961120854","cluster_addr":"172.21.15.161:6822/961120854","heartbeat_back_addr":"172.21.15.161:6830/961120854","heartbeat_front_addr":"172.21.15.161:6826/961120854","state":["exists","up"]},{"osd":6,"uuid":"5cb1785e-960f-4dd4-b295-9e21b2c3f875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6809","nonce":980533466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6811","nonce":980533466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6815","nonce":980533466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6813","nonce":980533466}]},"public_addr":"172.21.15.161:6809/980533466","cluster_addr":"172.21.15.161:6811/980533466","heartbeat_back_addr":"172.21.15.161:6815/980533466","heartbeat_front_addr":"172.21.15.161:6813/980533466","state":["exists","up"]},{"osd":7,"uuid":"5acb6619-e933-4b46-b1c2-60af30acb839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6817","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6819","nonce":2479691549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6821","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6823","nonce":2479691549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6829","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6831","nonce":2479691549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6825","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6827","nonce":2479691549}]},"public_addr":"172.21.15.161:6819/2479691549","cluster_addr":"172.21.15.161:6823/2479691549","heartbeat_back_addr":"172.21.15.161:6831/2479691549","heartbeat_front_addr":"172.21.15.161:6827/2479691549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.678857+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.685341+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.613603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.634940+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.564387+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.697347+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.637437+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.619397+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":1}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T08:25:43.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.832+0000 7f6555d79700 1 -- 172.21.15.84:0/3628876858 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f653c06a580 msgr2=0x7f653c06ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:43.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.832+0000 7f6555d79700 1 --2- 172.21.15.84:0/3628876858 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f653c06a580 0x7f653c06ca40 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6544009870 tx=0x7f6544008040 comp rx=0 tx=0).stop 2023-09-13T08:25:43.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.832+0000 7f6555d79700 1 -- 172.21.15.84:0/3628876858 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6550160e30 msgr2=0x7f6550160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:43.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.832+0000 7f6555d79700 1 --2- 172.21.15.84:0/3628876858 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6550160e30 0x7f6550160030 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f655008b5b0 tx=0x7f6548004ad0 comp rx=0 tx=0).stop 2023-09-13T08:25:43.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.832+0000 7f6555d79700 1 -- 172.21.15.84:0/3628876858 shutdown_connections 2023-09-13T08:25:43.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.832+0000 7f6555d79700 1 --2- 172.21.15.84:0/3628876858 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6550160e30 0x7f6550160030 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:43.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.832+0000 7f6555d79700 1 --2- 172.21.15.84:0/3628876858 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f653c06a580 0x7f653c06ca40 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:43.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.832+0000 7f6555d79700 1 --2- 172.21.15.84:0/3628876858 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f655006bad0 0x7f655014f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:43.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.832+0000 7f6555d79700 1 --2- 172.21.15.84:0/3628876858 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f655006c580 0x7f655015faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:43.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.832+0000 7f6555d79700 1 -- 172.21.15.84:0/3628876858 >> 172.21.15.84:0/3628876858 conn(0x7f65500d11c0 msgr2=0x7f65500b1070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:43.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.832+0000 7f6555d79700 1 -- 172.21.15.84:0/3628876858 shutdown_connections 2023-09-13T08:25:43.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.832+0000 7f6555d79700 1 -- 172.21.15.84:0/3628876858 wait complete. 2023-09-13T08:25:43.845 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T08:24:28.583720+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-13T08:24:39.862832+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-13T08:24:41.145511+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-09-13T08:24:44.775160+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-13T08:25:43.846 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T08:25:43.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.969+0000 7fe5a6a90700 1 Processor -- start 2023-09-13T08:25:43.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.969+0000 7fe5a6a90700 1 -- start start 2023-09-13T08:25:43.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.970+0000 7fe5a6a90700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe5a0140360 0x7fe5a006a620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:43.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.970+0000 7fe5a6a90700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe5a006ab60 0x7fe5a00ceb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:43.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.970+0000 7fe5a6a90700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5a00ccc50 con 0x7fe5a00cf060 2023-09-13T08:25:43.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.970+0000 7fe5a6a90700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5a00cf470 con 0x7fe5a006ab60 2023-09-13T08:25:43.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.970+0000 7fe5a6a90700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5a00ce080 con 0x7fe5a0140360 2023-09-13T08:25:43.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.970+0000 7fe59ffff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe5a006ab60 0x7fe5a00ceb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:43.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.970+0000 7fe59ffff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe5a006ab60 0x7fe5a00ceb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45204/0 (socket says 172.21.15.84:45204) 2023-09-13T08:25:43.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.970+0000 7fe59ffff700 1 -- 172.21.15.84:0/2964744624 learned_addr learned my addr 172.21.15.84:0/2964744624 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:43.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.971+0000 7fe5a482c700 1 --2- 172.21.15.84:0/2964744624 >> v2:172.21.15.161:3300/0 conn(0x7fe5a0140360 0x7fe5a006a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:43.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.971+0000 7fe59ffff700 1 -- 172.21.15.84:0/2964744624 >> v2:172.21.15.161:3300/0 conn(0x7fe5a0140360 msgr2=0x7fe5a006a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:43.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.971+0000 7fe59ffff700 1 --2- 172.21.15.84:0/2964744624 >> v2:172.21.15.161:3300/0 conn(0x7fe5a0140360 0x7fe5a006a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:43.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.971+0000 7fe59ffff700 1 -- 172.21.15.84:0/2964744624 >> v1:172.21.15.84:6789/0 conn(0x7fe5a00cf060 legacy=0x7fe5a0140740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:43.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.971+0000 7fe59ffff700 1 -- 172.21.15.84:0/2964744624 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5a00cc690 con 0x7fe5a006ab60 2023-09-13T08:25:43.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.971+0000 7fe5a482c700 1 --2- 172.21.15.84:0/2964744624 >> v2:172.21.15.161:3300/0 conn(0x7fe5a0140360 0x7fe5a006a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T08:25:43.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.971+0000 7fe59ffff700 1 --2- 172.21.15.84:0/2964744624 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5a006ab60 0x7fe5a00ceb20 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fe5a00b49f0 tx=0x7fe58c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b31057e71fb762a3 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:43.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.971+0000 7fe59f7fe700 1 -- 172.21.15.84:0/2964744624 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe58c00b870 con 0x7fe5a006ab60 2023-09-13T08:25:43.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.971+0000 7fe59f7fe700 1 -- 172.21.15.84:0/2964744624 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe58c00b9d0 con 0x7fe5a006ab60 2023-09-13T08:25:43.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.971+0000 7fe59f7fe700 1 -- 172.21.15.84:0/2964744624 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe58c00bd60 con 0x7fe5a006ab60 2023-09-13T08:25:43.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.971+0000 7fe5a6a90700 1 -- 172.21.15.84:0/2964744624 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5a006ab60 msgr2=0x7fe5a00ceb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:43.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.971+0000 7fe5a6a90700 1 --2- 172.21.15.84:0/2964744624 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5a006ab60 0x7fe5a00ceb20 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fe5a00b49f0 tx=0x7fe58c009bd0 comp rx=0 tx=0).stop 2023-09-13T08:25:43.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.971+0000 7fe5a6a90700 1 -- 172.21.15.84:0/2964744624 shutdown_connections 2023-09-13T08:25:43.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.971+0000 7fe5a6a90700 1 --2- 172.21.15.84:0/2964744624 >> v2:172.21.15.161:3300/0 conn(0x7fe5a0140360 0x7fe5a006a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:43.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.971+0000 7fe5a6a90700 1 --2- 172.21.15.84:0/2964744624 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5a006ab60 0x7fe5a00ceb20 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:43.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.971+0000 7fe5a6a90700 1 -- 172.21.15.84:0/2964744624 >> 172.21.15.84:0/2964744624 conn(0x7fe5a00cf8f0 msgr2=0x7fe5a00cfd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:43.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.971+0000 7fe5a6a90700 1 -- 172.21.15.84:0/2964744624 shutdown_connections 2023-09-13T08:25:43.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.971+0000 7fe5a6a90700 1 -- 172.21.15.84:0/2964744624 wait complete. 2023-09-13T08:25:43.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.973+0000 7fe5a6a90700 1 Processor -- start 2023-09-13T08:25:43.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.973+0000 7fe5a6a90700 1 -- start start 2023-09-13T08:25:43.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.973+0000 7fe5a6a90700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe5a006ab60 0x7fe5a013c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:43.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.973+0000 7fe5a6a90700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5a00cf060 0x7fe5a006e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:43.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.973+0000 7fe5a6a90700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe5a0140360 0x7fe5a006e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:43.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.974+0000 7fe5a6a90700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a0159fa0 con 0x7fe5a00cf060 2023-09-13T08:25:43.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.974+0000 7fe5a6a90700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a015a280 con 0x7fe5a0140360 2023-09-13T08:25:43.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.974+0000 7fe5a6a90700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a015a560 con 0x7fe5a006ab60 2023-09-13T08:25:43.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.974+0000 7fe59ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5a00cf060 0x7fe5a006e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:43.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.974+0000 7fe59ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5a00cf060 0x7fe5a006e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45212/0 (socket says 172.21.15.84:45212) 2023-09-13T08:25:43.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.974+0000 7fe59ffff700 1 -- 172.21.15.84:0/1190297326 learned_addr learned my addr 172.21.15.84:0/1190297326 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:43.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.974+0000 7fe5a482c700 1 --2- 172.21.15.84:0/1190297326 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe5a006ab60 0x7fe5a013c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:43.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.974+0000 7fe5a502d700 1 --2- 172.21.15.84:0/1190297326 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe5a0140360 0x7fe5a006e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:43.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.974+0000 7fe59ffff700 1 -- 172.21.15.84:0/1190297326 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe5a006ab60 msgr2=0x7fe5a013c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:43.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.974+0000 7fe59ffff700 1 --2- 172.21.15.84:0/1190297326 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe5a006ab60 0x7fe5a013c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:43.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.974+0000 7fe59ffff700 1 -- 172.21.15.84:0/1190297326 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe5a0140360 msgr2=0x7fe5a006e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:43.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.974+0000 7fe59ffff700 1 --2- 172.21.15.84:0/1190297326 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe5a0140360 0x7fe5a006e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:43.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.974+0000 7fe59ffff700 1 -- 172.21.15.84:0/1190297326 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe58c009550 con 0x7fe5a00cf060 2023-09-13T08:25:43.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.974+0000 7fe5a502d700 1 --2- 172.21.15.84:0/1190297326 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe5a0140360 0x7fe5a006e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T08:25:43.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.974+0000 7fe5a482c700 1 --2- 172.21.15.84:0/1190297326 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe5a006ab60 0x7fe5a013c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T08:25:43.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.974+0000 7fe59ffff700 1 --2- 172.21.15.84:0/1190297326 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5a00cf060 0x7fe5a006e060 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fe5a00b4d70 tx=0x7fe58c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:43.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.974+0000 7fe59d7fa700 1 -- 172.21.15.84:0/1190297326 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe58c004310 con 0x7fe5a00cf060 2023-09-13T08:25:43.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.974+0000 7fe59d7fa700 1 -- 172.21.15.84:0/1190297326 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe58c01f070 con 0x7fe5a00cf060 2023-09-13T08:25:43.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.974+0000 7fe59d7fa700 1 -- 172.21.15.84:0/1190297326 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe58c0036a0 con 0x7fe5a00cf060 2023-09-13T08:25:43.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.974+0000 7fe5a6a90700 1 -- 172.21.15.84:0/1190297326 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5a015a840 con 0x7fe5a00cf060 2023-09-13T08:25:43.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.974+0000 7fe5a6a90700 1 -- 172.21.15.84:0/1190297326 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5a013cb00 con 0x7fe5a00cf060 2023-09-13T08:25:43.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.975+0000 7fe5a6a90700 1 -- 172.21.15.84:0/1190297326 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5a015ad60 con 0x7fe5a00cf060 2023-09-13T08:25:43.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.976+0000 7fe59d7fa700 1 -- 172.21.15.84:0/1190297326 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fe58c021030 con 0x7fe5a00cf060 2023-09-13T08:25:43.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.976+0000 7fe59d7fa700 1 --2- 172.21.15.84:0/1190297326 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fe58406a580 0x7fe58406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:43.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.976+0000 7fe59d7fa700 1 -- 172.21.15.84:0/1190297326 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fe58c08a3b0 con 0x7fe5a00cf060 2023-09-13T08:25:43.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.976+0000 7fe5a482c700 1 --2- 172.21.15.84:0/1190297326 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fe58406a580 0x7fe58406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:43.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.976+0000 7fe5a482c700 1 --2- 172.21.15.84:0/1190297326 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fe58406a580 0x7fe58406ca40 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe5a01e7280 tx=0x7fe594008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:43.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:43.980+0000 7fe59d7fa700 1 -- 172.21.15.84:0/1190297326 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fe5a015ad60 con 0x7fe5a00cf060 2023-09-13T08:25:44.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.166+0000 7fe5a6a90700 1 -- 172.21.15.84:0/1190297326 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe5a015ad60 con 0x7fe5a00cf060 2023-09-13T08:25:44.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.167+0000 7fe59d7fa700 1 -- 172.21.15.84:0/1190297326 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe5a015ad60 con 0x7fe5a00cf060 2023-09-13T08:25:44.167 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-09-13T08:25:44.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.168+0000 7fe5a6a90700 1 -- 172.21.15.84:0/1190297326 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fe58406a580 msgr2=0x7fe58406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:44.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.168+0000 7fe5a6a90700 1 --2- 172.21.15.84:0/1190297326 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fe58406a580 0x7fe58406ca40 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe5a01e7280 tx=0x7fe594008040 comp rx=0 tx=0).stop 2023-09-13T08:25:44.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.168+0000 7fe5a6a90700 1 -- 172.21.15.84:0/1190297326 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5a00cf060 msgr2=0x7fe5a006e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:44.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.168+0000 7fe5a6a90700 1 --2- 172.21.15.84:0/1190297326 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5a00cf060 0x7fe5a006e060 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fe5a00b4d70 tx=0x7fe58c004750 comp rx=0 tx=0).stop 2023-09-13T08:25:44.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.169+0000 7fe5a6a90700 1 -- 172.21.15.84:0/1190297326 shutdown_connections 2023-09-13T08:25:44.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.169+0000 7fe5a6a90700 1 --2- 172.21.15.84:0/1190297326 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fe58406a580 0x7fe58406ca40 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:44.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.169+0000 7fe5a6a90700 1 --2- 172.21.15.84:0/1190297326 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe5a0140360 0x7fe5a006e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:44.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.169+0000 7fe5a6a90700 1 --2- 172.21.15.84:0/1190297326 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe5a006ab60 0x7fe5a013c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:44.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.169+0000 7fe5a6a90700 1 --2- 172.21.15.84:0/1190297326 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5a00cf060 0x7fe5a006e060 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:44.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.169+0000 7fe5a6a90700 1 -- 172.21.15.84:0/1190297326 >> 172.21.15.84:0/1190297326 conn(0x7fe5a00cf8f0 msgr2=0x7fe5a00cfcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:44.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.169+0000 7fe5a6a90700 1 -- 172.21.15.84:0/1190297326 shutdown_connections 2023-09-13T08:25:44.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.169+0000 7fe5a6a90700 1 -- 172.21.15.84:0/1190297326 wait complete. 2023-09-13T08:25:44.182 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-13T08:25:44.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.304+0000 7f3b0f5db700 1 Processor -- start 2023-09-13T08:25:44.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.305+0000 7f3b0f5db700 1 -- start start 2023-09-13T08:25:44.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.305+0000 7f3b0f5db700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3b080ca640 0x7f3b0806f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:44.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.305+0000 7f3b0f5db700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f3b0806a620 0x7f3b0806aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:44.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.306+0000 7f3b0f5db700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b0806af70 con 0x7f3b0815b4b0 2023-09-13T08:25:44.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.306+0000 7f3b0f5db700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b080cc460 con 0x7f3b080ca640 2023-09-13T08:25:44.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.306+0000 7f3b0f5db700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b080cacb0 con 0x7f3b0806a620 2023-09-13T08:25:44.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.306+0000 7f3b0cb76700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3b080ca640 0x7f3b0806f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:44.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.306+0000 7f3b0cb76700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3b080ca640 0x7f3b0806f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45218/0 (socket says 172.21.15.84:45218) 2023-09-13T08:25:44.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.306+0000 7f3b0cb76700 1 -- 172.21.15.84:0/259814545 learned_addr learned my addr 172.21.15.84:0/259814545 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:44.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.306+0000 7f3b0db78700 1 --2- 172.21.15.84:0/259814545 >> v2:172.21.15.161:3300/0 conn(0x7f3b0806a620 0x7f3b0806aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:44.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.306+0000 7f3b0cb76700 1 -- 172.21.15.84:0/259814545 >> v2:172.21.15.161:3300/0 conn(0x7f3b0806a620 msgr2=0x7f3b0806aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:44.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.306+0000 7f3b0cb76700 1 --2- 172.21.15.84:0/259814545 >> v2:172.21.15.161:3300/0 conn(0x7f3b0806a620 0x7f3b0806aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:44.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.306+0000 7f3b0cb76700 1 -- 172.21.15.84:0/259814545 >> v1:172.21.15.84:6789/0 conn(0x7f3b0815b4b0 legacy=0x7f3b080cbd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:44.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.306+0000 7f3b0cb76700 1 -- 172.21.15.84:0/259814545 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b080caf90 con 0x7f3b080ca640 2023-09-13T08:25:44.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.306+0000 7f3b0db78700 1 --2- 172.21.15.84:0/259814545 >> v2:172.21.15.161:3300/0 conn(0x7f3b0806a620 0x7f3b0806aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T08:25:44.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.306+0000 7f3b0cb76700 1 --2- 172.21.15.84:0/259814545 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b080ca640 0x7f3b0806f700 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f3b0815ff60 tx=0x7f3b04009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9d399b71ed67369 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:44.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.306+0000 7f3afffff700 1 -- 172.21.15.84:0/259814545 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b0400b870 con 0x7f3b080ca640 2023-09-13T08:25:44.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.306+0000 7f3afffff700 1 -- 172.21.15.84:0/259814545 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b0400b9d0 con 0x7f3b080ca640 2023-09-13T08:25:44.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.306+0000 7f3afffff700 1 -- 172.21.15.84:0/259814545 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b0400bd60 con 0x7f3b080ca640 2023-09-13T08:25:44.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.307+0000 7f3b0f5db700 1 -- 172.21.15.84:0/259814545 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b080ca640 msgr2=0x7f3b0806f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:44.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.307+0000 7f3b0f5db700 1 --2- 172.21.15.84:0/259814545 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b080ca640 0x7f3b0806f700 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f3b0815ff60 tx=0x7f3b04009bd0 comp rx=0 tx=0).stop 2023-09-13T08:25:44.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.307+0000 7f3b0f5db700 1 -- 172.21.15.84:0/259814545 shutdown_connections 2023-09-13T08:25:44.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.307+0000 7f3b0f5db700 1 --2- 172.21.15.84:0/259814545 >> v2:172.21.15.161:3300/0 conn(0x7f3b0806a620 0x7f3b0806aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:44.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.307+0000 7f3b0f5db700 1 --2- 172.21.15.84:0/259814545 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b080ca640 0x7f3b0806f700 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:44.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.307+0000 7f3b0f5db700 1 -- 172.21.15.84:0/259814545 >> 172.21.15.84:0/259814545 conn(0x7f3b080cca70 msgr2=0x7f3b080cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:44.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.307+0000 7f3b0f5db700 1 -- 172.21.15.84:0/259814545 shutdown_connections 2023-09-13T08:25:44.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.307+0000 7f3b0f5db700 1 -- 172.21.15.84:0/259814545 wait complete. 2023-09-13T08:25:44.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.308+0000 7f3b0f5db700 1 Processor -- start 2023-09-13T08:25:44.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.308+0000 7f3b0f5db700 1 -- start start 2023-09-13T08:25:44.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.309+0000 7f3b0f5db700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3b0806a620 0x7f3b080aeaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:44.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.309+0000 7f3b0f5db700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b0815b4b0 0x7f3b080c5af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:44.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.309+0000 7f3b0f5db700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3b081f0a10 0x7f3b080b44e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:44.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.309+0000 7f3b0f5db700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0815f850 con 0x7f3b0815b4b0 2023-09-13T08:25:44.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.309+0000 7f3b0f5db700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0815f290 con 0x7f3b081f0a10 2023-09-13T08:25:44.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.309+0000 7f3b0f5db700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0815f570 con 0x7f3b0806a620 2023-09-13T08:25:44.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.309+0000 7f3b0cb76700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b0815b4b0 0x7f3b080c5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:44.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.309+0000 7f3b0cb76700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b0815b4b0 0x7f3b080c5af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45226/0 (socket says 172.21.15.84:45226) 2023-09-13T08:25:44.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.309+0000 7f3b0cb76700 1 -- 172.21.15.84:0/3118251552 learned_addr learned my addr 172.21.15.84:0/3118251552 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:44.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.309+0000 7f3b0d377700 1 --2- 172.21.15.84:0/3118251552 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3b0806a620 0x7f3b080aeaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:44.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.309+0000 7f3b0cb76700 1 -- 172.21.15.84:0/3118251552 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3b0806a620 msgr2=0x7f3b080aeaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:44.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.309+0000 7f3b0cb76700 1 --2- 172.21.15.84:0/3118251552 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3b0806a620 0x7f3b080aeaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:44.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.309+0000 7f3b0cb76700 1 -- 172.21.15.84:0/3118251552 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3b081f0a10 msgr2=0x7f3b080b44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:44.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.309+0000 7f3b0db78700 1 --2- 172.21.15.84:0/3118251552 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3b081f0a10 0x7f3b080b44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:44.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.309+0000 7f3b0cb76700 1 --2- 172.21.15.84:0/3118251552 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3b081f0a10 0x7f3b080b44e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:44.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.309+0000 7f3b0cb76700 1 -- 172.21.15.84:0/3118251552 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b04009550 con 0x7f3b0815b4b0 2023-09-13T08:25:44.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.309+0000 7f3b0cb76700 1 --2- 172.21.15.84:0/3118251552 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b0815b4b0 0x7f3b080c5af0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f3b04013000 tx=0x7f3b04004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:44.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.309+0000 7f3afdffb700 1 -- 172.21.15.84:0/3118251552 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b04011720 con 0x7f3b0815b4b0 2023-09-13T08:25:44.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.309+0000 7f3afdffb700 1 -- 172.21.15.84:0/3118251552 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b0401f070 con 0x7f3b0815b4b0 2023-09-13T08:25:44.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.309+0000 7f3b0f5db700 1 -- 172.21.15.84:0/3118251552 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b0815ba70 con 0x7f3b0815b4b0 2023-09-13T08:25:44.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.309+0000 7f3afdffb700 1 -- 172.21.15.84:0/3118251552 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b04011ac0 con 0x7f3b0815b4b0 2023-09-13T08:25:44.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.310+0000 7f3b0f5db700 1 -- 172.21.15.84:0/3118251552 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b0815ef60 con 0x7f3b0815b4b0 2023-09-13T08:25:44.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.311+0000 7f3b0f5db700 1 -- 172.21.15.84:0/3118251552 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b0815bf90 con 0x7f3b0815b4b0 2023-09-13T08:25:44.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.311+0000 7f3afdffb700 1 -- 172.21.15.84:0/3118251552 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f3b04021030 con 0x7f3b0815b4b0 2023-09-13T08:25:44.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.311+0000 7f3afdffb700 1 --2- 172.21.15.84:0/3118251552 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f3aec06a5b0 0x7f3aec06ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:44.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.312+0000 7f3b0d377700 1 --2- 172.21.15.84:0/3118251552 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f3aec06a5b0 0x7f3aec06ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:44.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.312+0000 7f3afdffb700 1 -- 172.21.15.84:0/3118251552 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f3b0408a220 con 0x7f3b0815b4b0 2023-09-13T08:25:44.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.312+0000 7f3b0d377700 1 --2- 172.21.15.84:0/3118251552 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f3aec06a5b0 0x7f3aec06ca70 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3af8007fd0 tx=0x7f3af8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:44.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.316+0000 7f3afdffb700 1 -- 172.21.15.84:0/3118251552 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f3b0815bf90 con 0x7f3b0815b4b0 2023-09-13T08:25:44.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.504+0000 7f3b0f5db700 1 -- 172.21.15.84:0/3118251552 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3b0815bf90 con 0x7f3b0815b4b0 2023-09-13T08:25:44.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.505+0000 7f3afdffb700 1 -- 172.21.15.84:0/3118251552 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3b0815bf90 con 0x7f3b0815b4b0 2023-09-13T08:25:44.505 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-09-13T08:25:44.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.507+0000 7f3b0f5db700 1 -- 172.21.15.84:0/3118251552 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f3aec06a5b0 msgr2=0x7f3aec06ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:44.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.507+0000 7f3b0f5db700 1 --2- 172.21.15.84:0/3118251552 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f3aec06a5b0 0x7f3aec06ca70 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3af8007fd0 tx=0x7f3af8009040 comp rx=0 tx=0).stop 2023-09-13T08:25:44.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.507+0000 7f3b0f5db700 1 -- 172.21.15.84:0/3118251552 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b0815b4b0 msgr2=0x7f3b080c5af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:44.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.507+0000 7f3b0f5db700 1 --2- 172.21.15.84:0/3118251552 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b0815b4b0 0x7f3b080c5af0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f3b04013000 tx=0x7f3b04004750 comp rx=0 tx=0).stop 2023-09-13T08:25:44.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.507+0000 7f3b0f5db700 1 -- 172.21.15.84:0/3118251552 shutdown_connections 2023-09-13T08:25:44.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.507+0000 7f3b0f5db700 1 --2- 172.21.15.84:0/3118251552 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f3aec06a5b0 0x7f3aec06ca70 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:44.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.507+0000 7f3b0f5db700 1 --2- 172.21.15.84:0/3118251552 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3b081f0a10 0x7f3b080b44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:44.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.507+0000 7f3b0f5db700 1 --2- 172.21.15.84:0/3118251552 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3b0806a620 0x7f3b080aeaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:44.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.507+0000 7f3b0f5db700 1 --2- 172.21.15.84:0/3118251552 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b0815b4b0 0x7f3b080c5af0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:44.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.507+0000 7f3b0f5db700 1 -- 172.21.15.84:0/3118251552 >> 172.21.15.84:0/3118251552 conn(0x7f3b080cca70 msgr2=0x7f3b080cbc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:44.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.507+0000 7f3b0f5db700 1 -- 172.21.15.84:0/3118251552 shutdown_connections 2023-09-13T08:25:44.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.507+0000 7f3b0f5db700 1 -- 172.21.15.84:0/3118251552 wait complete. 2023-09-13T08:25:44.519 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-13T08:25:44.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.642+0000 7f04d9fe8700 1 Processor -- start 2023-09-13T08:25:44.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.642+0000 7f04d9fe8700 1 -- start start 2023-09-13T08:25:44.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.643+0000 7f04d9fe8700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f04d415e910 0x7f04d40cf570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:44.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.643+0000 7f04d9fe8700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f04d40cd590 0x7f04d40cdbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:44.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.643+0000 7f04d9fe8700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04d415e480 con 0x7f04d40ca8e0 2023-09-13T08:25:44.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.643+0000 7f04d9fe8700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04d40cfbe0 con 0x7f04d415e910 2023-09-13T08:25:44.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.643+0000 7f04d9fe8700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04d415de30 con 0x7f04d40cd590 2023-09-13T08:25:44.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.643+0000 7f04d37fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f04d40ca8e0 0x7f04d40cacc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:47878/0 (socket says 172.21.15.84:47878) 2023-09-13T08:25:44.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.643+0000 7f04d37fe700 1 -- 172.21.15.84:0/3218834580 learned_addr learned my addr 172.21.15.84:0/3218834580 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:25:44.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.643+0000 7f04d2ffd700 1 --2- 172.21.15.84:0/3218834580 >> v2:172.21.15.161:3300/0 conn(0x7f04d415e910 0x7f04d40cf570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:44.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.643+0000 7f04d3fff700 1 --2- 172.21.15.84:0/3218834580 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f04d40cd590 0x7f04d40cdbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:44.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.644+0000 7f04d27fc700 1 -- 172.21.15.84:0/3218834580 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2566055329 0 0) 0x7f04d415e480 con 0x7f04d40ca8e0 2023-09-13T08:25:44.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.644+0000 7f04d27fc700 1 -- 172.21.15.84:0/3218834580 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04bc0035b0 con 0x7f04d40ca8e0 2023-09-13T08:25:44.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.644+0000 7f04d2ffd700 1 -- 172.21.15.84:0/3218834580 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f04d40cd590 msgr2=0x7f04d40cdbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:44.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.644+0000 7f04d27fc700 1 -- 172.21.15.84:0/3218834580 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 98022135 0 0) 0x7f04bc0035b0 con 0x7f04d40ca8e0 2023-09-13T08:25:44.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.644+0000 7f04d2ffd700 1 --2- 172.21.15.84:0/3218834580 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f04d40cd590 0x7f04d40cdbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:44.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.644+0000 7f04d2ffd700 1 -- 172.21.15.84:0/3218834580 >> v1:172.21.15.84:6789/0 conn(0x7f04d40ca8e0 legacy=0x7f04d40cacc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:44.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.644+0000 7f04d2ffd700 1 -- 172.21.15.84:0/3218834580 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04d415e110 con 0x7f04d415e910 2023-09-13T08:25:44.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.644+0000 7f04d3fff700 1 --2- 172.21.15.84:0/3218834580 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f04d40cd590 0x7f04d40cdbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T08:25:44.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.644+0000 7f04d2ffd700 1 --2- 172.21.15.84:0/3218834580 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04d415e910 0x7f04d40cf570 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f04c4009840 tx=0x7f04c4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe292cbc89cf7c7a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:44.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.644+0000 7f04d27fc700 1 -- 172.21.15.84:0/3218834580 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c8001670 con 0x7f04d415e910 2023-09-13T08:25:44.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.644+0000 7f04d27fc700 1 -- 172.21.15.84:0/3218834580 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04c4004030 con 0x7f04d415e910 2023-09-13T08:25:44.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.644+0000 7f04d27fc700 1 -- 172.21.15.84:0/3218834580 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c40043a0 con 0x7f04d415e910 2023-09-13T08:25:44.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.645+0000 7f04d9fe8700 1 -- 172.21.15.84:0/3218834580 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04d415e910 msgr2=0x7f04d40cf570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:44.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.645+0000 7f04d9fe8700 1 --2- 172.21.15.84:0/3218834580 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04d415e910 0x7f04d40cf570 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f04c4009840 tx=0x7f04c4009b50 comp rx=0 tx=0).stop 2023-09-13T08:25:44.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.645+0000 7f04d9fe8700 1 -- 172.21.15.84:0/3218834580 shutdown_connections 2023-09-13T08:25:44.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.645+0000 7f04d9fe8700 1 --2- 172.21.15.84:0/3218834580 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f04d40cd590 0x7f04d40cdbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:44.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.645+0000 7f04d9fe8700 1 --2- 172.21.15.84:0/3218834580 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04d415e910 0x7f04d40cf570 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:44.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.645+0000 7f04d9fe8700 1 -- 172.21.15.84:0/3218834580 >> 172.21.15.84:0/3218834580 conn(0x7f04d40cca70 msgr2=0x7f04d40cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:44.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.645+0000 7f04d9fe8700 1 -- 172.21.15.84:0/3218834580 shutdown_connections 2023-09-13T08:25:44.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.645+0000 7f04d9fe8700 1 -- 172.21.15.84:0/3218834580 wait complete. 2023-09-13T08:25:44.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.646+0000 7f04d9fe8700 1 Processor -- start 2023-09-13T08:25:44.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.646+0000 7f04d9fe8700 1 -- start start 2023-09-13T08:25:44.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.647+0000 7f04d9fe8700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04d40ca8e0 0x7f04d41f25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:44.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.647+0000 7f04d9fe8700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f04d40cd590 0x7f04d40b54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:44.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.647+0000 7f04d9fe8700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04d415e910 0x7f04d41f6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:44.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.647+0000 7f04d9fe8700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04d40b2c50 con 0x7f04d40ca8e0 2023-09-13T08:25:44.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.647+0000 7f04d9fe8700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04d40c4a30 con 0x7f04d415e910 2023-09-13T08:25:44.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.647+0000 7f04d9fe8700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04d40ad4b0 con 0x7f04d40cd590 2023-09-13T08:25:44.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.647+0000 7f04d37fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04d40ca8e0 0x7f04d41f25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:44.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.647+0000 7f04d37fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04d40ca8e0 0x7f04d41f25c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45238/0 (socket says 172.21.15.84:45238) 2023-09-13T08:25:44.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.647+0000 7f04d37fe700 1 -- 172.21.15.84:0/3487893981 learned_addr learned my addr 172.21.15.84:0/3487893981 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:44.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.647+0000 7f04d3fff700 1 --2- 172.21.15.84:0/3487893981 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04d415e910 0x7f04d41f6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:44.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.647+0000 7f04d2ffd700 1 --2- 172.21.15.84:0/3487893981 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f04d40cd590 0x7f04d40b54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:44.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.647+0000 7f04d37fe700 1 -- 172.21.15.84:0/3487893981 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f04d40cd590 msgr2=0x7f04d40b54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:44.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.647+0000 7f04d37fe700 1 --2- 172.21.15.84:0/3487893981 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f04d40cd590 0x7f04d40b54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:44.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.647+0000 7f04d37fe700 1 -- 172.21.15.84:0/3487893981 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04d415e910 msgr2=0x7f04d41f6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:44.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.647+0000 7f04d37fe700 1 --2- 172.21.15.84:0/3487893981 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04d415e910 0x7f04d41f6390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:44.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.647+0000 7f04d37fe700 1 -- 172.21.15.84:0/3487893981 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04cc009a70 con 0x7f04d40ca8e0 2023-09-13T08:25:44.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.647+0000 7f04d3fff700 1 --2- 172.21.15.84:0/3487893981 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04d415e910 0x7f04d41f6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T08:25:44.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.647+0000 7f04d2ffd700 1 --2- 172.21.15.84:0/3487893981 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f04d40cd590 0x7f04d40b54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T08:25:44.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.648+0000 7f04d37fe700 1 --2- 172.21.15.84:0/3487893981 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04d40ca8e0 0x7f04d41f25c0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f04c80011e0 tx=0x7f04c800cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:44.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.648+0000 7f04bbfff700 1 -- 172.21.15.84:0/3487893981 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c8007560 con 0x7f04d40ca8e0 2023-09-13T08:25:44.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.648+0000 7f04bbfff700 1 -- 172.21.15.84:0/3487893981 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04c80076c0 con 0x7f04d40ca8e0 2023-09-13T08:25:44.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.648+0000 7f04bbfff700 1 -- 172.21.15.84:0/3487893981 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c8004a90 con 0x7f04d40ca8e0 2023-09-13T08:25:44.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.648+0000 7f04d9fe8700 1 -- 172.21.15.84:0/3487893981 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04c40094a0 con 0x7f04d40ca8e0 2023-09-13T08:25:44.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.648+0000 7f04d9fe8700 1 -- 172.21.15.84:0/3487893981 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04d40ada70 con 0x7f04d40ca8e0 2023-09-13T08:25:44.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.649+0000 7f04d9fe8700 1 -- 172.21.15.84:0/3487893981 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04d40adc60 con 0x7f04d40ca8e0 2023-09-13T08:25:44.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.649+0000 7f04bbfff700 1 -- 172.21.15.84:0/3487893981 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f04c8004bf0 con 0x7f04d40ca8e0 2023-09-13T08:25:44.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.650+0000 7f04bbfff700 1 --2- 172.21.15.84:0/3487893981 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f04c006a580 0x7f04c006ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:44.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.650+0000 7f04bbfff700 1 -- 172.21.15.84:0/3487893981 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f04c8087f40 con 0x7f04d40ca8e0 2023-09-13T08:25:44.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.650+0000 7f04d2ffd700 1 --2- 172.21.15.84:0/3487893981 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f04c006a580 0x7f04c006ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:44.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.650+0000 7f04d2ffd700 1 --2- 172.21.15.84:0/3487893981 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f04c006a580 0x7f04c006ca40 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f04c4009840 tx=0x7f04c4013040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:44.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.654+0000 7f04bbfff700 1 -- 172.21.15.84:0/3487893981 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f04d40adc60 con 0x7f04d40ca8e0 2023-09-13T08:25:44.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.844+0000 7f04d9fe8700 1 -- 172.21.15.84:0/3487893981 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f04d40adc60 con 0x7f04d40ca8e0 2023-09-13T08:25:44.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.845+0000 7f04bbfff700 1 -- 172.21.15.84:0/3487893981 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f04d40adc60 con 0x7f04d40ca8e0 2023-09-13T08:25:44.845 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-09-13T08:25:44.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.847+0000 7f04d9fe8700 1 -- 172.21.15.84:0/3487893981 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f04c006a580 msgr2=0x7f04c006ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:44.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.847+0000 7f04d9fe8700 1 --2- 172.21.15.84:0/3487893981 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f04c006a580 0x7f04c006ca40 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f04c4009840 tx=0x7f04c4013040 comp rx=0 tx=0).stop 2023-09-13T08:25:44.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.847+0000 7f04d9fe8700 1 -- 172.21.15.84:0/3487893981 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04d40ca8e0 msgr2=0x7f04d41f25c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:44.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.847+0000 7f04d9fe8700 1 --2- 172.21.15.84:0/3487893981 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04d40ca8e0 0x7f04d41f25c0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f04c80011e0 tx=0x7f04c800cb00 comp rx=0 tx=0).stop 2023-09-13T08:25:44.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.847+0000 7f04d9fe8700 1 -- 172.21.15.84:0/3487893981 shutdown_connections 2023-09-13T08:25:44.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.847+0000 7f04d9fe8700 1 --2- 172.21.15.84:0/3487893981 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f04c006a580 0x7f04c006ca40 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:44.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.847+0000 7f04d9fe8700 1 --2- 172.21.15.84:0/3487893981 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04d415e910 0x7f04d41f6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:44.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.847+0000 7f04d9fe8700 1 --2- 172.21.15.84:0/3487893981 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04d40ca8e0 0x7f04d41f25c0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:44.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.847+0000 7f04d9fe8700 1 --2- 172.21.15.84:0/3487893981 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f04d40cd590 0x7f04d40b54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:44.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.847+0000 7f04d9fe8700 1 -- 172.21.15.84:0/3487893981 >> 172.21.15.84:0/3487893981 conn(0x7f04d40cca70 msgr2=0x7f04d406d620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:44.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.847+0000 7f04d9fe8700 1 -- 172.21.15.84:0/3487893981 shutdown_connections 2023-09-13T08:25:44.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.847+0000 7f04d9fe8700 1 -- 172.21.15.84:0/3487893981 wait complete. 2023-09-13T08:25:44.859 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-09-13T08:25:44.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.983+0000 7fb344a5f700 1 Processor -- start 2023-09-13T08:25:44.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.983+0000 7fb344a5f700 1 -- start start 2023-09-13T08:25:44.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.984+0000 7fb344a5f700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb34015b4b0 0x7fb3400ca640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:44.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.984+0000 7fb344a5f700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb34006a620 0x7fb34006aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:44.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.984+0000 7fb344a5f700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb34006afb0 con 0x7fb34006f700 2023-09-13T08:25:44.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.984+0000 7fb344a5f700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3400cc460 con 0x7fb34015b4b0 2023-09-13T08:25:44.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.984+0000 7fb344a5f700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3400cacb0 con 0x7fb34006a620 2023-09-13T08:25:44.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.984+0000 7fb33e59c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb34015b4b0 0x7fb3400ca640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:44.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.984+0000 7fb33e59c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb34015b4b0 0x7fb3400ca640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45246/0 (socket says 172.21.15.84:45246) 2023-09-13T08:25:44.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.984+0000 7fb33e59c700 1 -- 172.21.15.84:0/1890880574 learned_addr learned my addr 172.21.15.84:0/1890880574 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:44.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.984+0000 7fb33e59c700 1 -- 172.21.15.84:0/1890880574 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb34006a620 msgr2=0x7fb34006aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:44.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.984+0000 7fb33ed9d700 1 --2- 172.21.15.84:0/1890880574 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb34006a620 0x7fb34006aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:44.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.984+0000 7fb33e59c700 1 --2- 172.21.15.84:0/1890880574 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb34006a620 0x7fb34006aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:44.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.984+0000 7fb33e59c700 1 -- 172.21.15.84:0/1890880574 >> v1:172.21.15.161:6789/0 conn(0x7fb34006f700 legacy=0x7fb3400cbd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:44.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.984+0000 7fb33e59c700 1 -- 172.21.15.84:0/1890880574 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3400caf90 con 0x7fb34015b4b0 2023-09-13T08:25:44.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.984+0000 7fb33e59c700 1 --2- 172.21.15.84:0/1890880574 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb34015b4b0 0x7fb3400ca640 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fb3300098f0 tx=0x7fb330009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e3e8b839f7afbf6 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:44.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.985+0000 7fb33d59a700 1 -- 172.21.15.84:0/1890880574 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb330004230 con 0x7fb34015b4b0 2023-09-13T08:25:44.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.985+0000 7fb33d59a700 1 -- 172.21.15.84:0/1890880574 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb330004390 con 0x7fb34015b4b0 2023-09-13T08:25:44.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.985+0000 7fb33d59a700 1 -- 172.21.15.84:0/1890880574 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3300036a0 con 0x7fb34015b4b0 2023-09-13T08:25:44.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.985+0000 7fb344a5f700 1 -- 172.21.15.84:0/1890880574 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb34015b4b0 msgr2=0x7fb3400ca640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:44.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.985+0000 7fb344a5f700 1 --2- 172.21.15.84:0/1890880574 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb34015b4b0 0x7fb3400ca640 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fb3300098f0 tx=0x7fb330009c00 comp rx=0 tx=0).stop 2023-09-13T08:25:44.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.985+0000 7fb344a5f700 1 -- 172.21.15.84:0/1890880574 shutdown_connections 2023-09-13T08:25:44.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.985+0000 7fb344a5f700 1 --2- 172.21.15.84:0/1890880574 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb34015b4b0 0x7fb3400ca640 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:44.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.985+0000 7fb344a5f700 1 --2- 172.21.15.84:0/1890880574 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb34006a620 0x7fb34006aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:44.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.985+0000 7fb344a5f700 1 -- 172.21.15.84:0/1890880574 >> 172.21.15.84:0/1890880574 conn(0x7fb3400cca70 msgr2=0x7fb3400cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:44.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.985+0000 7fb344a5f700 1 -- 172.21.15.84:0/1890880574 shutdown_connections 2023-09-13T08:25:44.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.985+0000 7fb344a5f700 1 -- 172.21.15.84:0/1890880574 wait complete. 2023-09-13T08:25:44.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.987+0000 7fb344a5f700 1 Processor -- start 2023-09-13T08:25:44.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.987+0000 7fb344a5f700 1 -- start start 2023-09-13T08:25:44.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.987+0000 7fb344a5f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb34006a620 0x7fb3400c6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:44.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.987+0000 7fb344a5f700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb34006f700 0x7fb3400c6760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:44.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.987+0000 7fb344a5f700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb34015b4b0 0x7fb3401f0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:44.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.987+0000 7fb344a5f700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb340152270 con 0x7fb34006a620 2023-09-13T08:25:44.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.987+0000 7fb344a5f700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb340152700 con 0x7fb34015b4b0 2023-09-13T08:25:44.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.987+0000 7fb344a5f700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb340151660 con 0x7fb34006f700 2023-09-13T08:25:44.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.987+0000 7fb33e59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb34006a620 0x7fb3400c6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:44.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.987+0000 7fb33e59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb34006a620 0x7fb3400c6220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45252/0 (socket says 172.21.15.84:45252) 2023-09-13T08:25:44.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.987+0000 7fb33e59c700 1 -- 172.21.15.84:0/2180811599 learned_addr learned my addr 172.21.15.84:0/2180811599 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:44.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.988+0000 7fb33dd9b700 1 --2- 172.21.15.84:0/2180811599 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb34006f700 0x7fb3400c6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:44.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.988+0000 7fb33e59c700 1 -- 172.21.15.84:0/2180811599 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb34006f700 msgr2=0x7fb3400c6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:44.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.988+0000 7fb33e59c700 1 --2- 172.21.15.84:0/2180811599 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb34006f700 0x7fb3400c6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:44.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.988+0000 7fb33ed9d700 1 --2- 172.21.15.84:0/2180811599 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb34015b4b0 0x7fb3401f0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:45.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.988+0000 7fb33e59c700 1 -- 172.21.15.84:0/2180811599 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb34015b4b0 msgr2=0x7fb3401f0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:45.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.988+0000 7fb33e59c700 1 --2- 172.21.15.84:0/2180811599 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb34015b4b0 0x7fb3401f0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:45.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.988+0000 7fb33e59c700 1 -- 172.21.15.84:0/2180811599 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb330009550 con 0x7fb34006a620 2023-09-13T08:25:45.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.988+0000 7fb33dd9b700 1 --2- 172.21.15.84:0/2180811599 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb34006f700 0x7fb3400c6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T08:25:45.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.988+0000 7fb33ed9d700 1 --2- 172.21.15.84:0/2180811599 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb34015b4b0 0x7fb3401f0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T08:25:45.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.988+0000 7fb33e59c700 1 --2- 172.21.15.84:0/2180811599 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb34006a620 0x7fb3400c6220 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fb330009130 tx=0x7fb330004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:45.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.988+0000 7fb32effd700 1 -- 172.21.15.84:0/2180811599 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb33000b860 con 0x7fb34006a620 2023-09-13T08:25:45.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.988+0000 7fb32effd700 1 -- 172.21.15.84:0/2180811599 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb33000b9c0 con 0x7fb34006a620 2023-09-13T08:25:45.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.988+0000 7fb32effd700 1 -- 172.21.15.84:0/2180811599 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb33000bd70 con 0x7fb34006a620 2023-09-13T08:25:45.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.988+0000 7fb344a5f700 1 -- 172.21.15.84:0/2180811599 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb340151940 con 0x7fb34006a620 2023-09-13T08:25:45.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.988+0000 7fb344a5f700 1 -- 172.21.15.84:0/2180811599 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb340151f00 con 0x7fb34006a620 2023-09-13T08:25:45.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.989+0000 7fb344a5f700 1 -- 172.21.15.84:0/2180811599 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb34004f200 con 0x7fb34006a620 2023-09-13T08:25:45.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.989+0000 7fb32effd700 1 -- 172.21.15.84:0/2180811599 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fb33001b440 con 0x7fb34006a620 2023-09-13T08:25:45.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.990+0000 7fb32effd700 1 --2- 172.21.15.84:0/2180811599 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fb32006a580 0x7fb32006ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:45.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.990+0000 7fb32effd700 1 -- 172.21.15.84:0/2180811599 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fb33008a600 con 0x7fb34006a620 2023-09-13T08:25:45.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.990+0000 7fb33dd9b700 1 --2- 172.21.15.84:0/2180811599 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fb32006a580 0x7fb32006ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:45.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.990+0000 7fb33dd9b700 1 --2- 172.21.15.84:0/2180811599 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fb32006a580 0x7fb32006ca40 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb3400af980 tx=0x7fb334009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:45.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:44.994+0000 7fb32effd700 1 -- 172.21.15.84:0/2180811599 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fb330055830 con 0x7fb34006a620 2023-09-13T08:25:45.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.185+0000 7fb344a5f700 1 -- 172.21.15.84:0/2180811599 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fb34006afb0 con 0x7fb34006a620 2023-09-13T08:25:45.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.185+0000 7fb32effd700 1 -- 172.21.15.84:0/2180811599 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fb34006afb0 con 0x7fb34006a620 2023-09-13T08:25:45.186 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-09-13T08:25:45.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.187+0000 7fb344a5f700 1 -- 172.21.15.84:0/2180811599 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fb32006a580 msgr2=0x7fb32006ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:45.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.187+0000 7fb344a5f700 1 --2- 172.21.15.84:0/2180811599 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fb32006a580 0x7fb32006ca40 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb3400af980 tx=0x7fb334009040 comp rx=0 tx=0).stop 2023-09-13T08:25:45.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.187+0000 7fb344a5f700 1 -- 172.21.15.84:0/2180811599 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb34006a620 msgr2=0x7fb3400c6220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:45.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.187+0000 7fb344a5f700 1 --2- 172.21.15.84:0/2180811599 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb34006a620 0x7fb3400c6220 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fb330009130 tx=0x7fb330004750 comp rx=0 tx=0).stop 2023-09-13T08:25:45.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.187+0000 7fb344a5f700 1 -- 172.21.15.84:0/2180811599 shutdown_connections 2023-09-13T08:25:45.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.187+0000 7fb344a5f700 1 --2- 172.21.15.84:0/2180811599 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fb32006a580 0x7fb32006ca40 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:45.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.187+0000 7fb344a5f700 1 --2- 172.21.15.84:0/2180811599 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb34015b4b0 0x7fb3401f0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:45.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.187+0000 7fb344a5f700 1 --2- 172.21.15.84:0/2180811599 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb34006a620 0x7fb3400c6220 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:45.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.187+0000 7fb344a5f700 1 --2- 172.21.15.84:0/2180811599 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb34006f700 0x7fb3400c6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:45.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.187+0000 7fb344a5f700 1 -- 172.21.15.84:0/2180811599 >> 172.21.15.84:0/2180811599 conn(0x7fb3400cca70 msgr2=0x7fb3400cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:45.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.187+0000 7fb344a5f700 1 -- 172.21.15.84:0/2180811599 shutdown_connections 2023-09-13T08:25:45.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.187+0000 7fb344a5f700 1 -- 172.21.15.84:0/2180811599 wait complete. 2023-09-13T08:25:45.199 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-09-13T08:25:45.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.320+0000 7f2479ca0700 1 Processor -- start 2023-09-13T08:25:45.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.320+0000 7f2479ca0700 1 -- start start 2023-09-13T08:25:45.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.321+0000 7f2479ca0700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f24740d1ce0 0x7f24740cf4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:45.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.321+0000 7f2479ca0700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f24740b0630 0x7f24740ae160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:45.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.321+0000 7f2479ca0700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f247415b940 con 0x7f247415b560 2023-09-13T08:25:45.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.321+0000 7f2479ca0700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24740d2170 con 0x7f24740d1ce0 2023-09-13T08:25:45.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.321+0000 7f2479ca0700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24740cc980 con 0x7f24740b0630 2023-09-13T08:25:45.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.321+0000 7f24737fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f247415b560 0x7f24740ced90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:47906/0 (socket says 172.21.15.84:47906) 2023-09-13T08:25:45.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.321+0000 7f24737fe700 1 -- 172.21.15.84:0/1935253125 learned_addr learned my addr 172.21.15.84:0/1935253125 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:25:45.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.321+0000 7f2472ffd700 1 --2- 172.21.15.84:0/1935253125 >> v2:172.21.15.161:3300/0 conn(0x7f24740d1ce0 0x7f24740cf4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:45.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.321+0000 7f2473fff700 1 --2- 172.21.15.84:0/1935253125 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f24740b0630 0x7f24740ae160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:45.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.322+0000 7f24727fc700 1 -- 172.21.15.84:0/1935253125 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4116168309 0 0) 0x7f247415b940 con 0x7f247415b560 2023-09-13T08:25:45.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.322+0000 7f24727fc700 1 -- 172.21.15.84:0/1935253125 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f245c0035b0 con 0x7f247415b560 2023-09-13T08:25:45.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.322+0000 7f24727fc700 1 -- 172.21.15.84:0/1935253125 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 419186238 0 0) 0x7f245c0035b0 con 0x7f247415b560 2023-09-13T08:25:45.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.322+0000 7f24727fc700 1 -- 172.21.15.84:0/1935253125 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f24740b0630 msgr2=0x7f24740ae160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:45.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.322+0000 7f24727fc700 1 --2- 172.21.15.84:0/1935253125 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f24740b0630 0x7f24740ae160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:45.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.322+0000 7f24727fc700 1 -- 172.21.15.84:0/1935253125 >> v2:172.21.15.161:3300/0 conn(0x7f24740d1ce0 msgr2=0x7f24740cf4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:45.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.322+0000 7f24727fc700 1 --2- 172.21.15.84:0/1935253125 >> v2:172.21.15.161:3300/0 conn(0x7f24740d1ce0 0x7f24740cf4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:45.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.322+0000 7f24727fc700 1 -- 172.21.15.84:0/1935253125 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24740ccc20 con 0x7f247415b560 2023-09-13T08:25:45.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.322+0000 7f24727fc700 1 -- 172.21.15.84:0/1935253125 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2302733408 0 0) 0x7f2468001670 con 0x7f247415b560 2023-09-13T08:25:45.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.322+0000 7f24727fc700 1 -- 172.21.15.84:0/1935253125 >> v1:172.21.15.84:6789/0 conn(0x7f247415b560 legacy=0x7f24740ced90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:45.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.322+0000 7f24727fc700 1 --2- 172.21.15.84:0/1935253125 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f24740b0630 0x7f245c003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:45.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.322+0000 7f24727fc700 1 --2- 172.21.15.84:0/1935253125 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f245c003f80 0x7f245c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:45.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.322+0000 7f24727fc700 1 --2- 172.21.15.84:0/1935253125 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f245c004d90 0x7f245c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:45.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.322+0000 7f24727fc700 1 -- 172.21.15.84:0/1935253125 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24740d2170 con 0x7f245c003f80 2023-09-13T08:25:45.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.322+0000 7f24727fc700 1 -- 172.21.15.84:0/1935253125 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24740cc980 con 0x7f245c004d90 2023-09-13T08:25:45.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.322+0000 7f24727fc700 1 -- 172.21.15.84:0/1935253125 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f245c00ba60 con 0x7f24740b0630 2023-09-13T08:25:45.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.322+0000 7f2472ffd700 1 --2- 172.21.15.84:0/1935253125 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f245c003f80 0x7f245c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:45.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.322+0000 7f2473fff700 1 --2- 172.21.15.84:0/1935253125 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f245c004d90 0x7f245c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:45.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.322+0000 7f24737fe700 1 --2- 172.21.15.84:0/1935253125 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f24740b0630 0x7f245c003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:45.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.322+0000 7f2472ffd700 1 -- 172.21.15.84:0/1935253125 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f24740b0630 msgr2=0x7f245c003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:45.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.322+0000 7f2472ffd700 1 --2- 172.21.15.84:0/1935253125 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f24740b0630 0x7f245c003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:45.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.322+0000 7f2472ffd700 1 -- 172.21.15.84:0/1935253125 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f245c004d90 msgr2=0x7f245c005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:45.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.322+0000 7f2472ffd700 1 --2- 172.21.15.84:0/1935253125 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f245c004d90 0x7f245c005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:45.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.322+0000 7f2472ffd700 1 -- 172.21.15.84:0/1935253125 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f245c0035b0 con 0x7f245c003f80 2023-09-13T08:25:45.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.323+0000 7f2472ffd700 1 --2- 172.21.15.84:0/1935253125 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f245c003f80 0x7f245c004850 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f2464009b90 tx=0x7f245c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af93fc92fb08fcc8 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:45.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.323+0000 7f24727fc700 1 -- 172.21.15.84:0/1935253125 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f246400e6c0 con 0x7f245c003f80 2023-09-13T08:25:45.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.323+0000 7f24727fc700 1 -- 172.21.15.84:0/1935253125 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f246400e820 con 0x7f245c003f80 2023-09-13T08:25:45.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.323+0000 7f24727fc700 1 -- 172.21.15.84:0/1935253125 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f246400eb90 con 0x7f245c003f80 2023-09-13T08:25:45.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.323+0000 7f2479ca0700 1 -- 172.21.15.84:0/1935253125 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f245c003f80 msgr2=0x7f245c004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:45.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.323+0000 7f2479ca0700 1 --2- 172.21.15.84:0/1935253125 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f245c003f80 0x7f245c004850 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f2464009b90 tx=0x7f245c005880 comp rx=0 tx=0).stop 2023-09-13T08:25:45.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.323+0000 7f2473fff700 1 -- 172.21.15.84:0/1935253125 reap_dead start 2023-09-13T08:25:45.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.323+0000 7f2479ca0700 1 -- 172.21.15.84:0/1935253125 shutdown_connections 2023-09-13T08:25:45.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.323+0000 7f2479ca0700 1 -- 172.21.15.84:0/1935253125 >> 172.21.15.84:0/1935253125 conn(0x7f24740d11c0 msgr2=0x7f24740d15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:45.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.323+0000 7f2479ca0700 1 -- 172.21.15.84:0/1935253125 shutdown_connections 2023-09-13T08:25:45.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.323+0000 7f2479ca0700 1 -- 172.21.15.84:0/1935253125 wait complete. 2023-09-13T08:25:45.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.324+0000 7f2479ca0700 1 Processor -- start 2023-09-13T08:25:45.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.325+0000 7f2479ca0700 1 -- start start 2023-09-13T08:25:45.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.325+0000 7f2479ca0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f245c003f80 0x7f24741f23f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:45.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.325+0000 7f2479ca0700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2474158980 0x7f24740ca270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:45.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.325+0000 7f2479ca0700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f24740ca7b0 0x7f247406b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:45.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.325+0000 7f2479ca0700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24740cac30 con 0x7f245c003f80 2023-09-13T08:25:45.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.325+0000 7f2479ca0700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24740c6e80 con 0x7f24740ca7b0 2023-09-13T08:25:45.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.325+0000 7f2479ca0700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24740c7160 con 0x7f2474158980 2023-09-13T08:25:45.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.325+0000 7f24737fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f245c003f80 0x7f24741f23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:45.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.325+0000 7f24737fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f245c003f80 0x7f24741f23f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45276/0 (socket says 172.21.15.84:45276) 2023-09-13T08:25:45.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.325+0000 7f24737fe700 1 -- 172.21.15.84:0/3244714604 learned_addr learned my addr 172.21.15.84:0/3244714604 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:45.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.326+0000 7f2472ffd700 1 --2- 172.21.15.84:0/3244714604 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2474158980 0x7f24740ca270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:45.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.326+0000 7f2473fff700 1 --2- 172.21.15.84:0/3244714604 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f24740ca7b0 0x7f247406b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:45.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.326+0000 7f24737fe700 1 -- 172.21.15.84:0/3244714604 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2474158980 msgr2=0x7f24740ca270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:45.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.326+0000 7f24737fe700 1 --2- 172.21.15.84:0/3244714604 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2474158980 0x7f24740ca270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:45.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.326+0000 7f24737fe700 1 -- 172.21.15.84:0/3244714604 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f24740ca7b0 msgr2=0x7f247406b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:45.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.326+0000 7f24737fe700 1 --2- 172.21.15.84:0/3244714604 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f24740ca7b0 0x7f247406b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:45.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.326+0000 7f24737fe700 1 -- 172.21.15.84:0/3244714604 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24740c7440 con 0x7f245c003f80 2023-09-13T08:25:45.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.326+0000 7f24737fe700 1 --2- 172.21.15.84:0/3244714604 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f245c003f80 0x7f24741f23f0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f2468000c00 tx=0x7f246800ead0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:45.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.326+0000 7f245bfff700 1 -- 172.21.15.84:0/3244714604 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2468012590 con 0x7f245c003f80 2023-09-13T08:25:45.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.326+0000 7f245bfff700 1 -- 172.21.15.84:0/3244714604 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2468012730 con 0x7f245c003f80 2023-09-13T08:25:45.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.326+0000 7f245bfff700 1 -- 172.21.15.84:0/3244714604 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2468012ae0 con 0x7f245c003f80 2023-09-13T08:25:45.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.326+0000 7f2479ca0700 1 -- 172.21.15.84:0/3244714604 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24740c7720 con 0x7f245c003f80 2023-09-13T08:25:45.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.326+0000 7f2479ca0700 1 -- 172.21.15.84:0/3244714604 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24740cafc0 con 0x7f245c003f80 2023-09-13T08:25:45.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.327+0000 7f2479ca0700 1 -- 172.21.15.84:0/3244714604 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f247404e9b0 con 0x7f245c003f80 2023-09-13T08:25:45.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.327+0000 7f245bfff700 1 -- 172.21.15.84:0/3244714604 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f2468012c40 con 0x7f245c003f80 2023-09-13T08:25:45.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.328+0000 7f245bfff700 1 --2- 172.21.15.84:0/3244714604 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f246006a580 0x7f246006ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:45.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.328+0000 7f245bfff700 1 -- 172.21.15.84:0/3244714604 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f2468088b60 con 0x7f245c003f80 2023-09-13T08:25:45.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.328+0000 7f2472ffd700 1 --2- 172.21.15.84:0/3244714604 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f246006a580 0x7f246006ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:45.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.328+0000 7f2472ffd700 1 --2- 172.21.15.84:0/3244714604 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f246006a580 0x7f246006ca40 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f24640090b0 tx=0x7f246401f040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:45.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.332+0000 7f245bfff700 1 -- 172.21.15.84:0/3244714604 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f2468053d00 con 0x7f245c003f80 2023-09-13T08:25:45.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.536+0000 7f2479ca0700 1 -- 172.21.15.84:0/3244714604 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f24740cd6a0 con 0x7f245c003f80 2023-09-13T08:25:45.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.536+0000 7f245bfff700 1 -- 172.21.15.84:0/3244714604 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f2468057320 con 0x7f245c003f80 2023-09-13T08:25:45.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.538+0000 7f2479ca0700 1 -- 172.21.15.84:0/3244714604 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f246006a580 msgr2=0x7f246006ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:45.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.538+0000 7f2479ca0700 1 --2- 172.21.15.84:0/3244714604 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f246006a580 0x7f246006ca40 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f24640090b0 tx=0x7f246401f040 comp rx=0 tx=0).stop 2023-09-13T08:25:45.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.538+0000 7f2479ca0700 1 -- 172.21.15.84:0/3244714604 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f245c003f80 msgr2=0x7f24741f23f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:45.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.538+0000 7f2479ca0700 1 --2- 172.21.15.84:0/3244714604 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f245c003f80 0x7f24741f23f0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f2468000c00 tx=0x7f246800ead0 comp rx=0 tx=0).stop 2023-09-13T08:25:45.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.538+0000 7f2479ca0700 1 -- 172.21.15.84:0/3244714604 shutdown_connections 2023-09-13T08:25:45.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.538+0000 7f2479ca0700 1 --2- 172.21.15.84:0/3244714604 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f246006a580 0x7f246006ca40 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:45.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.538+0000 7f2479ca0700 1 --2- 172.21.15.84:0/3244714604 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f24740ca7b0 0x7f247406b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:45.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.538+0000 7f2479ca0700 1 --2- 172.21.15.84:0/3244714604 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f245c003f80 0x7f24741f23f0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:45.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.538+0000 7f2479ca0700 1 --2- 172.21.15.84:0/3244714604 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2474158980 0x7f24740ca270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:45.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.538+0000 7f2479ca0700 1 -- 172.21.15.84:0/3244714604 >> 172.21.15.84:0/3244714604 conn(0x7f24740d11c0 msgr2=0x7f247415a730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:45.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.538+0000 7f2479ca0700 1 -- 172.21.15.84:0/3244714604 shutdown_connections 2023-09-13T08:25:45.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.539+0000 7f2479ca0700 1 -- 172.21.15.84:0/3244714604 wait complete. 2023-09-13T08:25:45.541 INFO:teuthology.orchestra.run.smithi084.stderr:listed 0 entries 2023-09-13T08:25:45.551 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-09-13T08:25:45.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:25:45.552 DEBUG:teuthology.orchestra.run.smithi161:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-09-13T08:25:45.599 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi161.front.sepia.ceph.com 2023-09-13T08:25:45.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:25:45.600 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-09-13T08:25:45.619 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-09-13T08:25:45.620 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T08:25:45.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.740+0000 7f99094d7700 1 Processor -- start 2023-09-13T08:25:45.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.740+0000 7f99094d7700 1 -- start start 2023-09-13T08:25:45.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.740+0000 7f99094d7700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f99040709d0 0x7f99040b1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:45.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.740+0000 7f99094d7700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f990415b690 con 0x7f990415b2b0 2023-09-13T08:25:45.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.740+0000 7f99094d7700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f990406c980 con 0x7f990406c4f0 2023-09-13T08:25:45.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.740+0000 7f99094d7700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f990406cc60 con 0x7f99040709d0 2023-09-13T08:25:45.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.740+0000 7f99037fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f99040709d0 0x7f99040b1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:45.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.741+0000 7f99037fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f99040709d0 0x7f99040b1d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45284/0 (socket says 172.21.15.84:45284) 2023-09-13T08:25:45.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.741+0000 7f99037fe700 1 -- 172.21.15.84:0/1142681464 learned_addr learned my addr 172.21.15.84:0/1142681464 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:45.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.741+0000 7f99037fe700 1 -- 172.21.15.84:0/1142681464 >> v1:172.21.15.161:6789/0 conn(0x7f990406c4f0 legacy=0x7f99040702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:45.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.741+0000 7f99037fe700 1 -- 172.21.15.84:0/1142681464 >> v1:172.21.15.84:6789/0 conn(0x7f990415b2b0 legacy=0x7f9904072160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:45.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.741+0000 7f99037fe700 1 -- 172.21.15.84:0/1142681464 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f990406cf40 con 0x7f99040709d0 2023-09-13T08:25:45.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.741+0000 7f99037fe700 1 --2- 172.21.15.84:0/1142681464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99040709d0 0x7f99040b1d60 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f98fc009e50 tx=0x7f98fc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d71b4e2ba6e889db server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:45.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.741+0000 7f9901ffb700 1 -- 172.21.15.84:0/1142681464 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98fc00e070 con 0x7f99040709d0 2023-09-13T08:25:45.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.741+0000 7f9901ffb700 1 -- 172.21.15.84:0/1142681464 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98fc003a20 con 0x7f99040709d0 2023-09-13T08:25:45.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.741+0000 7f9901ffb700 1 -- 172.21.15.84:0/1142681464 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98fc003dd0 con 0x7f99040709d0 2023-09-13T08:25:45.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.742+0000 7f99094d7700 1 -- 172.21.15.84:0/1142681464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99040709d0 msgr2=0x7f99040b1d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:45.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.742+0000 7f99094d7700 1 --2- 172.21.15.84:0/1142681464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99040709d0 0x7f99040b1d60 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f98fc009e50 tx=0x7f98fc00b330 comp rx=0 tx=0).stop 2023-09-13T08:25:45.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.742+0000 7f99094d7700 1 -- 172.21.15.84:0/1142681464 shutdown_connections 2023-09-13T08:25:45.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.742+0000 7f99094d7700 1 --2- 172.21.15.84:0/1142681464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99040709d0 0x7f99040b1d60 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:45.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.742+0000 7f99094d7700 1 -- 172.21.15.84:0/1142681464 >> 172.21.15.84:0/1142681464 conn(0x7f99040b0a20 msgr2=0x7f99040b0e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:45.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.742+0000 7f99094d7700 1 -- 172.21.15.84:0/1142681464 shutdown_connections 2023-09-13T08:25:45.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.742+0000 7f99094d7700 1 -- 172.21.15.84:0/1142681464 wait complete. 2023-09-13T08:25:45.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.743+0000 7f99094d7700 1 Processor -- start 2023-09-13T08:25:45.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.743+0000 7f99094d7700 1 -- start start 2023-09-13T08:25:45.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.744+0000 7f99094d7700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f99040709d0 0x7f9904154600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:45.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.744+0000 7f99094d7700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f990415b2b0 0x7f99040c4870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:45.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.744+0000 7f99094d7700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99040c4db0 0x7f99040c2a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:45.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.744+0000 7f99094d7700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99040c4090 con 0x7f990415b2b0 2023-09-13T08:25:45.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.744+0000 7f99094d7700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99040c5210 con 0x7f99040c4db0 2023-09-13T08:25:45.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.744+0000 7f99094d7700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99040c5410 con 0x7f99040709d0 2023-09-13T08:25:45.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.744+0000 7f99027fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f990415b2b0 0x7f99040c4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:45.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.744+0000 7f99027fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f990415b2b0 0x7f99040c4870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45288/0 (socket says 172.21.15.84:45288) 2023-09-13T08:25:45.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.744+0000 7f99027fc700 1 -- 172.21.15.84:0/560067214 learned_addr learned my addr 172.21.15.84:0/560067214 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:45.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.744+0000 7f99037fe700 1 --2- 172.21.15.84:0/560067214 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99040c4db0 0x7f99040c2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:45.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.744+0000 7f9902ffd700 1 --2- 172.21.15.84:0/560067214 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f99040709d0 0x7f9904154600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:45.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.744+0000 7f99027fc700 1 -- 172.21.15.84:0/560067214 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f99040709d0 msgr2=0x7f9904154600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:45.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.744+0000 7f99027fc700 1 --2- 172.21.15.84:0/560067214 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f99040709d0 0x7f9904154600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:45.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.744+0000 7f99027fc700 1 -- 172.21.15.84:0/560067214 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99040c4db0 msgr2=0x7f99040c2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:45.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.744+0000 7f99027fc700 1 --2- 172.21.15.84:0/560067214 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99040c4db0 0x7f99040c2a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:45.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.744+0000 7f99027fc700 1 -- 172.21.15.84:0/560067214 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98fc009b30 con 0x7f990415b2b0 2023-09-13T08:25:45.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.744+0000 7f99037fe700 1 --2- 172.21.15.84:0/560067214 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99040c4db0 0x7f99040c2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T08:25:45.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.744+0000 7f99027fc700 1 --2- 172.21.15.84:0/560067214 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f990415b2b0 0x7f99040c4870 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f98f800c4a0 tx=0x7f98f800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:45.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.744+0000 7f98eb7fe700 1 -- 172.21.15.84:0/560067214 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f8011790 con 0x7f990415b2b0 2023-09-13T08:25:45.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.744+0000 7f98eb7fe700 1 -- 172.21.15.84:0/560067214 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98f80118f0 con 0x7f990415b2b0 2023-09-13T08:25:45.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.744+0000 7f99094d7700 1 -- 172.21.15.84:0/560067214 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99040c56f0 con 0x7f990415b2b0 2023-09-13T08:25:45.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.745+0000 7f98eb7fe700 1 -- 172.21.15.84:0/560067214 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f8011ca0 con 0x7f990415b2b0 2023-09-13T08:25:45.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.745+0000 7f99094d7700 1 -- 172.21.15.84:0/560067214 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99040c5cb0 con 0x7f990415b2b0 2023-09-13T08:25:45.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.745+0000 7f99094d7700 1 -- 172.21.15.84:0/560067214 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f990404e9b0 con 0x7f990415b2b0 2023-09-13T08:25:45.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.746+0000 7f98eb7fe700 1 -- 172.21.15.84:0/560067214 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f98f801c460 con 0x7f990415b2b0 2023-09-13T08:25:45.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.746+0000 7f98eb7fe700 1 --2- 172.21.15.84:0/560067214 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f98f006a580 0x7f98f006ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:45.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.746+0000 7f98eb7fe700 1 -- 172.21.15.84:0/560067214 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f98f8088be0 con 0x7f990415b2b0 2023-09-13T08:25:45.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.746+0000 7f9902ffd700 1 --2- 172.21.15.84:0/560067214 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f98f006a580 0x7f98f006ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:45.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.747+0000 7f9902ffd700 1 --2- 172.21.15.84:0/560067214 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f98f006a580 0x7f98f006ca40 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f98f4001620 tx=0x7f98f4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:45.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.751+0000 7f98eb7fe700 1 -- 172.21.15.84:0/560067214 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f98f8053e10 con 0x7f990415b2b0 2023-09-13T08:25:45.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.985+0000 7f99094d7700 1 -- 172.21.15.84:0/560067214 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f990415cee0 con 0x7f990415b2b0 2023-09-13T08:25:45.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.985+0000 7f98eb7fe700 1 -- 172.21.15.84:0/560067214 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4909 (secure 0 0 0) 0x7f98f8057430 con 0x7f990415b2b0 2023-09-13T08:25:45.986 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:25:45.986 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/3581118217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6833","nonce":3581118217},{"type":"v1","addr":"172.21.15.161:6835","nonce":3581118217}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4296,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/566416855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":566416855},{"type":"v1","addr":"172.21.15.84:6835","nonce":566416855}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4299,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/482729238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":482729238},{"type":"v1","addr":"172.21.15.84:6837","nonce":482729238}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T08:24:42.132788+0000","modified":"2023-09-13T08:25:05.211766+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4314},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4314":{"gid":4314,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.161:6834/2524298549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":2524298549},{"type":"v1","addr":"172.21.15.161:6834","nonce":2524298549}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-13T08:25:45.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.987+0000 7f99094d7700 1 -- 172.21.15.84:0/560067214 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f98f006a580 msgr2=0x7f98f006ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:45.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.987+0000 7f99094d7700 1 --2- 172.21.15.84:0/560067214 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f98f006a580 0x7f98f006ca40 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f98f4001620 tx=0x7f98f4009040 comp rx=0 tx=0).stop 2023-09-13T08:25:45.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.987+0000 7f99094d7700 1 -- 172.21.15.84:0/560067214 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f990415b2b0 msgr2=0x7f99040c4870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:45.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.987+0000 7f99094d7700 1 --2- 172.21.15.84:0/560067214 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f990415b2b0 0x7f99040c4870 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f98f800c4a0 tx=0x7f98f800c860 comp rx=0 tx=0).stop 2023-09-13T08:25:45.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.987+0000 7f99094d7700 1 -- 172.21.15.84:0/560067214 shutdown_connections 2023-09-13T08:25:45.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.987+0000 7f99094d7700 1 --2- 172.21.15.84:0/560067214 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f98f006a580 0x7f98f006ca40 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:45.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.987+0000 7f99094d7700 1 --2- 172.21.15.84:0/560067214 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99040c4db0 0x7f99040c2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:45.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.987+0000 7f99094d7700 1 --2- 172.21.15.84:0/560067214 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f99040709d0 0x7f9904154600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:45.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.987+0000 7f99094d7700 1 --2- 172.21.15.84:0/560067214 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f990415b2b0 0x7f99040c4870 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:45.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.987+0000 7f99094d7700 1 -- 172.21.15.84:0/560067214 >> 172.21.15.84:0/560067214 conn(0x7f99040b0a20 msgr2=0x7f99040ae990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:45.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.987+0000 7f99094d7700 1 -- 172.21.15.84:0/560067214 shutdown_connections 2023-09-13T08:25:45.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:45.987+0000 7f99094d7700 1 -- 172.21.15.84:0/560067214 wait complete. 2023-09-13T08:25:45.991 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 9 2023-09-13T08:25:46.000 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T08:25:46.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.120+0000 7fcdaa25a700 1 Processor -- start 2023-09-13T08:25:46.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.120+0000 7fcdaa25a700 1 -- start start 2023-09-13T08:25:46.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.120+0000 7fcdaa25a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fcda40d0130 0x7fcda4161a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:46.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.120+0000 7fcdaa25a700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcda40ce230 0x7fcda40b84f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:46.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.120+0000 7fcdaa25a700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcda415e390 con 0x7fcda40d2ba0 2023-09-13T08:25:46.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.120+0000 7fcdaa25a700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcda40d23c0 con 0x7fcda40d0130 2023-09-13T08:25:46.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.120+0000 7fcdaa25a700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcda415daa0 con 0x7fcda40ce230 2023-09-13T08:25:46.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.120+0000 7fcda2ffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fcda40d0130 0x7fcda4161a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:46.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.121+0000 7fcda2ffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fcda40d0130 0x7fcda4161a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45296/0 (socket says 172.21.15.84:45296) 2023-09-13T08:25:46.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.121+0000 7fcda2ffd700 1 -- 172.21.15.84:0/1513448874 learned_addr learned my addr 172.21.15.84:0/1513448874 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:46.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.121+0000 7fcda3fff700 1 --2- 172.21.15.84:0/1513448874 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcda40ce230 0x7fcda40b84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:46.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.121+0000 7fcda2ffd700 1 -- 172.21.15.84:0/1513448874 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcda40ce230 msgr2=0x7fcda40b84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:46.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.121+0000 7fcda2ffd700 1 --2- 172.21.15.84:0/1513448874 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcda40ce230 0x7fcda40b84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:46.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.121+0000 7fcda2ffd700 1 -- 172.21.15.84:0/1513448874 >> v1:172.21.15.161:6789/0 conn(0x7fcda40d2ba0 legacy=0x7fcda40cfa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:46.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.121+0000 7fcda2ffd700 1 -- 172.21.15.84:0/1513448874 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcda415dd40 con 0x7fcda40d0130 2023-09-13T08:25:46.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.121+0000 7fcda3fff700 1 --2- 172.21.15.84:0/1513448874 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcda40ce230 0x7fcda40b84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T08:25:46.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.121+0000 7fcda2ffd700 1 --2- 172.21.15.84:0/1513448874 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcda40d0130 0x7fcda4161a20 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c0098f0 tx=0x7fcd8c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f83105cbd426e1b0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:46.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.121+0000 7fcda27fc700 1 -- 172.21.15.84:0/1513448874 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd8c004230 con 0x7fcda40d0130 2023-09-13T08:25:46.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.121+0000 7fcda27fc700 1 -- 172.21.15.84:0/1513448874 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd8c004390 con 0x7fcda40d0130 2023-09-13T08:25:46.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.121+0000 7fcda27fc700 1 -- 172.21.15.84:0/1513448874 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd8c0036a0 con 0x7fcda40d0130 2023-09-13T08:25:46.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.122+0000 7fcdaa25a700 1 -- 172.21.15.84:0/1513448874 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcda40d0130 msgr2=0x7fcda4161a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:46.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.122+0000 7fcdaa25a700 1 --2- 172.21.15.84:0/1513448874 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcda40d0130 0x7fcda4161a20 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c0098f0 tx=0x7fcd8c009c00 comp rx=0 tx=0).stop 2023-09-13T08:25:46.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.122+0000 7fcdaa25a700 1 -- 172.21.15.84:0/1513448874 shutdown_connections 2023-09-13T08:25:46.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.122+0000 7fcdaa25a700 1 --2- 172.21.15.84:0/1513448874 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcda40ce230 0x7fcda40b84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:46.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.122+0000 7fcdaa25a700 1 --2- 172.21.15.84:0/1513448874 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcda40d0130 0x7fcda4161a20 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:46.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.122+0000 7fcdaa25a700 1 -- 172.21.15.84:0/1513448874 >> 172.21.15.84:0/1513448874 conn(0x7fcda406b130 msgr2=0x7fcda406b540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:46.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.122+0000 7fcdaa25a700 1 -- 172.21.15.84:0/1513448874 shutdown_connections 2023-09-13T08:25:46.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.122+0000 7fcdaa25a700 1 -- 172.21.15.84:0/1513448874 wait complete. 2023-09-13T08:25:46.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.123+0000 7fcdaa25a700 1 Processor -- start 2023-09-13T08:25:46.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.123+0000 7fcdaa25a700 1 -- start start 2023-09-13T08:25:46.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.124+0000 7fcdaa25a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcda40ce230 0x7fcda41512f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:46.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.124+0000 7fcdaa25a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcda40d0130 0x7fcda4151ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:46.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.124+0000 7fcdaa25a700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcda40d2ba0 0x7fcda4159540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:46.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.124+0000 7fcdaa25a700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcda41f2980 con 0x7fcda40ce230 2023-09-13T08:25:46.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.124+0000 7fcdaa25a700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcda41528f0 con 0x7fcda40d0130 2023-09-13T08:25:46.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.124+0000 7fcdaa25a700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcda4152bd0 con 0x7fcda40d2ba0 2023-09-13T08:25:46.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.124+0000 7fcda37fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcda40ce230 0x7fcda41512f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:46.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.124+0000 7fcda37fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcda40ce230 0x7fcda41512f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45300/0 (socket says 172.21.15.84:45300) 2023-09-13T08:25:46.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.124+0000 7fcda37fe700 1 -- 172.21.15.84:0/3380202875 learned_addr learned my addr 172.21.15.84:0/3380202875 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:46.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.124+0000 7fcda3fff700 1 --2- 172.21.15.84:0/3380202875 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcda40d2ba0 0x7fcda4159540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:46.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.124+0000 7fcda2ffd700 1 --2- 172.21.15.84:0/3380202875 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcda40d0130 0x7fcda4151ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:46.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.124+0000 7fcda37fe700 1 -- 172.21.15.84:0/3380202875 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcda40d2ba0 msgr2=0x7fcda4159540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:46.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.124+0000 7fcda37fe700 1 --2- 172.21.15.84:0/3380202875 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcda40d2ba0 0x7fcda4159540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:46.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.124+0000 7fcda37fe700 1 -- 172.21.15.84:0/3380202875 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcda40d0130 msgr2=0x7fcda4151ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:46.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.124+0000 7fcda37fe700 1 --2- 172.21.15.84:0/3380202875 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcda40d0130 0x7fcda4151ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:46.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.124+0000 7fcda37fe700 1 -- 172.21.15.84:0/3380202875 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd8c009550 con 0x7fcda40ce230 2023-09-13T08:25:46.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.124+0000 7fcda37fe700 1 --2- 172.21.15.84:0/3380202875 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcda40ce230 0x7fcda41512f0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fcd9400b4a0 tx=0x7fcd9400b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:46.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.124+0000 7fcd9bfff700 1 -- 172.21.15.84:0/3380202875 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd94011830 con 0x7fcda40ce230 2023-09-13T08:25:46.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.124+0000 7fcd9bfff700 1 -- 172.21.15.84:0/3380202875 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd94011990 con 0x7fcda40ce230 2023-09-13T08:25:46.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.124+0000 7fcdaa25a700 1 -- 172.21.15.84:0/3380202875 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcda4152eb0 con 0x7fcda40ce230 2023-09-13T08:25:46.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.125+0000 7fcd9bfff700 1 -- 172.21.15.84:0/3380202875 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd94011d40 con 0x7fcda40ce230 2023-09-13T08:25:46.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.125+0000 7fcdaa25a700 1 -- 172.21.15.84:0/3380202875 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcda4153500 con 0x7fcda40ce230 2023-09-13T08:25:46.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.125+0000 7fcdaa25a700 1 -- 172.21.15.84:0/3380202875 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcda404e9b0 con 0x7fcda40ce230 2023-09-13T08:25:46.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.126+0000 7fcd9bfff700 1 -- 172.21.15.84:0/3380202875 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fcd9401a400 con 0x7fcda40ce230 2023-09-13T08:25:46.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.126+0000 7fcd9bfff700 1 --2- 172.21.15.84:0/3380202875 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fcd8406a580 0x7fcd8406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:46.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.126+0000 7fcd9bfff700 1 -- 172.21.15.84:0/3380202875 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fcd94088c30 con 0x7fcda40ce230 2023-09-13T08:25:46.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.126+0000 7fcda2ffd700 1 --2- 172.21.15.84:0/3380202875 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fcd8406a580 0x7fcd8406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:46.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.127+0000 7fcda2ffd700 1 --2- 172.21.15.84:0/3380202875 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fcd8406a580 0x7fcd8406ca40 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c009130 tx=0x7fcd8c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:46.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.131+0000 7fcd9bfff700 1 -- 172.21.15.84:0/3380202875 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fcd94053d30 con 0x7fcda40ce230 2023-09-13T08:25:46.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.323+0000 7fcdaa25a700 1 -- 172.21.15.84:0/3380202875 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcda40d1730 con 0x7fcda40ce230 2023-09-13T08:25:46.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.324+0000 7fcd9bfff700 1 -- 172.21.15.84:0/3380202875 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18757 (secure 0 0 0) 0x7fcd94015090 con 0x7fcda40ce230 2023-09-13T08:25:46.324 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:25:46.325 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":26,"fsid":"0107440b-b634-42c5-a643-5d31ea826116","created":"2023-09-13T08:24:16.931917+0000","modified":"2023-09-13T08:25:23.878460+0000","last_up_change":"2023-09-13T08:24:28.422631+0000","last_in_change":"2023-09-13T08:24:19.425578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T08:24:28.583720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-13T08:24:39.862832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-13T08:24:41.145511+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-13T08:24:44.775160+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4a53ec12-1469-4356-b4e1-2b8fc9b7c0f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6817","nonce":1599532366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6819","nonce":1599532366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6823","nonce":1599532366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6821","nonce":1599532366}]},"public_addr":"172.21.15.84:6817/1599532366","cluster_addr":"172.21.15.84:6819/1599532366","heartbeat_back_addr":"172.21.15.84:6823/1599532366","heartbeat_front_addr":"172.21.15.84:6821/1599532366","state":["exists","up"]},{"osd":1,"uuid":"11e964a0-b80c-4afc-bfbf-e2067969db29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6825","nonce":461860977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6827","nonce":461860977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6831","nonce":461860977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6829","nonce":461860977}]},"public_addr":"172.21.15.84:6825/461860977","cluster_addr":"172.21.15.84:6827/461860977","heartbeat_back_addr":"172.21.15.84:6831/461860977","heartbeat_front_addr":"172.21.15.84:6829/461860977","state":["exists","up"]},{"osd":2,"uuid":"3ce74529-4dd1-44c7-9576-968f5fdc0c25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6809","nonce":1168316165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6811","nonce":1168316165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6815","nonce":1168316165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6813","nonce":1168316165}]},"public_addr":"172.21.15.84:6809/1168316165","cluster_addr":"172.21.15.84:6811/1168316165","heartbeat_back_addr":"172.21.15.84:6815/1168316165","heartbeat_front_addr":"172.21.15.84:6813/1168316165","state":["exists","up"]},{"osd":3,"uuid":"460cb5c5-590a-4d06-a4d9-5bac2fdf33b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6801","nonce":1661609810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6803","nonce":1661609810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6807","nonce":1661609810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6805","nonce":1661609810}]},"public_addr":"172.21.15.84:6801/1661609810","cluster_addr":"172.21.15.84:6803/1661609810","heartbeat_back_addr":"172.21.15.84:6807/1661609810","heartbeat_front_addr":"172.21.15.84:6805/1661609810","state":["exists","up"]},{"osd":4,"uuid":"bf237dd0-3ebd-44b5-8078-24a63e00d792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6801","nonce":1303562374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6803","nonce":1303562374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6807","nonce":1303562374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6805","nonce":1303562374}]},"public_addr":"172.21.15.161:6801/1303562374","cluster_addr":"172.21.15.161:6803/1303562374","heartbeat_back_addr":"172.21.15.161:6807/1303562374","heartbeat_front_addr":"172.21.15.161:6805/1303562374","state":["exists","up"]},{"osd":5,"uuid":"e1e538e0-5844-456b-8c6e-434d3a914af1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6818","nonce":961120854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6822","nonce":961120854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6830","nonce":961120854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6826","nonce":961120854}]},"public_addr":"172.21.15.161:6818/961120854","cluster_addr":"172.21.15.161:6822/961120854","heartbeat_back_addr":"172.21.15.161:6830/961120854","heartbeat_front_addr":"172.21.15.161:6826/961120854","state":["exists","up"]},{"osd":6,"uuid":"5cb1785e-960f-4dd4-b295-9e21b2c3f875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6809","nonce":980533466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6811","nonce":980533466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6815","nonce":980533466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6813","nonce":980533466}]},"public_addr":"172.21.15.161:6809/980533466","cluster_addr":"172.21.15.161:6811/980533466","heartbeat_back_addr":"172.21.15.161:6815/980533466","heartbeat_front_addr":"172.21.15.161:6813/980533466","state":["exists","up"]},{"osd":7,"uuid":"5acb6619-e933-4b46-b1c2-60af30acb839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6817","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6819","nonce":2479691549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6821","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6823","nonce":2479691549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6829","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6831","nonce":2479691549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6825","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6827","nonce":2479691549}]},"public_addr":"172.21.15.161:6819/2479691549","cluster_addr":"172.21.15.161:6823/2479691549","heartbeat_back_addr":"172.21.15.161:6831/2479691549","heartbeat_front_addr":"172.21.15.161:6827/2479691549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.678857+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.685341+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.613603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.634940+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.564387+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.697347+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.637437+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.619397+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":1}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T08:25:46.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.326+0000 7fcdaa25a700 1 -- 172.21.15.84:0/3380202875 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fcd8406a580 msgr2=0x7fcd8406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:46.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.326+0000 7fcdaa25a700 1 --2- 172.21.15.84:0/3380202875 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fcd8406a580 0x7fcd8406ca40 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c009130 tx=0x7fcd8c008030 comp rx=0 tx=0).stop 2023-09-13T08:25:46.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.326+0000 7fcdaa25a700 1 -- 172.21.15.84:0/3380202875 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcda40ce230 msgr2=0x7fcda41512f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:46.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.326+0000 7fcdaa25a700 1 --2- 172.21.15.84:0/3380202875 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcda40ce230 0x7fcda41512f0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fcd9400b4a0 tx=0x7fcd9400b860 comp rx=0 tx=0).stop 2023-09-13T08:25:46.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.326+0000 7fcdaa25a700 1 -- 172.21.15.84:0/3380202875 shutdown_connections 2023-09-13T08:25:46.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.326+0000 7fcdaa25a700 1 --2- 172.21.15.84:0/3380202875 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcda40d2ba0 0x7fcda4159540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:46.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.326+0000 7fcdaa25a700 1 --2- 172.21.15.84:0/3380202875 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcda40ce230 0x7fcda41512f0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:46.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.326+0000 7fcdaa25a700 1 --2- 172.21.15.84:0/3380202875 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fcd8406a580 0x7fcd8406ca40 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:46.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.326+0000 7fcdaa25a700 1 --2- 172.21.15.84:0/3380202875 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcda40d0130 0x7fcda4151ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:46.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.326+0000 7fcdaa25a700 1 -- 172.21.15.84:0/3380202875 >> 172.21.15.84:0/3380202875 conn(0x7fcda406b130 msgr2=0x7fcda40b51f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:46.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.327+0000 7fcdaa25a700 1 -- 172.21.15.84:0/3380202875 shutdown_connections 2023-09-13T08:25:46.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.327+0000 7fcdaa25a700 1 -- 172.21.15.84:0/3380202875 wait complete. 2023-09-13T08:25:46.339 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T08:24:28.583720+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-13T08:24:39.862832+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-13T08:24:41.145511+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-09-13T08:24:44.775160+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-13T08:25:46.340 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T08:25:46.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.464+0000 7f9e26ebe700 1 Processor -- start 2023-09-13T08:25:46.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.464+0000 7f9e26ebe700 1 -- start start 2023-09-13T08:25:46.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.464+0000 7f9e26ebe700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9e200ced40 0x7f9e200cda40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:46.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.464+0000 7f9e26ebe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9e200cdf80 0x7f9e2015f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:46.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.464+0000 7f9e26ebe700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e200cd170 con 0x7f9e2015ea00 2023-09-13T08:25:46.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.464+0000 7f9e26ebe700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e200ce410 con 0x7f9e200cdf80 2023-09-13T08:25:46.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.464+0000 7f9e26ebe700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e200cc8d0 con 0x7f9e200ced40 2023-09-13T08:25:46.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.465+0000 7f9e24c5a700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f9e2015ea00 0x7f9e200cbd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:47954/0 (socket says 172.21.15.84:47954) 2023-09-13T08:25:46.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.465+0000 7f9e24c5a700 1 -- 172.21.15.84:0/3525694376 learned_addr learned my addr 172.21.15.84:0/3525694376 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:25:46.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.465+0000 7f9e2545b700 1 --2- 172.21.15.84:0/3525694376 >> v2:172.21.15.84:3300/0 conn(0x7f9e200cdf80 0x7f9e2015f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:46.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.465+0000 7f9e1ffff700 1 --2- 172.21.15.84:0/3525694376 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9e200ced40 0x7f9e200cda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:46.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.465+0000 7f9e2545b700 1 -- 172.21.15.84:0/3525694376 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9e200ced40 msgr2=0x7f9e200cda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:46.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.465+0000 7f9e2545b700 1 --2- 172.21.15.84:0/3525694376 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9e200ced40 0x7f9e200cda40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:46.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.465+0000 7f9e2545b700 1 -- 172.21.15.84:0/3525694376 >> v1:172.21.15.84:6789/0 conn(0x7f9e2015ea00 legacy=0x7f9e200cbd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:46.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.465+0000 7f9e2545b700 1 -- 172.21.15.84:0/3525694376 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e200ccbb0 con 0x7f9e200cdf80 2023-09-13T08:25:46.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.465+0000 7f9e2545b700 1 --2- 172.21.15.84:0/3525694376 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e200cdf80 0x7f9e2015f0f0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f9e18009d90 tx=0x7f9e1800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64d2725cd55c13e6 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:46.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.465+0000 7f9e1f7fe700 1 -- 172.21.15.84:0/3525694376 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e1800e070 con 0x7f9e200cdf80 2023-09-13T08:25:46.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.465+0000 7f9e1f7fe700 1 -- 172.21.15.84:0/3525694376 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e1800bbd0 con 0x7f9e200cdf80 2023-09-13T08:25:46.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.465+0000 7f9e1f7fe700 1 -- 172.21.15.84:0/3525694376 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e18012430 con 0x7f9e200cdf80 2023-09-13T08:25:46.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.466+0000 7f9e26ebe700 1 -- 172.21.15.84:0/3525694376 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e200cdf80 msgr2=0x7f9e2015f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:46.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.466+0000 7f9e26ebe700 1 --2- 172.21.15.84:0/3525694376 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e200cdf80 0x7f9e2015f0f0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f9e18009d90 tx=0x7f9e1800b330 comp rx=0 tx=0).stop 2023-09-13T08:25:46.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.466+0000 7f9e26ebe700 1 -- 172.21.15.84:0/3525694376 shutdown_connections 2023-09-13T08:25:46.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.466+0000 7f9e26ebe700 1 --2- 172.21.15.84:0/3525694376 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e200cdf80 0x7f9e2015f0f0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:46.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.466+0000 7f9e26ebe700 1 --2- 172.21.15.84:0/3525694376 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9e200ced40 0x7f9e200cda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:46.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.466+0000 7f9e26ebe700 1 -- 172.21.15.84:0/3525694376 >> 172.21.15.84:0/3525694376 conn(0x7f9e2009a470 msgr2=0x7f9e200d1170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:46.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.466+0000 7f9e26ebe700 1 -- 172.21.15.84:0/3525694376 shutdown_connections 2023-09-13T08:25:46.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.466+0000 7f9e26ebe700 1 -- 172.21.15.84:0/3525694376 wait complete. 2023-09-13T08:25:46.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.467+0000 7f9e26ebe700 1 Processor -- start 2023-09-13T08:25:46.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.467+0000 7f9e26ebe700 1 -- start start 2023-09-13T08:25:46.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.468+0000 7f9e26ebe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9e200cdf80 0x7f9e201f4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:46.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.468+0000 7f9e26ebe700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9e200ced40 0x7f9e2006ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:46.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.468+0000 7f9e26ebe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e2015ea00 0x7f9e200c6770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:46.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.468+0000 7f9e26ebe700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e201f53e0 con 0x7f9e2015ea00 2023-09-13T08:25:46.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.468+0000 7f9e26ebe700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e201f4450 con 0x7f9e200cdf80 2023-09-13T08:25:46.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.468+0000 7f9e26ebe700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e200c4e20 con 0x7f9e200ced40 2023-09-13T08:25:46.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.469+0000 7f9e2545b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e2015ea00 0x7f9e200c6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:46.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.469+0000 7f9e2545b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e2015ea00 0x7f9e200c6770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45318/0 (socket says 172.21.15.84:45318) 2023-09-13T08:25:46.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.469+0000 7f9e2545b700 1 -- 172.21.15.84:0/1438026468 learned_addr learned my addr 172.21.15.84:0/1438026468 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:46.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.469+0000 7f9e1ffff700 1 --2- 172.21.15.84:0/1438026468 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9e200ced40 0x7f9e2006ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:46.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.469+0000 7f9e24c5a700 1 --2- 172.21.15.84:0/1438026468 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9e200cdf80 0x7f9e201f4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:46.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.469+0000 7f9e2545b700 1 -- 172.21.15.84:0/1438026468 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9e200ced40 msgr2=0x7f9e2006ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:46.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.469+0000 7f9e2545b700 1 --2- 172.21.15.84:0/1438026468 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9e200ced40 0x7f9e2006ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:46.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.469+0000 7f9e2545b700 1 -- 172.21.15.84:0/1438026468 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9e200cdf80 msgr2=0x7f9e201f4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:46.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.469+0000 7f9e2545b700 1 --2- 172.21.15.84:0/1438026468 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9e200cdf80 0x7f9e201f4ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:46.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.469+0000 7f9e2545b700 1 -- 172.21.15.84:0/1438026468 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e18009a70 con 0x7f9e2015ea00 2023-09-13T08:25:46.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.469+0000 7f9e24c5a700 1 --2- 172.21.15.84:0/1438026468 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9e200cdf80 0x7f9e201f4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T08:25:46.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.469+0000 7f9e1ffff700 1 --2- 172.21.15.84:0/1438026468 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9e200ced40 0x7f9e2006ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T08:25:46.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.469+0000 7f9e2545b700 1 --2- 172.21.15.84:0/1438026468 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e2015ea00 0x7f9e200c6770 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f9e18014040 tx=0x7f9e18004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:46.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.469+0000 7f9e1d7fa700 1 -- 172.21.15.84:0/1438026468 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e18003ea0 con 0x7f9e2015ea00 2023-09-13T08:25:46.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.469+0000 7f9e1d7fa700 1 -- 172.21.15.84:0/1438026468 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e18020070 con 0x7f9e2015ea00 2023-09-13T08:25:46.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.469+0000 7f9e26ebe700 1 -- 172.21.15.84:0/1438026468 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e200c5100 con 0x7f9e2015ea00 2023-09-13T08:25:46.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.469+0000 7f9e1d7fa700 1 -- 172.21.15.84:0/1438026468 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e18004280 con 0x7f9e2015ea00 2023-09-13T08:25:46.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.469+0000 7f9e26ebe700 1 -- 172.21.15.84:0/1438026468 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e201f4980 con 0x7f9e2015ea00 2023-09-13T08:25:46.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.470+0000 7f9e26ebe700 1 -- 172.21.15.84:0/1438026468 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e200c52f0 con 0x7f9e2015ea00 2023-09-13T08:25:46.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.470+0000 7f9e1d7fa700 1 -- 172.21.15.84:0/1438026468 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f9e180043e0 con 0x7f9e2015ea00 2023-09-13T08:25:46.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.471+0000 7f9e1d7fa700 1 --2- 172.21.15.84:0/1438026468 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f9e0406a580 0x7f9e0406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:46.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.471+0000 7f9e1d7fa700 1 -- 172.21.15.84:0/1438026468 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f9e18022070 con 0x7f9e2015ea00 2023-09-13T08:25:46.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.471+0000 7f9e24c5a700 1 --2- 172.21.15.84:0/1438026468 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f9e0406a580 0x7f9e0406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:46.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.471+0000 7f9e24c5a700 1 --2- 172.21.15.84:0/1438026468 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f9e0406a580 0x7f9e0406ca40 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9e140010e0 tx=0x7f9e14009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:46.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.475+0000 7f9e1d7fa700 1 -- 172.21.15.84:0/1438026468 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f9e18056270 con 0x7f9e2015ea00 2023-09-13T08:25:46.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.664+0000 7f9e26ebe700 1 -- 172.21.15.84:0/1438026468 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9e2004f200 con 0x7f9e2015ea00 2023-09-13T08:25:46.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.664+0000 7f9e1d7fa700 1 -- 172.21.15.84:0/1438026468 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9e1801ae60 con 0x7f9e2015ea00 2023-09-13T08:25:46.664 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-09-13T08:25:46.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.666+0000 7f9e26ebe700 1 -- 172.21.15.84:0/1438026468 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f9e0406a580 msgr2=0x7f9e0406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:46.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.666+0000 7f9e26ebe700 1 --2- 172.21.15.84:0/1438026468 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f9e0406a580 0x7f9e0406ca40 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9e140010e0 tx=0x7f9e14009040 comp rx=0 tx=0).stop 2023-09-13T08:25:46.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.666+0000 7f9e26ebe700 1 -- 172.21.15.84:0/1438026468 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e2015ea00 msgr2=0x7f9e200c6770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:46.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.666+0000 7f9e26ebe700 1 --2- 172.21.15.84:0/1438026468 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e2015ea00 0x7f9e200c6770 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f9e18014040 tx=0x7f9e18004ad0 comp rx=0 tx=0).stop 2023-09-13T08:25:46.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.666+0000 7f9e26ebe700 1 -- 172.21.15.84:0/1438026468 shutdown_connections 2023-09-13T08:25:46.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.666+0000 7f9e26ebe700 1 --2- 172.21.15.84:0/1438026468 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e2015ea00 0x7f9e200c6770 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:46.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.666+0000 7f9e26ebe700 1 --2- 172.21.15.84:0/1438026468 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f9e0406a580 0x7f9e0406ca40 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:46.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.666+0000 7f9e26ebe700 1 --2- 172.21.15.84:0/1438026468 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9e200cdf80 0x7f9e201f4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:46.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.666+0000 7f9e26ebe700 1 --2- 172.21.15.84:0/1438026468 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9e200ced40 0x7f9e2006ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:46.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.666+0000 7f9e26ebe700 1 -- 172.21.15.84:0/1438026468 >> 172.21.15.84:0/1438026468 conn(0x7f9e2009a470 msgr2=0x7f9e200cfc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:46.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.666+0000 7f9e26ebe700 1 -- 172.21.15.84:0/1438026468 shutdown_connections 2023-09-13T08:25:46.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.666+0000 7f9e26ebe700 1 -- 172.21.15.84:0/1438026468 wait complete. 2023-09-13T08:25:46.678 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-13T08:25:46.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.804+0000 7f516cdce700 1 Processor -- start 2023-09-13T08:25:46.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.804+0000 7f516cdce700 1 -- start start 2023-09-13T08:25:46.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.805+0000 7f516cdce700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f516815a170 0x7f516806e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:46.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.805+0000 7f516cdce700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f51680ca640 0x7f51680caac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:46.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.805+0000 7f516cdce700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51680cfe40 con 0x7f51680cf910 2023-09-13T08:25:46.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.805+0000 7f516cdce700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f516815a550 con 0x7f51680ca640 2023-09-13T08:25:46.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.805+0000 7f516cdce700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51680cf4c0 con 0x7f516815a170 2023-09-13T08:25:46.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.805+0000 7f5165d9b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f51680cf910 0x7f516806ec80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:47968/0 (socket says 172.21.15.84:47968) 2023-09-13T08:25:46.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.805+0000 7f5165d9b700 1 -- 172.21.15.84:0/441350505 learned_addr learned my addr 172.21.15.84:0/441350505 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:25:46.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.805+0000 7f5166d9d700 1 --2- 172.21.15.84:0/441350505 >> v2:172.21.15.161:3300/0 conn(0x7f51680ca640 0x7f51680caac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:46.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.805+0000 7f516659c700 1 --2- 172.21.15.84:0/441350505 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f516815a170 0x7f516806e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:46.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.805+0000 7f516559a700 1 -- 172.21.15.84:0/441350505 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2422329283 0 0) 0x7f51680cfe40 con 0x7f51680cf910 2023-09-13T08:25:46.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.805+0000 7f516559a700 1 -- 172.21.15.84:0/441350505 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51500035b0 con 0x7f51680cf910 2023-09-13T08:25:46.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.805+0000 7f516559a700 1 -- 172.21.15.84:0/441350505 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1198562892 0 0) 0x7f51500035b0 con 0x7f51680cf910 2023-09-13T08:25:46.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.805+0000 7f516559a700 1 -- 172.21.15.84:0/441350505 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f516815a170 msgr2=0x7f516806e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:46.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.805+0000 7f516559a700 1 --2- 172.21.15.84:0/441350505 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f516815a170 0x7f516806e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:46.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.805+0000 7f516559a700 1 -- 172.21.15.84:0/441350505 >> v2:172.21.15.161:3300/0 conn(0x7f51680ca640 msgr2=0x7f51680caac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:46.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.805+0000 7f516559a700 1 --2- 172.21.15.84:0/441350505 >> v2:172.21.15.161:3300/0 conn(0x7f51680ca640 0x7f51680caac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:46.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.805+0000 7f516559a700 1 -- 172.21.15.84:0/441350505 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51680ce700 con 0x7f51680cf910 2023-09-13T08:25:46.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.805+0000 7f516559a700 1 -- 172.21.15.84:0/441350505 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2302733408 0 0) 0x7f515c001670 con 0x7f51680cf910 2023-09-13T08:25:46.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.805+0000 7f516559a700 1 -- 172.21.15.84:0/441350505 >> v1:172.21.15.84:6789/0 conn(0x7f51680cf910 legacy=0x7f516806ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:46.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.805+0000 7f516559a700 1 --2- 172.21.15.84:0/441350505 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f516815a170 0x7f5150003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:46.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.806+0000 7f516559a700 1 --2- 172.21.15.84:0/441350505 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5150003f80 0x7f5150004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:46.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.806+0000 7f516559a700 1 --2- 172.21.15.84:0/441350505 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5150004d90 0x7f5150005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:46.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.806+0000 7f516559a700 1 -- 172.21.15.84:0/441350505 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f516815a550 con 0x7f5150004d90 2023-09-13T08:25:46.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.806+0000 7f516559a700 1 -- 172.21.15.84:0/441350505 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51680cf4c0 con 0x7f5150003f80 2023-09-13T08:25:46.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.806+0000 7f516559a700 1 -- 172.21.15.84:0/441350505 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f515000ba10 con 0x7f516815a170 2023-09-13T08:25:46.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.806+0000 7f5166d9d700 1 --2- 172.21.15.84:0/441350505 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5150004d90 0x7f5150005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:46.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.806+0000 7f516659c700 1 --2- 172.21.15.84:0/441350505 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f516815a170 0x7f5150003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:46.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.806+0000 7f5165d9b700 1 --2- 172.21.15.84:0/441350505 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5150003f80 0x7f5150004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:46.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.806+0000 7f5166d9d700 1 -- 172.21.15.84:0/441350505 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f516815a170 msgr2=0x7f5150003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:46.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.806+0000 7f5166d9d700 1 --2- 172.21.15.84:0/441350505 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f516815a170 0x7f5150003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:46.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.806+0000 7f5166d9d700 1 -- 172.21.15.84:0/441350505 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5150003f80 msgr2=0x7f5150004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:46.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.806+0000 7f5166d9d700 1 --2- 172.21.15.84:0/441350505 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5150003f80 0x7f5150004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:46.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.806+0000 7f5166d9d700 1 -- 172.21.15.84:0/441350505 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51500035b0 con 0x7f5150004d90 2023-09-13T08:25:46.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.806+0000 7f5165d9b700 1 --2- 172.21.15.84:0/441350505 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5150003f80 0x7f5150004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T08:25:46.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.806+0000 7f5166d9d700 1 --2- 172.21.15.84:0/441350505 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5150004d90 0x7f5150005210 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f5160009fc0 tx=0x7f5150005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63ff023765da77b6 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:46.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.806+0000 7f516559a700 1 -- 172.21.15.84:0/441350505 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f516000ebd0 con 0x7f5150004d90 2023-09-13T08:25:46.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.806+0000 7f516559a700 1 -- 172.21.15.84:0/441350505 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f516000f040 con 0x7f5150004d90 2023-09-13T08:25:46.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.806+0000 7f516559a700 1 -- 172.21.15.84:0/441350505 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5160014480 con 0x7f5150004d90 2023-09-13T08:25:46.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.807+0000 7f516cdce700 1 -- 172.21.15.84:0/441350505 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5150004d90 msgr2=0x7f5150005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:46.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.807+0000 7f516cdce700 1 --2- 172.21.15.84:0/441350505 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5150004d90 0x7f5150005210 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f5160009fc0 tx=0x7f5150005880 comp rx=0 tx=0).stop 2023-09-13T08:25:46.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.807+0000 7f5166d9d700 1 -- 172.21.15.84:0/441350505 reap_dead start 2023-09-13T08:25:46.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.807+0000 7f516cdce700 1 -- 172.21.15.84:0/441350505 shutdown_connections 2023-09-13T08:25:46.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.807+0000 7f516cdce700 1 -- 172.21.15.84:0/441350505 >> 172.21.15.84:0/441350505 conn(0x7f51680cca70 msgr2=0x7f51680cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:46.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.807+0000 7f516cdce700 1 -- 172.21.15.84:0/441350505 shutdown_connections 2023-09-13T08:25:46.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.807+0000 7f516cdce700 1 -- 172.21.15.84:0/441350505 wait complete. 2023-09-13T08:25:46.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.808+0000 7f516cdce700 1 Processor -- start 2023-09-13T08:25:46.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.808+0000 7f516cdce700 1 -- start start 2023-09-13T08:25:46.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.809+0000 7f516cdce700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5150004d90 0x7f5168153b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:46.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.809+0000 7f516cdce700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f516814e570 0x7f516806a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:46.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.809+0000 7f516cdce700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f516806ab60 0x7f51681f3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:46.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.809+0000 7f516cdce700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f516806afe0 con 0x7f5150004d90 2023-09-13T08:25:46.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.809+0000 7f516cdce700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5168155810 con 0x7f516806ab60 2023-09-13T08:25:46.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.809+0000 7f516cdce700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51681536b0 con 0x7f516814e570 2023-09-13T08:25:46.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.809+0000 7f516659c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5150004d90 0x7f5168153b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:46.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.809+0000 7f516659c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5150004d90 0x7f5168153b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45332/0 (socket says 172.21.15.84:45332) 2023-09-13T08:25:46.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.809+0000 7f516659c700 1 -- 172.21.15.84:0/472032118 learned_addr learned my addr 172.21.15.84:0/472032118 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:46.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.809+0000 7f5166d9d700 1 --2- 172.21.15.84:0/472032118 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f516806ab60 0x7f51681f3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:46.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.809+0000 7f5165d9b700 1 --2- 172.21.15.84:0/472032118 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f516814e570 0x7f516806a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:46.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.809+0000 7f516659c700 1 -- 172.21.15.84:0/472032118 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f516814e570 msgr2=0x7f516806a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:46.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.809+0000 7f516659c700 1 --2- 172.21.15.84:0/472032118 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f516814e570 0x7f516806a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:46.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.809+0000 7f516659c700 1 -- 172.21.15.84:0/472032118 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f516806ab60 msgr2=0x7f51681f3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:46.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.809+0000 7f516659c700 1 --2- 172.21.15.84:0/472032118 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f516806ab60 0x7f51681f3f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:46.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.809+0000 7f516659c700 1 -- 172.21.15.84:0/472032118 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51681f4e30 con 0x7f5150004d90 2023-09-13T08:25:46.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.810+0000 7f516659c700 1 --2- 172.21.15.84:0/472032118 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5150004d90 0x7f5168153b40 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f5158011ad0 tx=0x7f5158011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:46.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.810+0000 7f5156ffd700 1 -- 172.21.15.84:0/472032118 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5158016a10 con 0x7f5150004d90 2023-09-13T08:25:46.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.810+0000 7f5156ffd700 1 -- 172.21.15.84:0/472032118 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5158016b70 con 0x7f5150004d90 2023-09-13T08:25:46.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.810+0000 7f5156ffd700 1 -- 172.21.15.84:0/472032118 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f515800f730 con 0x7f5150004d90 2023-09-13T08:25:46.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.810+0000 7f516cdce700 1 -- 172.21.15.84:0/472032118 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f516814e9f0 con 0x7f5150004d90 2023-09-13T08:25:46.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.810+0000 7f516cdce700 1 -- 172.21.15.84:0/472032118 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5168153060 con 0x7f5150004d90 2023-09-13T08:25:46.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.811+0000 7f516cdce700 1 -- 172.21.15.84:0/472032118 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f516804f200 con 0x7f5150004d90 2023-09-13T08:25:46.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.811+0000 7f5156ffd700 1 -- 172.21.15.84:0/472032118 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f515800f890 con 0x7f5150004d90 2023-09-13T08:25:46.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.812+0000 7f5156ffd700 1 --2- 172.21.15.84:0/472032118 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f514806a580 0x7f514806ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:46.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.812+0000 7f5165d9b700 1 --2- 172.21.15.84:0/472032118 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f514806a580 0x7f514806ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:46.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.812+0000 7f5156ffd700 1 -- 172.21.15.84:0/472032118 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f515808d380 con 0x7f5150004d90 2023-09-13T08:25:46.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.812+0000 7f5165d9b700 1 --2- 172.21.15.84:0/472032118 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f514806a580 0x7f514806ca40 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f516806f0a0 tx=0x7f515c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:46.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:46.816+0000 7f5156ffd700 1 -- 172.21.15.84:0/472032118 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f5158058670 con 0x7f5150004d90 2023-09-13T08:25:47.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.009+0000 7f516cdce700 1 -- 172.21.15.84:0/472032118 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f51680cc850 con 0x7f5150004d90 2023-09-13T08:25:47.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.009+0000 7f5156ffd700 1 -- 172.21.15.84:0/472032118 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f515805bc90 con 0x7f5150004d90 2023-09-13T08:25:47.010 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-09-13T08:25:47.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.011+0000 7f516cdce700 1 -- 172.21.15.84:0/472032118 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f514806a580 msgr2=0x7f514806ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:47.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.011+0000 7f516cdce700 1 --2- 172.21.15.84:0/472032118 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f514806a580 0x7f514806ca40 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f516806f0a0 tx=0x7f515c009040 comp rx=0 tx=0).stop 2023-09-13T08:25:47.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.011+0000 7f516cdce700 1 -- 172.21.15.84:0/472032118 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5150004d90 msgr2=0x7f5168153b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:47.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.011+0000 7f516cdce700 1 --2- 172.21.15.84:0/472032118 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5150004d90 0x7f5168153b40 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f5158011ad0 tx=0x7f5158011e90 comp rx=0 tx=0).stop 2023-09-13T08:25:47.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.011+0000 7f516cdce700 1 -- 172.21.15.84:0/472032118 shutdown_connections 2023-09-13T08:25:47.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.011+0000 7f516cdce700 1 --2- 172.21.15.84:0/472032118 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f514806a580 0x7f514806ca40 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:47.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.011+0000 7f516cdce700 1 --2- 172.21.15.84:0/472032118 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f516806ab60 0x7f51681f3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:47.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.011+0000 7f516cdce700 1 --2- 172.21.15.84:0/472032118 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5150004d90 0x7f5168153b40 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:47.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.011+0000 7f516cdce700 1 --2- 172.21.15.84:0/472032118 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f516814e570 0x7f516806a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:47.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.011+0000 7f516cdce700 1 -- 172.21.15.84:0/472032118 >> 172.21.15.84:0/472032118 conn(0x7f51680cca70 msgr2=0x7f5168158440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:47.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.011+0000 7f516cdce700 1 -- 172.21.15.84:0/472032118 shutdown_connections 2023-09-13T08:25:47.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.011+0000 7f516cdce700 1 -- 172.21.15.84:0/472032118 wait complete. 2023-09-13T08:25:47.024 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-13T08:25:47.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.148+0000 7f6dcc6b3700 1 Processor -- start 2023-09-13T08:25:47.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.148+0000 7f6dcc6b3700 1 -- start start 2023-09-13T08:25:47.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.149+0000 7f6dcc6b3700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6dc415d570 0x7f6dc40b8d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:47.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.149+0000 7f6dcc6b3700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f6dc4160ff0 0x7f6dc40cfc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:47.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.149+0000 7f6dcc6b3700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6dc40d0170 0x7f6dc40b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:47.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.149+0000 7f6dcc6b3700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dc415d950 con 0x7f6dc40d0170 2023-09-13T08:25:47.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.149+0000 7f6dcc6b3700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dc40d05e0 con 0x7f6dc4160ff0 2023-09-13T08:25:47.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.149+0000 7f6dcc6b3700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc4161450 con 0x7f6dc415d570 2023-09-13T08:25:47.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.149+0000 7f6dcac50700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6dc40d0170 0x7f6dc40b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:47.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.149+0000 7f6dcac50700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6dc40d0170 0x7f6dc40b4d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45344/0 (socket says 172.21.15.84:45344) 2023-09-13T08:25:47.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.149+0000 7f6dcac50700 1 -- 172.21.15.84:0/2747717364 learned_addr learned my addr 172.21.15.84:0/2747717364 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:47.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.149+0000 7f6dc9c4e700 1 --2- 172.21.15.84:0/2747717364 >> v2:172.21.15.161:3300/0 conn(0x7f6dc4160ff0 0x7f6dc40cfc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:47.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.149+0000 7f6dca44f700 1 --2- 172.21.15.84:0/2747717364 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6dc415d570 0x7f6dc40b8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:47.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.149+0000 7f6dcac50700 1 -- 172.21.15.84:0/2747717364 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6dc415d570 msgr2=0x7f6dc40b8d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:47.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.149+0000 7f6dcac50700 1 --2- 172.21.15.84:0/2747717364 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6dc415d570 0x7f6dc40b8d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:47.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.149+0000 7f6dcac50700 1 -- 172.21.15.84:0/2747717364 >> v2:172.21.15.161:3300/0 conn(0x7f6dc4160ff0 msgr2=0x7f6dc40cfc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:47.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.149+0000 7f6dcac50700 1 --2- 172.21.15.84:0/2747717364 >> v2:172.21.15.161:3300/0 conn(0x7f6dc4160ff0 0x7f6dc40cfc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:47.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.149+0000 7f6dcac50700 1 -- 172.21.15.84:0/2747717364 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dc41616f0 con 0x7f6dc40d0170 2023-09-13T08:25:47.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.149+0000 7f6dcac50700 1 --2- 172.21.15.84:0/2747717364 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6dc40d0170 0x7f6dc40b4d00 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f6dc40b5e40 tx=0x7f6dbc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e801aa25eab4899 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:47.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.149+0000 7f6dc944d700 1 -- 172.21.15.84:0/2747717364 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc00e070 con 0x7f6dc40d0170 2023-09-13T08:25:47.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.149+0000 7f6dc944d700 1 -- 172.21.15.84:0/2747717364 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dbc00b9c0 con 0x7f6dc40d0170 2023-09-13T08:25:47.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.149+0000 7f6dc944d700 1 -- 172.21.15.84:0/2747717364 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc00bd70 con 0x7f6dc40d0170 2023-09-13T08:25:47.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.150+0000 7f6dcc6b3700 1 -- 172.21.15.84:0/2747717364 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6dc40d0170 msgr2=0x7f6dc40b4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:47.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.150+0000 7f6dcc6b3700 1 --2- 172.21.15.84:0/2747717364 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6dc40d0170 0x7f6dc40b4d00 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f6dc40b5e40 tx=0x7f6dbc00b330 comp rx=0 tx=0).stop 2023-09-13T08:25:47.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.150+0000 7f6dcc6b3700 1 -- 172.21.15.84:0/2747717364 shutdown_connections 2023-09-13T08:25:47.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.150+0000 7f6dcc6b3700 1 --2- 172.21.15.84:0/2747717364 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6dc40d0170 0x7f6dc40b4d00 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:47.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.150+0000 7f6dcc6b3700 1 --2- 172.21.15.84:0/2747717364 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6dc415d570 0x7f6dc40b8d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:47.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.150+0000 7f6dcc6b3700 1 --2- 172.21.15.84:0/2747717364 >> v2:172.21.15.161:3300/0 conn(0x7f6dc4160ff0 0x7f6dc40cfc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:47.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.150+0000 7f6dcc6b3700 1 -- 172.21.15.84:0/2747717364 >> 172.21.15.84:0/2747717364 conn(0x7f6dc406b0d0 msgr2=0x7f6dc406b4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:47.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.150+0000 7f6dcc6b3700 1 -- 172.21.15.84:0/2747717364 shutdown_connections 2023-09-13T08:25:47.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.150+0000 7f6dcc6b3700 1 -- 172.21.15.84:0/2747717364 wait complete. 2023-09-13T08:25:47.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.151+0000 7f6dcc6b3700 1 Processor -- start 2023-09-13T08:25:47.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.151+0000 7f6dcc6b3700 1 -- start start 2023-09-13T08:25:47.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.152+0000 7f6dcc6b3700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6dc40d0170 0x7f6dc415a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:47.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.152+0000 7f6dcc6b3700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6dc415d570 0x7f6dc41518d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:47.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.152+0000 7f6dcc6b3700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6dc4160ff0 0x7f6dc4150810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:47.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.152+0000 7f6dcc6b3700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc415f5d0 con 0x7f6dc415d570 2023-09-13T08:25:47.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.152+0000 7f6dcc6b3700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc4160800 con 0x7f6dc4160ff0 2023-09-13T08:25:47.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.152+0000 7f6dcc6b3700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc415a7b0 con 0x7f6dc40d0170 2023-09-13T08:25:47.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.152+0000 7f6dc9c4e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6dc415d570 0x7f6dc41518d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:47.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.152+0000 7f6dc9c4e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6dc415d570 0x7f6dc41518d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45348/0 (socket says 172.21.15.84:45348) 2023-09-13T08:25:47.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.152+0000 7f6dc9c4e700 1 -- 172.21.15.84:0/2468726241 learned_addr learned my addr 172.21.15.84:0/2468726241 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:47.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.152+0000 7f6dca44f700 1 --2- 172.21.15.84:0/2468726241 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6dc40d0170 0x7f6dc415a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:47.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.152+0000 7f6dcac50700 1 --2- 172.21.15.84:0/2468726241 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6dc4160ff0 0x7f6dc4150810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:47.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.152+0000 7f6dc9c4e700 1 -- 172.21.15.84:0/2468726241 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6dc40d0170 msgr2=0x7f6dc415a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:47.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.152+0000 7f6dc9c4e700 1 --2- 172.21.15.84:0/2468726241 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6dc40d0170 0x7f6dc415a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:47.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.152+0000 7f6dc9c4e700 1 -- 172.21.15.84:0/2468726241 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6dc4160ff0 msgr2=0x7f6dc4150810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:47.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.152+0000 7f6dc9c4e700 1 --2- 172.21.15.84:0/2468726241 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6dc4160ff0 0x7f6dc4150810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:47.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.152+0000 7f6dc9c4e700 1 -- 172.21.15.84:0/2468726241 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dbc009b30 con 0x7f6dc415d570 2023-09-13T08:25:47.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.153+0000 7f6dc9c4e700 1 --2- 172.21.15.84:0/2468726241 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6dc415d570 0x7f6dc41518d0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f6db400d800 tx=0x7f6db400dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:47.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.153+0000 7f6dbaffd700 1 -- 172.21.15.84:0/2468726241 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db40125f0 con 0x7f6dc415d570 2023-09-13T08:25:47.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.153+0000 7f6dbaffd700 1 -- 172.21.15.84:0/2468726241 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6db4012750 con 0x7f6dc415d570 2023-09-13T08:25:47.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.153+0000 7f6dbaffd700 1 -- 172.21.15.84:0/2468726241 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db4012b00 con 0x7f6dc415d570 2023-09-13T08:25:47.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.153+0000 7f6dcc6b3700 1 -- 172.21.15.84:0/2468726241 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dc40cabe0 con 0x7f6dc415d570 2023-09-13T08:25:47.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.153+0000 7f6dcc6b3700 1 -- 172.21.15.84:0/2468726241 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dc40cb1a0 con 0x7f6dc415d570 2023-09-13T08:25:47.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.154+0000 7f6dcc6b3700 1 -- 172.21.15.84:0/2468726241 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dc404f200 con 0x7f6dc415d570 2023-09-13T08:25:47.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.154+0000 7f6dbaffd700 1 -- 172.21.15.84:0/2468726241 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f6db4012c60 con 0x7f6dc415d570 2023-09-13T08:25:47.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.154+0000 7f6dbaffd700 1 --2- 172.21.15.84:0/2468726241 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f6da806a580 0x7f6da806ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:47.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.154+0000 7f6dbaffd700 1 -- 172.21.15.84:0/2468726241 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f6db4089230 con 0x7f6dc415d570 2023-09-13T08:25:47.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.155+0000 7f6dca44f700 1 --2- 172.21.15.84:0/2468726241 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f6da806a580 0x7f6da806ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:47.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.155+0000 7f6dca44f700 1 --2- 172.21.15.84:0/2468726241 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f6da806a580 0x7f6da806ca40 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6dc000c900 tx=0x7f6dc0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:47.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.159+0000 7f6dbaffd700 1 -- 172.21.15.84:0/2468726241 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f6db40543d0 con 0x7f6dc415d570 2023-09-13T08:25:47.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.349+0000 7f6dcc6b3700 1 -- 172.21.15.84:0/2468726241 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6dc4153c50 con 0x7f6dc415d570 2023-09-13T08:25:47.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.350+0000 7f6dbaffd700 1 -- 172.21.15.84:0/2468726241 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6db40579f0 con 0x7f6dc415d570 2023-09-13T08:25:47.350 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-09-13T08:25:47.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.352+0000 7f6dcc6b3700 1 -- 172.21.15.84:0/2468726241 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f6da806a580 msgr2=0x7f6da806ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:47.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.352+0000 7f6dcc6b3700 1 --2- 172.21.15.84:0/2468726241 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f6da806a580 0x7f6da806ca40 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6dc000c900 tx=0x7f6dc0008040 comp rx=0 tx=0).stop 2023-09-13T08:25:47.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.352+0000 7f6dcc6b3700 1 -- 172.21.15.84:0/2468726241 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6dc415d570 msgr2=0x7f6dc41518d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:47.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.352+0000 7f6dcc6b3700 1 --2- 172.21.15.84:0/2468726241 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6dc415d570 0x7f6dc41518d0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f6db400d800 tx=0x7f6db400dbc0 comp rx=0 tx=0).stop 2023-09-13T08:25:47.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.352+0000 7f6dcc6b3700 1 -- 172.21.15.84:0/2468726241 shutdown_connections 2023-09-13T08:25:47.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.352+0000 7f6dcc6b3700 1 --2- 172.21.15.84:0/2468726241 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f6da806a580 0x7f6da806ca40 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:47.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.352+0000 7f6dcc6b3700 1 --2- 172.21.15.84:0/2468726241 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6dc4160ff0 0x7f6dc4150810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:47.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.352+0000 7f6dcc6b3700 1 --2- 172.21.15.84:0/2468726241 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6dc40d0170 0x7f6dc415a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:47.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.352+0000 7f6dcc6b3700 1 --2- 172.21.15.84:0/2468726241 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6dc415d570 0x7f6dc41518d0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:47.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.352+0000 7f6dcc6b3700 1 -- 172.21.15.84:0/2468726241 >> 172.21.15.84:0/2468726241 conn(0x7f6dc406b0d0 msgr2=0x7f6dc4157c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:47.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.352+0000 7f6dcc6b3700 1 -- 172.21.15.84:0/2468726241 shutdown_connections 2023-09-13T08:25:47.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.352+0000 7f6dcc6b3700 1 -- 172.21.15.84:0/2468726241 wait complete. 2023-09-13T08:25:47.364 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-09-13T08:25:47.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.488+0000 7f01bda49700 1 Processor -- start 2023-09-13T08:25:47.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.488+0000 7f01bda49700 1 -- start start 2023-09-13T08:25:47.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.489+0000 7f01bda49700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f01b80b49f0 0x7f01b8168220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:47.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.489+0000 7f01bda49700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01b80b3550 con 0x7f01b815d580 2023-09-13T08:25:47.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.489+0000 7f01bda49700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01b80b2c60 con 0x7f01b80d3f40 2023-09-13T08:25:47.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.489+0000 7f01bda49700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01b80d2110 con 0x7f01b80b49f0 2023-09-13T08:25:47.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.489+0000 7f01b77fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f01b80b49f0 0x7f01b8168220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:47.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.489+0000 7f01b77fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f01b80b49f0 0x7f01b8168220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45358/0 (socket says 172.21.15.84:45358) 2023-09-13T08:25:47.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.489+0000 7f01b77fe700 1 -- 172.21.15.84:0/1485933757 learned_addr learned my addr 172.21.15.84:0/1485933757 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:47.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.489+0000 7f01b77fe700 1 -- 172.21.15.84:0/1485933757 >> v1:172.21.15.161:6789/0 conn(0x7f01b80d3f40 legacy=0x7f01b80cfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:47.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.489+0000 7f01b77fe700 1 -- 172.21.15.84:0/1485933757 >> v1:172.21.15.84:6789/0 conn(0x7f01b815d580 legacy=0x7f01b80d18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:47.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.489+0000 7f01b77fe700 1 -- 172.21.15.84:0/1485933757 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01b80b2f00 con 0x7f01b80b49f0 2023-09-13T08:25:47.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.489+0000 7f01b77fe700 1 --2- 172.21.15.84:0/1485933757 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b80b49f0 0x7f01b8168220 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f01b0009e50 tx=0x7f01b000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=510c64e445377149 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:47.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.489+0000 7f01b5ffb700 1 -- 172.21.15.84:0/1485933757 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b000e070 con 0x7f01b80b49f0 2023-09-13T08:25:47.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.489+0000 7f01b5ffb700 1 -- 172.21.15.84:0/1485933757 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01b0003a20 con 0x7f01b80b49f0 2023-09-13T08:25:47.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.490+0000 7f01b5ffb700 1 -- 172.21.15.84:0/1485933757 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b0003dd0 con 0x7f01b80b49f0 2023-09-13T08:25:47.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.490+0000 7f01bda49700 1 -- 172.21.15.84:0/1485933757 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b80b49f0 msgr2=0x7f01b8168220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:47.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.490+0000 7f01bda49700 1 --2- 172.21.15.84:0/1485933757 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b80b49f0 0x7f01b8168220 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f01b0009e50 tx=0x7f01b000b330 comp rx=0 tx=0).stop 2023-09-13T08:25:47.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.490+0000 7f01bda49700 1 -- 172.21.15.84:0/1485933757 shutdown_connections 2023-09-13T08:25:47.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.490+0000 7f01bda49700 1 --2- 172.21.15.84:0/1485933757 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b80b49f0 0x7f01b8168220 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:47.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.490+0000 7f01bda49700 1 -- 172.21.15.84:0/1485933757 >> 172.21.15.84:0/1485933757 conn(0x7f01b80d3300 msgr2=0x7f01b80d3710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:47.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.490+0000 7f01bda49700 1 -- 172.21.15.84:0/1485933757 shutdown_connections 2023-09-13T08:25:47.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.490+0000 7f01bda49700 1 -- 172.21.15.84:0/1485933757 wait complete. 2023-09-13T08:25:47.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.491+0000 7f01bda49700 1 Processor -- start 2023-09-13T08:25:47.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.491+0000 7f01bda49700 1 -- start start 2023-09-13T08:25:47.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.492+0000 7f01bda49700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f01b80b49f0 0x7f01b815e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:47.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.492+0000 7f01bda49700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b80d3f40 0x7f01b80b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:47.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.492+0000 7f01bda49700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f01b815d580 0x7f01b80b5310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:47.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.492+0000 7f01bda49700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01b815b2f0 con 0x7f01b80d3f40 2023-09-13T08:25:47.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.492+0000 7f01bda49700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01b80c79a0 con 0x7f01b815d580 2023-09-13T08:25:47.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.492+0000 7f01bda49700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01b81604b0 con 0x7f01b80b49f0 2023-09-13T08:25:47.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.492+0000 7f01b67fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b80d3f40 0x7f01b80b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:47.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.492+0000 7f01b67fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b80d3f40 0x7f01b80b4dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45362/0 (socket says 172.21.15.84:45362) 2023-09-13T08:25:47.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.492+0000 7f01b67fc700 1 -- 172.21.15.84:0/1899194551 learned_addr learned my addr 172.21.15.84:0/1899194551 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:47.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.492+0000 7f01b77fe700 1 --2- 172.21.15.84:0/1899194551 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f01b815d580 0x7f01b80b5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:47.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.492+0000 7f01b67fc700 1 -- 172.21.15.84:0/1899194551 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f01b80b49f0 msgr2=0x7f01b815e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:47.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.492+0000 7f01b67fc700 1 --2- 172.21.15.84:0/1899194551 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f01b80b49f0 0x7f01b815e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:47.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.492+0000 7f01b67fc700 1 -- 172.21.15.84:0/1899194551 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f01b815d580 msgr2=0x7f01b80b5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:47.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.492+0000 7f01b67fc700 1 --2- 172.21.15.84:0/1899194551 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f01b815d580 0x7f01b80b5310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:47.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.493+0000 7f01b67fc700 1 -- 172.21.15.84:0/1899194551 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01b0009b30 con 0x7f01b80d3f40 2023-09-13T08:25:47.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.493+0000 7f01b67fc700 1 --2- 172.21.15.84:0/1899194551 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b80d3f40 0x7f01b80b4dd0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f01a800c4d0 tx=0x7f01a800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:47.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.493+0000 7f019ffff700 1 -- 172.21.15.84:0/1899194551 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a8011790 con 0x7f01b80d3f40 2023-09-13T08:25:47.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.493+0000 7f019ffff700 1 -- 172.21.15.84:0/1899194551 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01a80118f0 con 0x7f01b80d3f40 2023-09-13T08:25:47.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.493+0000 7f019ffff700 1 -- 172.21.15.84:0/1899194551 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a8011ca0 con 0x7f01b80d3f40 2023-09-13T08:25:47.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.493+0000 7f01bda49700 1 -- 172.21.15.84:0/1899194551 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01b8160790 con 0x7f01b80d3f40 2023-09-13T08:25:47.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.493+0000 7f01bda49700 1 -- 172.21.15.84:0/1899194551 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01b815e0d0 con 0x7f01b80d3f40 2023-09-13T08:25:47.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.494+0000 7f01bda49700 1 -- 172.21.15.84:0/1899194551 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01b804f200 con 0x7f01b80d3f40 2023-09-13T08:25:47.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.494+0000 7f019ffff700 1 -- 172.21.15.84:0/1899194551 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f01a801c460 con 0x7f01b80d3f40 2023-09-13T08:25:47.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.494+0000 7f019ffff700 1 --2- 172.21.15.84:0/1899194551 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f01a406a580 0x7f01a406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:47.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.495+0000 7f019ffff700 1 -- 172.21.15.84:0/1899194551 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f01a8088be0 con 0x7f01b80d3f40 2023-09-13T08:25:47.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.495+0000 7f01b6ffd700 1 --2- 172.21.15.84:0/1899194551 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f01a406a580 0x7f01a406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:47.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.495+0000 7f01b6ffd700 1 --2- 172.21.15.84:0/1899194551 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f01a406a580 0x7f01a406ca40 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f01ac000f60 tx=0x7f01ac007a60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:47.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.499+0000 7f019ffff700 1 -- 172.21.15.84:0/1899194551 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f01a8053e10 con 0x7f01b80d3f40 2023-09-13T08:25:47.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.689+0000 7f01bda49700 1 -- 172.21.15.84:0/1899194551 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f01b80b5b30 con 0x7f01b80d3f40 2023-09-13T08:25:47.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.689+0000 7f019ffff700 1 -- 172.21.15.84:0/1899194551 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f01a8057430 con 0x7f01b80d3f40 2023-09-13T08:25:47.690 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-09-13T08:25:47.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.691+0000 7f01bda49700 1 -- 172.21.15.84:0/1899194551 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f01a406a580 msgr2=0x7f01a406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:47.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.691+0000 7f01bda49700 1 --2- 172.21.15.84:0/1899194551 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f01a406a580 0x7f01a406ca40 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f01ac000f60 tx=0x7f01ac007a60 comp rx=0 tx=0).stop 2023-09-13T08:25:47.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.691+0000 7f01bda49700 1 -- 172.21.15.84:0/1899194551 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b80d3f40 msgr2=0x7f01b80b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:47.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.691+0000 7f01bda49700 1 --2- 172.21.15.84:0/1899194551 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b80d3f40 0x7f01b80b4dd0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f01a800c4d0 tx=0x7f01a800c890 comp rx=0 tx=0).stop 2023-09-13T08:25:47.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.691+0000 7f01bda49700 1 -- 172.21.15.84:0/1899194551 shutdown_connections 2023-09-13T08:25:47.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.691+0000 7f01bda49700 1 --2- 172.21.15.84:0/1899194551 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f01a406a580 0x7f01a406ca40 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:47.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.691+0000 7f01bda49700 1 --2- 172.21.15.84:0/1899194551 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f01b815d580 0x7f01b80b5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:47.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.691+0000 7f01bda49700 1 --2- 172.21.15.84:0/1899194551 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f01b80b49f0 0x7f01b815e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:47.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.691+0000 7f01bda49700 1 --2- 172.21.15.84:0/1899194551 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b80d3f40 0x7f01b80b4dd0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:47.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.691+0000 7f01bda49700 1 -- 172.21.15.84:0/1899194551 >> 172.21.15.84:0/1899194551 conn(0x7f01b80d3300 msgr2=0x7f01b80b16c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:47.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.692+0000 7f01bda49700 1 -- 172.21.15.84:0/1899194551 shutdown_connections 2023-09-13T08:25:47.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.692+0000 7f01bda49700 1 -- 172.21.15.84:0/1899194551 wait complete. 2023-09-13T08:25:47.704 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T08:25:47.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.823+0000 7fc9d0015700 1 Processor -- start 2023-09-13T08:25:47.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.824+0000 7fc9d0015700 1 -- start start 2023-09-13T08:25:47.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.824+0000 7fc9d0015700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc9c815b560 0x7fc9c80ced90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:47.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.824+0000 7fc9d0015700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc9c80b0630 0x7fc9c80ae160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:47.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.825+0000 7fc9d0015700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9c815b940 con 0x7fc9c80d1ce0 2023-09-13T08:25:47.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.825+0000 7fc9d0015700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9c80d2170 con 0x7fc9c80b0630 2023-09-13T08:25:47.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.825+0000 7fc9d0015700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c80cc980 con 0x7fc9c815b560 2023-09-13T08:25:47.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.825+0000 7fc9ce5b2700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc9c80b0630 0x7fc9c80ae160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:47.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.825+0000 7fc9ce5b2700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc9c80b0630 0x7fc9c80ae160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45372/0 (socket says 172.21.15.84:45372) 2023-09-13T08:25:47.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.825+0000 7fc9ce5b2700 1 -- 172.21.15.84:0/1669449372 learned_addr learned my addr 172.21.15.84:0/1669449372 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:47.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.825+0000 7fc9cddb1700 1 --2- 172.21.15.84:0/1669449372 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc9c815b560 0x7fc9c80ced90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:47.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.825+0000 7fc9ce5b2700 1 -- 172.21.15.84:0/1669449372 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc9c815b560 msgr2=0x7fc9c80ced90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:47.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.825+0000 7fc9ce5b2700 1 --2- 172.21.15.84:0/1669449372 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc9c815b560 0x7fc9c80ced90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:47.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.825+0000 7fc9ce5b2700 1 -- 172.21.15.84:0/1669449372 >> v1:172.21.15.84:6789/0 conn(0x7fc9c80d1ce0 legacy=0x7fc9c80cf2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:47.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.825+0000 7fc9ce5b2700 1 -- 172.21.15.84:0/1669449372 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9c80ccc20 con 0x7fc9c80b0630 2023-09-13T08:25:47.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.825+0000 7fc9cddb1700 1 --2- 172.21.15.84:0/1669449372 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc9c815b560 0x7fc9c80ced90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T08:25:47.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.825+0000 7fc9ce5b2700 1 --2- 172.21.15.84:0/1669449372 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9c80b0630 0x7fc9c80ae160 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fc9c0009e50 tx=0x7fc9c000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1c72ed0308aab42 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:47.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.825+0000 7fc9ccdaf700 1 -- 172.21.15.84:0/1669449372 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c000e070 con 0x7fc9c80b0630 2023-09-13T08:25:47.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.825+0000 7fc9ccdaf700 1 -- 172.21.15.84:0/1669449372 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9c000b9c0 con 0x7fc9c80b0630 2023-09-13T08:25:47.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.825+0000 7fc9ccdaf700 1 -- 172.21.15.84:0/1669449372 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c000bd70 con 0x7fc9c80b0630 2023-09-13T08:25:47.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.826+0000 7fc9d0015700 1 -- 172.21.15.84:0/1669449372 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9c80b0630 msgr2=0x7fc9c80ae160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:47.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.826+0000 7fc9d0015700 1 --2- 172.21.15.84:0/1669449372 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9c80b0630 0x7fc9c80ae160 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fc9c0009e50 tx=0x7fc9c000b330 comp rx=0 tx=0).stop 2023-09-13T08:25:47.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.826+0000 7fc9d0015700 1 -- 172.21.15.84:0/1669449372 shutdown_connections 2023-09-13T08:25:47.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.826+0000 7fc9d0015700 1 --2- 172.21.15.84:0/1669449372 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9c80b0630 0x7fc9c80ae160 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:47.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.826+0000 7fc9d0015700 1 --2- 172.21.15.84:0/1669449372 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc9c815b560 0x7fc9c80ced90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:47.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.826+0000 7fc9d0015700 1 -- 172.21.15.84:0/1669449372 >> 172.21.15.84:0/1669449372 conn(0x7fc9c80d11c0 msgr2=0x7fc9c80d15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:47.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.826+0000 7fc9d0015700 1 -- 172.21.15.84:0/1669449372 shutdown_connections 2023-09-13T08:25:47.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.826+0000 7fc9d0015700 1 -- 172.21.15.84:0/1669449372 wait complete. 2023-09-13T08:25:47.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.827+0000 7fc9d0015700 1 Processor -- start 2023-09-13T08:25:47.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.827+0000 7fc9d0015700 1 -- start start 2023-09-13T08:25:47.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.828+0000 7fc9d0015700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc9c80b0630 0x7fc9c81585a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:47.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.828+0000 7fc9d0015700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc9c815b560 0x7fc9c80af3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:47.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.828+0000 7fc9d0015700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9c80c7960 0x7fc9c80ca390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:47.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.828+0000 7fc9d0015700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c80c8ca0 con 0x7fc9c80c7960 2023-09-13T08:25:47.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.828+0000 7fc9d0015700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c8158ae0 con 0x7fc9c815b560 2023-09-13T08:25:47.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.828+0000 7fc9d0015700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c80c8ef0 con 0x7fc9c80b0630 2023-09-13T08:25:47.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.828+0000 7fc9ce5b2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9c80c7960 0x7fc9c80ca390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:47.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.828+0000 7fc9ce5b2700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9c80c7960 0x7fc9c80ca390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45378/0 (socket says 172.21.15.84:45378) 2023-09-13T08:25:47.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.828+0000 7fc9ce5b2700 1 -- 172.21.15.84:0/4082722154 learned_addr learned my addr 172.21.15.84:0/4082722154 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:47.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.828+0000 7fc9cddb1700 1 --2- 172.21.15.84:0/4082722154 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc9c80b0630 0x7fc9c81585a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:47.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.828+0000 7fc9cd5b0700 1 --2- 172.21.15.84:0/4082722154 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc9c815b560 0x7fc9c80af3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:47.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.828+0000 7fc9ce5b2700 1 -- 172.21.15.84:0/4082722154 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc9c80b0630 msgr2=0x7fc9c81585a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:47.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.828+0000 7fc9ce5b2700 1 --2- 172.21.15.84:0/4082722154 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc9c80b0630 0x7fc9c81585a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:47.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.828+0000 7fc9ce5b2700 1 -- 172.21.15.84:0/4082722154 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc9c815b560 msgr2=0x7fc9c80af3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:47.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.828+0000 7fc9ce5b2700 1 --2- 172.21.15.84:0/4082722154 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc9c815b560 0x7fc9c80af3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:47.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.828+0000 7fc9ce5b2700 1 -- 172.21.15.84:0/4082722154 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9c0009b30 con 0x7fc9c80c7960 2023-09-13T08:25:47.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.828+0000 7fc9ce5b2700 1 --2- 172.21.15.84:0/4082722154 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9c80c7960 0x7fc9c80ca390 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fc9c808b5b0 tx=0x7fc9c0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:47.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.828+0000 7fc9be7fc700 1 -- 172.21.15.84:0/4082722154 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c00092e0 con 0x7fc9c80c7960 2023-09-13T08:25:47.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.828+0000 7fc9be7fc700 1 -- 172.21.15.84:0/4082722154 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9c0004960 con 0x7fc9c80c7960 2023-09-13T08:25:47.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.829+0000 7fc9d0015700 1 -- 172.21.15.84:0/4082722154 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9c80c91d0 con 0x7fc9c80c7960 2023-09-13T08:25:47.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.829+0000 7fc9be7fc700 1 -- 172.21.15.84:0/4082722154 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c001b670 con 0x7fc9c80c7960 2023-09-13T08:25:47.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.829+0000 7fc9d0015700 1 -- 172.21.15.84:0/4082722154 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9c80c9790 con 0x7fc9c80c7960 2023-09-13T08:25:47.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.829+0000 7fc9d0015700 1 -- 172.21.15.84:0/4082722154 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9c8072820 con 0x7fc9c80c7960 2023-09-13T08:25:47.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.830+0000 7fc9be7fc700 1 -- 172.21.15.84:0/4082722154 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fc9c001b7d0 con 0x7fc9c80c7960 2023-09-13T08:25:47.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.830+0000 7fc9be7fc700 1 --2- 172.21.15.84:0/4082722154 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fc9ac06a5b0 0x7fc9ac06ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:47.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.830+0000 7fc9be7fc700 1 -- 172.21.15.84:0/4082722154 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fc9c008a810 con 0x7fc9c80c7960 2023-09-13T08:25:47.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.830+0000 7fc9cddb1700 1 --2- 172.21.15.84:0/4082722154 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fc9ac06a5b0 0x7fc9ac06ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:47.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.831+0000 7fc9cddb1700 1 --2- 172.21.15.84:0/4082722154 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fc9ac06a5b0 0x7fc9ac06ca70 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc9b8006fd0 tx=0x7fc9b8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:47.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:47.835+0000 7fc9be7fc700 1 -- 172.21.15.84:0/4082722154 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fc9c00559a0 con 0x7fc9c80c7960 2023-09-13T08:25:48.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.072+0000 7fc9d0015700 1 -- 172.21.15.84:0/4082722154 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc9c804e9b0 con 0x7fc9c80c7960 2023-09-13T08:25:48.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.072+0000 7fc9be7fc700 1 -- 172.21.15.84:0/4082722154 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4909 (secure 0 0 0) 0x7fc9c0058fc0 con 0x7fc9c80c7960 2023-09-13T08:25:48.073 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:25:48.073 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/3581118217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6833","nonce":3581118217},{"type":"v1","addr":"172.21.15.161:6835","nonce":3581118217}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4296,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/566416855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":566416855},{"type":"v1","addr":"172.21.15.84:6835","nonce":566416855}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4299,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/482729238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":482729238},{"type":"v1","addr":"172.21.15.84:6837","nonce":482729238}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T08:24:42.132788+0000","modified":"2023-09-13T08:25:05.211766+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4314},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4314":{"gid":4314,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.161:6834/2524298549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":2524298549},{"type":"v1","addr":"172.21.15.161:6834","nonce":2524298549}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-13T08:25:48.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.075+0000 7fc9d0015700 1 -- 172.21.15.84:0/4082722154 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fc9ac06a5b0 msgr2=0x7fc9ac06ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:48.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.075+0000 7fc9d0015700 1 --2- 172.21.15.84:0/4082722154 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fc9ac06a5b0 0x7fc9ac06ca70 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc9b8006fd0 tx=0x7fc9b8008040 comp rx=0 tx=0).stop 2023-09-13T08:25:48.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.075+0000 7fc9d0015700 1 -- 172.21.15.84:0/4082722154 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9c80c7960 msgr2=0x7fc9c80ca390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:48.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.075+0000 7fc9d0015700 1 --2- 172.21.15.84:0/4082722154 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9c80c7960 0x7fc9c80ca390 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fc9c808b5b0 tx=0x7fc9c0004ad0 comp rx=0 tx=0).stop 2023-09-13T08:25:48.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.075+0000 7fc9d0015700 1 -- 172.21.15.84:0/4082722154 shutdown_connections 2023-09-13T08:25:48.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.075+0000 7fc9d0015700 1 --2- 172.21.15.84:0/4082722154 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9c80c7960 0x7fc9c80ca390 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:48.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.075+0000 7fc9d0015700 1 --2- 172.21.15.84:0/4082722154 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc9c80b0630 0x7fc9c81585a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:48.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.075+0000 7fc9d0015700 1 --2- 172.21.15.84:0/4082722154 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fc9ac06a5b0 0x7fc9ac06ca70 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:48.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.075+0000 7fc9d0015700 1 --2- 172.21.15.84:0/4082722154 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc9c815b560 0x7fc9c80af3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:48.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.075+0000 7fc9d0015700 1 -- 172.21.15.84:0/4082722154 >> 172.21.15.84:0/4082722154 conn(0x7fc9c80d11c0 msgr2=0x7fc9c806ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:48.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.075+0000 7fc9d0015700 1 -- 172.21.15.84:0/4082722154 shutdown_connections 2023-09-13T08:25:48.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.075+0000 7fc9d0015700 1 -- 172.21.15.84:0/4082722154 wait complete. 2023-09-13T08:25:48.077 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 9 2023-09-13T08:25:48.089 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T08:25:48.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.208+0000 7fadd7e4d700 1 Processor -- start 2023-09-13T08:25:48.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.209+0000 7fadd7e4d700 1 -- start start 2023-09-13T08:25:48.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.209+0000 7fadd7e4d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fadd015d530 0x7fadd0161bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:48.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.209+0000 7fadd7e4d700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fadd006a620 0x7fadd006aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:48.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.209+0000 7fadd7e4d700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadd006af90 con 0x7fadd00ca920 2023-09-13T08:25:48.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.209+0000 7fadd7e4d700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadd00cff20 con 0x7fadd015d530 2023-09-13T08:25:48.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.209+0000 7fadd7e4d700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadd01620f0 con 0x7fadd006a620 2023-09-13T08:25:48.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.210+0000 7fadd5be9700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fadd015d530 0x7fadd0161bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:48.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.210+0000 7fadd5be9700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fadd015d530 0x7fadd0161bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45382/0 (socket says 172.21.15.84:45382) 2023-09-13T08:25:48.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.210+0000 7fadd5be9700 1 -- 172.21.15.84:0/3102814835 learned_addr learned my addr 172.21.15.84:0/3102814835 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:48.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.210+0000 7fadd63ea700 1 --2- 172.21.15.84:0/3102814835 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fadd006a620 0x7fadd006aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:48.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.210+0000 7fadd5be9700 1 -- 172.21.15.84:0/3102814835 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fadd006a620 msgr2=0x7fadd006aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:48.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.210+0000 7fadd5be9700 1 --2- 172.21.15.84:0/3102814835 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fadd006a620 0x7fadd006aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:48.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.210+0000 7fadd5be9700 1 -- 172.21.15.84:0/3102814835 >> v1:172.21.15.161:6789/0 conn(0x7fadd00ca920 legacy=0x7fadd006d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:48.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.210+0000 7fadd5be9700 1 -- 172.21.15.84:0/3102814835 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadd00cae50 con 0x7fadd015d530 2023-09-13T08:25:48.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.210+0000 7fadd63ea700 1 --2- 172.21.15.84:0/3102814835 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fadd006a620 0x7fadd006aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T08:25:48.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.210+0000 7fadd5be9700 1 --2- 172.21.15.84:0/3102814835 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fadd015d530 0x7fadd0161bb0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fadc00098f0 tx=0x7fadc0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e46e88fe983471c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:48.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.210+0000 7fadd4be7700 1 -- 172.21.15.84:0/3102814835 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc0004230 con 0x7fadd015d530 2023-09-13T08:25:48.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.210+0000 7fadd4be7700 1 -- 172.21.15.84:0/3102814835 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadc0004390 con 0x7fadd015d530 2023-09-13T08:25:48.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.210+0000 7fadd4be7700 1 -- 172.21.15.84:0/3102814835 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc00036a0 con 0x7fadd015d530 2023-09-13T08:25:48.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.211+0000 7fadd7e4d700 1 -- 172.21.15.84:0/3102814835 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fadd015d530 msgr2=0x7fadd0161bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:48.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.211+0000 7fadd7e4d700 1 --2- 172.21.15.84:0/3102814835 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fadd015d530 0x7fadd0161bb0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fadc00098f0 tx=0x7fadc0009c00 comp rx=0 tx=0).stop 2023-09-13T08:25:48.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.211+0000 7fadd7e4d700 1 -- 172.21.15.84:0/3102814835 shutdown_connections 2023-09-13T08:25:48.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.211+0000 7fadd7e4d700 1 --2- 172.21.15.84:0/3102814835 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fadd015d530 0x7fadd0161bb0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:48.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.211+0000 7fadd7e4d700 1 --2- 172.21.15.84:0/3102814835 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fadd006a620 0x7fadd006aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:48.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.211+0000 7fadd7e4d700 1 -- 172.21.15.84:0/3102814835 >> 172.21.15.84:0/3102814835 conn(0x7fadd00d00c0 msgr2=0x7fadd00d04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:48.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.211+0000 7fadd7e4d700 1 -- 172.21.15.84:0/3102814835 shutdown_connections 2023-09-13T08:25:48.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.211+0000 7fadd7e4d700 1 -- 172.21.15.84:0/3102814835 wait complete. 2023-09-13T08:25:48.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.212+0000 7fadd7e4d700 1 Processor -- start 2023-09-13T08:25:48.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.212+0000 7fadd7e4d700 1 -- start start 2023-09-13T08:25:48.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.213+0000 7fadd7e4d700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fadd006a620 0x7fadd00aef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:48.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.213+0000 7fadd7e4d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fadd00ca920 0x7fadd014d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:48.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.213+0000 7fadd7e4d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fadd015d530 0x7fadd00ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:48.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.213+0000 7fadd7e4d700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd00ad6f0 con 0x7fadd015d530 2023-09-13T08:25:48.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.213+0000 7fadd7e4d700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd014eac0 con 0x7fadd00ca920 2023-09-13T08:25:48.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.213+0000 7fadd7e4d700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadd014eda0 con 0x7fadd006a620 2023-09-13T08:25:48.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.213+0000 7fadd63ea700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fadd015d530 0x7fadd00ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:48.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.213+0000 7fadd63ea700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fadd015d530 0x7fadd00ac8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45392/0 (socket says 172.21.15.84:45392) 2023-09-13T08:25:48.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.213+0000 7fadd63ea700 1 -- 172.21.15.84:0/3913717244 learned_addr learned my addr 172.21.15.84:0/3913717244 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:48.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.213+0000 7fadd5be9700 1 --2- 172.21.15.84:0/3913717244 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fadd006a620 0x7fadd00aef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:48.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.213+0000 7fadd53e8700 1 --2- 172.21.15.84:0/3913717244 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fadd00ca920 0x7fadd014d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:48.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.213+0000 7fadd63ea700 1 -- 172.21.15.84:0/3913717244 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fadd006a620 msgr2=0x7fadd00aef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:48.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.213+0000 7fadd63ea700 1 --2- 172.21.15.84:0/3913717244 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fadd006a620 0x7fadd00aef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:48.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.213+0000 7fadd63ea700 1 -- 172.21.15.84:0/3913717244 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fadd00ca920 msgr2=0x7fadd014d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:48.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.213+0000 7fadd63ea700 1 --2- 172.21.15.84:0/3913717244 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fadd00ca920 0x7fadd014d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:48.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.213+0000 7fadd63ea700 1 -- 172.21.15.84:0/3913717244 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadc0009550 con 0x7fadd015d530 2023-09-13T08:25:48.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.213+0000 7fadd63ea700 1 --2- 172.21.15.84:0/3913717244 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fadd015d530 0x7fadd00ac8e0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fadc800ce40 tx=0x7fadc800ce70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:48.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.213+0000 7fadc67fc700 1 -- 172.21.15.84:0/3913717244 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc800ac40 con 0x7fadd015d530 2023-09-13T08:25:48.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.213+0000 7fadc67fc700 1 -- 172.21.15.84:0/3913717244 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadc800ada0 con 0x7fadd015d530 2023-09-13T08:25:48.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.213+0000 7fadd7e4d700 1 -- 172.21.15.84:0/3913717244 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadd014f080 con 0x7fadd015d530 2023-09-13T08:25:48.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.213+0000 7fadc67fc700 1 -- 172.21.15.84:0/3913717244 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc8015680 con 0x7fadd015d530 2023-09-13T08:25:48.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.214+0000 7fadd7e4d700 1 -- 172.21.15.84:0/3913717244 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadd00ace20 con 0x7fadd015d530 2023-09-13T08:25:48.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.214+0000 7fadd7e4d700 1 -- 172.21.15.84:0/3913717244 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadd014f270 con 0x7fadd015d530 2023-09-13T08:25:48.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.215+0000 7fadc67fc700 1 -- 172.21.15.84:0/3913717244 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fadc800d430 con 0x7fadd015d530 2023-09-13T08:25:48.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.215+0000 7fadc67fc700 1 --2- 172.21.15.84:0/3913717244 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fadb406a580 0x7fadb406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:48.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.215+0000 7fadc67fc700 1 -- 172.21.15.84:0/3913717244 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fadc80891e0 con 0x7fadd015d530 2023-09-13T08:25:48.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.215+0000 7fadd5be9700 1 --2- 172.21.15.84:0/3913717244 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fadb406a580 0x7fadb406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:48.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.216+0000 7fadd5be9700 1 --2- 172.21.15.84:0/3913717244 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fadb406a580 0x7fadb406ca40 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fadc0009130 tx=0x7fadc0008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:48.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.220+0000 7fadc67fc700 1 -- 172.21.15.84:0/3913717244 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fadc8054380 con 0x7fadd015d530 2023-09-13T08:25:48.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.412+0000 7fadd7e4d700 1 -- 172.21.15.84:0/3913717244 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fadd004e9b0 con 0x7fadd015d530 2023-09-13T08:25:48.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.413+0000 7fadc67fc700 1 -- 172.21.15.84:0/3913717244 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18757 (secure 0 0 0) 0x7fadc80579a0 con 0x7fadd015d530 2023-09-13T08:25:48.414 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:25:48.415 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":26,"fsid":"0107440b-b634-42c5-a643-5d31ea826116","created":"2023-09-13T08:24:16.931917+0000","modified":"2023-09-13T08:25:23.878460+0000","last_up_change":"2023-09-13T08:24:28.422631+0000","last_in_change":"2023-09-13T08:24:19.425578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T08:24:28.583720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-13T08:24:39.862832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-13T08:24:41.145511+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-13T08:24:44.775160+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4a53ec12-1469-4356-b4e1-2b8fc9b7c0f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6817","nonce":1599532366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6819","nonce":1599532366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6823","nonce":1599532366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6821","nonce":1599532366}]},"public_addr":"172.21.15.84:6817/1599532366","cluster_addr":"172.21.15.84:6819/1599532366","heartbeat_back_addr":"172.21.15.84:6823/1599532366","heartbeat_front_addr":"172.21.15.84:6821/1599532366","state":["exists","up"]},{"osd":1,"uuid":"11e964a0-b80c-4afc-bfbf-e2067969db29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6825","nonce":461860977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6827","nonce":461860977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6831","nonce":461860977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6829","nonce":461860977}]},"public_addr":"172.21.15.84:6825/461860977","cluster_addr":"172.21.15.84:6827/461860977","heartbeat_back_addr":"172.21.15.84:6831/461860977","heartbeat_front_addr":"172.21.15.84:6829/461860977","state":["exists","up"]},{"osd":2,"uuid":"3ce74529-4dd1-44c7-9576-968f5fdc0c25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6809","nonce":1168316165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6811","nonce":1168316165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6815","nonce":1168316165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6813","nonce":1168316165}]},"public_addr":"172.21.15.84:6809/1168316165","cluster_addr":"172.21.15.84:6811/1168316165","heartbeat_back_addr":"172.21.15.84:6815/1168316165","heartbeat_front_addr":"172.21.15.84:6813/1168316165","state":["exists","up"]},{"osd":3,"uuid":"460cb5c5-590a-4d06-a4d9-5bac2fdf33b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6801","nonce":1661609810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6803","nonce":1661609810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6807","nonce":1661609810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6805","nonce":1661609810}]},"public_addr":"172.21.15.84:6801/1661609810","cluster_addr":"172.21.15.84:6803/1661609810","heartbeat_back_addr":"172.21.15.84:6807/1661609810","heartbeat_front_addr":"172.21.15.84:6805/1661609810","state":["exists","up"]},{"osd":4,"uuid":"bf237dd0-3ebd-44b5-8078-24a63e00d792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6801","nonce":1303562374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6803","nonce":1303562374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6807","nonce":1303562374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6805","nonce":1303562374}]},"public_addr":"172.21.15.161:6801/1303562374","cluster_addr":"172.21.15.161:6803/1303562374","heartbeat_back_addr":"172.21.15.161:6807/1303562374","heartbeat_front_addr":"172.21.15.161:6805/1303562374","state":["exists","up"]},{"osd":5,"uuid":"e1e538e0-5844-456b-8c6e-434d3a914af1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6818","nonce":961120854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6822","nonce":961120854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6830","nonce":961120854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6826","nonce":961120854}]},"public_addr":"172.21.15.161:6818/961120854","cluster_addr":"172.21.15.161:6822/961120854","heartbeat_back_addr":"172.21.15.161:6830/961120854","heartbeat_front_addr":"172.21.15.161:6826/961120854","state":["exists","up"]},{"osd":6,"uuid":"5cb1785e-960f-4dd4-b295-9e21b2c3f875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6809","nonce":980533466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6811","nonce":980533466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6815","nonce":980533466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6813","nonce":980533466}]},"public_addr":"172.21.15.161:6809/980533466","cluster_addr":"172.21.15.161:6811/980533466","heartbeat_back_addr":"172.21.15.161:6815/980533466","heartbeat_front_addr":"172.21.15.161:6813/980533466","state":["exists","up"]},{"osd":7,"uuid":"5acb6619-e933-4b46-b1c2-60af30acb839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6817","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6819","nonce":2479691549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6821","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6823","nonce":2479691549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6829","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6831","nonce":2479691549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6825","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6827","nonce":2479691549}]},"public_addr":"172.21.15.161:6819/2479691549","cluster_addr":"172.21.15.161:6823/2479691549","heartbeat_back_addr":"172.21.15.161:6831/2479691549","heartbeat_front_addr":"172.21.15.161:6827/2479691549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.678857+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.685341+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.613603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.634940+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.564387+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.697347+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.637437+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.619397+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":1}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T08:25:48.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.415+0000 7fadd7e4d700 1 -- 172.21.15.84:0/3913717244 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fadb406a580 msgr2=0x7fadb406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:48.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.415+0000 7fadd7e4d700 1 --2- 172.21.15.84:0/3913717244 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fadb406a580 0x7fadb406ca40 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fadc0009130 tx=0x7fadc0008030 comp rx=0 tx=0).stop 2023-09-13T08:25:48.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.415+0000 7fadd7e4d700 1 -- 172.21.15.84:0/3913717244 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fadd015d530 msgr2=0x7fadd00ac8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:48.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.415+0000 7fadd7e4d700 1 --2- 172.21.15.84:0/3913717244 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fadd015d530 0x7fadd00ac8e0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fadc800ce40 tx=0x7fadc800ce70 comp rx=0 tx=0).stop 2023-09-13T08:25:48.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.415+0000 7fadd7e4d700 1 -- 172.21.15.84:0/3913717244 shutdown_connections 2023-09-13T08:25:48.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.415+0000 7fadd7e4d700 1 --2- 172.21.15.84:0/3913717244 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fadd015d530 0x7fadd00ac8e0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:48.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.415+0000 7fadd7e4d700 1 --2- 172.21.15.84:0/3913717244 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fadd006a620 0x7fadd00aef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:48.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.416+0000 7fadd7e4d700 1 --2- 172.21.15.84:0/3913717244 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fadb406a580 0x7fadb406ca40 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:48.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.416+0000 7fadd7e4d700 1 --2- 172.21.15.84:0/3913717244 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fadd00ca920 0x7fadd014d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:48.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.416+0000 7fadd7e4d700 1 -- 172.21.15.84:0/3913717244 >> 172.21.15.84:0/3913717244 conn(0x7fadd00d00c0 msgr2=0x7fadd00ce860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:48.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.416+0000 7fadd7e4d700 1 -- 172.21.15.84:0/3913717244 shutdown_connections 2023-09-13T08:25:48.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.416+0000 7fadd7e4d700 1 -- 172.21.15.84:0/3913717244 wait complete. 2023-09-13T08:25:48.428 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-09-13T08:25:48.429 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T08:25:48.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.549+0000 7f6144018700 1 Processor -- start 2023-09-13T08:25:48.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.549+0000 7f6144018700 1 -- start start 2023-09-13T08:25:48.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.550+0000 7f6144018700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f613c0b3b70 0x7f613c070e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:48.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.550+0000 7f6144018700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f613c0ae670 0x7f613c0713a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:48.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.550+0000 7f6144018700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f613c0b1680 con 0x7f613c159c60 2023-09-13T08:25:48.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.550+0000 7f6144018700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f613c0706f0 con 0x7f613c0b3b70 2023-09-13T08:25:48.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.550+0000 7f6144018700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f613c0ae2c0 con 0x7f613c0ae670 2023-09-13T08:25:48.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.550+0000 7f61415b3700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f613c0b3b70 0x7f613c070e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:48.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.550+0000 7f61415b3700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f613c0b3b70 0x7f613c070e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45398/0 (socket says 172.21.15.84:45398) 2023-09-13T08:25:48.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.550+0000 7f61415b3700 1 -- 172.21.15.84:0/1662349248 learned_addr learned my addr 172.21.15.84:0/1662349248 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:48.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.550+0000 7f61425b5700 1 --2- 172.21.15.84:0/1662349248 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f613c0ae670 0x7f613c0713a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:48.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.550+0000 7f61415b3700 1 -- 172.21.15.84:0/1662349248 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f613c0ae670 msgr2=0x7f613c0713a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:48.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.550+0000 7f61415b3700 1 --2- 172.21.15.84:0/1662349248 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f613c0ae670 0x7f613c0713a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:48.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.550+0000 7f61415b3700 1 -- 172.21.15.84:0/1662349248 >> v1:172.21.15.161:6789/0 conn(0x7f613c159c60 legacy=0x7f613c0ce590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:48.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.550+0000 7f61415b3700 1 -- 172.21.15.84:0/1662349248 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f613c0b18d0 con 0x7f613c0b3b70 2023-09-13T08:25:48.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.550+0000 7f61415b3700 1 --2- 172.21.15.84:0/1662349248 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f613c0b3b70 0x7f613c070e60 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f612c0098f0 tx=0x7f612c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=594e201d4b05c33b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:48.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.550+0000 7f6140db2700 1 -- 172.21.15.84:0/1662349248 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f612c00b8a0 con 0x7f613c0b3b70 2023-09-13T08:25:48.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.550+0000 7f6140db2700 1 -- 172.21.15.84:0/1662349248 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f612c00ba00 con 0x7f613c0b3b70 2023-09-13T08:25:48.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.550+0000 7f6140db2700 1 -- 172.21.15.84:0/1662349248 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f612c00bd90 con 0x7f613c0b3b70 2023-09-13T08:25:48.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.551+0000 7f6144018700 1 -- 172.21.15.84:0/1662349248 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f613c0b3b70 msgr2=0x7f613c070e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:48.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.551+0000 7f6144018700 1 --2- 172.21.15.84:0/1662349248 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f613c0b3b70 0x7f613c070e60 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f612c0098f0 tx=0x7f612c009c00 comp rx=0 tx=0).stop 2023-09-13T08:25:48.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.551+0000 7f6144018700 1 -- 172.21.15.84:0/1662349248 shutdown_connections 2023-09-13T08:25:48.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.551+0000 7f6144018700 1 --2- 172.21.15.84:0/1662349248 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f613c0ae670 0x7f613c0713a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:48.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.551+0000 7f6144018700 1 --2- 172.21.15.84:0/1662349248 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f613c0b3b70 0x7f613c070e60 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:48.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.551+0000 7f6144018700 1 -- 172.21.15.84:0/1662349248 >> 172.21.15.84:0/1662349248 conn(0x7f613c0cbd80 msgr2=0x7f613c0cc160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:48.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.551+0000 7f6144018700 1 -- 172.21.15.84:0/1662349248 shutdown_connections 2023-09-13T08:25:48.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.551+0000 7f6144018700 1 -- 172.21.15.84:0/1662349248 wait complete. 2023-09-13T08:25:48.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.552+0000 7f6144018700 1 Processor -- start 2023-09-13T08:25:48.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.552+0000 7f6144018700 1 -- start start 2023-09-13T08:25:48.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.553+0000 7f6144018700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f613c0ae670 0x7f613c0ac7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:48.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.553+0000 7f6144018700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f613c0b3b70 0x7f613c1528f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:48.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.553+0000 7f6144018700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f613c159c60 0x7f613c1f6da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:48.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.553+0000 7f6144018700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f613c0aeb60 con 0x7f613c0ae670 2023-09-13T08:25:48.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.553+0000 7f6144018700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f613c0af400 con 0x7f613c0b3b70 2023-09-13T08:25:48.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.553+0000 7f6144018700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f613c152e30 con 0x7f613c159c60 2023-09-13T08:25:48.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.553+0000 7f6141db4700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f613c0ae670 0x7f613c0ac7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:48.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.553+0000 7f6141db4700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f613c0ae670 0x7f613c0ac7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45402/0 (socket says 172.21.15.84:45402) 2023-09-13T08:25:48.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.553+0000 7f6141db4700 1 -- 172.21.15.84:0/3440439026 learned_addr learned my addr 172.21.15.84:0/3440439026 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:48.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.553+0000 7f6141db4700 1 -- 172.21.15.84:0/3440439026 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f613c159c60 msgr2=0x7f613c1f6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:48.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.553+0000 7f61415b3700 1 --2- 172.21.15.84:0/3440439026 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f613c0b3b70 0x7f613c1528f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:48.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.553+0000 7f61425b5700 1 --2- 172.21.15.84:0/3440439026 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f613c159c60 0x7f613c1f6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:48.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.553+0000 7f6141db4700 1 --2- 172.21.15.84:0/3440439026 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f613c159c60 0x7f613c1f6da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:48.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.553+0000 7f6141db4700 1 -- 172.21.15.84:0/3440439026 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f613c0b3b70 msgr2=0x7f613c1528f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:48.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.553+0000 7f6141db4700 1 --2- 172.21.15.84:0/3440439026 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f613c0b3b70 0x7f613c1528f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:48.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.553+0000 7f6141db4700 1 -- 172.21.15.84:0/3440439026 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f612c009550 con 0x7f613c0ae670 2023-09-13T08:25:48.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.554+0000 7f6141db4700 1 --2- 172.21.15.84:0/3440439026 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f613c0ae670 0x7f613c0ac7d0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f613800c4d0 tx=0x7f613800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:48.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.554+0000 7f61327fc700 1 -- 172.21.15.84:0/3440439026 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61380052d0 con 0x7f613c0ae670 2023-09-13T08:25:48.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.554+0000 7f61327fc700 1 -- 172.21.15.84:0/3440439026 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6138005430 con 0x7f613c0ae670 2023-09-13T08:25:48.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.554+0000 7f6144018700 1 -- 172.21.15.84:0/3440439026 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f613c1f72e0 con 0x7f613c0ae670 2023-09-13T08:25:48.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.554+0000 7f61327fc700 1 -- 172.21.15.84:0/3440439026 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61380038f0 con 0x7f613c0ae670 2023-09-13T08:25:48.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.554+0000 7f6144018700 1 -- 172.21.15.84:0/3440439026 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f613c0aedb0 con 0x7f613c0ae670 2023-09-13T08:25:48.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.555+0000 7f6144018700 1 -- 172.21.15.84:0/3440439026 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f613c04e9b0 con 0x7f613c0ae670 2023-09-13T08:25:48.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.555+0000 7f61327fc700 1 -- 172.21.15.84:0/3440439026 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f6138003a50 con 0x7f613c0ae670 2023-09-13T08:25:48.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.555+0000 7f61327fc700 1 --2- 172.21.15.84:0/3440439026 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f612006a580 0x7f612006ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:48.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.556+0000 7f61415b3700 1 --2- 172.21.15.84:0/3440439026 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f612006a580 0x7f612006ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:48.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.556+0000 7f61327fc700 1 -- 172.21.15.84:0/3440439026 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f6138088300 con 0x7f613c0ae670 2023-09-13T08:25:48.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.556+0000 7f61415b3700 1 --2- 172.21.15.84:0/3440439026 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f612006a580 0x7f612006ca40 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f613c1f62f0 tx=0x7f612c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:48.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.560+0000 7f61327fc700 1 -- 172.21.15.84:0/3440439026 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f6138053490 con 0x7f613c0ae670 2023-09-13T08:25:48.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.795+0000 7f6144018700 1 -- 172.21.15.84:0/3440439026 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f613c156ea0 con 0x7f613c0ae670 2023-09-13T08:25:48.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.795+0000 7f61327fc700 1 -- 172.21.15.84:0/3440439026 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4909 (secure 0 0 0) 0x7f6138056ab0 con 0x7f613c0ae670 2023-09-13T08:25:48.796 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:25:48.796 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/3581118217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6833","nonce":3581118217},{"type":"v1","addr":"172.21.15.161:6835","nonce":3581118217}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4296,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/566416855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":566416855},{"type":"v1","addr":"172.21.15.84:6835","nonce":566416855}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4299,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/482729238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":482729238},{"type":"v1","addr":"172.21.15.84:6837","nonce":482729238}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T08:24:42.132788+0000","modified":"2023-09-13T08:25:05.211766+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4314},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4314":{"gid":4314,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.161:6834/2524298549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":2524298549},{"type":"v1","addr":"172.21.15.161:6834","nonce":2524298549}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-13T08:25:48.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.797+0000 7f6144018700 1 -- 172.21.15.84:0/3440439026 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f612006a580 msgr2=0x7f612006ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:48.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.797+0000 7f6144018700 1 --2- 172.21.15.84:0/3440439026 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f612006a580 0x7f612006ca40 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f613c1f62f0 tx=0x7f612c008030 comp rx=0 tx=0).stop 2023-09-13T08:25:48.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.797+0000 7f6144018700 1 -- 172.21.15.84:0/3440439026 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f613c0ae670 msgr2=0x7f613c0ac7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:48.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.797+0000 7f6144018700 1 --2- 172.21.15.84:0/3440439026 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f613c0ae670 0x7f613c0ac7d0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f613800c4d0 tx=0x7f613800c890 comp rx=0 tx=0).stop 2023-09-13T08:25:48.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.797+0000 7f6144018700 1 -- 172.21.15.84:0/3440439026 shutdown_connections 2023-09-13T08:25:48.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.797+0000 7f6144018700 1 --2- 172.21.15.84:0/3440439026 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f613c159c60 0x7f613c1f6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:48.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.798+0000 7f6144018700 1 --2- 172.21.15.84:0/3440439026 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f613c0ae670 0x7f613c0ac7d0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:48.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.798+0000 7f6144018700 1 --2- 172.21.15.84:0/3440439026 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f612006a580 0x7f612006ca40 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:48.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.798+0000 7f6144018700 1 --2- 172.21.15.84:0/3440439026 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f613c0b3b70 0x7f613c1528f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:48.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.798+0000 7f6144018700 1 -- 172.21.15.84:0/3440439026 >> 172.21.15.84:0/3440439026 conn(0x7f613c0cbd80 msgr2=0x7f613c158260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:48.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.798+0000 7f6144018700 1 -- 172.21.15.84:0/3440439026 shutdown_connections 2023-09-13T08:25:48.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.798+0000 7f6144018700 1 -- 172.21.15.84:0/3440439026 wait complete. 2023-09-13T08:25:48.800 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 9 2023-09-13T08:25:48.810 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T08:25:48.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.930+0000 7f665a80f700 1 Processor -- start 2023-09-13T08:25:48.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.930+0000 7f665a80f700 1 -- start start 2023-09-13T08:25:48.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.931+0000 7f665a80f700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f66540ca920 0x7f665406d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:48.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.931+0000 7f665a80f700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66540cae50 con 0x7f665415d530 2023-09-13T08:25:48.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.931+0000 7f665a80f700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66540cb130 con 0x7f665406a620 2023-09-13T08:25:48.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.931+0000 7f665a80f700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66540cff20 con 0x7f66540ca920 2023-09-13T08:25:48.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.931+0000 7f6653fff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f665415d530 0x7f6654161bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:48056/0 (socket says 172.21.15.84:48056) 2023-09-13T08:25:48.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.931+0000 7f6653fff700 1 -- 172.21.15.84:0/1068258479 learned_addr learned my addr 172.21.15.84:0/1068258479 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:25:48.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.931+0000 7f66537fe700 1 --2- 172.21.15.84:0/1068258479 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f66540ca920 0x7f665406d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:48.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.932+0000 7f6652ffd700 1 -- 172.21.15.84:0/1068258479 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2379386137 0 0) 0x7f66540cae50 con 0x7f665415d530 2023-09-13T08:25:48.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.932+0000 7f6652ffd700 1 -- 172.21.15.84:0/1068258479 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f663c0035b0 con 0x7f665415d530 2023-09-13T08:25:48.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.932+0000 7f6652ffd700 1 -- 172.21.15.84:0/1068258479 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 749011623 0 0) 0x7f66540cb130 con 0x7f665406a620 2023-09-13T08:25:48.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.932+0000 7f6652ffd700 1 -- 172.21.15.84:0/1068258479 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66540cae50 con 0x7f665406a620 2023-09-13T08:25:48.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.932+0000 7f6652ffd700 1 -- 172.21.15.84:0/1068258479 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3862134139 0 0) 0x7f663c0035b0 con 0x7f665415d530 2023-09-13T08:25:48.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.932+0000 7f6652ffd700 1 -- 172.21.15.84:0/1068258479 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f66540ca920 msgr2=0x7f665406d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:48.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.932+0000 7f6652ffd700 1 --2- 172.21.15.84:0/1068258479 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f66540ca920 0x7f665406d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:48.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.932+0000 7f6652ffd700 1 -- 172.21.15.84:0/1068258479 >> v1:172.21.15.161:6789/0 conn(0x7f665406a620 legacy=0x7f66540ce490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:48.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.932+0000 7f6652ffd700 1 -- 172.21.15.84:0/1068258479 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66540cb410 con 0x7f665415d530 2023-09-13T08:25:48.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.932+0000 7f6652ffd700 1 -- 172.21.15.84:0/1068258479 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2302733408 0 0) 0x7f6644001670 con 0x7f665415d530 2023-09-13T08:25:48.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.932+0000 7f6652ffd700 1 -- 172.21.15.84:0/1068258479 >> v1:172.21.15.84:6789/0 conn(0x7f665415d530 legacy=0x7f6654161bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:48.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.932+0000 7f6652ffd700 1 --2- 172.21.15.84:0/1068258479 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f663c003bc0 0x7f663c003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:48.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.932+0000 7f6652ffd700 1 --2- 172.21.15.84:0/1068258479 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f66540ca920 0x7f663c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:48.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.932+0000 7f6652ffd700 1 --2- 172.21.15.84:0/1068258479 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f663c004d90 0x7f663c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:48.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.932+0000 7f6652ffd700 1 -- 172.21.15.84:0/1068258479 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f663c00bac0 con 0x7f663c003bc0 2023-09-13T08:25:48.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.932+0000 7f6652ffd700 1 -- 172.21.15.84:0/1068258479 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f663c00bc00 con 0x7f663c004d90 2023-09-13T08:25:48.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.932+0000 7f6652ffd700 1 -- 172.21.15.84:0/1068258479 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f663c00bdc0 con 0x7f66540ca920 2023-09-13T08:25:48.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.932+0000 7f6653fff700 1 --2- 172.21.15.84:0/1068258479 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f663c003bc0 0x7f663c003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:48.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.932+0000 7f66537fe700 1 --2- 172.21.15.84:0/1068258479 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f66540ca920 0x7f663c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:48.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.932+0000 7f6658dac700 1 --2- 172.21.15.84:0/1068258479 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f663c004d90 0x7f663c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:48.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.932+0000 7f6653fff700 1 -- 172.21.15.84:0/1068258479 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f66540ca920 msgr2=0x7f663c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:48.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.932+0000 7f6653fff700 1 --2- 172.21.15.84:0/1068258479 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f66540ca920 0x7f663c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:48.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.932+0000 7f6653fff700 1 -- 172.21.15.84:0/1068258479 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f663c004d90 msgr2=0x7f663c005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:48.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.932+0000 7f6653fff700 1 --2- 172.21.15.84:0/1068258479 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f663c004d90 0x7f663c005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:48.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.932+0000 7f6653fff700 1 -- 172.21.15.84:0/1068258479 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f663c0035b0 con 0x7f663c003bc0 2023-09-13T08:25:48.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.932+0000 7f66537fe700 1 --2- 172.21.15.84:0/1068258479 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f66540ca920 0x7f663c004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T08:25:48.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.932+0000 7f6653fff700 1 --2- 172.21.15.84:0/1068258479 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f663c003bc0 0x7f663c003fc0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f664400c210 tx=0x7f663c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=314017f188c83620 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:48.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.933+0000 7f6652ffd700 1 -- 172.21.15.84:0/1068258479 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f664400cdb0 con 0x7f663c003bc0 2023-09-13T08:25:48.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.933+0000 7f6652ffd700 1 -- 172.21.15.84:0/1068258479 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6644001af0 con 0x7f663c003bc0 2023-09-13T08:25:48.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.933+0000 7f6652ffd700 1 -- 172.21.15.84:0/1068258479 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6644005ba0 con 0x7f663c003bc0 2023-09-13T08:25:48.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.933+0000 7f665a80f700 1 -- 172.21.15.84:0/1068258479 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f663c003bc0 msgr2=0x7f663c003fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:48.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.933+0000 7f665a80f700 1 --2- 172.21.15.84:0/1068258479 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f663c003bc0 0x7f663c003fc0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f664400c210 tx=0x7f663c005880 comp rx=0 tx=0).stop 2023-09-13T08:25:48.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.933+0000 7f6658dac700 1 -- 172.21.15.84:0/1068258479 reap_dead start 2023-09-13T08:25:48.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.933+0000 7f665a80f700 1 -- 172.21.15.84:0/1068258479 shutdown_connections 2023-09-13T08:25:48.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.933+0000 7f665a80f700 1 -- 172.21.15.84:0/1068258479 >> 172.21.15.84:0/1068258479 conn(0x7f66540d00c0 msgr2=0x7f66540d04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:48.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.933+0000 7f665a80f700 1 -- 172.21.15.84:0/1068258479 shutdown_connections 2023-09-13T08:25:48.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.933+0000 7f665a80f700 1 -- 172.21.15.84:0/1068258479 wait complete. 2023-09-13T08:25:48.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.935+0000 7f665a80f700 1 Processor -- start 2023-09-13T08:25:48.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.935+0000 7f665a80f700 1 -- start start 2023-09-13T08:25:48.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.936+0000 7f665a80f700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f663c003bc0 0x7f66540c6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:48.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.936+0000 7f665a80f700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6654156770 0x7f6654156bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:48.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.936+0000 7f665a80f700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f665415eca0 0x7f665415f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:48.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.936+0000 7f665a80f700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6654157130 con 0x7f663c003bc0 2023-09-13T08:25:48.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.936+0000 7f665a80f700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f665415fa10 con 0x7f6654156770 2023-09-13T08:25:48.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.936+0000 7f665a80f700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f665415fcf0 con 0x7f665415eca0 2023-09-13T08:25:48.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.936+0000 7f6653fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f663c003bc0 0x7f66540c6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:48.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.936+0000 7f6653fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f663c003bc0 0x7f66540c6190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45422/0 (socket says 172.21.15.84:45422) 2023-09-13T08:25:48.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.936+0000 7f6653fff700 1 -- 172.21.15.84:0/3508766299 learned_addr learned my addr 172.21.15.84:0/3508766299 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:48.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.936+0000 7f66537fe700 1 --2- 172.21.15.84:0/3508766299 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6654156770 0x7f6654156bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:48.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.936+0000 7f6658dac700 1 --2- 172.21.15.84:0/3508766299 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f665415eca0 0x7f665415f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:48.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.936+0000 7f6653fff700 1 -- 172.21.15.84:0/3508766299 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f665415eca0 msgr2=0x7f665415f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:48.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.936+0000 7f6653fff700 1 --2- 172.21.15.84:0/3508766299 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f665415eca0 0x7f665415f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:48.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.936+0000 7f6653fff700 1 -- 172.21.15.84:0/3508766299 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6654156770 msgr2=0x7f6654156bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:48.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.936+0000 7f6653fff700 1 --2- 172.21.15.84:0/3508766299 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6654156770 0x7f6654156bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:48.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.936+0000 7f6653fff700 1 -- 172.21.15.84:0/3508766299 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f665415ffd0 con 0x7f663c003bc0 2023-09-13T08:25:48.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.936+0000 7f6653fff700 1 --2- 172.21.15.84:0/3508766299 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f663c003bc0 0x7f66540c6190 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f663c0047b0 tx=0x7f6644001980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:48.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.936+0000 7f6650ff9700 1 -- 172.21.15.84:0/3508766299 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66440072d0 con 0x7f663c003bc0 2023-09-13T08:25:48.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.936+0000 7f6650ff9700 1 -- 172.21.15.84:0/3508766299 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6644007430 con 0x7f663c003bc0 2023-09-13T08:25:48.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.937+0000 7f665a80f700 1 -- 172.21.15.84:0/3508766299 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66541602b0 con 0x7f663c003bc0 2023-09-13T08:25:48.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.937+0000 7f6650ff9700 1 -- 172.21.15.84:0/3508766299 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66440077e0 con 0x7f663c003bc0 2023-09-13T08:25:48.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.937+0000 7f665a80f700 1 -- 172.21.15.84:0/3508766299 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66540c66d0 con 0x7f663c003bc0 2023-09-13T08:25:48.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.937+0000 7f665a80f700 1 -- 172.21.15.84:0/3508766299 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6654153ce0 con 0x7f663c003bc0 2023-09-13T08:25:48.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.938+0000 7f6650ff9700 1 -- 172.21.15.84:0/3508766299 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f664401e430 con 0x7f663c003bc0 2023-09-13T08:25:48.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.938+0000 7f6650ff9700 1 --2- 172.21.15.84:0/3508766299 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f664006a580 0x7f664006ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:48.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.938+0000 7f6650ff9700 1 -- 172.21.15.84:0/3508766299 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f66440899a0 con 0x7f663c003bc0 2023-09-13T08:25:48.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.938+0000 7f66537fe700 1 --2- 172.21.15.84:0/3508766299 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f664006a580 0x7f664006ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:48.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.939+0000 7f66537fe700 1 --2- 172.21.15.84:0/3508766299 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f664006a580 0x7f664006ca40 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6654071e90 tx=0x7f6648008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:48.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:48.943+0000 7f6650ff9700 1 -- 172.21.15.84:0/3508766299 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f6644054c80 con 0x7f663c003bc0 2023-09-13T08:25:49.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.175+0000 7f665a80f700 1 -- 172.21.15.84:0/3508766299 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f665404e9b0 con 0x7f663c003bc0 2023-09-13T08:25:49.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.176+0000 7f6650ff9700 1 -- 172.21.15.84:0/3508766299 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4909 (secure 0 0 0) 0x7f66440582a0 con 0x7f663c003bc0 2023-09-13T08:25:49.176 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:25:49.176 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/3581118217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6833","nonce":3581118217},{"type":"v1","addr":"172.21.15.161:6835","nonce":3581118217}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4296,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/566416855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":566416855},{"type":"v1","addr":"172.21.15.84:6835","nonce":566416855}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4299,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/482729238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":482729238},{"type":"v1","addr":"172.21.15.84:6837","nonce":482729238}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T08:24:42.132788+0000","modified":"2023-09-13T08:25:05.211766+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4314},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4314":{"gid":4314,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.161:6834/2524298549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":2524298549},{"type":"v1","addr":"172.21.15.161:6834","nonce":2524298549}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-13T08:25:49.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.178+0000 7f665a80f700 1 -- 172.21.15.84:0/3508766299 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f664006a580 msgr2=0x7f664006ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:49.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.178+0000 7f665a80f700 1 --2- 172.21.15.84:0/3508766299 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f664006a580 0x7f664006ca40 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6654071e90 tx=0x7f6648008040 comp rx=0 tx=0).stop 2023-09-13T08:25:49.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.178+0000 7f665a80f700 1 -- 172.21.15.84:0/3508766299 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f663c003bc0 msgr2=0x7f66540c6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:49.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.178+0000 7f665a80f700 1 --2- 172.21.15.84:0/3508766299 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f663c003bc0 0x7f66540c6190 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f663c0047b0 tx=0x7f6644001980 comp rx=0 tx=0).stop 2023-09-13T08:25:49.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.178+0000 7f665a80f700 1 -- 172.21.15.84:0/3508766299 shutdown_connections 2023-09-13T08:25:49.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.178+0000 7f665a80f700 1 --2- 172.21.15.84:0/3508766299 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f665415eca0 0x7f665415f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:49.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.178+0000 7f665a80f700 1 --2- 172.21.15.84:0/3508766299 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f663c003bc0 0x7f66540c6190 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:49.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.178+0000 7f665a80f700 1 --2- 172.21.15.84:0/3508766299 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f664006a580 0x7f664006ca40 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:49.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.178+0000 7f665a80f700 1 --2- 172.21.15.84:0/3508766299 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6654156770 0x7f6654156bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:49.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.178+0000 7f665a80f700 1 -- 172.21.15.84:0/3508766299 >> 172.21.15.84:0/3508766299 conn(0x7f66540d00c0 msgr2=0x7f66540733d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:49.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.178+0000 7f665a80f700 1 -- 172.21.15.84:0/3508766299 shutdown_connections 2023-09-13T08:25:49.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.178+0000 7f665a80f700 1 -- 172.21.15.84:0/3508766299 wait complete. 2023-09-13T08:25:49.184 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 9 2023-09-13T08:25:49.190 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T08:25:49.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.310+0000 7ff5f9cc9700 1 Processor -- start 2023-09-13T08:25:49.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.311+0000 7ff5f9cc9700 1 -- start start 2023-09-13T08:25:49.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.311+0000 7ff5f9cc9700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff5f415d530 0x7ff5f4161bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:49.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.311+0000 7ff5f9cc9700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff5f40ca920 0x7ff5f406d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:49.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.311+0000 7ff5f9cc9700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5f41620f0 con 0x7ff5f406a620 2023-09-13T08:25:49.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.311+0000 7ff5f9cc9700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5f40cff20 con 0x7ff5f40ca920 2023-09-13T08:25:49.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.311+0000 7ff5f9cc9700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f40cae50 con 0x7ff5f415d530 2023-09-13T08:25:49.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.312+0000 7ff5f37fe700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff5f415d530 0x7ff5f4161bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:49.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.312+0000 7ff5f37fe700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff5f415d530 0x7ff5f4161bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.84:55294/0 (socket says 172.21.15.84:55294) 2023-09-13T08:25:49.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.312+0000 7ff5f37fe700 1 -- 172.21.15.84:0/2648560173 learned_addr learned my addr 172.21.15.84:0/2648560173 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:49.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.312+0000 7ff5f2ffd700 1 --2- 172.21.15.84:0/2648560173 >> v2:172.21.15.161:3300/0 conn(0x7ff5f40ca920 0x7ff5f406d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:49.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.312+0000 7ff5f37fe700 1 -- 172.21.15.84:0/2648560173 >> v2:172.21.15.161:3300/0 conn(0x7ff5f40ca920 msgr2=0x7ff5f406d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:49.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.312+0000 7ff5f37fe700 1 --2- 172.21.15.84:0/2648560173 >> v2:172.21.15.161:3300/0 conn(0x7ff5f40ca920 0x7ff5f406d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:49.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.312+0000 7ff5f37fe700 1 -- 172.21.15.84:0/2648560173 >> v1:172.21.15.161:6789/0 conn(0x7ff5f406a620 legacy=0x7ff5f40ce490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:49.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.312+0000 7ff5f37fe700 1 -- 172.21.15.84:0/2648560173 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5f40cb130 con 0x7ff5f415d530 2023-09-13T08:25:49.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.312+0000 7ff5f2ffd700 1 --2- 172.21.15.84:0/2648560173 >> v2:172.21.15.161:3300/0 conn(0x7ff5f40ca920 0x7ff5f406d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T08:25:49.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.312+0000 7ff5f37fe700 1 --2- 172.21.15.84:0/2648560173 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff5f415d530 0x7ff5f4161bb0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff5e40098f0 tx=0x7ff5e4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=caff86346f8d0964 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:49.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.312+0000 7ff5f27fc700 1 -- 172.21.15.84:0/2648560173 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e4011830 con 0x7ff5f415d530 2023-09-13T08:25:49.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.312+0000 7ff5f27fc700 1 -- 172.21.15.84:0/2648560173 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5e4011990 con 0x7ff5f415d530 2023-09-13T08:25:49.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.312+0000 7ff5f27fc700 1 -- 172.21.15.84:0/2648560173 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e4011d20 con 0x7ff5f415d530 2023-09-13T08:25:49.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.313+0000 7ff5f9cc9700 1 -- 172.21.15.84:0/2648560173 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff5f415d530 msgr2=0x7ff5f4161bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:49.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.313+0000 7ff5f9cc9700 1 --2- 172.21.15.84:0/2648560173 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff5f415d530 0x7ff5f4161bb0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff5e40098f0 tx=0x7ff5e4009c00 comp rx=0 tx=0).stop 2023-09-13T08:25:49.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.313+0000 7ff5f9cc9700 1 -- 172.21.15.84:0/2648560173 shutdown_connections 2023-09-13T08:25:49.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.313+0000 7ff5f9cc9700 1 --2- 172.21.15.84:0/2648560173 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff5f415d530 0x7ff5f4161bb0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:49.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.313+0000 7ff5f9cc9700 1 --2- 172.21.15.84:0/2648560173 >> v2:172.21.15.161:3300/0 conn(0x7ff5f40ca920 0x7ff5f406d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:49.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.313+0000 7ff5f9cc9700 1 -- 172.21.15.84:0/2648560173 >> 172.21.15.84:0/2648560173 conn(0x7ff5f40d00c0 msgr2=0x7ff5f40d04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:49.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.313+0000 7ff5f9cc9700 1 -- 172.21.15.84:0/2648560173 shutdown_connections 2023-09-13T08:25:49.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.313+0000 7ff5f9cc9700 1 -- 172.21.15.84:0/2648560173 wait complete. 2023-09-13T08:25:49.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.314+0000 7ff5f9cc9700 1 Processor -- start 2023-09-13T08:25:49.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.314+0000 7ff5f9cc9700 1 -- start start 2023-09-13T08:25:49.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.315+0000 7ff5f9cc9700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5f406a620 0x7ff5f40ace60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:49.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.315+0000 7ff5f9cc9700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5f40ca920 0x7ff5f414da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:49.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.315+0000 7ff5f9cc9700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff5f415d530 0x7ff5f40ae670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:49.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.315+0000 7ff5f9cc9700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f414e2b0 con 0x7ff5f406a620 2023-09-13T08:25:49.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.315+0000 7ff5f9cc9700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f414e590 con 0x7ff5f40ca920 2023-09-13T08:25:49.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.315+0000 7ff5f9cc9700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f414e870 con 0x7ff5f415d530 2023-09-13T08:25:49.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.315+0000 7ff5f37fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5f406a620 0x7ff5f40ace60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:49.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.315+0000 7ff5f37fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5f406a620 0x7ff5f40ace60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45436/0 (socket says 172.21.15.84:45436) 2023-09-13T08:25:49.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.315+0000 7ff5f37fe700 1 -- 172.21.15.84:0/2875407622 learned_addr learned my addr 172.21.15.84:0/2875407622 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:49.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.315+0000 7ff5f37fe700 1 -- 172.21.15.84:0/2875407622 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff5f415d530 msgr2=0x7ff5f40ae670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:49.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.315+0000 7ff5f37fe700 1 --2- 172.21.15.84:0/2875407622 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff5f415d530 0x7ff5f40ae670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:49.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.315+0000 7ff5f37fe700 1 -- 172.21.15.84:0/2875407622 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5f40ca920 msgr2=0x7ff5f414da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:49.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.315+0000 7ff5f2ffd700 1 --2- 172.21.15.84:0/2875407622 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5f40ca920 0x7ff5f414da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:49.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.315+0000 7ff5f37fe700 1 --2- 172.21.15.84:0/2875407622 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5f40ca920 0x7ff5f414da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:49.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.315+0000 7ff5f37fe700 1 -- 172.21.15.84:0/2875407622 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5dc0094a0 con 0x7ff5f406a620 2023-09-13T08:25:49.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.316+0000 7ff5f37fe700 1 --2- 172.21.15.84:0/2875407622 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5f406a620 0x7ff5f40ace60 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7ff5e4009c40 tx=0x7ff5e4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:49.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.316+0000 7ff5ebfff700 1 -- 172.21.15.84:0/2875407622 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e40036a0 con 0x7ff5f406a620 2023-09-13T08:25:49.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.316+0000 7ff5ebfff700 1 -- 172.21.15.84:0/2875407622 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5e401e070 con 0x7ff5f406a620 2023-09-13T08:25:49.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.316+0000 7ff5f9cc9700 1 -- 172.21.15.84:0/2875407622 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5e4009550 con 0x7ff5f406a620 2023-09-13T08:25:49.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.316+0000 7ff5ebfff700 1 -- 172.21.15.84:0/2875407622 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e4003a60 con 0x7ff5f406a620 2023-09-13T08:25:49.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.316+0000 7ff5f9cc9700 1 -- 172.21.15.84:0/2875407622 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5f414ee30 con 0x7ff5f406a620 2023-09-13T08:25:49.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.317+0000 7ff5f9cc9700 1 -- 172.21.15.84:0/2875407622 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5f404e9b0 con 0x7ff5f406a620 2023-09-13T08:25:49.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.317+0000 7ff5ebfff700 1 -- 172.21.15.84:0/2875407622 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7ff5e4003bc0 con 0x7ff5f406a620 2023-09-13T08:25:49.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.318+0000 7ff5ebfff700 1 --2- 172.21.15.84:0/2875407622 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7ff5d406a580 0x7ff5d406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:49.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.318+0000 7ff5ebfff700 1 -- 172.21.15.84:0/2875407622 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7ff5e408a0c0 con 0x7ff5f406a620 2023-09-13T08:25:49.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.318+0000 7ff5f2ffd700 1 --2- 172.21.15.84:0/2875407622 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7ff5d406a580 0x7ff5d406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:49.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.318+0000 7ff5f2ffd700 1 --2- 172.21.15.84:0/2875407622 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7ff5d406a580 0x7ff5d406ca40 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff5f41f6250 tx=0x7ff5dc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:49.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.322+0000 7ff5ebfff700 1 -- 172.21.15.84:0/2875407622 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7ff5e40553d0 con 0x7ff5f406a620 2023-09-13T08:25:49.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.509+0000 7ff5f9cc9700 1 -- 172.21.15.84:0/2875407622 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff5f40b6040 con 0x7ff5f406a620 2023-09-13T08:25:49.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.510+0000 7ff5ebfff700 1 -- 172.21.15.84:0/2875407622 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18757 (secure 0 0 0) 0x7ff5e40589f0 con 0x7ff5f406a620 2023-09-13T08:25:49.510 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:25:49.511 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":26,"fsid":"0107440b-b634-42c5-a643-5d31ea826116","created":"2023-09-13T08:24:16.931917+0000","modified":"2023-09-13T08:25:23.878460+0000","last_up_change":"2023-09-13T08:24:28.422631+0000","last_in_change":"2023-09-13T08:24:19.425578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T08:24:28.583720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-13T08:24:39.862832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-13T08:24:41.145511+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-13T08:24:44.775160+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4a53ec12-1469-4356-b4e1-2b8fc9b7c0f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6817","nonce":1599532366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6819","nonce":1599532366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6823","nonce":1599532366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6821","nonce":1599532366}]},"public_addr":"172.21.15.84:6817/1599532366","cluster_addr":"172.21.15.84:6819/1599532366","heartbeat_back_addr":"172.21.15.84:6823/1599532366","heartbeat_front_addr":"172.21.15.84:6821/1599532366","state":["exists","up"]},{"osd":1,"uuid":"11e964a0-b80c-4afc-bfbf-e2067969db29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6825","nonce":461860977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6827","nonce":461860977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6831","nonce":461860977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6829","nonce":461860977}]},"public_addr":"172.21.15.84:6825/461860977","cluster_addr":"172.21.15.84:6827/461860977","heartbeat_back_addr":"172.21.15.84:6831/461860977","heartbeat_front_addr":"172.21.15.84:6829/461860977","state":["exists","up"]},{"osd":2,"uuid":"3ce74529-4dd1-44c7-9576-968f5fdc0c25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6809","nonce":1168316165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6811","nonce":1168316165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6815","nonce":1168316165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6813","nonce":1168316165}]},"public_addr":"172.21.15.84:6809/1168316165","cluster_addr":"172.21.15.84:6811/1168316165","heartbeat_back_addr":"172.21.15.84:6815/1168316165","heartbeat_front_addr":"172.21.15.84:6813/1168316165","state":["exists","up"]},{"osd":3,"uuid":"460cb5c5-590a-4d06-a4d9-5bac2fdf33b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6801","nonce":1661609810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6803","nonce":1661609810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6807","nonce":1661609810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6805","nonce":1661609810}]},"public_addr":"172.21.15.84:6801/1661609810","cluster_addr":"172.21.15.84:6803/1661609810","heartbeat_back_addr":"172.21.15.84:6807/1661609810","heartbeat_front_addr":"172.21.15.84:6805/1661609810","state":["exists","up"]},{"osd":4,"uuid":"bf237dd0-3ebd-44b5-8078-24a63e00d792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6801","nonce":1303562374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6803","nonce":1303562374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6807","nonce":1303562374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6805","nonce":1303562374}]},"public_addr":"172.21.15.161:6801/1303562374","cluster_addr":"172.21.15.161:6803/1303562374","heartbeat_back_addr":"172.21.15.161:6807/1303562374","heartbeat_front_addr":"172.21.15.161:6805/1303562374","state":["exists","up"]},{"osd":5,"uuid":"e1e538e0-5844-456b-8c6e-434d3a914af1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6818","nonce":961120854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6822","nonce":961120854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6830","nonce":961120854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6826","nonce":961120854}]},"public_addr":"172.21.15.161:6818/961120854","cluster_addr":"172.21.15.161:6822/961120854","heartbeat_back_addr":"172.21.15.161:6830/961120854","heartbeat_front_addr":"172.21.15.161:6826/961120854","state":["exists","up"]},{"osd":6,"uuid":"5cb1785e-960f-4dd4-b295-9e21b2c3f875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6809","nonce":980533466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6811","nonce":980533466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6815","nonce":980533466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6813","nonce":980533466}]},"public_addr":"172.21.15.161:6809/980533466","cluster_addr":"172.21.15.161:6811/980533466","heartbeat_back_addr":"172.21.15.161:6815/980533466","heartbeat_front_addr":"172.21.15.161:6813/980533466","state":["exists","up"]},{"osd":7,"uuid":"5acb6619-e933-4b46-b1c2-60af30acb839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6817","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6819","nonce":2479691549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6821","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6823","nonce":2479691549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6829","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6831","nonce":2479691549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6825","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6827","nonce":2479691549}]},"public_addr":"172.21.15.161:6819/2479691549","cluster_addr":"172.21.15.161:6823/2479691549","heartbeat_back_addr":"172.21.15.161:6831/2479691549","heartbeat_front_addr":"172.21.15.161:6827/2479691549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.678857+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.685341+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.613603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.634940+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.564387+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.697347+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.637437+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.619397+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":1}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T08:25:49.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.512+0000 7ff5f9cc9700 1 -- 172.21.15.84:0/2875407622 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7ff5d406a580 msgr2=0x7ff5d406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:49.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.513+0000 7ff5f9cc9700 1 --2- 172.21.15.84:0/2875407622 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7ff5d406a580 0x7ff5d406ca40 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff5f41f6250 tx=0x7ff5dc008040 comp rx=0 tx=0).stop 2023-09-13T08:25:49.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.513+0000 7ff5f9cc9700 1 -- 172.21.15.84:0/2875407622 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5f406a620 msgr2=0x7ff5f40ace60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:49.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.513+0000 7ff5f9cc9700 1 --2- 172.21.15.84:0/2875407622 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5f406a620 0x7ff5f40ace60 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7ff5e4009c40 tx=0x7ff5e4004750 comp rx=0 tx=0).stop 2023-09-13T08:25:49.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.513+0000 7ff5f9cc9700 1 -- 172.21.15.84:0/2875407622 shutdown_connections 2023-09-13T08:25:49.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.513+0000 7ff5f9cc9700 1 --2- 172.21.15.84:0/2875407622 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff5f415d530 0x7ff5f40ae670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:49.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.513+0000 7ff5f9cc9700 1 --2- 172.21.15.84:0/2875407622 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5f406a620 0x7ff5f40ace60 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:49.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.513+0000 7ff5f9cc9700 1 --2- 172.21.15.84:0/2875407622 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7ff5d406a580 0x7ff5d406ca40 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:49.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.513+0000 7ff5f9cc9700 1 --2- 172.21.15.84:0/2875407622 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5f40ca920 0x7ff5f414da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:49.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.513+0000 7ff5f9cc9700 1 -- 172.21.15.84:0/2875407622 >> 172.21.15.84:0/2875407622 conn(0x7ff5f40d00c0 msgr2=0x7ff5f40cf190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:49.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.513+0000 7ff5f9cc9700 1 -- 172.21.15.84:0/2875407622 shutdown_connections 2023-09-13T08:25:49.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.513+0000 7ff5f9cc9700 1 -- 172.21.15.84:0/2875407622 wait complete. 2023-09-13T08:25:49.525 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-09-13T08:25:49.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.646+0000 7f8906591700 1 Processor -- start 2023-09-13T08:25:49.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.646+0000 7f8906591700 1 -- start start 2023-09-13T08:25:49.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.647+0000 7f8906591700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f89000ca920 0x7f890006d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:49.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.647+0000 7f8906591700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89000cae50 con 0x7f890015d530 2023-09-13T08:25:49.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.647+0000 7f8906591700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89000cb130 con 0x7f890006a620 2023-09-13T08:25:49.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.647+0000 7f8906591700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89000cff20 con 0x7f89000ca920 2023-09-13T08:25:49.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.647+0000 7f88fffff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f890015d530 0x7f8900161bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:48090/0 (socket says 172.21.15.84:48090) 2023-09-13T08:25:49.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.647+0000 7f88fffff700 1 -- 172.21.15.84:0/1767687933 learned_addr learned my addr 172.21.15.84:0/1767687933 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:25:49.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.647+0000 7f88ff7fe700 1 --2- 172.21.15.84:0/1767687933 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f89000ca920 0x7f890006d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:49.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.647+0000 7f88feffd700 1 -- 172.21.15.84:0/1767687933 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1604165024 0 0) 0x7f89000cae50 con 0x7f890015d530 2023-09-13T08:25:49.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.647+0000 7f88feffd700 1 -- 172.21.15.84:0/1767687933 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88ec0035b0 con 0x7f890015d530 2023-09-13T08:25:49.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.647+0000 7f88feffd700 1 -- 172.21.15.84:0/1767687933 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 798670357 0 0) 0x7f89000cb130 con 0x7f890006a620 2023-09-13T08:25:49.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.647+0000 7f88feffd700 1 -- 172.21.15.84:0/1767687933 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89000cae50 con 0x7f890006a620 2023-09-13T08:25:49.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.647+0000 7f88ff7fe700 1 -- 172.21.15.84:0/1767687933 >> v1:172.21.15.161:6789/0 conn(0x7f890006a620 legacy=0x7f89000ce490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:49.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.647+0000 7f88ff7fe700 1 -- 172.21.15.84:0/1767687933 >> v1:172.21.15.84:6789/0 conn(0x7f890015d530 legacy=0x7f8900161bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:49.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.647+0000 7f88ff7fe700 1 -- 172.21.15.84:0/1767687933 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89000cb410 con 0x7f89000ca920 2023-09-13T08:25:49.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.648+0000 7f88ff7fe700 1 --2- 172.21.15.84:0/1767687933 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f89000ca920 0x7f890006d700 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f88f0009870 tx=0x7f88f0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=863fcc11f3e08874 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:49.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.648+0000 7f88feffd700 1 -- 172.21.15.84:0/1767687933 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f0011830 con 0x7f89000ca920 2023-09-13T08:25:49.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.648+0000 7f88feffd700 1 -- 172.21.15.84:0/1767687933 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88f0011990 con 0x7f89000ca920 2023-09-13T08:25:49.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.648+0000 7f88feffd700 1 -- 172.21.15.84:0/1767687933 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f0011d00 con 0x7f89000ca920 2023-09-13T08:25:49.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.648+0000 7f8906591700 1 -- 172.21.15.84:0/1767687933 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f89000ca920 msgr2=0x7f890006d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:49.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.648+0000 7f8906591700 1 --2- 172.21.15.84:0/1767687933 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f89000ca920 0x7f890006d700 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f88f0009870 tx=0x7f88f0009b80 comp rx=0 tx=0).stop 2023-09-13T08:25:49.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.648+0000 7f8906591700 1 -- 172.21.15.84:0/1767687933 shutdown_connections 2023-09-13T08:25:49.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.648+0000 7f8906591700 1 --2- 172.21.15.84:0/1767687933 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f89000ca920 0x7f890006d700 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:49.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.648+0000 7f8906591700 1 -- 172.21.15.84:0/1767687933 >> 172.21.15.84:0/1767687933 conn(0x7f89000d00c0 msgr2=0x7f89000d04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:49.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.648+0000 7f8906591700 1 -- 172.21.15.84:0/1767687933 shutdown_connections 2023-09-13T08:25:49.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.648+0000 7f8906591700 1 -- 172.21.15.84:0/1767687933 wait complete. 2023-09-13T08:25:49.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.650+0000 7f8906591700 1 Processor -- start 2023-09-13T08:25:49.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.650+0000 7f8906591700 1 -- start start 2023-09-13T08:25:49.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.650+0000 7f8906591700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f890006a620 0x7f890015cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:49.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.650+0000 7f8906591700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f89000ca920 0x7f890014f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:49.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.650+0000 7f8906591700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f890015d530 0x7f89000ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:49.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.650+0000 7f8906591700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f890014f960 con 0x7f890006a620 2023-09-13T08:25:49.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.650+0000 7f8906591700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89000ad0c0 con 0x7f890015d530 2023-09-13T08:25:49.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.650+0000 7f8906591700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89000ace20 con 0x7f89000ca920 2023-09-13T08:25:49.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.651+0000 7f88fffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f890006a620 0x7f890015cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:49.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.651+0000 7f88fffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f890006a620 0x7f890015cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45450/0 (socket says 172.21.15.84:45450) 2023-09-13T08:25:49.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.651+0000 7f88fffff700 1 -- 172.21.15.84:0/3448221383 learned_addr learned my addr 172.21.15.84:0/3448221383 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:49.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.651+0000 7f88fffff700 1 -- 172.21.15.84:0/3448221383 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f89000ca920 msgr2=0x7f890014f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:49.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.651+0000 7f88fffff700 1 --2- 172.21.15.84:0/3448221383 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f89000ca920 0x7f890014f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:49.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.651+0000 7f88fffff700 1 -- 172.21.15.84:0/3448221383 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f890015d530 msgr2=0x7f89000ac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:49.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.651+0000 7f8904b2e700 1 --2- 172.21.15.84:0/3448221383 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f890015d530 0x7f89000ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:49.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.651+0000 7f88fffff700 1 --2- 172.21.15.84:0/3448221383 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f890015d530 0x7f89000ac8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:49.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.651+0000 7f88fffff700 1 -- 172.21.15.84:0/3448221383 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88f00094a0 con 0x7f890006a620 2023-09-13T08:25:49.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.651+0000 7f88fffff700 1 --2- 172.21.15.84:0/3448221383 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f890006a620 0x7f890015cb10 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f88e800c4d0 tx=0x7f88e800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:49.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.651+0000 7f88fcff9700 1 -- 172.21.15.84:0/3448221383 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e8005d70 con 0x7f890006a620 2023-09-13T08:25:49.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.651+0000 7f88fcff9700 1 -- 172.21.15.84:0/3448221383 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88e80070d0 con 0x7f890006a620 2023-09-13T08:25:49.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.651+0000 7f8906591700 1 -- 172.21.15.84:0/3448221383 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89000af800 con 0x7f890006a620 2023-09-13T08:25:49.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.651+0000 7f88fcff9700 1 -- 172.21.15.84:0/3448221383 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e8007480 con 0x7f890006a620 2023-09-13T08:25:49.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.651+0000 7f8906591700 1 -- 172.21.15.84:0/3448221383 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89000afdc0 con 0x7f890006a620 2023-09-13T08:25:49.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.652+0000 7f8906591700 1 -- 172.21.15.84:0/3448221383 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f890004e9b0 con 0x7f890006a620 2023-09-13T08:25:49.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.653+0000 7f88fcff9700 1 -- 172.21.15.84:0/3448221383 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f88e80075e0 con 0x7f890006a620 2023-09-13T08:25:49.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.653+0000 7f88fcff9700 1 --2- 172.21.15.84:0/3448221383 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f88e006a580 0x7f88e006ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:49.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.653+0000 7f88fcff9700 1 -- 172.21.15.84:0/3448221383 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f88e8088450 con 0x7f890006a620 2023-09-13T08:25:49.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.653+0000 7f88ff7fe700 1 --2- 172.21.15.84:0/3448221383 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f88e006a580 0x7f88e006ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:49.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.653+0000 7f88ff7fe700 1 --2- 172.21.15.84:0/3448221383 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f88e006a580 0x7f88e006ca40 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f89000cad80 tx=0x7f88f0010000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:49.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.657+0000 7f88fcff9700 1 -- 172.21.15.84:0/3448221383 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f88e8053570 con 0x7f890006a620 2023-09-13T08:25:49.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.890+0000 7f8906591700 1 -- 172.21.15.84:0/3448221383 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f89000b6040 con 0x7f890006a620 2023-09-13T08:25:49.891 INFO:tasks.ceph.mon.a.smithi084.stderr:2023-09-13T08:25:49.891+0000 7f4f341b1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-09-13T08:25:49.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.895+0000 7f88fcff9700 1 -- 172.21.15.84:0/3448221383 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) v1 ==== 161+0+0 (secure 0 0 0) 0x7f88e8056b90 con 0x7f890006a620 2023-09-13T08:25:49.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.897+0000 7f8906591700 1 -- 172.21.15.84:0/3448221383 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f88e006a580 msgr2=0x7f88e006ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:49.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.897+0000 7f8906591700 1 --2- 172.21.15.84:0/3448221383 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f88e006a580 0x7f88e006ca40 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f89000cad80 tx=0x7f88f0010000 comp rx=0 tx=0).stop 2023-09-13T08:25:49.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.897+0000 7f8906591700 1 -- 172.21.15.84:0/3448221383 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f890006a620 msgr2=0x7f890015cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:49.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.897+0000 7f8906591700 1 --2- 172.21.15.84:0/3448221383 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f890006a620 0x7f890015cb10 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f88e800c4d0 tx=0x7f88e800c890 comp rx=0 tx=0).stop 2023-09-13T08:25:49.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.897+0000 7f8906591700 1 -- 172.21.15.84:0/3448221383 shutdown_connections 2023-09-13T08:25:49.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.897+0000 7f8906591700 1 --2- 172.21.15.84:0/3448221383 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f88e006a580 0x7f88e006ca40 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:49.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.897+0000 7f8906591700 1 --2- 172.21.15.84:0/3448221383 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f890015d530 0x7f89000ac8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:49.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.897+0000 7f8906591700 1 --2- 172.21.15.84:0/3448221383 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f890006a620 0x7f890015cb10 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:49.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.897+0000 7f8906591700 1 --2- 172.21.15.84:0/3448221383 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f89000ca920 0x7f890014f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:49.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.897+0000 7f8906591700 1 -- 172.21.15.84:0/3448221383 >> 172.21.15.84:0/3448221383 conn(0x7f89000d00c0 msgr2=0x7f89000b3530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:49.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.897+0000 7f8906591700 1 -- 172.21.15.84:0/3448221383 shutdown_connections 2023-09-13T08:25:49.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:49.897+0000 7f8906591700 1 -- 172.21.15.84:0/3448221383 wait complete. 2023-09-13T08:25:49.901 INFO:teuthology.orchestra.run.smithi084.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-09-13T08:25:49.902 INFO:tasks.ceph.mds.b.smithi161.stderr: -5898> 2023-09-13T08:24:46.139+0000 7f5181f76700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-09-13T08:25:49.910 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-09-13T08:25:49.933 INFO:tasks.ceph.mds.b.smithi161.stdout:starting mds.b at 2023-09-13T08:25:50.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:50.034+0000 7f34e6309700 1 Processor -- start 2023-09-13T08:25:50.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:50.034+0000 7f34e6309700 1 -- start start 2023-09-13T08:25:50.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:50.035+0000 7f34e6309700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f34e00af130 0x7f34e015b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:50.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:50.035+0000 7f34e6309700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34e015ec90 con 0x7f34e00b1ab0 2023-09-13T08:25:50.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:50.035+0000 7f34e6309700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34e015e420 con 0x7f34e00ce510 2023-09-13T08:25:50.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:50.035+0000 7f34e6309700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34e015e6d0 con 0x7f34e00af130 2023-09-13T08:25:50.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:50.035+0000 7f34dffff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f34e00af130 0x7f34e015b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:50.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:50.035+0000 7f34dffff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f34e00af130 0x7f34e015b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45458/0 (socket says 172.21.15.84:45458) 2023-09-13T08:25:50.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:50.035+0000 7f34dffff700 1 -- 172.21.15.84:0/3945653290 learned_addr learned my addr 172.21.15.84:0/3945653290 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:50.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:50.036+0000 7f34dffff700 1 -- 172.21.15.84:0/3945653290 >> v1:172.21.15.161:6789/0 conn(0x7f34e00ce510 legacy=0x7f34e015dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:50.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:50.036+0000 7f34dffff700 1 -- 172.21.15.84:0/3945653290 >> v1:172.21.15.84:6789/0 conn(0x7f34e00b1ab0 legacy=0x7f34e00b1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:50.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:50.036+0000 7f34dffff700 1 -- 172.21.15.84:0/3945653290 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34e015e9b0 con 0x7f34e00af130 2023-09-13T08:25:50.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:50.036+0000 7f34dffff700 1 --2- 172.21.15.84:0/3945653290 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34e00af130 0x7f34e015b0c0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f34d40098f0 tx=0x7f34d4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ceceff4fb4a17eb server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:50.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:50.036+0000 7f34deffd700 1 -- 172.21.15.84:0/3945653290 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d400f8a0 con 0x7f34e00af130 2023-09-13T08:25:50.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:50.036+0000 7f34deffd700 1 -- 172.21.15.84:0/3945653290 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34d400fa00 con 0x7f34e00af130 2023-09-13T08:25:50.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:50.036+0000 7f34deffd700 1 -- 172.21.15.84:0/3945653290 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d400fd90 con 0x7f34e00af130 2023-09-13T08:25:50.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:50.036+0000 7f34e6309700 1 -- 172.21.15.84:0/3945653290 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34e00af130 msgr2=0x7f34e015b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:50.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:50.036+0000 7f34e6309700 1 --2- 172.21.15.84:0/3945653290 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34e00af130 0x7f34e015b0c0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f34d40098f0 tx=0x7f34d4009c00 comp rx=0 tx=0).stop 2023-09-13T08:25:50.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:50.037+0000 7f34e6309700 1 -- 172.21.15.84:0/3945653290 shutdown_connections 2023-09-13T08:25:50.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:50.037+0000 7f34e6309700 1 --2- 172.21.15.84:0/3945653290 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34e00af130 0x7f34e015b0c0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:50.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:50.037+0000 7f34e6309700 1 -- 172.21.15.84:0/3945653290 >> 172.21.15.84:0/3945653290 conn(0x7f34e00ccab0 msgr2=0x7f34e00ccec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:50.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:50.037+0000 7f34e6309700 1 -- 172.21.15.84:0/3945653290 shutdown_connections 2023-09-13T08:25:50.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:50.037+0000 7f34e6309700 1 -- 172.21.15.84:0/3945653290 wait complete. 2023-09-13T08:25:50.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:50.038+0000 7f34e6309700 1 Processor -- start 2023-09-13T08:25:50.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:50.038+0000 7f34e6309700 1 -- start start 2023-09-13T08:25:50.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:50.039+0000 7f34e6309700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34e00af130 0x7f34e00b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:50.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:50.039+0000 7f34e6309700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f34e00b1ab0 0x7f34e00b3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:50.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:50.039+0000 7f34e6309700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f34e015c9c0 0x7f34e00ad280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:50.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:50.039+0000 7f34e6309700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34e01f3f40 con 0x7f34e00af130 2023-09-13T08:25:50.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:50.039+0000 7f34e6309700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34e00d0c90 con 0x7f34e00b1ab0 2023-09-13T08:25:50.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:50.039+0000 7f34e6309700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34e01f3330 con 0x7f34e015c9c0 2023-09-13T08:25:50.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:50.039+0000 7f34dffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34e00af130 0x7f34e00b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:50.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:50.039+0000 7f34dffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34e00af130 0x7f34e00b2c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45462/0 (socket says 172.21.15.84:45462) 2023-09-13T08:25:50.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:50.039+0000 7f34dffff700 1 -- 172.21.15.84:0/2466780817 learned_addr learned my addr 172.21.15.84:0/2466780817 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:50.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:50.039+0000 7f34df7fe700 1 --2- 172.21.15.84:0/2466780817 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f34e00b1ab0 0x7f34e00b3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:50.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:50.039+0000 7f34e48a6700 1 --2- 172.21.15.84:0/2466780817 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f34e015c9c0 0x7f34e00ad280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:50.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:50.039+0000 7f34dffff700 1 -- 172.21.15.84:0/2466780817 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f34e015c9c0 msgr2=0x7f34e00ad280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:50.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:50.039+0000 7f34dffff700 1 --2- 172.21.15.84:0/2466780817 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f34e015c9c0 0x7f34e00ad280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:50.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:50.039+0000 7f34dffff700 1 -- 172.21.15.84:0/2466780817 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f34e00b1ab0 msgr2=0x7f34e00b3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:50.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:50.039+0000 7f34dffff700 1 --2- 172.21.15.84:0/2466780817 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f34e00b1ab0 0x7f34e00b3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:50.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:50.039+0000 7f34dffff700 1 -- 172.21.15.84:0/2466780817 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34d4009550 con 0x7f34e00af130 2023-09-13T08:25:50.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:50.039+0000 7f34e48a6700 1 --2- 172.21.15.84:0/2466780817 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f34e015c9c0 0x7f34e00ad280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T08:25:50.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:50.039+0000 7f34dffff700 1 --2- 172.21.15.84:0/2466780817 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34e00af130 0x7f34e00b2c50 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f34e00724f0 tx=0x7f34d4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:50.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:50.039+0000 7f34dcff9700 1 -- 172.21.15.84:0/2466780817 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d4003ab0 con 0x7f34e00af130 2023-09-13T08:25:50.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:50.039+0000 7f34dcff9700 1 -- 172.21.15.84:0/2466780817 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34d4003c10 con 0x7f34e00af130 2023-09-13T08:25:50.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:50.039+0000 7f34e6309700 1 -- 172.21.15.84:0/2466780817 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34e01f3610 con 0x7f34e00af130 2023-09-13T08:25:50.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:50.039+0000 7f34dcff9700 1 -- 172.21.15.84:0/2466780817 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d4010470 con 0x7f34e00af130 2023-09-13T08:25:50.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:50.039+0000 7f34e6309700 1 -- 172.21.15.84:0/2466780817 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34e01f3bd0 con 0x7f34e00af130 2023-09-13T08:25:50.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:50.040+0000 7f34e6309700 1 -- 172.21.15.84:0/2466780817 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34e015b580 con 0x7f34e00af130 2023-09-13T08:25:50.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:50.041+0000 7f34dcff9700 1 -- 172.21.15.84:0/2466780817 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f34d4024450 con 0x7f34e00af130 2023-09-13T08:25:50.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:50.041+0000 7f34dcff9700 1 --2- 172.21.15.84:0/2466780817 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f34cc06a580 0x7f34cc06ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:50.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:50.041+0000 7f34df7fe700 1 --2- 172.21.15.84:0/2466780817 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f34cc06a580 0x7f34cc06ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:50.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:50.041+0000 7f34dcff9700 1 -- 172.21.15.84:0/2466780817 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6778+0+0 (secure 0 0 0) 0x7f34d408a890 con 0x7f34e00af130 2023-09-13T08:25:50.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:50.042+0000 7f34df7fe700 1 --2- 172.21.15.84:0/2466780817 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f34cc06a580 0x7f34cc06ca40 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f34e0157eb0 tx=0x7f34d0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:50.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:50.046+0000 7f34dcff9700 1 -- 172.21.15.84:0/2466780817 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f34d4055a70 con 0x7f34e00af130 2023-09-13T08:25:50.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:50.278+0000 7f34e6309700 1 -- 172.21.15.84:0/2466780817 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f34e004e9b0 con 0x7f34e00af130 2023-09-13T08:25:50.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:50.896+0000 7f34dcff9700 1 -- 172.21.15.84:0/2466780817 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f34d4059090 con 0x7f34e00af130 2023-09-13T08:25:50.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:50.898+0000 7f34e6309700 1 -- 172.21.15.84:0/2466780817 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f34cc06a580 msgr2=0x7f34cc06ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:50.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:50.898+0000 7f34e6309700 1 --2- 172.21.15.84:0/2466780817 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f34cc06a580 0x7f34cc06ca40 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f34e0157eb0 tx=0x7f34d0009040 comp rx=0 tx=0).stop 2023-09-13T08:25:50.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:50.898+0000 7f34e6309700 1 -- 172.21.15.84:0/2466780817 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34e00af130 msgr2=0x7f34e00b2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:50.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:50.898+0000 7f34e6309700 1 --2- 172.21.15.84:0/2466780817 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34e00af130 0x7f34e00b2c50 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f34e00724f0 tx=0x7f34d4004750 comp rx=0 tx=0).stop 2023-09-13T08:25:50.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:50.898+0000 7f34e6309700 1 -- 172.21.15.84:0/2466780817 shutdown_connections 2023-09-13T08:25:50.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:50.898+0000 7f34e6309700 1 --2- 172.21.15.84:0/2466780817 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f34e015c9c0 0x7f34e00ad280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:50.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:50.898+0000 7f34e6309700 1 --2- 172.21.15.84:0/2466780817 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34e00af130 0x7f34e00b2c50 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:50.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:50.898+0000 7f34e6309700 1 --2- 172.21.15.84:0/2466780817 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f34cc06a580 0x7f34cc06ca40 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:50.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:50.898+0000 7f34e6309700 1 --2- 172.21.15.84:0/2466780817 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f34e00b1ab0 0x7f34e00b3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:50.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:50.898+0000 7f34e6309700 1 -- 172.21.15.84:0/2466780817 >> 172.21.15.84:0/2466780817 conn(0x7f34e00ccab0 msgr2=0x7f34e006dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:50.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:50.898+0000 7f34e6309700 1 -- 172.21.15.84:0/2466780817 shutdown_connections 2023-09-13T08:25:50.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:50.898+0000 7f34e6309700 1 -- 172.21.15.84:0/2466780817 wait complete. 2023-09-13T08:25:50.912 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-09-13T08:25:51.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:51.041+0000 7f03f93de700 1 Processor -- start 2023-09-13T08:25:51.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:51.041+0000 7f03f93de700 1 -- start start 2023-09-13T08:25:51.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:51.042+0000 7f03f93de700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f03f40d1c30 0x7f03f40cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:51.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:51.042+0000 7f03f93de700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f03f40d4030 0x7f03f415d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:51.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:51.042+0000 7f03f93de700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f03f40d2010 0x7f03f415d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:51.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:51.042+0000 7f03f93de700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03f415dce0 con 0x7f03f40d1c30 2023-09-13T08:25:51.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:51.042+0000 7f03f93de700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03f40cf350 con 0x7f03f40d2010 2023-09-13T08:25:51.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:51.042+0000 7f03f93de700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03f40b6360 con 0x7f03f40d4030 2023-09-13T08:25:51.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:51.042+0000 7f03f2ffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f03f40d1c30 0x7f03f40cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:51.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:51.042+0000 7f03f2ffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f03f40d1c30 0x7f03f40cea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45470/0 (socket says 172.21.15.84:45470) 2023-09-13T08:25:51.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:51.042+0000 7f03f2ffd700 1 -- 172.21.15.84:0/1197026122 learned_addr learned my addr 172.21.15.84:0/1197026122 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:51.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:51.042+0000 7f03f27fc700 1 --2- 172.21.15.84:0/1197026122 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f03f40d4030 0x7f03f415d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:51.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:51.042+0000 7f03f37fe700 1 --2- 172.21.15.84:0/1197026122 >> v2:172.21.15.161:3300/0 conn(0x7f03f40d2010 0x7f03f415d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:51.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:51.042+0000 7f03f2ffd700 1 -- 172.21.15.84:0/1197026122 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f03f40d4030 msgr2=0x7f03f415d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:51.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:51.042+0000 7f03f2ffd700 1 --2- 172.21.15.84:0/1197026122 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f03f40d4030 0x7f03f415d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:51.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:51.042+0000 7f03f2ffd700 1 -- 172.21.15.84:0/1197026122 >> v2:172.21.15.161:3300/0 conn(0x7f03f40d2010 msgr2=0x7f03f415d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:51.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:51.042+0000 7f03f2ffd700 1 --2- 172.21.15.84:0/1197026122 >> v2:172.21.15.161:3300/0 conn(0x7f03f40d2010 0x7f03f415d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:51.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:51.042+0000 7f03f2ffd700 1 -- 172.21.15.84:0/1197026122 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03f40b6640 con 0x7f03f40d1c30 2023-09-13T08:25:51.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:51.042+0000 7f03f2ffd700 1 --2- 172.21.15.84:0/1197026122 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03f40d1c30 0x7f03f40cea00 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f03f408d8f0 tx=0x7f03e8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89eb6482d27c2e3c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:51.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:51.042+0000 7f03f1ffb700 1 -- 172.21.15.84:0/1197026122 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e8011830 con 0x7f03f40d1c30 2023-09-13T08:25:51.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:51.043+0000 7f03f1ffb700 1 -- 172.21.15.84:0/1197026122 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03e8011990 con 0x7f03f40d1c30 2023-09-13T08:25:51.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:51.043+0000 7f03f1ffb700 1 -- 172.21.15.84:0/1197026122 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e8011d20 con 0x7f03f40d1c30 2023-09-13T08:25:51.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:51.043+0000 7f03f93de700 1 -- 172.21.15.84:0/1197026122 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03f40d1c30 msgr2=0x7f03f40cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:51.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:51.043+0000 7f03f93de700 1 --2- 172.21.15.84:0/1197026122 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03f40d1c30 0x7f03f40cea00 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f03f408d8f0 tx=0x7f03e8009bd0 comp rx=0 tx=0).stop 2023-09-13T08:25:51.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:51.043+0000 7f03f93de700 1 -- 172.21.15.84:0/1197026122 shutdown_connections 2023-09-13T08:25:51.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:51.043+0000 7f03f93de700 1 --2- 172.21.15.84:0/1197026122 >> v2:172.21.15.161:3300/0 conn(0x7f03f40d2010 0x7f03f415d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:51.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:51.043+0000 7f03f93de700 1 --2- 172.21.15.84:0/1197026122 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03f40d1c30 0x7f03f40cea00 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:51.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:51.043+0000 7f03f93de700 1 --2- 172.21.15.84:0/1197026122 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f03f40d4030 0x7f03f415d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:51.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:51.043+0000 7f03f93de700 1 -- 172.21.15.84:0/1197026122 >> 172.21.15.84:0/1197026122 conn(0x7f03f409c6b0 msgr2=0x7f03f40d33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:51.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:51.043+0000 7f03f93de700 1 -- 172.21.15.84:0/1197026122 shutdown_connections 2023-09-13T08:25:51.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:51.043+0000 7f03f93de700 1 -- 172.21.15.84:0/1197026122 wait complete. 2023-09-13T08:25:51.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:51.044+0000 7f03f93de700 1 Processor -- start 2023-09-13T08:25:51.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:51.044+0000 7f03f93de700 1 -- start start 2023-09-13T08:25:51.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:51.045+0000 7f03f93de700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f03f40d1c30 0x7f03f415a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:51.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:51.045+0000 7f03f93de700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03f40d2010 0x7f03f40c8f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:51.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:51.045+0000 7f03f93de700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03f40d4030 0x7f03f40cb500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:51.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:51.045+0000 7f03f93de700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f414a740 con 0x7f03f40d4030 2023-09-13T08:25:51.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:51.045+0000 7f03f93de700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f415a5d0 con 0x7f03f40d2010 2023-09-13T08:25:51.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:51.045+0000 7f03f93de700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03f4157990 con 0x7f03f40d1c30 2023-09-13T08:25:51.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:51.045+0000 7f03f37fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03f40d4030 0x7f03f40cb500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:51.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:51.045+0000 7f03f37fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03f40d4030 0x7f03f40cb500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45480/0 (socket says 172.21.15.84:45480) 2023-09-13T08:25:51.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:51.045+0000 7f03f37fe700 1 -- 172.21.15.84:0/2267848433 learned_addr learned my addr 172.21.15.84:0/2267848433 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:51.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:51.045+0000 7f03f2ffd700 1 --2- 172.21.15.84:0/2267848433 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f03f40d1c30 0x7f03f415a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:51.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:51.045+0000 7f03f27fc700 1 --2- 172.21.15.84:0/2267848433 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03f40d2010 0x7f03f40c8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:51.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:51.046+0000 7f03f37fe700 1 -- 172.21.15.84:0/2267848433 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f03f40d1c30 msgr2=0x7f03f415a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:51.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:51.046+0000 7f03f37fe700 1 --2- 172.21.15.84:0/2267848433 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f03f40d1c30 0x7f03f415a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:51.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:51.046+0000 7f03f37fe700 1 -- 172.21.15.84:0/2267848433 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03f40d2010 msgr2=0x7f03f40c8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:51.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:51.046+0000 7f03f37fe700 1 --2- 172.21.15.84:0/2267848433 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03f40d2010 0x7f03f40c8f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:51.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:51.046+0000 7f03f37fe700 1 -- 172.21.15.84:0/2267848433 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03e8009550 con 0x7f03f40d4030 2023-09-13T08:25:51.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:51.046+0000 7f03f37fe700 1 --2- 172.21.15.84:0/2267848433 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03f40d4030 0x7f03f40cb500 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f03ec00eed0 tx=0x7f03ec00b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:51.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:51.046+0000 7f03db7fe700 1 -- 172.21.15.84:0/2267848433 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03ec010040 con 0x7f03f40d4030 2023-09-13T08:25:51.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:51.046+0000 7f03db7fe700 1 -- 172.21.15.84:0/2267848433 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03ec00bc80 con 0x7f03f40d4030 2023-09-13T08:25:51.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:51.046+0000 7f03f93de700 1 -- 172.21.15.84:0/2267848433 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03f4157c70 con 0x7f03f40d4030 2023-09-13T08:25:51.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:51.046+0000 7f03db7fe700 1 -- 172.21.15.84:0/2267848433 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03ec009e40 con 0x7f03f40d4030 2023-09-13T08:25:51.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:51.046+0000 7f03f93de700 1 -- 172.21.15.84:0/2267848433 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03f40c94a0 con 0x7f03f40d4030 2023-09-13T08:25:51.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:51.047+0000 7f03f93de700 1 -- 172.21.15.84:0/2267848433 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03f4157eb0 con 0x7f03f40d4030 2023-09-13T08:25:51.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:51.047+0000 7f03db7fe700 1 -- 172.21.15.84:0/2267848433 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f03ec01d400 con 0x7f03f40d4030 2023-09-13T08:25:51.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:51.048+0000 7f03db7fe700 1 --2- 172.21.15.84:0/2267848433 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f03e006a580 0x7f03e006ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:51.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:51.048+0000 7f03f2ffd700 1 --2- 172.21.15.84:0/2267848433 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f03e006a580 0x7f03e006ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:51.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:51.048+0000 7f03db7fe700 1 -- 172.21.15.84:0/2267848433 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6778+0+0 (secure 0 0 0) 0x7f03ec0894f0 con 0x7f03f40d4030 2023-09-13T08:25:51.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:51.048+0000 7f03f2ffd700 1 --2- 172.21.15.84:0/2267848433 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f03e006a580 0x7f03e006ca40 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f03e8014040 tx=0x7f03e8008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:51.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:51.052+0000 7f03db7fe700 1 -- 172.21.15.84:0/2267848433 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f03f4157eb0 con 0x7f03f40d4030 2023-09-13T08:25:51.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:51.241+0000 7f03f93de700 1 -- 172.21.15.84:0/2267848433 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f03f414a230 con 0x7f03f40d4030 2023-09-13T08:25:51.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:51.977+0000 7f03db7fe700 1 -- 172.21.15.84:0/2267848433 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v28) v1 ==== 181+0+0 (secure 0 0 0) 0x7f03f414a230 con 0x7f03f40d4030 2023-09-13T08:25:51.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:51.980+0000 7f03f93de700 1 -- 172.21.15.84:0/2267848433 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f03e006a580 msgr2=0x7f03e006ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:51.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:51.980+0000 7f03f93de700 1 --2- 172.21.15.84:0/2267848433 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f03e006a580 0x7f03e006ca40 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f03e8014040 tx=0x7f03e8008030 comp rx=0 tx=0).stop 2023-09-13T08:25:51.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:51.980+0000 7f03f93de700 1 -- 172.21.15.84:0/2267848433 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03f40d4030 msgr2=0x7f03f40cb500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:51.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:51.980+0000 7f03f93de700 1 --2- 172.21.15.84:0/2267848433 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03f40d4030 0x7f03f40cb500 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f03ec00eed0 tx=0x7f03ec00b390 comp rx=0 tx=0).stop 2023-09-13T08:25:51.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:51.980+0000 7f03f93de700 1 -- 172.21.15.84:0/2267848433 shutdown_connections 2023-09-13T08:25:51.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:51.980+0000 7f03f93de700 1 --2- 172.21.15.84:0/2267848433 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03f40d4030 0x7f03f40cb500 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:51.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:51.980+0000 7f03f93de700 1 --2- 172.21.15.84:0/2267848433 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f03f40d1c30 0x7f03f415a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:51.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:51.980+0000 7f03f93de700 1 --2- 172.21.15.84:0/2267848433 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f03e006a580 0x7f03e006ca40 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:51.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:51.980+0000 7f03f93de700 1 --2- 172.21.15.84:0/2267848433 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03f40d2010 0x7f03f40c8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:51.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:51.980+0000 7f03f93de700 1 -- 172.21.15.84:0/2267848433 >> 172.21.15.84:0/2267848433 conn(0x7f03f409c6b0 msgr2=0x7f03f40b8d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:51.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:51.980+0000 7f03f93de700 1 -- 172.21.15.84:0/2267848433 shutdown_connections 2023-09-13T08:25:51.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:51.981+0000 7f03f93de700 1 -- 172.21.15.84:0/2267848433 wait complete. 2023-09-13T08:25:51.983 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_metadata' removed 2023-09-13T08:25:51.995 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-09-13T08:25:52.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:52.123+0000 7f6aa4975700 1 Processor -- start 2023-09-13T08:25:52.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:52.123+0000 7f6aa4975700 1 -- start start 2023-09-13T08:25:52.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:52.124+0000 7f6aa4975700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f6aa00d4030 0x7f6aa015d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:52.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:52.124+0000 7f6aa4975700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6aa00cf110 con 0x7f6aa00d1c30 2023-09-13T08:25:52.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:52.124+0000 7f6aa4975700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6aa00cf350 con 0x7f6aa00d2010 2023-09-13T08:25:52.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:52.124+0000 7f6aa4975700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6aa00b6360 con 0x7f6aa00d4030 2023-09-13T08:25:52.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:52.124+0000 7f6a9e59c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f6aa00d1c30 0x7f6aa00cea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:48130/0 (socket says 172.21.15.84:48130) 2023-09-13T08:25:52.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:52.124+0000 7f6a9e59c700 1 -- 172.21.15.84:0/2736409817 learned_addr learned my addr 172.21.15.84:0/2736409817 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:25:52.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:52.124+0000 7f6a9dd9b700 1 --2- 172.21.15.84:0/2736409817 >> v2:172.21.15.161:3300/0 conn(0x7f6aa00d4030 0x7f6aa015d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:52.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:52.124+0000 7f6a9d59a700 1 -- 172.21.15.84:0/2736409817 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 806606300 0 0) 0x7f6a90001110 con 0x7f6aa00d1c30 2023-09-13T08:25:52.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:52.124+0000 7f6a9d59a700 1 -- 172.21.15.84:0/2736409817 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a880035b0 con 0x7f6aa00d1c30 2023-09-13T08:25:52.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:52.124+0000 7f6a9d59a700 1 -- 172.21.15.84:0/2736409817 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3042379690 0 0) 0x7f6a880035b0 con 0x7f6aa00d1c30 2023-09-13T08:25:52.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:52.124+0000 7f6a9d59a700 1 -- 172.21.15.84:0/2736409817 >> v2:172.21.15.161:3300/0 conn(0x7f6aa00d4030 msgr2=0x7f6aa015d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:52.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:52.124+0000 7f6a9d59a700 1 --2- 172.21.15.84:0/2736409817 >> v2:172.21.15.161:3300/0 conn(0x7f6aa00d4030 0x7f6aa015d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:52.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:52.124+0000 7f6a9d59a700 1 -- 172.21.15.84:0/2736409817 >> v1:172.21.15.161:6789/0 conn(0x7f6aa00d2010 legacy=0x7f6aa0167370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:52.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:52.124+0000 7f6a9d59a700 1 -- 172.21.15.84:0/2736409817 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aa00b6640 con 0x7f6aa00d1c30 2023-09-13T08:25:52.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:52.124+0000 7f6a9d59a700 1 -- 172.21.15.84:0/2736409817 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2302733408 0 0) 0x7f6a90001800 con 0x7f6aa00d1c30 2023-09-13T08:25:52.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:52.124+0000 7f6a9d59a700 1 -- 172.21.15.84:0/2736409817 >> v1:172.21.15.84:6789/0 conn(0x7f6aa00d1c30 legacy=0x7f6aa00cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:52.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:52.125+0000 7f6a9d59a700 1 --2- 172.21.15.84:0/2736409817 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6a88003a00 0x7f6a88003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:52.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:52.125+0000 7f6a9d59a700 1 --2- 172.21.15.84:0/2736409817 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a88004850 0x7f6a88004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:52.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:52.125+0000 7f6a9d59a700 1 --2- 172.21.15.84:0/2736409817 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a88005210 0x7f6a8800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:52.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:52.125+0000 7f6a9d59a700 1 -- 172.21.15.84:0/2736409817 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa00b6360 con 0x7f6a88004850 2023-09-13T08:25:52.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:52.125+0000 7f6a9d59a700 1 -- 172.21.15.84:0/2736409817 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8800c1b0 con 0x7f6a88005210 2023-09-13T08:25:52.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:52.125+0000 7f6a9d59a700 1 -- 172.21.15.84:0/2736409817 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8800c370 con 0x7f6a88003a00 2023-09-13T08:25:52.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:52.125+0000 7f6a9dd9b700 1 --2- 172.21.15.84:0/2736409817 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a88004850 0x7f6a88004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:52.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:52.125+0000 7f6a9e59c700 1 --2- 172.21.15.84:0/2736409817 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6a88003a00 0x7f6a88003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:52.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:52.125+0000 7f6a9ed9d700 1 --2- 172.21.15.84:0/2736409817 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a88005210 0x7f6a8800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:52.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:52.125+0000 7f6a9dd9b700 1 -- 172.21.15.84:0/2736409817 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6a88003a00 msgr2=0x7f6a88003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:52.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:52.125+0000 7f6a9dd9b700 1 --2- 172.21.15.84:0/2736409817 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6a88003a00 0x7f6a88003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:52.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:52.125+0000 7f6a9dd9b700 1 -- 172.21.15.84:0/2736409817 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a88005210 msgr2=0x7f6a8800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:52.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:52.125+0000 7f6a9dd9b700 1 --2- 172.21.15.84:0/2736409817 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a88005210 0x7f6a8800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:52.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:52.125+0000 7f6a9dd9b700 1 -- 172.21.15.84:0/2736409817 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a880035b0 con 0x7f6a88004850 2023-09-13T08:25:52.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:52.125+0000 7f6a9ed9d700 1 -- 172.21.15.84:0/2736409817 reap_dead start 2023-09-13T08:25:52.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:52.125+0000 7f6a9dd9b700 1 --2- 172.21.15.84:0/2736409817 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a88004850 0x7f6a88004cd0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f6a94009b30 tx=0x7f6a88005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c5f40a1d19ce9c4 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:52.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:52.125+0000 7f6a9d59a700 1 -- 172.21.15.84:0/2736409817 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a9400e6c0 con 0x7f6a88004850 2023-09-13T08:25:52.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:52.125+0000 7f6a9d59a700 1 -- 172.21.15.84:0/2736409817 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a9400e820 con 0x7f6a88004850 2023-09-13T08:25:52.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:52.125+0000 7f6a9d59a700 1 -- 172.21.15.84:0/2736409817 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a9400eb90 con 0x7f6a88004850 2023-09-13T08:25:52.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:52.126+0000 7f6aa4975700 1 -- 172.21.15.84:0/2736409817 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a88004850 msgr2=0x7f6a88004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:52.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:52.126+0000 7f6aa4975700 1 --2- 172.21.15.84:0/2736409817 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a88004850 0x7f6a88004cd0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f6a94009b30 tx=0x7f6a88005880 comp rx=0 tx=0).stop 2023-09-13T08:25:52.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:52.126+0000 7f6aa4975700 1 -- 172.21.15.84:0/2736409817 shutdown_connections 2023-09-13T08:25:52.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:52.126+0000 7f6aa4975700 1 --2- 172.21.15.84:0/2736409817 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a88004850 0x7f6a88004cd0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:52.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:52.126+0000 7f6aa4975700 1 -- 172.21.15.84:0/2736409817 >> 172.21.15.84:0/2736409817 conn(0x7f6aa009c6b0 msgr2=0x7f6aa00d33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:52.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:52.126+0000 7f6aa4975700 1 -- 172.21.15.84:0/2736409817 shutdown_connections 2023-09-13T08:25:52.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:52.126+0000 7f6aa4975700 1 -- 172.21.15.84:0/2736409817 wait complete. 2023-09-13T08:25:52.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:52.127+0000 7f6aa4975700 1 Processor -- start 2023-09-13T08:25:52.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:52.127+0000 7f6aa4975700 1 -- start start 2023-09-13T08:25:52.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:52.128+0000 7f6aa4975700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a88004850 0x7f6aa00c7b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:52.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:52.128+0000 7f6aa4975700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6aa0157690 0x7f6aa01566f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:52.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:52.128+0000 7f6aa4975700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6aa015ed40 0x7f6aa015f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:52.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:52.128+0000 7f6aa4975700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa015f730 con 0x7f6a88004850 2023-09-13T08:25:52.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:52.128+0000 7f6aa4975700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa01589b0 con 0x7f6aa015ed40 2023-09-13T08:25:52.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:52.128+0000 7f6aa4975700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa0157e30 con 0x7f6aa0157690 2023-09-13T08:25:52.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:52.128+0000 7f6a9e59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a88004850 0x7f6aa00c7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:52.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:52.128+0000 7f6a9e59c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a88004850 0x7f6aa00c7b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45496/0 (socket says 172.21.15.84:45496) 2023-09-13T08:25:52.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:52.128+0000 7f6a9e59c700 1 -- 172.21.15.84:0/4124728261 learned_addr learned my addr 172.21.15.84:0/4124728261 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:52.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:52.128+0000 7f6a9dd9b700 1 --2- 172.21.15.84:0/4124728261 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6aa0157690 0x7f6aa01566f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:52.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:52.128+0000 7f6a9ed9d700 1 --2- 172.21.15.84:0/4124728261 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6aa015ed40 0x7f6aa015f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:52.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:52.128+0000 7f6a9e59c700 1 -- 172.21.15.84:0/4124728261 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6aa0157690 msgr2=0x7f6aa01566f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:52.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:52.128+0000 7f6a9e59c700 1 --2- 172.21.15.84:0/4124728261 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6aa0157690 0x7f6aa01566f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:52.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:52.128+0000 7f6a9e59c700 1 -- 172.21.15.84:0/4124728261 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6aa015ed40 msgr2=0x7f6aa015f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:52.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:52.128+0000 7f6a9e59c700 1 --2- 172.21.15.84:0/4124728261 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6aa015ed40 0x7f6aa015f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:52.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:52.128+0000 7f6a9e59c700 1 -- 172.21.15.84:0/4124728261 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aa0158110 con 0x7f6a88004850 2023-09-13T08:25:52.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:52.128+0000 7f6a9dd9b700 1 --2- 172.21.15.84:0/4124728261 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6aa0157690 0x7f6aa01566f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T08:25:52.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:52.128+0000 7f6a9e59c700 1 --2- 172.21.15.84:0/4124728261 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a88004850 0x7f6aa00c7b30 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f6a90001eb0 tx=0x7f6a90007690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:52.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:52.129+0000 7f6a8effd700 1 -- 172.21.15.84:0/4124728261 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a900077b0 con 0x7f6a88004850 2023-09-13T08:25:52.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:52.129+0000 7f6a8effd700 1 -- 172.21.15.84:0/4124728261 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a9000e860 con 0x7f6a88004850 2023-09-13T08:25:52.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:52.129+0000 7f6aa4975700 1 -- 172.21.15.84:0/4124728261 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6aa01583f0 con 0x7f6a88004850 2023-09-13T08:25:52.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:52.129+0000 7f6a8effd700 1 -- 172.21.15.84:0/4124728261 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a9000ec10 con 0x7f6a88004850 2023-09-13T08:25:52.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:52.129+0000 7f6aa4975700 1 -- 172.21.15.84:0/4124728261 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6aa0157b10 con 0x7f6a88004850 2023-09-13T08:25:52.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:52.130+0000 7f6aa4975700 1 -- 172.21.15.84:0/4124728261 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6aa004e9b0 con 0x7f6a88004850 2023-09-13T08:25:52.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:52.130+0000 7f6a8effd700 1 -- 172.21.15.84:0/4124728261 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f6a9001d460 con 0x7f6a88004850 2023-09-13T08:25:52.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:52.130+0000 7f6a8effd700 1 --2- 172.21.15.84:0/4124728261 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f6a8006a580 0x7f6a8006ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:52.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:52.131+0000 7f6a8effd700 1 -- 172.21.15.84:0/4124728261 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6340+0+0 (secure 0 0 0) 0x7f6a90088a50 con 0x7f6a88004850 2023-09-13T08:25:52.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:52.131+0000 7f6a9dd9b700 1 --2- 172.21.15.84:0/4124728261 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f6a8006a580 0x7f6a8006ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:52.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:52.131+0000 7f6a9dd9b700 1 --2- 172.21.15.84:0/4124728261 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f6a8006a580 0x7f6a8006ca40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6aa006cea0 tx=0x7f6a94008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:52.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:52.135+0000 7f6a8effd700 1 -- 172.21.15.84:0/4124728261 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f6a90053d40 con 0x7f6a88004850 2023-09-13T08:25:52.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:52.323+0000 7f6aa4975700 1 -- 172.21.15.84:0/4124728261 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6aa00cf110 con 0x7f6a88004850 2023-09-13T08:25:52.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:52.992+0000 7f6a8effd700 1 -- 172.21.15.84:0/4124728261 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v29) v1 ==== 169+0+0 (secure 0 0 0) 0x7f6aa00cf110 con 0x7f6a88004850 2023-09-13T08:25:52.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:52.995+0000 7f6aa4975700 1 -- 172.21.15.84:0/4124728261 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f6a8006a580 msgr2=0x7f6a8006ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:52.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:52.995+0000 7f6aa4975700 1 --2- 172.21.15.84:0/4124728261 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f6a8006a580 0x7f6a8006ca40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6aa006cea0 tx=0x7f6a94008030 comp rx=0 tx=0).stop 2023-09-13T08:25:52.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:52.995+0000 7f6aa4975700 1 -- 172.21.15.84:0/4124728261 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a88004850 msgr2=0x7f6aa00c7b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:52.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:52.995+0000 7f6aa4975700 1 --2- 172.21.15.84:0/4124728261 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a88004850 0x7f6aa00c7b30 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f6a90001eb0 tx=0x7f6a90007690 comp rx=0 tx=0).stop 2023-09-13T08:25:52.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:52.995+0000 7f6aa4975700 1 -- 172.21.15.84:0/4124728261 shutdown_connections 2023-09-13T08:25:52.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:52.995+0000 7f6aa4975700 1 --2- 172.21.15.84:0/4124728261 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f6a8006a580 0x7f6a8006ca40 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:52.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:52.995+0000 7f6aa4975700 1 --2- 172.21.15.84:0/4124728261 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6aa015ed40 0x7f6aa015f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:52.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:52.995+0000 7f6aa4975700 1 --2- 172.21.15.84:0/4124728261 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a88004850 0x7f6aa00c7b30 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:52.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:52.995+0000 7f6aa4975700 1 --2- 172.21.15.84:0/4124728261 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6aa0157690 0x7f6aa01566f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:52.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:52.995+0000 7f6aa4975700 1 -- 172.21.15.84:0/4124728261 >> 172.21.15.84:0/4124728261 conn(0x7f6aa009c6b0 msgr2=0x7f6aa00b7780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:53.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:52.995+0000 7f6aa4975700 1 -- 172.21.15.84:0/4124728261 shutdown_connections 2023-09-13T08:25:53.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:52.996+0000 7f6aa4975700 1 -- 172.21.15.84:0/4124728261 wait complete. 2023-09-13T08:25:53.002 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_data' removed 2023-09-13T08:25:53.009 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-09-13T08:25:53.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:53.145+0000 7f9c002d4700 1 Processor -- start 2023-09-13T08:25:53.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:53.145+0000 7f9c002d4700 1 -- start start 2023-09-13T08:25:53.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:53.146+0000 7f9c002d4700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9bf8158f70 0x7f9bf806fce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:53.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:53.146+0000 7f9c002d4700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9bf815b780 0x7f9bf80cb790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:53.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:53.146+0000 7f9c002d4700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bf8070220 con 0x7f9bf80cbcd0 2023-09-13T08:25:53.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:53.146+0000 7f9c002d4700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bf815bcc0 con 0x7f9bf8158f70 2023-09-13T08:25:53.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:53.146+0000 7f9c002d4700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf815bfa0 con 0x7f9bf815b780 2023-09-13T08:25:53.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:53.146+0000 7f9bfd86f700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9bf815b780 0x7f9bf80cb790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:53.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:53.146+0000 7f9bfe070700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9bf8158f70 0x7f9bf806fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:53.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:53.146+0000 7f9bfd86f700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9bf815b780 0x7f9bf80cb790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.84:55372/0 (socket says 172.21.15.84:55372) 2023-09-13T08:25:53.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:53.146+0000 7f9bfe070700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9bf8158f70 0x7f9bf806fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.84:41276/0 (socket says 172.21.15.84:41276) 2023-09-13T08:25:53.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:53.146+0000 7f9bfd86f700 1 -- 172.21.15.84:0/805299144 learned_addr learned my addr 172.21.15.84:0/805299144 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:53.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:53.146+0000 7f9bfe871700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f9bf80cbcd0 0x7f9bf80b2b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.84:34322/0 (socket says 172.21.15.84:34322) 2023-09-13T08:25:53.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:53.146+0000 7f9bfe070700 1 -- 172.21.15.84:0/805299144 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9bf815b780 msgr2=0x7f9bf80cb790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:53.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:53.146+0000 7f9bfe070700 1 --2- 172.21.15.84:0/805299144 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9bf815b780 0x7f9bf80cb790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:53.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:53.146+0000 7f9bfe070700 1 -- 172.21.15.84:0/805299144 >> v1:172.21.15.161:6789/0 conn(0x7f9bf80cbcd0 legacy=0x7f9bf80b2b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:53.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:53.146+0000 7f9bfe070700 1 -- 172.21.15.84:0/805299144 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bf815c280 con 0x7f9bf8158f70 2023-09-13T08:25:53.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:53.146+0000 7f9bfd86f700 1 --2- 172.21.15.84:0/805299144 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9bf815b780 0x7f9bf80cb790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T08:25:53.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:53.147+0000 7f9bfe070700 1 --2- 172.21.15.84:0/805299144 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9bf8158f70 0x7f9bf806fce0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9bf4009840 tx=0x7f9bf4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8e65e7ef4f5ac46 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:53.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:53.147+0000 7f9bfd06e700 1 -- 172.21.15.84:0/805299144 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf4011830 con 0x7f9bf8158f70 2023-09-13T08:25:53.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:53.147+0000 7f9bfd06e700 1 -- 172.21.15.84:0/805299144 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bf4011990 con 0x7f9bf8158f70 2023-09-13T08:25:53.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:53.147+0000 7f9bfd06e700 1 -- 172.21.15.84:0/805299144 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf4011d20 con 0x7f9bf8158f70 2023-09-13T08:25:53.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:53.147+0000 7f9c002d4700 1 -- 172.21.15.84:0/805299144 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9bf8158f70 msgr2=0x7f9bf806fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:53.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:53.147+0000 7f9c002d4700 1 --2- 172.21.15.84:0/805299144 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9bf8158f70 0x7f9bf806fce0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9bf4009840 tx=0x7f9bf4009b50 comp rx=0 tx=0).stop 2023-09-13T08:25:53.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:53.147+0000 7f9c002d4700 1 -- 172.21.15.84:0/805299144 shutdown_connections 2023-09-13T08:25:53.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:53.147+0000 7f9c002d4700 1 --2- 172.21.15.84:0/805299144 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9bf8158f70 0x7f9bf806fce0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:53.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:53.147+0000 7f9c002d4700 1 --2- 172.21.15.84:0/805299144 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9bf815b780 0x7f9bf80cb790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:53.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:53.147+0000 7f9c002d4700 1 -- 172.21.15.84:0/805299144 >> 172.21.15.84:0/805299144 conn(0x7f9bf80cdb50 msgr2=0x7f9bf80cdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:53.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:53.147+0000 7f9c002d4700 1 -- 172.21.15.84:0/805299144 shutdown_connections 2023-09-13T08:25:53.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:53.147+0000 7f9c002d4700 1 -- 172.21.15.84:0/805299144 wait complete. 2023-09-13T08:25:53.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:53.149+0000 7f9c002d4700 1 Processor -- start 2023-09-13T08:25:53.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:53.149+0000 7f9c002d4700 1 -- start start 2023-09-13T08:25:53.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:53.149+0000 7f9c002d4700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9bf80cbcd0 0x7f9bf80b1f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:53.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:53.149+0000 7f9c002d4700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9bf8158f70 0x7f9bf80cec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:53.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:53.149+0000 7f9c002d4700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9bf815b780 0x7f9bf80cf170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:53.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:53.149+0000 7f9c002d4700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf80c9a50 con 0x7f9bf815b780 2023-09-13T08:25:53.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:53.149+0000 7f9c002d4700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf806c580 con 0x7f9bf80cbcd0 2023-09-13T08:25:53.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:53.149+0000 7f9c002d4700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf80c8dd0 con 0x7f9bf8158f70 2023-09-13T08:25:53.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:53.149+0000 7f9bfe871700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9bf815b780 0x7f9bf80cf170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:53.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:53.149+0000 7f9bfe871700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9bf815b780 0x7f9bf80cf170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45514/0 (socket says 172.21.15.84:45514) 2023-09-13T08:25:53.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:53.149+0000 7f9bfe871700 1 -- 172.21.15.84:0/1308786566 learned_addr learned my addr 172.21.15.84:0/1308786566 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:53.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:53.150+0000 7f9bfd86f700 1 --2- 172.21.15.84:0/1308786566 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9bf8158f70 0x7f9bf80cec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:53.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:53.150+0000 7f9bfe070700 1 --2- 172.21.15.84:0/1308786566 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9bf80cbcd0 0x7f9bf80b1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:53.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:53.150+0000 7f9bfe871700 1 -- 172.21.15.84:0/1308786566 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9bf8158f70 msgr2=0x7f9bf80cec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:53.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:53.150+0000 7f9bfe871700 1 --2- 172.21.15.84:0/1308786566 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9bf8158f70 0x7f9bf80cec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:53.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:53.150+0000 7f9bfe871700 1 -- 172.21.15.84:0/1308786566 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9bf80cbcd0 msgr2=0x7f9bf80b1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:53.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:53.150+0000 7f9bfe871700 1 --2- 172.21.15.84:0/1308786566 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9bf80cbcd0 0x7f9bf80b1f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:53.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:53.150+0000 7f9bfe871700 1 -- 172.21.15.84:0/1308786566 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9be8009550 con 0x7f9bf815b780 2023-09-13T08:25:53.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:53.150+0000 7f9bfe871700 1 --2- 172.21.15.84:0/1308786566 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9bf815b780 0x7f9bf80cf170 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f9bf000cc00 tx=0x7f9bf000cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:53.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:53.150+0000 7f9beeffd700 1 -- 172.21.15.84:0/1308786566 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf000aa40 con 0x7f9bf815b780 2023-09-13T08:25:53.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:53.150+0000 7f9beeffd700 1 -- 172.21.15.84:0/1308786566 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bf000aba0 con 0x7f9bf815b780 2023-09-13T08:25:53.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:53.150+0000 7f9c002d4700 1 -- 172.21.15.84:0/1308786566 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bf40094a0 con 0x7f9bf815b780 2023-09-13T08:25:53.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:53.150+0000 7f9beeffd700 1 -- 172.21.15.84:0/1308786566 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf0007070 con 0x7f9bf815b780 2023-09-13T08:25:53.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:53.150+0000 7f9c002d4700 1 -- 172.21.15.84:0/1308786566 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bf80c9390 con 0x7f9bf815b780 2023-09-13T08:25:53.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:53.151+0000 7f9c002d4700 1 -- 172.21.15.84:0/1308786566 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bf80c9b90 con 0x7f9bf815b780 2023-09-13T08:25:53.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:53.152+0000 7f9beeffd700 1 -- 172.21.15.84:0/1308786566 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f9bf00071d0 con 0x7f9bf815b780 2023-09-13T08:25:53.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:53.152+0000 7f9beeffd700 1 --2- 172.21.15.84:0/1308786566 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f9bdc06a580 0x7f9bdc06ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:53.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:53.152+0000 7f9beeffd700 1 -- 172.21.15.84:0/1308786566 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5781+0+0 (secure 0 0 0) 0x7f9bf00886a0 con 0x7f9bf815b780 2023-09-13T08:25:53.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:53.152+0000 7f9bfe070700 1 --2- 172.21.15.84:0/1308786566 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f9bdc06a580 0x7f9bdc06ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:53.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:53.152+0000 7f9bfe070700 1 --2- 172.21.15.84:0/1308786566 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f9bdc06a580 0x7f9bdc06ca40 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9bf4000c00 tx=0x7f9bf4008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:53.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:53.156+0000 7f9beeffd700 1 -- 172.21.15.84:0/1308786566 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f9bf80c9b90 con 0x7f9bf815b780 2023-09-13T08:25:53.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:53.345+0000 7f9c002d4700 1 -- 172.21.15.84:0/1308786566 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f9bf80c9b90 con 0x7f9bf815b780 2023-09-13T08:25:53.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:53.998+0000 7f9beeffd700 1 -- 172.21.15.84:0/1308786566 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v30) v1 ==== 178+0+0 (secure 0 0 0) 0x7f9bf80c9b90 con 0x7f9bf815b780 2023-09-13T08:25:54.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:54.001+0000 7f9c002d4700 1 -- 172.21.15.84:0/1308786566 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f9bdc06a580 msgr2=0x7f9bdc06ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:54.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:54.001+0000 7f9c002d4700 1 --2- 172.21.15.84:0/1308786566 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f9bdc06a580 0x7f9bdc06ca40 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9bf4000c00 tx=0x7f9bf4008030 comp rx=0 tx=0).stop 2023-09-13T08:25:54.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:54.001+0000 7f9c002d4700 1 -- 172.21.15.84:0/1308786566 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9bf815b780 msgr2=0x7f9bf80cf170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:54.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:54.001+0000 7f9c002d4700 1 --2- 172.21.15.84:0/1308786566 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9bf815b780 0x7f9bf80cf170 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f9bf000cc00 tx=0x7f9bf000cf10 comp rx=0 tx=0).stop 2023-09-13T08:25:54.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:54.001+0000 7f9c002d4700 1 -- 172.21.15.84:0/1308786566 shutdown_connections 2023-09-13T08:25:54.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:54.001+0000 7f9c002d4700 1 --2- 172.21.15.84:0/1308786566 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9bf815b780 0x7f9bf80cf170 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:54.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:54.001+0000 7f9c002d4700 1 --2- 172.21.15.84:0/1308786566 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f9bdc06a580 0x7f9bdc06ca40 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:54.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:54.001+0000 7f9c002d4700 1 --2- 172.21.15.84:0/1308786566 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9bf80cbcd0 0x7f9bf80b1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:54.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:54.001+0000 7f9c002d4700 1 --2- 172.21.15.84:0/1308786566 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9bf8158f70 0x7f9bf80cec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:54.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:54.001+0000 7f9c002d4700 1 -- 172.21.15.84:0/1308786566 >> 172.21.15.84:0/1308786566 conn(0x7f9bf80cdb50 msgr2=0x7f9bf8070440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:54.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:54.001+0000 7f9c002d4700 1 -- 172.21.15.84:0/1308786566 shutdown_connections 2023-09-13T08:25:54.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:54.001+0000 7f9c002d4700 1 -- 172.21.15.84:0/1308786566 wait complete. 2023-09-13T08:25:54.007 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_data_ec' removed 2023-09-13T08:25:54.015 INFO:tasks.ceph.mds.a:Restarting daemon 2023-09-13T08:25:54.015 INFO:tasks.ceph.mds.a:Stopping old one... 2023-09-13T08:25:54.016 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-09-13T08:25:54.016 INFO:teuthology.orchestra.run:waiting for 300 2023-09-13T08:25:54.016 INFO:tasks.ceph.mds.c:Restarting daemon 2023-09-13T08:25:54.017 INFO:tasks.ceph.mds.c:Stopping old one... 2023-09-13T08:25:54.017 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-09-13T08:25:54.017 INFO:teuthology.orchestra.run:waiting for 300 2023-09-13T08:25:54.018 INFO:tasks.ceph.mds.b:Restarting daemon 2023-09-13T08:25:54.018 INFO:tasks.ceph.mds.b:Stopping old one... 2023-09-13T08:25:54.018 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-09-13T08:25:54.019 INFO:teuthology.orchestra.run:waiting for 300 2023-09-13T08:25:54.019 INFO:tasks.ceph.mds.d:Restarting daemon 2023-09-13T08:25:54.019 INFO:tasks.ceph.mds.d:Stopping old one... 2023-09-13T08:25:54.021 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-09-13T08:25:54.021 INFO:teuthology.orchestra.run:waiting for 300 2023-09-13T08:25:54.025 INFO:tasks.ceph.mds.a:Stopped 2023-09-13T08:25:54.026 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-09-13T08:25:54.027 INFO:tasks.ceph.mds.c:Stopped 2023-09-13T08:25:54.027 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-09-13T08:25:54.030 INFO:tasks.ceph.mds.b:Stopped 2023-09-13T08:25:54.030 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-09-13T08:25:54.031 INFO:tasks.ceph.mds.d:Stopped 2023-09-13T08:25:54.032 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-09-13T08:25:54.068 INFO:tasks.ceph.mds.a:Started 2023-09-13T08:25:54.069 DEBUG:teuthology.parallel:result is None 2023-09-13T08:25:54.070 INFO:tasks.ceph.mds.c:Started 2023-09-13T08:25:54.070 DEBUG:teuthology.parallel:result is None 2023-09-13T08:25:54.074 INFO:tasks.ceph.mds.b:Started 2023-09-13T08:25:54.074 DEBUG:teuthology.parallel:result is None 2023-09-13T08:25:54.075 INFO:tasks.ceph.mds.d:Started 2023-09-13T08:25:54.076 DEBUG:teuthology.parallel:result is None 2023-09-13T08:25:54.076 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-09-13T08:25:54.150 INFO:tasks.ceph.mds.a.smithi084.stdout:starting mds.a at 2023-09-13T08:25:54.170 INFO:tasks.ceph.mds.c.smithi084.stdout:starting mds.c at 2023-09-13T08:25:54.171 INFO:tasks.ceph.mds.a.smithi084.stderr:2023-09-13T08:25:54.151+0000 7f786c400700 -1 PosixStack listen unable to listen on v1:0.0.0.0:6835/0: (98) Address already in use 2023-09-13T08:25:54.172 INFO:tasks.ceph.mds.b.smithi161.stdout:starting mds.b at 2023-09-13T08:25:54.173 INFO:tasks.ceph.mds.d.smithi161.stdout:starting mds.d at 2023-09-13T08:25:54.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:54.206+0000 7fba8022c700 1 Processor -- start 2023-09-13T08:25:54.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:54.206+0000 7fba8022c700 1 -- start start 2023-09-13T08:25:54.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:54.207+0000 7fba8022c700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fba7815b420 0x7fba780b1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:54.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:54.207+0000 7fba8022c700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fba7806d360 0x7fba780b2600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:54.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:54.207+0000 7fba8022c700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba780af210 con 0x7fba780aec10 2023-09-13T08:25:54.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:54.207+0000 7fba8022c700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba780b0330 con 0x7fba7815b420 2023-09-13T08:25:54.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:54.207+0000 7fba8022c700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba780afd40 con 0x7fba7806d360 2023-09-13T08:25:54.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:54.207+0000 7fba7dfc8700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fba7815b420 0x7fba780b1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:54.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:54.207+0000 7fba7e7c9700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fba7806d360 0x7fba780b2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:54.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:54.207+0000 7fba7dfc8700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fba7815b420 0x7fba780b1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.84:41320/0 (socket says 172.21.15.84:41320) 2023-09-13T08:25:54.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:54.207+0000 7fba7d7c7700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fba780aec10 0x7fba7806cc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.84:34366/0 (socket says 172.21.15.84:34366) 2023-09-13T08:25:54.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:54.207+0000 7fba7dfc8700 1 -- 172.21.15.84:0/764133179 learned_addr learned my addr 172.21.15.84:0/764133179 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:54.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:54.207+0000 7fba7dfc8700 1 -- 172.21.15.84:0/764133179 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fba7806d360 msgr2=0x7fba780b2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:54.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:54.207+0000 7fba7dfc8700 1 --2- 172.21.15.84:0/764133179 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fba7806d360 0x7fba780b2600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:54.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:54.207+0000 7fba7dfc8700 1 -- 172.21.15.84:0/764133179 >> v1:172.21.15.161:6789/0 conn(0x7fba780aec10 legacy=0x7fba7806cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:54.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:54.207+0000 7fba7dfc8700 1 -- 172.21.15.84:0/764133179 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba780af4f0 con 0x7fba7815b420 2023-09-13T08:25:54.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:54.207+0000 7fba7cfc6700 1 -- 172.21.15.84:0/764133179 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1987661849 0 0) 0x7fba780af210 con 0x7fba780aec10 2023-09-13T08:25:54.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:54.207+0000 7fba7e7c9700 1 --2- 172.21.15.84:0/764133179 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fba7806d360 0x7fba780b2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T08:25:54.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:54.208+0000 7fba7dfc8700 1 --2- 172.21.15.84:0/764133179 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fba7815b420 0x7fba780b1da0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fba740098f0 tx=0x7fba74009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=177f3e97e7d039b1 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:54.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:54.208+0000 7fba7cfc6700 1 -- 172.21.15.84:0/764133179 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba74011830 con 0x7fba7815b420 2023-09-13T08:25:54.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:54.208+0000 7fba7cfc6700 1 -- 172.21.15.84:0/764133179 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba74011990 con 0x7fba7815b420 2023-09-13T08:25:54.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:54.208+0000 7fba7cfc6700 1 -- 172.21.15.84:0/764133179 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba74011d20 con 0x7fba7815b420 2023-09-13T08:25:54.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:54.208+0000 7fba8022c700 1 -- 172.21.15.84:0/764133179 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fba7815b420 msgr2=0x7fba780b1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:54.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:54.208+0000 7fba8022c700 1 --2- 172.21.15.84:0/764133179 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fba7815b420 0x7fba780b1da0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fba740098f0 tx=0x7fba74009c00 comp rx=0 tx=0).stop 2023-09-13T08:25:54.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:54.208+0000 7fba8022c700 1 -- 172.21.15.84:0/764133179 shutdown_connections 2023-09-13T08:25:54.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:54.208+0000 7fba8022c700 1 --2- 172.21.15.84:0/764133179 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fba7815b420 0x7fba780b1da0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:54.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:54.208+0000 7fba8022c700 1 --2- 172.21.15.84:0/764133179 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fba7806d360 0x7fba780b2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:54.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:54.208+0000 7fba8022c700 1 -- 172.21.15.84:0/764133179 >> 172.21.15.84:0/764133179 conn(0x7fba780cc230 msgr2=0x7fba780cc640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:54.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:54.208+0000 7fba8022c700 1 -- 172.21.15.84:0/764133179 shutdown_connections 2023-09-13T08:25:54.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:54.208+0000 7fba8022c700 1 -- 172.21.15.84:0/764133179 wait complete. 2023-09-13T08:25:54.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:54.209+0000 7fba8022c700 1 Processor -- start 2023-09-13T08:25:54.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:54.210+0000 7fba8022c700 1 -- start start 2023-09-13T08:25:54.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:54.210+0000 7fba8022c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba7806d360 0x7fba781598a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:54.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:54.210+0000 7fba8022c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fba780aec10 0x7fba781f3b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:54.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:54.210+0000 7fba8022c700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fba7815b420 0x7fba781f40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:54.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:54.210+0000 7fba8022c700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba78159de0 con 0x7fba7806d360 2023-09-13T08:25:54.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:54.210+0000 7fba8022c700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba7815c510 con 0x7fba780aec10 2023-09-13T08:25:54.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:54.210+0000 7fba8022c700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba7815a250 con 0x7fba7815b420 2023-09-13T08:25:54.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:54.210+0000 7fba7dfc8700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba7806d360 0x7fba781598a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:54.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:54.210+0000 7fba7dfc8700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba7806d360 0x7fba781598a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45554/0 (socket says 172.21.15.84:45554) 2023-09-13T08:25:54.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:54.210+0000 7fba7dfc8700 1 -- 172.21.15.84:0/2496674544 learned_addr learned my addr 172.21.15.84:0/2496674544 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:54.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:54.211+0000 7fba7d7c7700 1 --2- 172.21.15.84:0/2496674544 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fba780aec10 0x7fba781f3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:54.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:54.211+0000 7fba7e7c9700 1 --2- 172.21.15.84:0/2496674544 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fba7815b420 0x7fba781f40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:54.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:54.211+0000 7fba7dfc8700 1 -- 172.21.15.84:0/2496674544 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fba7815b420 msgr2=0x7fba781f40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:54.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:54.211+0000 7fba7dfc8700 1 --2- 172.21.15.84:0/2496674544 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fba7815b420 0x7fba781f40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:54.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:54.211+0000 7fba7dfc8700 1 -- 172.21.15.84:0/2496674544 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fba780aec10 msgr2=0x7fba781f3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:54.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:54.211+0000 7fba7dfc8700 1 --2- 172.21.15.84:0/2496674544 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fba780aec10 0x7fba781f3b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:54.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:54.211+0000 7fba7dfc8700 1 -- 172.21.15.84:0/2496674544 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba70009a70 con 0x7fba7806d360 2023-09-13T08:25:54.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:54.211+0000 7fba7dfc8700 1 --2- 172.21.15.84:0/2496674544 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba7806d360 0x7fba781598a0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fba74009c40 tx=0x7fba74004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:54.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:54.211+0000 7fba6e7fc700 1 -- 172.21.15.84:0/2496674544 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba74004480 con 0x7fba7806d360 2023-09-13T08:25:54.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:54.211+0000 7fba6e7fc700 1 -- 172.21.15.84:0/2496674544 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba7401f070 con 0x7fba7806d360 2023-09-13T08:25:54.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:54.211+0000 7fba8022c700 1 -- 172.21.15.84:0/2496674544 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba74009550 con 0x7fba7806d360 2023-09-13T08:25:54.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:54.211+0000 7fba6e7fc700 1 -- 172.21.15.84:0/2496674544 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba740038c0 con 0x7fba7806d360 2023-09-13T08:25:54.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:54.211+0000 7fba8022c700 1 -- 172.21.15.84:0/2496674544 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba781f49e0 con 0x7fba7806d360 2023-09-13T08:25:54.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:54.212+0000 7fba8022c700 1 -- 172.21.15.84:0/2496674544 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba7804e9b0 con 0x7fba7806d360 2023-09-13T08:25:54.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:54.212+0000 7fba6e7fc700 1 -- 172.21.15.84:0/2496674544 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fba74021030 con 0x7fba7806d360 2023-09-13T08:25:54.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:54.213+0000 7fba6e7fc700 1 --2- 172.21.15.84:0/2496674544 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fba5c06a580 0x7fba5c06ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:54.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:54.213+0000 7fba6e7fc700 1 -- 172.21.15.84:0/2496674544 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fba74089d50 con 0x7fba7806d360 2023-09-13T08:25:54.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:54.213+0000 7fba7d7c7700 1 --2- 172.21.15.84:0/2496674544 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fba5c06a580 0x7fba5c06ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:54.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:54.213+0000 7fba7d7c7700 1 --2- 172.21.15.84:0/2496674544 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fba5c06a580 0x7fba5c06ca40 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fba780ae0c0 tx=0x7fba68007be0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:54.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:54.217+0000 7fba6e7fc700 1 -- 172.21.15.84:0/2496674544 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fba7408d030 con 0x7fba7806d360 2023-09-13T08:25:54.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:54.422+0000 7fba8022c700 1 -- 172.21.15.84:0/2496674544 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fba780ae9f0 con 0x7fba7806d360 2023-09-13T08:25:55.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.005+0000 7fba6e7fc700 1 -- 172.21.15.84:0/2496674544 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v32) v1 ==== 97+0+0 (secure 0 0 0) 0x7fba740554a0 con 0x7fba7806d360 2023-09-13T08:25:55.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.008+0000 7fba8022c700 1 -- 172.21.15.84:0/2496674544 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fba5c06a580 msgr2=0x7fba5c06ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:55.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.008+0000 7fba8022c700 1 --2- 172.21.15.84:0/2496674544 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fba5c06a580 0x7fba5c06ca40 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fba780ae0c0 tx=0x7fba68007be0 comp rx=0 tx=0).stop 2023-09-13T08:25:55.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.008+0000 7fba8022c700 1 -- 172.21.15.84:0/2496674544 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba7806d360 msgr2=0x7fba781598a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:55.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.008+0000 7fba8022c700 1 --2- 172.21.15.84:0/2496674544 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba7806d360 0x7fba781598a0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fba74009c40 tx=0x7fba74004750 comp rx=0 tx=0).stop 2023-09-13T08:25:55.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.008+0000 7fba8022c700 1 -- 172.21.15.84:0/2496674544 shutdown_connections 2023-09-13T08:25:55.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.008+0000 7fba8022c700 1 --2- 172.21.15.84:0/2496674544 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fba7815b420 0x7fba781f40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:55.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.008+0000 7fba8022c700 1 --2- 172.21.15.84:0/2496674544 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba7806d360 0x7fba781598a0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:55.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.008+0000 7fba8022c700 1 --2- 172.21.15.84:0/2496674544 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fba5c06a580 0x7fba5c06ca40 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:55.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.008+0000 7fba8022c700 1 --2- 172.21.15.84:0/2496674544 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fba780aec10 0x7fba781f3b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:55.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.008+0000 7fba8022c700 1 -- 172.21.15.84:0/2496674544 >> 172.21.15.84:0/2496674544 conn(0x7fba780cc230 msgr2=0x7fba780cec50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:55.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.008+0000 7fba8022c700 1 -- 172.21.15.84:0/2496674544 shutdown_connections 2023-09-13T08:25:55.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.008+0000 7fba8022c700 1 -- 172.21.15.84:0/2496674544 wait complete. 2023-09-13T08:25:55.012 INFO:teuthology.orchestra.run.smithi084.stderr: removed all blocklist entries 2023-09-13T08:25:55.023 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-09-13T08:25:55.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.144+0000 7fb5b00f9700 1 Processor -- start 2023-09-13T08:25:55.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.144+0000 7fb5b00f9700 1 -- start start 2023-09-13T08:25:55.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.145+0000 7fb5b00f9700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb5a80ce920 0x7fb5a80ced00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:55.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.145+0000 7fb5b00f9700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5a8151800 con 0x7fb5a815b200 2023-09-13T08:25:55.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.145+0000 7fb5b00f9700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5a815ad70 con 0x7fb5a80cc900 2023-09-13T08:25:55.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.145+0000 7fb5b00f9700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5a815edd0 con 0x7fb5a80ce920 2023-09-13T08:25:55.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.145+0000 7fb5ade95700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb5a80ce920 0x7fb5a80ced00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:55.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.145+0000 7fb5ad694700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fb5a815b200 0x7fb5a815de70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:48210/0 (socket says 172.21.15.84:48210) 2023-09-13T08:25:55.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.145+0000 7fb5ade95700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb5a80ce920 0x7fb5a80ced00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45564/0 (socket says 172.21.15.84:45564) 2023-09-13T08:25:55.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.145+0000 7fb5ad694700 1 -- 172.21.15.84:0/2224178596 learned_addr learned my addr 172.21.15.84:0/2224178596 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:25:55.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.145+0000 7fb5ade95700 1 -- 172.21.15.84:0/2224178596 >> v1:172.21.15.161:6789/0 conn(0x7fb5a80cc900 legacy=0x7fb5a80ccd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:55.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.145+0000 7fb5ade95700 1 -- 172.21.15.84:0/2224178596 >> v1:172.21.15.84:6789/0 conn(0x7fb5a815b200 legacy=0x7fb5a815de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:55.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.145+0000 7fb5ade95700 1 -- 172.21.15.84:0/2224178596 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5a815e580 con 0x7fb5a80ce920 2023-09-13T08:25:55.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.145+0000 7fb5ace93700 1 -- 172.21.15.84:0/2224178596 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2369152591 0 0) 0x7fb598001110 con 0x7fb5a815b200 2023-09-13T08:25:55.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.145+0000 7fb5ade95700 1 --2- 172.21.15.84:0/2224178596 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb5a80ce920 0x7fb5a80ced00 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fb5a4009840 tx=0x7fb5a4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e712e5c0f70bebf3 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:55.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.145+0000 7fb5ace93700 1 -- 172.21.15.84:0/2224178596 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5a4004230 con 0x7fb5a80ce920 2023-09-13T08:25:55.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.145+0000 7fb5ace93700 1 -- 172.21.15.84:0/2224178596 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5a4004390 con 0x7fb5a80ce920 2023-09-13T08:25:55.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.145+0000 7fb5ace93700 1 -- 172.21.15.84:0/2224178596 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5a40036a0 con 0x7fb5a80ce920 2023-09-13T08:25:55.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.146+0000 7fb5b00f9700 1 -- 172.21.15.84:0/2224178596 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb5a80ce920 msgr2=0x7fb5a80ced00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:55.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.146+0000 7fb5b00f9700 1 --2- 172.21.15.84:0/2224178596 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb5a80ce920 0x7fb5a80ced00 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fb5a4009840 tx=0x7fb5a4009b50 comp rx=0 tx=0).stop 2023-09-13T08:25:55.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.146+0000 7fb5b00f9700 1 -- 172.21.15.84:0/2224178596 shutdown_connections 2023-09-13T08:25:55.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.146+0000 7fb5b00f9700 1 --2- 172.21.15.84:0/2224178596 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb5a80ce920 0x7fb5a80ced00 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:55.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.146+0000 7fb5b00f9700 1 -- 172.21.15.84:0/2224178596 >> 172.21.15.84:0/2224178596 conn(0x7fb5a80b1b80 msgr2=0x7fb5a80b1f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:55.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.146+0000 7fb5b00f9700 1 -- 172.21.15.84:0/2224178596 shutdown_connections 2023-09-13T08:25:55.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.146+0000 7fb5b00f9700 1 -- 172.21.15.84:0/2224178596 wait complete. 2023-09-13T08:25:55.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.147+0000 7fb5b00f9700 1 Processor -- start 2023-09-13T08:25:55.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.147+0000 7fb5b00f9700 1 -- start start 2023-09-13T08:25:55.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.148+0000 7fb5b00f9700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb5a80cc900 0x7fb5a80b4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:55.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.148+0000 7fb5b00f9700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb5a80ce920 0x7fb5a80b51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:55.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.148+0000 7fb5b00f9700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb5a815b200 0x7fb5a80c3b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:55.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.148+0000 7fb5b00f9700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a80c85a0 con 0x7fb5a80cc900 2023-09-13T08:25:55.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.148+0000 7fb5b00f9700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a80cc580 con 0x7fb5a815b200 2023-09-13T08:25:55.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.148+0000 7fb5b00f9700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a814bdc0 con 0x7fb5a80ce920 2023-09-13T08:25:55.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.148+0000 7fb5ade95700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb5a80cc900 0x7fb5a80b4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:55.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.148+0000 7fb5ade95700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb5a80cc900 0x7fb5a80b4c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45568/0 (socket says 172.21.15.84:45568) 2023-09-13T08:25:55.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.148+0000 7fb5ade95700 1 -- 172.21.15.84:0/2970100198 learned_addr learned my addr 172.21.15.84:0/2970100198 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:55.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.148+0000 7fb5ad694700 1 --2- 172.21.15.84:0/2970100198 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb5a80ce920 0x7fb5a80b51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:55.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.148+0000 7fb5ae696700 1 --2- 172.21.15.84:0/2970100198 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb5a815b200 0x7fb5a80c3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:55.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.148+0000 7fb5ade95700 1 -- 172.21.15.84:0/2970100198 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb5a80ce920 msgr2=0x7fb5a80b51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:55.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.148+0000 7fb5ade95700 1 --2- 172.21.15.84:0/2970100198 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb5a80ce920 0x7fb5a80b51c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:55.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.148+0000 7fb5ade95700 1 -- 172.21.15.84:0/2970100198 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb5a815b200 msgr2=0x7fb5a80c3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:55.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.148+0000 7fb5ade95700 1 --2- 172.21.15.84:0/2970100198 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb5a815b200 0x7fb5a80c3b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:55.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.148+0000 7fb5ade95700 1 -- 172.21.15.84:0/2970100198 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5a40094a0 con 0x7fb5a80cc900 2023-09-13T08:25:55.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.148+0000 7fb5ad694700 1 --2- 172.21.15.84:0/2970100198 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb5a80ce920 0x7fb5a80b51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T08:25:55.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.148+0000 7fb5ade95700 1 --2- 172.21.15.84:0/2970100198 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb5a80cc900 0x7fb5a80b4c80 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fb5a8072c40 tx=0x7fb5a4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:55.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.149+0000 7fb59e7fc700 1 -- 172.21.15.84:0/2970100198 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5a4011630 con 0x7fb5a80cc900 2023-09-13T08:25:55.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.149+0000 7fb59e7fc700 1 -- 172.21.15.84:0/2970100198 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5a401e070 con 0x7fb5a80cc900 2023-09-13T08:25:55.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.149+0000 7fb59e7fc700 1 -- 172.21.15.84:0/2970100198 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5a40119f0 con 0x7fb5a80cc900 2023-09-13T08:25:55.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.149+0000 7fb5b00f9700 1 -- 172.21.15.84:0/2970100198 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5a80c7c40 con 0x7fb5a80cc900 2023-09-13T08:25:55.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.149+0000 7fb5b00f9700 1 -- 172.21.15.84:0/2970100198 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5a80c81c0 con 0x7fb5a80cc900 2023-09-13T08:25:55.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.150+0000 7fb5b00f9700 1 -- 172.21.15.84:0/2970100198 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5a804e9b0 con 0x7fb5a80cc900 2023-09-13T08:25:55.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.150+0000 7fb59e7fc700 1 -- 172.21.15.84:0/2970100198 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fb5a4011b50 con 0x7fb5a80cc900 2023-09-13T08:25:55.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.150+0000 7fb59e7fc700 1 --2- 172.21.15.84:0/2970100198 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fb58c06a580 0x7fb58c06ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:55.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.150+0000 7fb59e7fc700 1 -- 172.21.15.84:0/2970100198 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fb5a4089bd0 con 0x7fb5a80cc900 2023-09-13T08:25:55.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.150+0000 7fb5ad694700 1 --2- 172.21.15.84:0/2970100198 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fb58c06a580 0x7fb58c06ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:55.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.151+0000 7fb5ad694700 1 --2- 172.21.15.84:0/2970100198 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fb58c06a580 0x7fb58c06ca40 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb598007fd0 tx=0x7fb598009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:55.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.155+0000 7fb59e7fc700 1 -- 172.21.15.84:0/2970100198 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fb5a40553f0 con 0x7fb5a80cc900 2023-09-13T08:25:55.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.418+0000 7fb5b00f9700 1 -- 172.21.15.84:0/2970100198 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fb5a80b5fb0 con 0x7fb5a80cc900 2023-09-13T08:25:55.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.418+0000 7fb59e7fc700 1 -- 172.21.15.84:0/2970100198 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+6645 (secure 0 0 0) 0x7fb5a4020090 con 0x7fb5a80cc900 2023-09-13T08:25:55.420 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:25:55.420 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-09-13T08:25:55.420 INFO:teuthology.orchestra.run.smithi084.stdout: "auth_dump": [ 2023-09-13T08:25:55.420 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-09-13T08:25:55.421 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.a", 2023-09-13T08:25:55.421 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCPcQFlctWjDBAAjv8Ie2euiQ6pyxzgFW1YnA==", 2023-09-13T08:25:55.421 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-09-13T08:25:55.421 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-09-13T08:25:55.421 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-09-13T08:25:55.422 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-09-13T08:25:55.422 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-09-13T08:25:55.422 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-09-13T08:25:55.422 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-09-13T08:25:55.423 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-09-13T08:25:55.423 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.b", 2023-09-13T08:25:55.423 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCPcQFliCDLGBAA7Gj7Wn2u3MdhIL2IN9Q0sw==", 2023-09-13T08:25:55.423 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-09-13T08:25:55.423 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-09-13T08:25:55.423 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-09-13T08:25:55.424 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-09-13T08:25:55.424 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-09-13T08:25:55.424 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-09-13T08:25:55.424 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-09-13T08:25:55.425 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-09-13T08:25:55.425 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.c", 2023-09-13T08:25:55.425 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCPcQFldCLlExAAHorwgOqe8i2PhYeiMwS1QQ==", 2023-09-13T08:25:55.425 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-09-13T08:25:55.425 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-09-13T08:25:55.426 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-09-13T08:25:55.426 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-09-13T08:25:55.426 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-09-13T08:25:55.426 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-09-13T08:25:55.426 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-09-13T08:25:55.427 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-09-13T08:25:55.427 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.d", 2023-09-13T08:25:55.427 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCPcQFleskvIBAA2eW3D23vDpEs4fHiCUi/Hw==", 2023-09-13T08:25:55.427 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-09-13T08:25:55.427 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-09-13T08:25:55.428 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-09-13T08:25:55.428 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-09-13T08:25:55.428 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-09-13T08:25:55.428 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-09-13T08:25:55.428 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-09-13T08:25:55.429 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-09-13T08:25:55.429 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.0", 2023-09-13T08:25:55.429 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCScQFlxmZ/ORAAjoQuoNbStmNRKDzKQMdqrQ==", 2023-09-13T08:25:55.429 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-09-13T08:25:55.429 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-09-13T08:25:55.430 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-09-13T08:25:55.430 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-09-13T08:25:55.430 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-09-13T08:25:55.430 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-09-13T08:25:55.431 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-09-13T08:25:55.431 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.1", 2023-09-13T08:25:55.431 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCVcQFlcLw9OhAAU/UJ6t85Q1OD/BbCc5T41g==", 2023-09-13T08:25:55.431 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-09-13T08:25:55.431 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-09-13T08:25:55.432 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-09-13T08:25:55.432 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-09-13T08:25:55.432 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-09-13T08:25:55.433 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-09-13T08:25:55.433 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-09-13T08:25:55.433 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.2", 2023-09-13T08:25:55.433 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCYcQFlkGswORAAUlpF3Wr0ig2bFZHgkp2eUA==", 2023-09-13T08:25:55.434 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-09-13T08:25:55.434 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-09-13T08:25:55.434 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-09-13T08:25:55.434 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-09-13T08:25:55.434 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-09-13T08:25:55.435 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-09-13T08:25:55.435 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-09-13T08:25:55.435 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.3", 2023-09-13T08:25:55.435 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCbcQFlF4KYOBAAy4SV9QpY5jSl9Z65Kvg6ew==", 2023-09-13T08:25:55.435 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-09-13T08:25:55.436 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-09-13T08:25:55.436 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-09-13T08:25:55.436 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-09-13T08:25:55.436 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-09-13T08:25:55.436 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-09-13T08:25:55.437 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-09-13T08:25:55.437 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.4", 2023-09-13T08:25:55.437 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQChcQFlbop8OhAAGPG1rHs6gxDr1NKhzBZpCg==", 2023-09-13T08:25:55.437 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-09-13T08:25:55.437 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-09-13T08:25:55.438 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-09-13T08:25:55.438 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-09-13T08:25:55.438 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-09-13T08:25:55.438 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-09-13T08:25:55.439 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-09-13T08:25:55.439 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.5", 2023-09-13T08:25:55.439 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCkcQFlTQ+KORAA44V7Ff4R2Lep1GSgbR14hg==", 2023-09-13T08:25:55.439 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-09-13T08:25:55.439 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-09-13T08:25:55.440 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-09-13T08:25:55.440 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-09-13T08:25:55.440 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-09-13T08:25:55.440 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-09-13T08:25:55.440 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-09-13T08:25:55.441 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.6", 2023-09-13T08:25:55.441 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCncQFlXoqqOBAAhKHSELMXASOuwRf+HNFNTQ==", 2023-09-13T08:25:55.441 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-09-13T08:25:55.441 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-09-13T08:25:55.441 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-09-13T08:25:55.442 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-09-13T08:25:55.442 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-09-13T08:25:55.442 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-09-13T08:25:55.442 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-09-13T08:25:55.443 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.7", 2023-09-13T08:25:55.443 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCqcQFl41hvOBAAWug1ynxu8FPe+VasDEj7bg==", 2023-09-13T08:25:55.443 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-09-13T08:25:55.443 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-09-13T08:25:55.443 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-09-13T08:25:55.443 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-09-13T08:25:55.444 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-09-13T08:25:55.444 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-09-13T08:25:55.444 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-09-13T08:25:55.444 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.0", 2023-09-13T08:25:55.445 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCPcQFlYASSJBAAizLV8EZeo+kCkamPephtLA==", 2023-09-13T08:25:55.445 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-09-13T08:25:55.445 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-09-13T08:25:55.445 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow r", 2023-09-13T08:25:55.445 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow rw", 2023-09-13T08:25:55.446 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rwx" 2023-09-13T08:25:55.446 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-09-13T08:25:55.446 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-09-13T08:25:55.446 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-09-13T08:25:55.446 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.1", 2023-09-13T08:25:55.447 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCPcQFl4Ds8KxAAKDNxtu4ME9yAx0MkKURXyg==", 2023-09-13T08:25:55.447 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-09-13T08:25:55.447 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-09-13T08:25:55.447 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow r", 2023-09-13T08:25:55.448 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow rw", 2023-09-13T08:25:55.448 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rwx" 2023-09-13T08:25:55.448 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-09-13T08:25:55.448 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-09-13T08:25:55.448 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-09-13T08:25:55.448 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.2", 2023-09-13T08:25:55.449 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCPcQFlKVPiJxAAKS+vqTzaRhG5mWy7VHIJSg==", 2023-09-13T08:25:55.449 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-09-13T08:25:55.449 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-09-13T08:25:55.449 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow r", 2023-09-13T08:25:55.449 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow rw", 2023-09-13T08:25:55.450 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rwx" 2023-09-13T08:25:55.450 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-09-13T08:25:55.450 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-09-13T08:25:55.450 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-09-13T08:25:55.451 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.3", 2023-09-13T08:25:55.451 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCPcQFlvMGOLhAAbUG2OYs/pRmbOykXCcRGGQ==", 2023-09-13T08:25:55.451 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-09-13T08:25:55.451 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-09-13T08:25:55.451 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow r", 2023-09-13T08:25:55.451 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow rw", 2023-09-13T08:25:55.452 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rwx" 2023-09-13T08:25:55.452 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-09-13T08:25:55.452 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-09-13T08:25:55.452 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-09-13T08:25:55.452 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.admin", 2023-09-13T08:25:55.453 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q==", 2023-09-13T08:25:55.453 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-09-13T08:25:55.453 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow *", 2023-09-13T08:25:55.453 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-09-13T08:25:55.453 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-09-13T08:25:55.454 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-09-13T08:25:55.454 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-09-13T08:25:55.454 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-09-13T08:25:55.454 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-09-13T08:25:55.454 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.bootstrap-mds", 2023-09-13T08:25:55.455 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCwcQFlyPCSNxAAU4XXKeho9UY5xYXBWahfxw==", 2023-09-13T08:25:55.455 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-09-13T08:25:55.455 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile bootstrap-mds" 2023-09-13T08:25:55.455 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-09-13T08:25:55.455 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-09-13T08:25:55.456 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-09-13T08:25:55.456 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.bootstrap-mgr", 2023-09-13T08:25:55.456 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCwcQFl3/qSNxAAVr3qztNjW27+aKUwGXnfrw==", 2023-09-13T08:25:55.456 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-09-13T08:25:55.456 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile bootstrap-mgr" 2023-09-13T08:25:55.457 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-09-13T08:25:55.457 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-09-13T08:25:55.457 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-09-13T08:25:55.457 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.bootstrap-osd", 2023-09-13T08:25:55.457 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCwcQFlpAKTNxAAMjkbz1yvx+SBoGqc2NkVdA==", 2023-09-13T08:25:55.458 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-09-13T08:25:55.458 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile bootstrap-osd" 2023-09-13T08:25:55.458 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-09-13T08:25:55.458 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-09-13T08:25:55.458 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-09-13T08:25:55.459 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.bootstrap-rbd", 2023-09-13T08:25:55.459 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCwcQFlQAqTNxAAppNZXOa4UVW1vcpB6rfCVw==", 2023-09-13T08:25:55.459 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-09-13T08:25:55.459 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile bootstrap-rbd" 2023-09-13T08:25:55.459 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-09-13T08:25:55.460 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-09-13T08:25:55.460 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-09-13T08:25:55.460 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-09-13T08:25:55.460 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCwcQFlBhKTNxAAapiRLn0hGFEvEZ32wyvy2w==", 2023-09-13T08:25:55.460 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-09-13T08:25:55.461 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-09-13T08:25:55.461 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-09-13T08:25:55.461 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-09-13T08:25:55.461 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-09-13T08:25:55.461 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.bootstrap-rgw", 2023-09-13T08:25:55.462 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCwcQFlHxqTNxAAa9GItfMa5ZiEEm3MEPqnyg==", 2023-09-13T08:25:55.462 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-09-13T08:25:55.462 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile bootstrap-rgw" 2023-09-13T08:25:55.462 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-09-13T08:25:55.462 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-09-13T08:25:55.463 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-09-13T08:25:55.463 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mgr.x", 2023-09-13T08:25:55.463 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCPcQFlNckxCRAAzT6vm5n688QBgYwOYbFjDQ==", 2023-09-13T08:25:55.463 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-09-13T08:25:55.463 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow *", 2023-09-13T08:25:55.464 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile mgr", 2023-09-13T08:25:55.464 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-09-13T08:25:55.464 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-09-13T08:25:55.464 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-09-13T08:25:55.464 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-09-13T08:25:55.465 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mgr.y", 2023-09-13T08:25:55.465 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCPcQFlE6IpBBAA29jyBsRyFE46WTWA2h9CCA==", 2023-09-13T08:25:55.465 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-09-13T08:25:55.465 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow *", 2023-09-13T08:25:55.465 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile mgr", 2023-09-13T08:25:55.466 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-09-13T08:25:55.466 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-09-13T08:25:55.466 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-09-13T08:25:55.466 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2023-09-13T08:25:55.466 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-09-13T08:25:55.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.420+0000 7fb5b00f9700 1 -- 172.21.15.84:0/2970100198 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fb58c06a580 msgr2=0x7fb58c06ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:55.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.420+0000 7fb5b00f9700 1 --2- 172.21.15.84:0/2970100198 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fb58c06a580 0x7fb58c06ca40 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb598007fd0 tx=0x7fb598009040 comp rx=0 tx=0).stop 2023-09-13T08:25:55.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.420+0000 7fb5b00f9700 1 -- 172.21.15.84:0/2970100198 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb5a80cc900 msgr2=0x7fb5a80b4c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:55.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.420+0000 7fb5b00f9700 1 --2- 172.21.15.84:0/2970100198 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb5a80cc900 0x7fb5a80b4c80 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fb5a8072c40 tx=0x7fb5a4004750 comp rx=0 tx=0).stop 2023-09-13T08:25:55.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.420+0000 7fb5b00f9700 1 -- 172.21.15.84:0/2970100198 shutdown_connections 2023-09-13T08:25:55.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.420+0000 7fb5b00f9700 1 --2- 172.21.15.84:0/2970100198 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fb58c06a580 0x7fb58c06ca40 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:55.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.420+0000 7fb5b00f9700 1 --2- 172.21.15.84:0/2970100198 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb5a815b200 0x7fb5a80c3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:55.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.420+0000 7fb5b00f9700 1 --2- 172.21.15.84:0/2970100198 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb5a80cc900 0x7fb5a80b4c80 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:55.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.420+0000 7fb5b00f9700 1 --2- 172.21.15.84:0/2970100198 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb5a80ce920 0x7fb5a80b51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:55.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.420+0000 7fb5b00f9700 1 -- 172.21.15.84:0/2970100198 >> 172.21.15.84:0/2970100198 conn(0x7fb5a80b1b80 msgr2=0x7fb5a806a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:55.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.420+0000 7fb5b00f9700 1 -- 172.21.15.84:0/2970100198 shutdown_connections 2023-09-13T08:25:55.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.420+0000 7fb5b00f9700 1 -- 172.21.15.84:0/2970100198 wait complete. 2023-09-13T08:25:55.471 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-09-13T08:25:55.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.592+0000 7f5a8c852700 1 Processor -- start 2023-09-13T08:25:55.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.592+0000 7f5a8c852700 1 -- start start 2023-09-13T08:25:55.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.592+0000 7f5a8c852700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5a88071ac0 0x7f5a8815a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:55.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.592+0000 7f5a8c852700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5a8815eb80 0x7f5a8815ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:55.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.592+0000 7f5a8c852700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a8815b690 con 0x7f5a880cc340 2023-09-13T08:25:55.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.593+0000 7f5a8c852700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a8815b970 con 0x7f5a8815eb80 2023-09-13T08:25:55.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.593+0000 7f5a8c852700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a880cc720 con 0x7f5a88071ac0 2023-09-13T08:25:55.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.593+0000 7f5a8659c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f5a880cc340 0x7f5a880713b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:48222/0 (socket says 172.21.15.84:48222) 2023-09-13T08:25:55.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.593+0000 7f5a8659c700 1 -- 172.21.15.84:0/1416087200 learned_addr learned my addr 172.21.15.84:0/1416087200 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:25:55.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.593+0000 7f5a86d9d700 1 --2- 172.21.15.84:0/1416087200 >> v2:172.21.15.84:3300/0 conn(0x7f5a8815eb80 0x7f5a8815ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:55.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.593+0000 7f5a85d9b700 1 --2- 172.21.15.84:0/1416087200 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5a88071ac0 0x7f5a8815a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:55.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.593+0000 7f5a8559a700 1 -- 172.21.15.84:0/1416087200 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 499013034 0 0) 0x7f5a8815b690 con 0x7f5a880cc340 2023-09-13T08:25:55.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.593+0000 7f5a8559a700 1 -- 172.21.15.84:0/1416087200 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a700035b0 con 0x7f5a880cc340 2023-09-13T08:25:55.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.593+0000 7f5a86d9d700 1 -- 172.21.15.84:0/1416087200 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5a88071ac0 msgr2=0x7f5a8815a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:55.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.593+0000 7f5a86d9d700 1 --2- 172.21.15.84:0/1416087200 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5a88071ac0 0x7f5a8815a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:55.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.593+0000 7f5a86d9d700 1 -- 172.21.15.84:0/1416087200 >> v1:172.21.15.84:6789/0 conn(0x7f5a880cc340 legacy=0x7f5a880713b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:55.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.593+0000 7f5a86d9d700 1 -- 172.21.15.84:0/1416087200 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a8815e0a0 con 0x7f5a8815eb80 2023-09-13T08:25:55.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.593+0000 7f5a86d9d700 1 --2- 172.21.15.84:0/1416087200 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a8815eb80 0x7f5a8815ae00 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f5a80009d90 tx=0x7f5a8000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35de862d70fccc35 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:55.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.593+0000 7f5a8559a700 1 -- 172.21.15.84:0/1416087200 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a8000e070 con 0x7f5a8815eb80 2023-09-13T08:25:55.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.593+0000 7f5a8559a700 1 -- 172.21.15.84:0/1416087200 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a8000bb20 con 0x7f5a8815eb80 2023-09-13T08:25:55.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.593+0000 7f5a8559a700 1 -- 172.21.15.84:0/1416087200 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a80012430 con 0x7f5a8815eb80 2023-09-13T08:25:55.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.594+0000 7f5a8c852700 1 -- 172.21.15.84:0/1416087200 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a8815eb80 msgr2=0x7f5a8815ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:55.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.594+0000 7f5a8c852700 1 --2- 172.21.15.84:0/1416087200 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a8815eb80 0x7f5a8815ae00 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f5a80009d90 tx=0x7f5a8000b330 comp rx=0 tx=0).stop 2023-09-13T08:25:55.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.594+0000 7f5a8c852700 1 -- 172.21.15.84:0/1416087200 shutdown_connections 2023-09-13T08:25:55.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.594+0000 7f5a8c852700 1 --2- 172.21.15.84:0/1416087200 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a8815eb80 0x7f5a8815ae00 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:55.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.594+0000 7f5a8c852700 1 --2- 172.21.15.84:0/1416087200 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5a88071ac0 0x7f5a8815a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:55.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.594+0000 7f5a8c852700 1 -- 172.21.15.84:0/1416087200 >> 172.21.15.84:0/1416087200 conn(0x7f5a880d00c0 msgr2=0x7f5a880d04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:55.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.594+0000 7f5a8c852700 1 -- 172.21.15.84:0/1416087200 shutdown_connections 2023-09-13T08:25:55.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.594+0000 7f5a8c852700 1 -- 172.21.15.84:0/1416087200 wait complete. 2023-09-13T08:25:55.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.595+0000 7f5a8c852700 1 Processor -- start 2023-09-13T08:25:55.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.595+0000 7f5a8c852700 1 -- start start 2023-09-13T08:25:55.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.596+0000 7f5a8c852700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5a88071ac0 0x7f5a8814c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:55.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.596+0000 7f5a8c852700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a880cc340 0x7f5a880c8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:55.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.596+0000 7f5a8c852700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5a8815eb80 0x7f5a8806a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:55.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.596+0000 7f5a8c852700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a881f2b40 con 0x7f5a880cc340 2023-09-13T08:25:55.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.596+0000 7f5a8c852700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a880b2fd0 con 0x7f5a8815eb80 2023-09-13T08:25:55.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.596+0000 7f5a8c852700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a880c9f90 con 0x7f5a88071ac0 2023-09-13T08:25:55.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.596+0000 7f5a85d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a880cc340 0x7f5a880c8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:55.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.596+0000 7f5a85d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a880cc340 0x7f5a880c8cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45582/0 (socket says 172.21.15.84:45582) 2023-09-13T08:25:55.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.596+0000 7f5a85d9b700 1 -- 172.21.15.84:0/310476784 learned_addr learned my addr 172.21.15.84:0/310476784 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:55.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.596+0000 7f5a8659c700 1 --2- 172.21.15.84:0/310476784 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5a88071ac0 0x7f5a8814c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:55.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.596+0000 7f5a86d9d700 1 --2- 172.21.15.84:0/310476784 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5a8815eb80 0x7f5a8806a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:55.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.596+0000 7f5a85d9b700 1 -- 172.21.15.84:0/310476784 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5a88071ac0 msgr2=0x7f5a8814c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:55.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.596+0000 7f5a85d9b700 1 --2- 172.21.15.84:0/310476784 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5a88071ac0 0x7f5a8814c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:55.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.596+0000 7f5a85d9b700 1 -- 172.21.15.84:0/310476784 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5a8815eb80 msgr2=0x7f5a8806a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:55.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.596+0000 7f5a85d9b700 1 --2- 172.21.15.84:0/310476784 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5a8815eb80 0x7f5a8806a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:55.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.596+0000 7f5a85d9b700 1 -- 172.21.15.84:0/310476784 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a80009a70 con 0x7f5a880cc340 2023-09-13T08:25:55.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.597+0000 7f5a85d9b700 1 --2- 172.21.15.84:0/310476784 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a880cc340 0x7f5a880c8cf0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f5a7800d800 tx=0x7f5a7800dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:55.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.597+0000 7f5a76ffd700 1 -- 172.21.15.84:0/310476784 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a780125f0 con 0x7f5a880cc340 2023-09-13T08:25:55.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.597+0000 7f5a76ffd700 1 -- 172.21.15.84:0/310476784 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a78012750 con 0x7f5a880cc340 2023-09-13T08:25:55.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.597+0000 7f5a8c852700 1 -- 172.21.15.84:0/310476784 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a880c96f0 con 0x7f5a880cc340 2023-09-13T08:25:55.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.597+0000 7f5a76ffd700 1 -- 172.21.15.84:0/310476784 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a78012b00 con 0x7f5a880cc340 2023-09-13T08:25:55.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.597+0000 7f5a8c852700 1 -- 172.21.15.84:0/310476784 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a880c9cb0 con 0x7f5a880cc340 2023-09-13T08:25:55.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.598+0000 7f5a8c852700 1 -- 172.21.15.84:0/310476784 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a88154e30 con 0x7f5a880cc340 2023-09-13T08:25:55.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.598+0000 7f5a76ffd700 1 -- 172.21.15.84:0/310476784 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f5a78012c60 con 0x7f5a880cc340 2023-09-13T08:25:55.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.599+0000 7f5a76ffd700 1 --2- 172.21.15.84:0/310476784 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f5a6806a580 0x7f5a6806ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:55.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.599+0000 7f5a76ffd700 1 -- 172.21.15.84:0/310476784 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f5a78088be0 con 0x7f5a880cc340 2023-09-13T08:25:55.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.599+0000 7f5a8659c700 1 --2- 172.21.15.84:0/310476784 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f5a6806a580 0x7f5a6806ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:55.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.599+0000 7f5a8659c700 1 --2- 172.21.15.84:0/310476784 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f5a6806a580 0x7f5a6806ca40 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5a7c0011e0 tx=0x7f5a7c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:55.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.604+0000 7f5a76ffd700 1 -- 172.21.15.84:0/310476784 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f5a88154e30 con 0x7f5a880cc340 2023-09-13T08:25:55.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.871+0000 7f5a8c852700 1 -- 172.21.15.84:0/310476784 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f5a88154e30 con 0x7f5a880cc340 2023-09-13T08:25:55.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.875+0000 7f5a76ffd700 1 -- 172.21.15.84:0/310476784 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7f5a88154e30 con 0x7f5a880cc340 2023-09-13T08:25:55.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.877+0000 7f5a8c852700 1 -- 172.21.15.84:0/310476784 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f5a6806a580 msgr2=0x7f5a6806ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:55.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.877+0000 7f5a8c852700 1 --2- 172.21.15.84:0/310476784 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f5a6806a580 0x7f5a6806ca40 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5a7c0011e0 tx=0x7f5a7c009040 comp rx=0 tx=0).stop 2023-09-13T08:25:55.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.877+0000 7f5a8c852700 1 -- 172.21.15.84:0/310476784 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a880cc340 msgr2=0x7f5a880c8cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:55.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.877+0000 7f5a8c852700 1 --2- 172.21.15.84:0/310476784 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a880cc340 0x7f5a880c8cf0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f5a7800d800 tx=0x7f5a7800dbc0 comp rx=0 tx=0).stop 2023-09-13T08:25:55.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.877+0000 7f5a8c852700 1 -- 172.21.15.84:0/310476784 shutdown_connections 2023-09-13T08:25:55.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.877+0000 7f5a8c852700 1 --2- 172.21.15.84:0/310476784 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f5a6806a580 0x7f5a6806ca40 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:55.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.877+0000 7f5a8c852700 1 --2- 172.21.15.84:0/310476784 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5a8815eb80 0x7f5a8806a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:55.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.877+0000 7f5a8c852700 1 --2- 172.21.15.84:0/310476784 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5a88071ac0 0x7f5a8814c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:55.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.877+0000 7f5a8c852700 1 --2- 172.21.15.84:0/310476784 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a880cc340 0x7f5a880c8cf0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:55.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.877+0000 7f5a8c852700 1 -- 172.21.15.84:0/310476784 >> 172.21.15.84:0/310476784 conn(0x7f5a880d00c0 msgr2=0x7f5a8815d160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:55.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.877+0000 7f5a8c852700 1 -- 172.21.15.84:0/310476784 shutdown_connections 2023-09-13T08:25:55.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:55.877+0000 7f5a8c852700 1 -- 172.21.15.84:0/310476784 wait complete. 2023-09-13T08:25:55.890 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-09-13T08:25:56.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.010+0000 7f6f2cf34700 1 Processor -- start 2023-09-13T08:25:56.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.010+0000 7f6f2cf34700 1 -- start start 2023-09-13T08:25:56.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.011+0000 7f6f2cf34700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6f280cc340 0x7f6f280713b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:56.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.011+0000 7f6f2cf34700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f2815b690 con 0x7f6f280718f0 2023-09-13T08:25:56.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.011+0000 7f6f2cf34700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f2815e0a0 con 0x7f6f2815eb80 2023-09-13T08:25:56.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.011+0000 7f6f2cf34700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f2815b970 con 0x7f6f280cc340 2023-09-13T08:25:56.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.011+0000 7f6f26d9d700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f6f280718f0 0x7f6f280cdc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:48240/0 (socket says 172.21.15.84:48240) 2023-09-13T08:25:56.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.011+0000 7f6f26d9d700 1 -- 172.21.15.84:0/896157737 learned_addr learned my addr 172.21.15.84:0/896157737 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:25:56.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.011+0000 7f6f2659c700 1 --2- 172.21.15.84:0/896157737 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6f280cc340 0x7f6f280713b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:56.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.012+0000 7f6f2559a700 1 -- 172.21.15.84:0/896157737 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 169238117 0 0) 0x7f6f2815b690 con 0x7f6f280718f0 2023-09-13T08:25:56.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.012+0000 7f6f2559a700 1 -- 172.21.15.84:0/896157737 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f100035b0 con 0x7f6f280718f0 2023-09-13T08:25:56.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.012+0000 7f6f2559a700 1 -- 172.21.15.84:0/896157737 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2873797369 0 0) 0x7f6f100035b0 con 0x7f6f280718f0 2023-09-13T08:25:56.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.012+0000 7f6f2559a700 1 -- 172.21.15.84:0/896157737 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6f280cc340 msgr2=0x7f6f280713b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:56.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.012+0000 7f6f2559a700 1 --2- 172.21.15.84:0/896157737 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6f280cc340 0x7f6f280713b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:56.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.012+0000 7f6f2559a700 1 -- 172.21.15.84:0/896157737 >> v1:172.21.15.161:6789/0 conn(0x7f6f2815eb80 legacy=0x7f6f2815a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:56.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.012+0000 7f6f2559a700 1 -- 172.21.15.84:0/896157737 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f2815e380 con 0x7f6f280718f0 2023-09-13T08:25:56.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.012+0000 7f6f2559a700 1 -- 172.21.15.84:0/896157737 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2302733408 0 0) 0x7f6f200019f0 con 0x7f6f280718f0 2023-09-13T08:25:56.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.012+0000 7f6f2559a700 1 -- 172.21.15.84:0/896157737 >> v1:172.21.15.84:6789/0 conn(0x7f6f280718f0 legacy=0x7f6f280cdc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:56.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.012+0000 7f6f2559a700 1 --2- 172.21.15.84:0/896157737 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f10003a30 0x7f6f10003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:56.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.012+0000 7f6f2559a700 1 --2- 172.21.15.84:0/896157737 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6f280cc340 0x7f6f10004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:56.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.012+0000 7f6f2559a700 1 --2- 172.21.15.84:0/896157737 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f10004d90 0x7f6f10005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:56.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.012+0000 7f6f2559a700 1 -- 172.21.15.84:0/896157737 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f2815b970 con 0x7f6f10003a30 2023-09-13T08:25:56.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.012+0000 7f6f2559a700 1 -- 172.21.15.84:0/896157737 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f1000bb10 con 0x7f6f10004d90 2023-09-13T08:25:56.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.012+0000 7f6f2559a700 1 -- 172.21.15.84:0/896157737 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f1000bcd0 con 0x7f6f280cc340 2023-09-13T08:25:56.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.012+0000 7f6f2659c700 1 --2- 172.21.15.84:0/896157737 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f10003a30 0x7f6f10003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:56.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.012+0000 7f6f25d9b700 1 --2- 172.21.15.84:0/896157737 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6f280cc340 0x7f6f10004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:56.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.012+0000 7f6f26d9d700 1 --2- 172.21.15.84:0/896157737 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f10004d90 0x7f6f10005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:56.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.012+0000 7f6f2659c700 1 -- 172.21.15.84:0/896157737 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6f280cc340 msgr2=0x7f6f10004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:56.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.012+0000 7f6f2659c700 1 --2- 172.21.15.84:0/896157737 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6f280cc340 0x7f6f10004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:56.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.012+0000 7f6f2659c700 1 -- 172.21.15.84:0/896157737 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f10004d90 msgr2=0x7f6f10005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:56.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.012+0000 7f6f2659c700 1 --2- 172.21.15.84:0/896157737 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f10004d90 0x7f6f10005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:56.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.012+0000 7f6f2659c700 1 -- 172.21.15.84:0/896157737 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f100035b0 con 0x7f6f10003a30 2023-09-13T08:25:56.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.013+0000 7f6f2659c700 1 --2- 172.21.15.84:0/896157737 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f10003a30 0x7f6f10003e30 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f6f18009b60 tx=0x7f6f10005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b7f7fb43134a589 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:56.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.013+0000 7f6f2559a700 1 -- 172.21.15.84:0/896157737 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f1800e6c0 con 0x7f6f10003a30 2023-09-13T08:25:56.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.013+0000 7f6f2559a700 1 -- 172.21.15.84:0/896157737 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f1800e820 con 0x7f6f10003a30 2023-09-13T08:25:56.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.013+0000 7f6f2559a700 1 -- 172.21.15.84:0/896157737 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f1800eb90 con 0x7f6f10003a30 2023-09-13T08:25:56.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.013+0000 7f6f2cf34700 1 -- 172.21.15.84:0/896157737 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f10003a30 msgr2=0x7f6f10003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:56.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.013+0000 7f6f2cf34700 1 --2- 172.21.15.84:0/896157737 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f10003a30 0x7f6f10003e30 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f6f18009b60 tx=0x7f6f10005880 comp rx=0 tx=0).stop 2023-09-13T08:25:56.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.013+0000 7f6f26d9d700 1 -- 172.21.15.84:0/896157737 reap_dead start 2023-09-13T08:25:56.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.014+0000 7f6f2cf34700 1 -- 172.21.15.84:0/896157737 shutdown_connections 2023-09-13T08:25:56.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.014+0000 7f6f2cf34700 1 -- 172.21.15.84:0/896157737 >> 172.21.15.84:0/896157737 conn(0x7f6f280d00c0 msgr2=0x7f6f280d04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:56.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.014+0000 7f6f2cf34700 1 -- 172.21.15.84:0/896157737 shutdown_connections 2023-09-13T08:25:56.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.014+0000 7f6f2cf34700 1 -- 172.21.15.84:0/896157737 wait complete. 2023-09-13T08:25:56.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.015+0000 7f6f2cf34700 1 Processor -- start 2023-09-13T08:25:56.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.016+0000 7f6f2cf34700 1 -- start start 2023-09-13T08:25:56.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.016+0000 7f6f2cf34700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6f10003a30 0x7f6f28151800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:56.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.016+0000 7f6f2cf34700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f280b2f00 0x7f6f281efc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:56.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.016+0000 7f6f2cf34700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f2815c450 0x7f6f280b35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:56.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.016+0000 7f6f2cf34700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f2815cd80 con 0x7f6f2815c450 2023-09-13T08:25:56.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.016+0000 7f6f2cf34700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f2815d060 con 0x7f6f280b2f00 2023-09-13T08:25:56.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.016+0000 7f6f2cf34700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f280c5130 con 0x7f6f10003a30 2023-09-13T08:25:56.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.017+0000 7f6f26d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f2815c450 0x7f6f280b35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:56.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.017+0000 7f6f26d9d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f2815c450 0x7f6f280b35f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45608/0 (socket says 172.21.15.84:45608) 2023-09-13T08:25:56.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.017+0000 7f6f26d9d700 1 -- 172.21.15.84:0/3782785640 learned_addr learned my addr 172.21.15.84:0/3782785640 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:56.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.017+0000 7f6f2659c700 1 --2- 172.21.15.84:0/3782785640 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6f10003a30 0x7f6f28151800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:56.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.017+0000 7f6f25d9b700 1 --2- 172.21.15.84:0/3782785640 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f280b2f00 0x7f6f281efc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:56.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.017+0000 7f6f26d9d700 1 -- 172.21.15.84:0/3782785640 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6f10003a30 msgr2=0x7f6f28151800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:56.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.017+0000 7f6f26d9d700 1 --2- 172.21.15.84:0/3782785640 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6f10003a30 0x7f6f28151800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:56.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.017+0000 7f6f26d9d700 1 -- 172.21.15.84:0/3782785640 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f280b2f00 msgr2=0x7f6f281efc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:56.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.017+0000 7f6f26d9d700 1 --2- 172.21.15.84:0/3782785640 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f280b2f00 0x7f6f281efc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:56.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.017+0000 7f6f26d9d700 1 -- 172.21.15.84:0/3782785640 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f280c5410 con 0x7f6f2815c450 2023-09-13T08:25:56.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.017+0000 7f6f26d9d700 1 --2- 172.21.15.84:0/3782785640 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f2815c450 0x7f6f280b35f0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f6f20001330 tx=0x7f6f2000e440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:56.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.017+0000 7f6f16ffd700 1 -- 172.21.15.84:0/3782785640 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f2000ec40 con 0x7f6f2815c450 2023-09-13T08:25:56.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.017+0000 7f6f16ffd700 1 -- 172.21.15.84:0/3782785640 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f2000edc0 con 0x7f6f2815c450 2023-09-13T08:25:56.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.017+0000 7f6f2cf34700 1 -- 172.21.15.84:0/3782785640 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f280c56f0 con 0x7f6f2815c450 2023-09-13T08:25:56.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.017+0000 7f6f16ffd700 1 -- 172.21.15.84:0/3782785640 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f20013660 con 0x7f6f2815c450 2023-09-13T08:25:56.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.017+0000 7f6f2cf34700 1 -- 172.21.15.84:0/3782785640 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f2815cac0 con 0x7f6f2815c450 2023-09-13T08:25:56.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.018+0000 7f6f2cf34700 1 -- 172.21.15.84:0/3782785640 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f280c58e0 con 0x7f6f2815c450 2023-09-13T08:25:56.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.019+0000 7f6f16ffd700 1 -- 172.21.15.84:0/3782785640 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f6f200137c0 con 0x7f6f2815c450 2023-09-13T08:25:56.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.019+0000 7f6f16ffd700 1 --2- 172.21.15.84:0/3782785640 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f6f0806a580 0x7f6f0806ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:56.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.019+0000 7f6f2659c700 1 --2- 172.21.15.84:0/3782785640 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f6f0806a580 0x7f6f0806ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:56.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.019+0000 7f6f16ffd700 1 -- 172.21.15.84:0/3782785640 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f6f20088ca0 con 0x7f6f2815c450 2023-09-13T08:25:56.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.019+0000 7f6f2659c700 1 --2- 172.21.15.84:0/3782785640 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f6f0806a580 0x7f6f0806ca40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6f180090b0 tx=0x7f6f1801f040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:56.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.024+0000 7f6f16ffd700 1 -- 172.21.15.84:0/3782785640 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f6f200544c0 con 0x7f6f2815c450 2023-09-13T08:25:56.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.293+0000 7f6f2cf34700 1 -- 172.21.15.84:0/3782785640 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f6f2804e9b0 con 0x7f6f2815c450 2023-09-13T08:25:56.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.296+0000 7f6f16ffd700 1 -- 172.21.15.84:0/3782785640 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7f6f20057ae0 con 0x7f6f2815c450 2023-09-13T08:25:56.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.298+0000 7f6f2cf34700 1 -- 172.21.15.84:0/3782785640 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f6f0806a580 msgr2=0x7f6f0806ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:56.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.298+0000 7f6f2cf34700 1 --2- 172.21.15.84:0/3782785640 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f6f0806a580 0x7f6f0806ca40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6f180090b0 tx=0x7f6f1801f040 comp rx=0 tx=0).stop 2023-09-13T08:25:56.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.298+0000 7f6f2cf34700 1 -- 172.21.15.84:0/3782785640 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f2815c450 msgr2=0x7f6f280b35f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:56.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.298+0000 7f6f2cf34700 1 --2- 172.21.15.84:0/3782785640 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f2815c450 0x7f6f280b35f0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f6f20001330 tx=0x7f6f2000e440 comp rx=0 tx=0).stop 2023-09-13T08:25:56.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.298+0000 7f6f2cf34700 1 -- 172.21.15.84:0/3782785640 shutdown_connections 2023-09-13T08:25:56.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.298+0000 7f6f2cf34700 1 --2- 172.21.15.84:0/3782785640 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f2815c450 0x7f6f280b35f0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:56.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.298+0000 7f6f2cf34700 1 --2- 172.21.15.84:0/3782785640 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6f10003a30 0x7f6f28151800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:56.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.298+0000 7f6f2cf34700 1 --2- 172.21.15.84:0/3782785640 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f6f0806a580 0x7f6f0806ca40 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:56.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.298+0000 7f6f2cf34700 1 --2- 172.21.15.84:0/3782785640 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f280b2f00 0x7f6f281efc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:56.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.298+0000 7f6f2cf34700 1 -- 172.21.15.84:0/3782785640 >> 172.21.15.84:0/3782785640 conn(0x7f6f280d00c0 msgr2=0x7f6f280ceeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:56.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.298+0000 7f6f2cf34700 1 -- 172.21.15.84:0/3782785640 shutdown_connections 2023-09-13T08:25:56.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.298+0000 7f6f2cf34700 1 -- 172.21.15.84:0/3782785640 wait complete. 2023-09-13T08:25:56.311 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-09-13T08:25:56.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.432+0000 7ff2ad005700 1 Processor -- start 2023-09-13T08:25:56.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.432+0000 7ff2ad005700 1 -- start start 2023-09-13T08:25:56.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.432+0000 7ff2ad005700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff2a806df80 0x7ff2a806a620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:56.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.432+0000 7ff2ad005700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff2a806ab60 0x7ff2a815baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:56.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.432+0000 7ff2ad005700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff2a815bfe0 0x7ff2a81584b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:56.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.432+0000 7ff2ad005700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2a815f9a0 con 0x7ff2a806df80 2023-09-13T08:25:56.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.432+0000 7ff2ad005700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2a815fdc0 con 0x7ff2a806ab60 2023-09-13T08:25:56.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.432+0000 7ff2ad005700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a806afc0 con 0x7ff2a815bfe0 2023-09-13T08:25:56.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.432+0000 7ff2a6d9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff2a806df80 0x7ff2a806a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:56.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.432+0000 7ff2a6d9d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff2a806df80 0x7ff2a806a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45612/0 (socket says 172.21.15.84:45612) 2023-09-13T08:25:56.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.432+0000 7ff2a6d9d700 1 -- 172.21.15.84:0/2870588182 learned_addr learned my addr 172.21.15.84:0/2870588182 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:56.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.433+0000 7ff2a6d9d700 1 -- 172.21.15.84:0/2870588182 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff2a815bfe0 msgr2=0x7ff2a81584b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:56.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.433+0000 7ff2a6d9d700 1 --2- 172.21.15.84:0/2870588182 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff2a815bfe0 0x7ff2a81584b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:56.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.433+0000 7ff2a6d9d700 1 -- 172.21.15.84:0/2870588182 >> v2:172.21.15.161:3300/0 conn(0x7ff2a806ab60 msgr2=0x7ff2a815baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:56.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.433+0000 7ff2a6d9d700 1 --2- 172.21.15.84:0/2870588182 >> v2:172.21.15.161:3300/0 conn(0x7ff2a806ab60 0x7ff2a815baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:56.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.433+0000 7ff2a6d9d700 1 -- 172.21.15.84:0/2870588182 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2a815c810 con 0x7ff2a806df80 2023-09-13T08:25:56.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.433+0000 7ff2a6d9d700 1 --2- 172.21.15.84:0/2870588182 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2a806df80 0x7ff2a806a620 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7ff2a80cfef0 tx=0x7ff29c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95a8bdfd9c0208d5 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:56.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.433+0000 7ff2a5d9b700 1 -- 172.21.15.84:0/2870588182 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff29c00b860 con 0x7ff2a806df80 2023-09-13T08:25:56.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.433+0000 7ff2a5d9b700 1 -- 172.21.15.84:0/2870588182 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff29c00b9c0 con 0x7ff2a806df80 2023-09-13T08:25:56.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.433+0000 7ff2a5d9b700 1 -- 172.21.15.84:0/2870588182 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff29c00bd50 con 0x7ff2a806df80 2023-09-13T08:25:56.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.433+0000 7ff2ad005700 1 -- 172.21.15.84:0/2870588182 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2a806df80 msgr2=0x7ff2a806a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:56.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.433+0000 7ff2ad005700 1 --2- 172.21.15.84:0/2870588182 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2a806df80 0x7ff2a806a620 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7ff2a80cfef0 tx=0x7ff29c009c00 comp rx=0 tx=0).stop 2023-09-13T08:25:56.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.433+0000 7ff2ad005700 1 -- 172.21.15.84:0/2870588182 shutdown_connections 2023-09-13T08:25:56.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.433+0000 7ff2ad005700 1 --2- 172.21.15.84:0/2870588182 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff2a815bfe0 0x7ff2a81584b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:56.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.433+0000 7ff2ad005700 1 --2- 172.21.15.84:0/2870588182 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2a806df80 0x7ff2a806a620 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:56.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.433+0000 7ff2ad005700 1 --2- 172.21.15.84:0/2870588182 >> v2:172.21.15.161:3300/0 conn(0x7ff2a806ab60 0x7ff2a815baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:56.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.433+0000 7ff2ad005700 1 -- 172.21.15.84:0/2870588182 >> 172.21.15.84:0/2870588182 conn(0x7ff2a80d00c0 msgr2=0x7ff2a80d04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:56.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.434+0000 7ff2ad005700 1 -- 172.21.15.84:0/2870588182 shutdown_connections 2023-09-13T08:25:56.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.434+0000 7ff2ad005700 1 -- 172.21.15.84:0/2870588182 wait complete. 2023-09-13T08:25:56.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.435+0000 7ff2ad005700 1 Processor -- start 2023-09-13T08:25:56.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.435+0000 7ff2ad005700 1 -- start start 2023-09-13T08:25:56.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.437+0000 7ff2ad005700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff2a806ab60 0x7ff2a81f08b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:56.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.437+0000 7ff2ad005700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff2a806df80 0x7ff2a81f48b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:56.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.437+0000 7ff2ad005700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2a815bfe0 0x7ff2a80c2d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:56.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.437+0000 7ff2ad005700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a80b37e0 con 0x7ff2a815bfe0 2023-09-13T08:25:56.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.437+0000 7ff2ad005700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a81f4df0 con 0x7ff2a806ab60 2023-09-13T08:25:56.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.437+0000 7ff2ad005700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a81f0f00 con 0x7ff2a806df80 2023-09-13T08:25:56.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.437+0000 7ff2a759e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2a815bfe0 0x7ff2a80c2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:56.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.437+0000 7ff2a6d9d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff2a806ab60 0x7ff2a81f08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:56.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.437+0000 7ff2a659c700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff2a806df80 0x7ff2a81f48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:56.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.437+0000 7ff2a759e700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2a815bfe0 0x7ff2a80c2d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45622/0 (socket says 172.21.15.84:45622) 2023-09-13T08:25:56.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.437+0000 7ff2a759e700 1 -- 172.21.15.84:0/1322276017 learned_addr learned my addr 172.21.15.84:0/1322276017 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:56.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.437+0000 7ff2a759e700 1 -- 172.21.15.84:0/1322276017 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff2a806df80 msgr2=0x7ff2a81f48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:56.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.437+0000 7ff2a759e700 1 --2- 172.21.15.84:0/1322276017 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff2a806df80 0x7ff2a81f48b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:56.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.437+0000 7ff2a759e700 1 -- 172.21.15.84:0/1322276017 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff2a806ab60 msgr2=0x7ff2a81f08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:56.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.437+0000 7ff2a759e700 1 --2- 172.21.15.84:0/1322276017 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff2a806ab60 0x7ff2a81f08b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:56.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.437+0000 7ff2a759e700 1 -- 172.21.15.84:0/1322276017 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff29c009550 con 0x7ff2a815bfe0 2023-09-13T08:25:56.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.437+0000 7ff2a759e700 1 --2- 172.21.15.84:0/1322276017 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2a815bfe0 0x7ff2a80c2d60 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7ff2a000b9e0 tx=0x7ff2a000bcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:56.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.437+0000 7ff28f7fe700 1 -- 172.21.15.84:0/1322276017 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2a000d820 con 0x7ff2a815bfe0 2023-09-13T08:25:56.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.437+0000 7ff28f7fe700 1 -- 172.21.15.84:0/1322276017 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2a000d9a0 con 0x7ff2a815bfe0 2023-09-13T08:25:56.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.437+0000 7ff2ad005700 1 -- 172.21.15.84:0/1322276017 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2a81f11e0 con 0x7ff2a815bfe0 2023-09-13T08:25:56.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.437+0000 7ff28f7fe700 1 -- 172.21.15.84:0/1322276017 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2a000dd50 con 0x7ff2a815bfe0 2023-09-13T08:25:56.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.437+0000 7ff2ad005700 1 -- 172.21.15.84:0/1322276017 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2a81f17a0 con 0x7ff2a815bfe0 2023-09-13T08:25:56.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.438+0000 7ff2ad005700 1 -- 172.21.15.84:0/1322276017 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2a804e9b0 con 0x7ff2a815bfe0 2023-09-13T08:25:56.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.438+0000 7ff28f7fe700 1 -- 172.21.15.84:0/1322276017 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7ff2a0015420 con 0x7ff2a815bfe0 2023-09-13T08:25:56.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.438+0000 7ff28f7fe700 1 --2- 172.21.15.84:0/1322276017 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7ff29406a580 0x7ff29406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:56.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.438+0000 7ff28f7fe700 1 -- 172.21.15.84:0/1322276017 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7ff2a0011070 con 0x7ff2a815bfe0 2023-09-13T08:25:56.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.438+0000 7ff2a6d9d700 1 --2- 172.21.15.84:0/1322276017 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7ff29406a580 0x7ff29406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:56.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.439+0000 7ff2a6d9d700 1 --2- 172.21.15.84:0/1322276017 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7ff29406a580 0x7ff29406ca40 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff29c000c00 tx=0x7ff29c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:56.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.443+0000 7ff28f7fe700 1 -- 172.21.15.84:0/1322276017 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7ff2a004e9b0 con 0x7ff2a815bfe0 2023-09-13T08:25:56.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.705+0000 7ff2ad005700 1 -- 172.21.15.84:0/1322276017 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7ff2a80726b0 con 0x7ff2a815bfe0 2023-09-13T08:25:56.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.708+0000 7ff28f7fe700 1 -- 172.21.15.84:0/1322276017 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7ff2a0053de0 con 0x7ff2a815bfe0 2023-09-13T08:25:56.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.710+0000 7ff2ad005700 1 -- 172.21.15.84:0/1322276017 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7ff29406a580 msgr2=0x7ff29406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:56.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.710+0000 7ff2ad005700 1 --2- 172.21.15.84:0/1322276017 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7ff29406a580 0x7ff29406ca40 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff29c000c00 tx=0x7ff29c008030 comp rx=0 tx=0).stop 2023-09-13T08:25:56.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.710+0000 7ff2ad005700 1 -- 172.21.15.84:0/1322276017 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2a815bfe0 msgr2=0x7ff2a80c2d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:56.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.710+0000 7ff2ad005700 1 --2- 172.21.15.84:0/1322276017 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2a815bfe0 0x7ff2a80c2d60 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7ff2a000b9e0 tx=0x7ff2a000bcf0 comp rx=0 tx=0).stop 2023-09-13T08:25:56.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.710+0000 7ff2ad005700 1 -- 172.21.15.84:0/1322276017 shutdown_connections 2023-09-13T08:25:56.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.710+0000 7ff2ad005700 1 --2- 172.21.15.84:0/1322276017 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2a815bfe0 0x7ff2a80c2d60 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:56.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.710+0000 7ff2ad005700 1 --2- 172.21.15.84:0/1322276017 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7ff29406a580 0x7ff29406ca40 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:56.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.710+0000 7ff2ad005700 1 --2- 172.21.15.84:0/1322276017 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff2a806ab60 0x7ff2a81f08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:56.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.710+0000 7ff2ad005700 1 --2- 172.21.15.84:0/1322276017 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff2a806df80 0x7ff2a81f48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:56.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.710+0000 7ff2ad005700 1 -- 172.21.15.84:0/1322276017 >> 172.21.15.84:0/1322276017 conn(0x7ff2a80d00c0 msgr2=0x7ff2a8144a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:56.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.710+0000 7ff2ad005700 1 -- 172.21.15.84:0/1322276017 shutdown_connections 2023-09-13T08:25:56.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.710+0000 7ff2ad005700 1 -- 172.21.15.84:0/1322276017 wait complete. 2023-09-13T08:25:56.724 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-09-13T08:25:56.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.844+0000 7f9bae3ee700 1 Processor -- start 2023-09-13T08:25:56.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.844+0000 7f9bae3ee700 1 -- start start 2023-09-13T08:25:56.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.845+0000 7f9bae3ee700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9ba80cc340 0x7f9ba80713b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:56.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.845+0000 7f9bae3ee700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ba815b690 con 0x7f9ba815eb80 2023-09-13T08:25:56.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.845+0000 7f9bae3ee700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ba815e0a0 con 0x7f9ba80718f0 2023-09-13T08:25:56.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.845+0000 7f9bae3ee700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ba815b970 con 0x7f9ba80cc340 2023-09-13T08:25:56.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.845+0000 7f9ba77fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f9ba815eb80 0x7f9ba815a8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:48274/0 (socket says 172.21.15.84:48274) 2023-09-13T08:25:56.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.845+0000 7f9ba77fe700 1 -- 172.21.15.84:0/1660169736 learned_addr learned my addr 172.21.15.84:0/1660169736 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:25:56.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.845+0000 7f9ba6ffd700 1 -- 172.21.15.84:0/1660169736 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1126396055 0 0) 0x7f9ba815b690 con 0x7f9ba815eb80 2023-09-13T08:25:56.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.845+0000 7f9ba6ffd700 1 -- 172.21.15.84:0/1660169736 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b900035b0 con 0x7f9ba815eb80 2023-09-13T08:25:56.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.845+0000 7f9ba7fff700 1 --2- 172.21.15.84:0/1660169736 >> v2:172.21.15.161:3300/0 conn(0x7f9ba80cc340 0x7f9ba80713b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:56.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.845+0000 7f9ba6ffd700 1 -- 172.21.15.84:0/1660169736 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2136519754 0 0) 0x7f9b900035b0 con 0x7f9ba815eb80 2023-09-13T08:25:56.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.845+0000 7f9ba6ffd700 1 -- 172.21.15.84:0/1660169736 >> v2:172.21.15.161:3300/0 conn(0x7f9ba80cc340 msgr2=0x7f9ba80713b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:56.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.845+0000 7f9ba6ffd700 1 --2- 172.21.15.84:0/1660169736 >> v2:172.21.15.161:3300/0 conn(0x7f9ba80cc340 0x7f9ba80713b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:56.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.845+0000 7f9ba6ffd700 1 -- 172.21.15.84:0/1660169736 >> v1:172.21.15.161:6789/0 conn(0x7f9ba80718f0 legacy=0x7f9ba80cdc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:56.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.845+0000 7f9ba6ffd700 1 -- 172.21.15.84:0/1660169736 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ba815e380 con 0x7f9ba815eb80 2023-09-13T08:25:56.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.845+0000 7f9ba6ffd700 1 -- 172.21.15.84:0/1660169736 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2302733408 0 0) 0x7f9b98001670 con 0x7f9ba815eb80 2023-09-13T08:25:56.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.845+0000 7f9ba6ffd700 1 -- 172.21.15.84:0/1660169736 >> v1:172.21.15.84:6789/0 conn(0x7f9ba815eb80 legacy=0x7f9ba815a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:56.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.845+0000 7f9ba6ffd700 1 --2- 172.21.15.84:0/1660169736 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9b90003a00 0x7f9b90003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:56.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.845+0000 7f9ba6ffd700 1 --2- 172.21.15.84:0/1660169736 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b90004850 0x7f9b90004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:56.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.845+0000 7f9ba6ffd700 1 --2- 172.21.15.84:0/1660169736 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b90005210 0x7f9b9000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:56.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.845+0000 7f9ba6ffd700 1 -- 172.21.15.84:0/1660169736 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba815b970 con 0x7f9b90004850 2023-09-13T08:25:56.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.845+0000 7f9ba6ffd700 1 -- 172.21.15.84:0/1660169736 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b9000c1b0 con 0x7f9b90005210 2023-09-13T08:25:56.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.845+0000 7f9ba6ffd700 1 -- 172.21.15.84:0/1660169736 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b9000c370 con 0x7f9b90003a00 2023-09-13T08:25:56.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.845+0000 7f9ba77fe700 1 --2- 172.21.15.84:0/1660169736 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b90004850 0x7f9b90004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:56.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.845+0000 7f9ba7fff700 1 --2- 172.21.15.84:0/1660169736 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9b90003a00 0x7f9b90003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:56.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.845+0000 7f9bac98b700 1 --2- 172.21.15.84:0/1660169736 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b90005210 0x7f9b9000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:56.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.845+0000 7f9ba77fe700 1 -- 172.21.15.84:0/1660169736 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9b90003a00 msgr2=0x7f9b90003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:56.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.845+0000 7f9ba77fe700 1 --2- 172.21.15.84:0/1660169736 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9b90003a00 0x7f9b90003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:56.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.845+0000 7f9ba77fe700 1 -- 172.21.15.84:0/1660169736 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b90005210 msgr2=0x7f9b9000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:56.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.845+0000 7f9ba77fe700 1 --2- 172.21.15.84:0/1660169736 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b90005210 0x7f9b9000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:56.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.845+0000 7f9bac98b700 1 -- 172.21.15.84:0/1660169736 reap_dead start 2023-09-13T08:25:56.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.845+0000 7f9ba77fe700 1 -- 172.21.15.84:0/1660169736 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b900035b0 con 0x7f9b90004850 2023-09-13T08:25:56.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.845+0000 7f9ba77fe700 1 --2- 172.21.15.84:0/1660169736 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b90004850 0x7f9b90004cd0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f9b9800c240 tx=0x7f9b90005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9428c5bdb1315f0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:56.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.845+0000 7f9ba6ffd700 1 -- 172.21.15.84:0/1660169736 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b98007c10 con 0x7f9b90004850 2023-09-13T08:25:56.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.845+0000 7f9ba6ffd700 1 -- 172.21.15.84:0/1660169736 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b9800ce00 con 0x7f9b90004850 2023-09-13T08:25:56.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.845+0000 7f9ba6ffd700 1 -- 172.21.15.84:0/1660169736 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b98005ba0 con 0x7f9b90004850 2023-09-13T08:25:56.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.846+0000 7f9bae3ee700 1 -- 172.21.15.84:0/1660169736 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b90004850 msgr2=0x7f9b90004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:56.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.846+0000 7f9bae3ee700 1 --2- 172.21.15.84:0/1660169736 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b90004850 0x7f9b90004cd0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f9b9800c240 tx=0x7f9b90005880 comp rx=0 tx=0).stop 2023-09-13T08:25:56.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.846+0000 7f9bae3ee700 1 -- 172.21.15.84:0/1660169736 shutdown_connections 2023-09-13T08:25:56.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.846+0000 7f9bae3ee700 1 --2- 172.21.15.84:0/1660169736 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b90004850 0x7f9b90004cd0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:56.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.846+0000 7f9bae3ee700 1 -- 172.21.15.84:0/1660169736 >> 172.21.15.84:0/1660169736 conn(0x7f9ba80d00c0 msgr2=0x7f9ba80d04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:56.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.846+0000 7f9bae3ee700 1 -- 172.21.15.84:0/1660169736 shutdown_connections 2023-09-13T08:25:56.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.846+0000 7f9bae3ee700 1 -- 172.21.15.84:0/1660169736 wait complete. 2023-09-13T08:25:56.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.847+0000 7f9bae3ee700 1 Processor -- start 2023-09-13T08:25:56.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.847+0000 7f9bae3ee700 1 -- start start 2023-09-13T08:25:56.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.848+0000 7f9bae3ee700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b90004850 0x7f9ba8152550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:56.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.848+0000 7f9bae3ee700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ba814c380 0x7f9ba81509c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:56.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.848+0000 7f9bae3ee700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9ba81593e0 0x7f9ba8159860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:56.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.848+0000 7f9bae3ee700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba814c800 con 0x7f9ba814c380 2023-09-13T08:25:56.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.848+0000 7f9bae3ee700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba8159da0 con 0x7f9b90004850 2023-09-13T08:25:56.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.848+0000 7f9bae3ee700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba81511d0 con 0x7f9ba81593e0 2023-09-13T08:25:56.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.848+0000 7f9ba77fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ba814c380 0x7f9ba81509c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:56.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.848+0000 7f9ba77fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ba814c380 0x7f9ba81509c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45640/0 (socket says 172.21.15.84:45640) 2023-09-13T08:25:56.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.848+0000 7f9ba77fe700 1 -- 172.21.15.84:0/4202764467 learned_addr learned my addr 172.21.15.84:0/4202764467 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:56.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.848+0000 7f9bac98b700 1 --2- 172.21.15.84:0/4202764467 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9ba81593e0 0x7f9ba8159860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:56.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.848+0000 7f9ba7fff700 1 --2- 172.21.15.84:0/4202764467 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b90004850 0x7f9ba8152550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:56.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.848+0000 7f9ba77fe700 1 -- 172.21.15.84:0/4202764467 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9ba81593e0 msgr2=0x7f9ba8159860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:56.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.848+0000 7f9ba77fe700 1 --2- 172.21.15.84:0/4202764467 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9ba81593e0 0x7f9ba8159860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:56.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.848+0000 7f9ba77fe700 1 -- 172.21.15.84:0/4202764467 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b90004850 msgr2=0x7f9ba8152550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:56.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.848+0000 7f9ba77fe700 1 --2- 172.21.15.84:0/4202764467 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b90004850 0x7f9ba8152550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:56.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.848+0000 7f9ba77fe700 1 -- 172.21.15.84:0/4202764467 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ba81514b0 con 0x7f9ba814c380 2023-09-13T08:25:56.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.848+0000 7f9ba77fe700 1 --2- 172.21.15.84:0/4202764467 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ba814c380 0x7f9ba81509c0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f9b9000c180 tx=0x7f9b98001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:56.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.848+0000 7f9ba4ff9700 1 -- 172.21.15.84:0/4202764467 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b98001670 con 0x7f9ba814c380 2023-09-13T08:25:56.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.848+0000 7f9ba4ff9700 1 -- 172.21.15.84:0/4202764467 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b980070d0 con 0x7f9ba814c380 2023-09-13T08:25:56.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.849+0000 7f9ba4ff9700 1 -- 172.21.15.84:0/4202764467 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b98007460 con 0x7f9ba814c380 2023-09-13T08:25:56.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.849+0000 7f9bae3ee700 1 -- 172.21.15.84:0/4202764467 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ba8151790 con 0x7f9ba814c380 2023-09-13T08:25:56.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.849+0000 7f9bae3ee700 1 -- 172.21.15.84:0/4202764467 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ba8151d50 con 0x7f9ba814c380 2023-09-13T08:25:56.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.849+0000 7f9bae3ee700 1 -- 172.21.15.84:0/4202764467 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ba81523a0 con 0x7f9ba814c380 2023-09-13T08:25:56.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.850+0000 7f9ba4ff9700 1 -- 172.21.15.84:0/4202764467 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f9b980075c0 con 0x7f9ba814c380 2023-09-13T08:25:56.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.850+0000 7f9ba4ff9700 1 --2- 172.21.15.84:0/4202764467 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f9b9406a580 0x7f9b9406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:56.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.850+0000 7f9ba4ff9700 1 -- 172.21.15.84:0/4202764467 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f9b980896b0 con 0x7f9ba814c380 2023-09-13T08:25:56.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.850+0000 7f9ba7fff700 1 --2- 172.21.15.84:0/4202764467 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f9b9406a580 0x7f9b9406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:56.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.851+0000 7f9ba7fff700 1 --2- 172.21.15.84:0/4202764467 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f9b9406a580 0x7f9b9406ca40 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c009ce0 tx=0x7f9b9c009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:56.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:56.856+0000 7f9ba4ff9700 1 -- 172.21.15.84:0/4202764467 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f9b98054ed0 con 0x7f9ba814c380 2023-09-13T08:25:57.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.122+0000 7f9bae3ee700 1 -- 172.21.15.84:0/4202764467 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f9ba804e9b0 con 0x7f9ba814c380 2023-09-13T08:25:57.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.125+0000 7f9ba4ff9700 1 -- 172.21.15.84:0/4202764467 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f9b980584f0 con 0x7f9ba814c380 2023-09-13T08:25:57.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.127+0000 7f9bae3ee700 1 -- 172.21.15.84:0/4202764467 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f9b9406a580 msgr2=0x7f9b9406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:57.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.127+0000 7f9bae3ee700 1 --2- 172.21.15.84:0/4202764467 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f9b9406a580 0x7f9b9406ca40 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c009ce0 tx=0x7f9b9c009210 comp rx=0 tx=0).stop 2023-09-13T08:25:57.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.127+0000 7f9bae3ee700 1 -- 172.21.15.84:0/4202764467 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ba814c380 msgr2=0x7f9ba81509c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:57.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.127+0000 7f9bae3ee700 1 --2- 172.21.15.84:0/4202764467 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ba814c380 0x7f9ba81509c0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f9b9000c180 tx=0x7f9b98001a00 comp rx=0 tx=0).stop 2023-09-13T08:25:57.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.127+0000 7f9bae3ee700 1 -- 172.21.15.84:0/4202764467 shutdown_connections 2023-09-13T08:25:57.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.127+0000 7f9bae3ee700 1 --2- 172.21.15.84:0/4202764467 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9ba81593e0 0x7f9ba8159860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:57.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.127+0000 7f9bae3ee700 1 --2- 172.21.15.84:0/4202764467 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f9b9406a580 0x7f9b9406ca40 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:57.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.127+0000 7f9bae3ee700 1 --2- 172.21.15.84:0/4202764467 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b90004850 0x7f9ba8152550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:57.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.127+0000 7f9bae3ee700 1 --2- 172.21.15.84:0/4202764467 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ba814c380 0x7f9ba81509c0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:57.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.127+0000 7f9bae3ee700 1 -- 172.21.15.84:0/4202764467 >> 172.21.15.84:0/4202764467 conn(0x7f9ba80d00c0 msgr2=0x7f9ba80cf3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:57.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.127+0000 7f9bae3ee700 1 -- 172.21.15.84:0/4202764467 shutdown_connections 2023-09-13T08:25:57.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.127+0000 7f9bae3ee700 1 -- 172.21.15.84:0/4202764467 wait complete. 2023-09-13T08:25:57.139 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-09-13T08:25:57.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.260+0000 7fa41abf8700 1 Processor -- start 2023-09-13T08:25:57.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.260+0000 7fa41abf8700 1 -- start start 2023-09-13T08:25:57.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.261+0000 7fa41abf8700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa4140ca920 0x7fa41406d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:57.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.261+0000 7fa41abf8700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4140cae50 con 0x7fa41406a620 2023-09-13T08:25:57.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.261+0000 7fa41abf8700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4140cb130 con 0x7fa41415d530 2023-09-13T08:25:57.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.261+0000 7fa41abf8700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4140cff20 con 0x7fa4140ca920 2023-09-13T08:25:57.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.261+0000 7fa413fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa4140ca920 0x7fa41406d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:57.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.261+0000 7fa419195700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fa41406a620 0x7fa4140ce490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:48296/0 (socket says 172.21.15.84:48296) 2023-09-13T08:25:57.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.261+0000 7fa419195700 1 -- 172.21.15.84:0/1570779632 learned_addr learned my addr 172.21.15.84:0/1570779632 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:25:57.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.262+0000 7fa413fff700 1 -- 172.21.15.84:0/1570779632 >> v1:172.21.15.161:6789/0 conn(0x7fa41415d530 legacy=0x7fa414161bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:57.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.262+0000 7fa413fff700 1 -- 172.21.15.84:0/1570779632 >> v1:172.21.15.84:6789/0 conn(0x7fa41406a620 legacy=0x7fa4140ce490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:57.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.262+0000 7fa413fff700 1 -- 172.21.15.84:0/1570779632 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4140cb410 con 0x7fa4140ca920 2023-09-13T08:25:57.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.262+0000 7fa413fff700 1 --2- 172.21.15.84:0/1570779632 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4140ca920 0x7fa41406d700 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fa400009840 tx=0x7fa400009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=181391ab7933386c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:57.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.262+0000 7fa4137fe700 1 -- 172.21.15.84:0/1570779632 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa400004230 con 0x7fa4140ca920 2023-09-13T08:25:57.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.262+0000 7fa4137fe700 1 -- 172.21.15.84:0/1570779632 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa400004390 con 0x7fa4140ca920 2023-09-13T08:25:57.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.262+0000 7fa4137fe700 1 -- 172.21.15.84:0/1570779632 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4000036a0 con 0x7fa4140ca920 2023-09-13T08:25:57.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.262+0000 7fa41abf8700 1 -- 172.21.15.84:0/1570779632 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4140ca920 msgr2=0x7fa41406d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:57.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.262+0000 7fa41abf8700 1 --2- 172.21.15.84:0/1570779632 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4140ca920 0x7fa41406d700 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fa400009840 tx=0x7fa400009b50 comp rx=0 tx=0).stop 2023-09-13T08:25:57.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.262+0000 7fa41abf8700 1 -- 172.21.15.84:0/1570779632 shutdown_connections 2023-09-13T08:25:57.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.262+0000 7fa41abf8700 1 --2- 172.21.15.84:0/1570779632 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4140ca920 0x7fa41406d700 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:57.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.262+0000 7fa41abf8700 1 -- 172.21.15.84:0/1570779632 >> 172.21.15.84:0/1570779632 conn(0x7fa4140d00c0 msgr2=0x7fa4140d04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:57.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.262+0000 7fa41abf8700 1 -- 172.21.15.84:0/1570779632 shutdown_connections 2023-09-13T08:25:57.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.262+0000 7fa41abf8700 1 -- 172.21.15.84:0/1570779632 wait complete. 2023-09-13T08:25:57.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.264+0000 7fa41abf8700 1 Processor -- start 2023-09-13T08:25:57.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.264+0000 7fa41abf8700 1 -- start start 2023-09-13T08:25:57.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.264+0000 7fa41abf8700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa41406a620 0x7fa414159600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:57.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.264+0000 7fa41abf8700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa4140ca920 0x7fa41415fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:57.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.264+0000 7fa41abf8700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa41415d530 0x7fa41414ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:57.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.264+0000 7fa41abf8700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4140c80e0 con 0x7fa41406a620 2023-09-13T08:25:57.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.264+0000 7fa41abf8700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4140c7a60 con 0x7fa4140ca920 2023-09-13T08:25:57.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.264+0000 7fa41abf8700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa414160410 con 0x7fa41415d530 2023-09-13T08:25:57.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.265+0000 7fa418994700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa41406a620 0x7fa414159600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:57.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.265+0000 7fa418994700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa41406a620 0x7fa414159600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45652/0 (socket says 172.21.15.84:45652) 2023-09-13T08:25:57.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.265+0000 7fa418994700 1 -- 172.21.15.84:0/1434389722 learned_addr learned my addr 172.21.15.84:0/1434389722 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:57.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.265+0000 7fa413fff700 1 --2- 172.21.15.84:0/1434389722 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa4140ca920 0x7fa41415fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:57.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.265+0000 7fa419195700 1 --2- 172.21.15.84:0/1434389722 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa41415d530 0x7fa41414ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:57.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.265+0000 7fa418994700 1 -- 172.21.15.84:0/1434389722 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa41415d530 msgr2=0x7fa41414ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:57.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.265+0000 7fa418994700 1 --2- 172.21.15.84:0/1434389722 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa41415d530 0x7fa41414ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:57.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.265+0000 7fa418994700 1 -- 172.21.15.84:0/1434389722 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa4140ca920 msgr2=0x7fa41415fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:57.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.265+0000 7fa418994700 1 --2- 172.21.15.84:0/1434389722 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa4140ca920 0x7fa41415fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:57.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.265+0000 7fa418994700 1 -- 172.21.15.84:0/1434389722 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4000094a0 con 0x7fa41406a620 2023-09-13T08:25:57.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.265+0000 7fa413fff700 1 --2- 172.21.15.84:0/1434389722 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa4140ca920 0x7fa41415fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T08:25:57.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.265+0000 7fa418994700 1 --2- 172.21.15.84:0/1434389722 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa41406a620 0x7fa414159600 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fa40800b4a0 tx=0x7fa40800b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:57.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.265+0000 7fa4117fa700 1 -- 172.21.15.84:0/1434389722 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa408011830 con 0x7fa41406a620 2023-09-13T08:25:57.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.265+0000 7fa4117fa700 1 -- 172.21.15.84:0/1434389722 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa408011990 con 0x7fa41406a620 2023-09-13T08:25:57.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.265+0000 7fa41abf8700 1 -- 172.21.15.84:0/1434389722 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4141606f0 con 0x7fa41406a620 2023-09-13T08:25:57.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.265+0000 7fa4117fa700 1 -- 172.21.15.84:0/1434389722 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa408011d40 con 0x7fa41406a620 2023-09-13T08:25:57.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.265+0000 7fa41abf8700 1 -- 172.21.15.84:0/1434389722 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4141600e0 con 0x7fa41406a620 2023-09-13T08:25:57.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.266+0000 7fa41abf8700 1 -- 172.21.15.84:0/1434389722 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa41404e9b0 con 0x7fa41406a620 2023-09-13T08:25:57.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.267+0000 7fa4117fa700 1 -- 172.21.15.84:0/1434389722 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fa40801a400 con 0x7fa41406a620 2023-09-13T08:25:57.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.267+0000 7fa4117fa700 1 --2- 172.21.15.84:0/1434389722 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fa3f806a580 0x7fa3f806ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:57.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.267+0000 7fa4117fa700 1 -- 172.21.15.84:0/1434389722 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fa408088520 con 0x7fa41406a620 2023-09-13T08:25:57.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.267+0000 7fa413fff700 1 --2- 172.21.15.84:0/1434389722 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fa3f806a580 0x7fa3f806ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:57.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.267+0000 7fa413fff700 1 --2- 172.21.15.84:0/1434389722 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fa3f806a580 0x7fa3f806ca40 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa4140c79f0 tx=0x7fa400008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:57.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.271+0000 7fa4117fa700 1 -- 172.21.15.84:0/1434389722 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fa408053df0 con 0x7fa41406a620 2023-09-13T08:25:57.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.539+0000 7fa41abf8700 1 -- 172.21.15.84:0/1434389722 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7fa4140b6040 con 0x7fa41406a620 2023-09-13T08:25:57.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.542+0000 7fa4117fa700 1 -- 172.21.15.84:0/1434389722 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7fa408057410 con 0x7fa41406a620 2023-09-13T08:25:57.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.544+0000 7fa41abf8700 1 -- 172.21.15.84:0/1434389722 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fa3f806a580 msgr2=0x7fa3f806ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:57.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.544+0000 7fa41abf8700 1 --2- 172.21.15.84:0/1434389722 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fa3f806a580 0x7fa3f806ca40 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa4140c79f0 tx=0x7fa400008030 comp rx=0 tx=0).stop 2023-09-13T08:25:57.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.544+0000 7fa41abf8700 1 -- 172.21.15.84:0/1434389722 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa41406a620 msgr2=0x7fa414159600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:57.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.544+0000 7fa41abf8700 1 --2- 172.21.15.84:0/1434389722 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa41406a620 0x7fa414159600 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fa40800b4a0 tx=0x7fa40800b860 comp rx=0 tx=0).stop 2023-09-13T08:25:57.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.544+0000 7fa41abf8700 1 -- 172.21.15.84:0/1434389722 shutdown_connections 2023-09-13T08:25:57.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.544+0000 7fa41abf8700 1 --2- 172.21.15.84:0/1434389722 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa41415d530 0x7fa41414ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:57.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.544+0000 7fa41abf8700 1 --2- 172.21.15.84:0/1434389722 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa41406a620 0x7fa414159600 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:57.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.544+0000 7fa41abf8700 1 --2- 172.21.15.84:0/1434389722 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fa3f806a580 0x7fa3f806ca40 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:57.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.544+0000 7fa41abf8700 1 --2- 172.21.15.84:0/1434389722 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa4140ca920 0x7fa41415fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:57.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.544+0000 7fa41abf8700 1 -- 172.21.15.84:0/1434389722 >> 172.21.15.84:0/1434389722 conn(0x7fa4140d00c0 msgr2=0x7fa4140b2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:57.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.544+0000 7fa41abf8700 1 -- 172.21.15.84:0/1434389722 shutdown_connections 2023-09-13T08:25:57.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.544+0000 7fa41abf8700 1 -- 172.21.15.84:0/1434389722 wait complete. 2023-09-13T08:25:57.556 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-09-13T08:25:57.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.678+0000 7f51cf0ae700 1 Processor -- start 2023-09-13T08:25:57.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.678+0000 7f51cf0ae700 1 -- start start 2023-09-13T08:25:57.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.678+0000 7f51cf0ae700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f51c80cc340 0x7f51c80713b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:57.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.678+0000 7f51cf0ae700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f51c80718f0 0x7f51c815afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:57.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.678+0000 7f51cf0ae700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51c815b690 con 0x7f51c815eb80 2023-09-13T08:25:57.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.678+0000 7f51cf0ae700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51c815b970 con 0x7f51c80718f0 2023-09-13T08:25:57.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.678+0000 7f51cf0ae700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51c80cc720 con 0x7f51c80cc340 2023-09-13T08:25:57.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.679+0000 7f51cd64b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f51c80718f0 0x7f51c815afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:57.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.679+0000 7f51cd64b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f51c80718f0 0x7f51c815afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45662/0 (socket says 172.21.15.84:45662) 2023-09-13T08:25:57.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.679+0000 7f51cd64b700 1 -- 172.21.15.84:0/4265180804 learned_addr learned my addr 172.21.15.84:0/4265180804 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:57.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.679+0000 7f51cce4a700 1 --2- 172.21.15.84:0/4265180804 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f51c80cc340 0x7f51c80713b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:57.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.679+0000 7f51cd64b700 1 -- 172.21.15.84:0/4265180804 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f51c80cc340 msgr2=0x7f51c80713b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:57.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.679+0000 7f51cd64b700 1 --2- 172.21.15.84:0/4265180804 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f51c80cc340 0x7f51c80713b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:57.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.679+0000 7f51cd64b700 1 -- 172.21.15.84:0/4265180804 >> v1:172.21.15.161:6789/0 conn(0x7f51c815eb80 legacy=0x7f51c815a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:57.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.679+0000 7f51cd64b700 1 -- 172.21.15.84:0/4265180804 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51c815e0a0 con 0x7f51c80718f0 2023-09-13T08:25:57.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.679+0000 7f51cd64b700 1 --2- 172.21.15.84:0/4265180804 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51c80718f0 0x7f51c815afd0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f51c000d150 tx=0x7f51c000d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a75260b4054ec8da server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:57.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.679+0000 7f51c77fe700 1 -- 172.21.15.84:0/4265180804 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51c0010070 con 0x7f51c80718f0 2023-09-13T08:25:57.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.679+0000 7f51c77fe700 1 -- 172.21.15.84:0/4265180804 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51c000ddc0 con 0x7f51c80718f0 2023-09-13T08:25:57.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.679+0000 7f51c77fe700 1 -- 172.21.15.84:0/4265180804 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51c000b310 con 0x7f51c80718f0 2023-09-13T08:25:57.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.680+0000 7f51cf0ae700 1 -- 172.21.15.84:0/4265180804 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51c80718f0 msgr2=0x7f51c815afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:57.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.680+0000 7f51cf0ae700 1 --2- 172.21.15.84:0/4265180804 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51c80718f0 0x7f51c815afd0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f51c000d150 tx=0x7f51c000d460 comp rx=0 tx=0).stop 2023-09-13T08:25:57.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.680+0000 7f51cf0ae700 1 -- 172.21.15.84:0/4265180804 shutdown_connections 2023-09-13T08:25:57.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.680+0000 7f51cf0ae700 1 --2- 172.21.15.84:0/4265180804 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51c80718f0 0x7f51c815afd0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:57.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.680+0000 7f51cf0ae700 1 --2- 172.21.15.84:0/4265180804 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f51c80cc340 0x7f51c80713b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:57.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.680+0000 7f51cf0ae700 1 -- 172.21.15.84:0/4265180804 >> 172.21.15.84:0/4265180804 conn(0x7f51c80d00c0 msgr2=0x7f51c80d04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:57.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.680+0000 7f51cf0ae700 1 -- 172.21.15.84:0/4265180804 shutdown_connections 2023-09-13T08:25:57.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.680+0000 7f51cf0ae700 1 -- 172.21.15.84:0/4265180804 wait complete. 2023-09-13T08:25:57.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.681+0000 7f51cf0ae700 1 Processor -- start 2023-09-13T08:25:57.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.681+0000 7f51cf0ae700 1 -- start start 2023-09-13T08:25:57.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.682+0000 7f51cf0ae700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f51c80718f0 0x7f51c81f1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:57.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.682+0000 7f51cf0ae700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51c80cc340 0x7f51c80b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:57.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.682+0000 7f51cf0ae700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f51c815eb80 0x7f51c80b5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:57.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.682+0000 7f51cf0ae700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51c80ce440 con 0x7f51c80cc340 2023-09-13T08:25:57.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.682+0000 7f51cf0ae700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51c80cd830 con 0x7f51c815eb80 2023-09-13T08:25:57.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.682+0000 7f51cf0ae700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51c80cdb10 con 0x7f51c80718f0 2023-09-13T08:25:57.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.682+0000 7f51c7fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51c80cc340 0x7f51c80b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:57.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.682+0000 7f51c7fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51c80cc340 0x7f51c80b4dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45668/0 (socket says 172.21.15.84:45668) 2023-09-13T08:25:57.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.682+0000 7f51c7fff700 1 -- 172.21.15.84:0/3348414497 learned_addr learned my addr 172.21.15.84:0/3348414497 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:57.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.682+0000 7f51cce4a700 1 --2- 172.21.15.84:0/3348414497 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f51c80718f0 0x7f51c81f1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:57.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.682+0000 7f51cd64b700 1 --2- 172.21.15.84:0/3348414497 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f51c815eb80 0x7f51c80b5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:57.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.682+0000 7f51c7fff700 1 -- 172.21.15.84:0/3348414497 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f51c80718f0 msgr2=0x7f51c81f1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:57.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.682+0000 7f51c7fff700 1 --2- 172.21.15.84:0/3348414497 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f51c80718f0 0x7f51c81f1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:57.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.682+0000 7f51c7fff700 1 -- 172.21.15.84:0/3348414497 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f51c815eb80 msgr2=0x7f51c80b5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:57.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.682+0000 7f51c7fff700 1 --2- 172.21.15.84:0/3348414497 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f51c815eb80 0x7f51c80b5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:57.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.682+0000 7f51c7fff700 1 -- 172.21.15.84:0/3348414497 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51c000bd40 con 0x7f51c80cc340 2023-09-13T08:25:57.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.682+0000 7f51c7fff700 1 --2- 172.21.15.84:0/3348414497 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51c80cc340 0x7f51c80b4dc0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f51b400c450 tx=0x7f51b400c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:57.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.683+0000 7f51c57fa700 1 -- 172.21.15.84:0/3348414497 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b40052d0 con 0x7f51c80cc340 2023-09-13T08:25:57.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.683+0000 7f51c57fa700 1 -- 172.21.15.84:0/3348414497 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51b4005430 con 0x7f51c80cc340 2023-09-13T08:25:57.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.683+0000 7f51cf0ae700 1 -- 172.21.15.84:0/3348414497 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51c80cddf0 con 0x7f51c80cc340 2023-09-13T08:25:57.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.683+0000 7f51c57fa700 1 -- 172.21.15.84:0/3348414497 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b40038c0 con 0x7f51c80cc340 2023-09-13T08:25:57.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.683+0000 7f51cf0ae700 1 -- 172.21.15.84:0/3348414497 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51c80cd500 con 0x7f51c80cc340 2023-09-13T08:25:57.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.684+0000 7f51cf0ae700 1 -- 172.21.15.84:0/3348414497 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51c8154e30 con 0x7f51c80cc340 2023-09-13T08:25:57.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.684+0000 7f51c57fa700 1 -- 172.21.15.84:0/3348414497 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f51b4003a20 con 0x7f51c80cc340 2023-09-13T08:25:57.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.684+0000 7f51c57fa700 1 --2- 172.21.15.84:0/3348414497 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f51ac06a580 0x7f51ac06ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:57.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.684+0000 7f51cce4a700 1 --2- 172.21.15.84:0/3348414497 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f51ac06a580 0x7f51ac06ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:57.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.684+0000 7f51c57fa700 1 -- 172.21.15.84:0/3348414497 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f51b4087b20 con 0x7f51c80cc340 2023-09-13T08:25:57.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.685+0000 7f51cce4a700 1 --2- 172.21.15.84:0/3348414497 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f51ac06a580 0x7f51ac06ca40 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f51bc0099d0 tx=0x7f51bc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:57.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.689+0000 7f51c57fa700 1 -- 172.21.15.84:0/3348414497 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f51c8154e30 con 0x7f51c80cc340 2023-09-13T08:25:57.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.956+0000 7f51cf0ae700 1 -- 172.21.15.84:0/3348414497 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f51c8154e30 con 0x7f51c80cc340 2023-09-13T08:25:57.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.960+0000 7f51c57fa700 1 -- 172.21.15.84:0/3348414497 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f51c8154e30 con 0x7f51c80cc340 2023-09-13T08:25:57.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.962+0000 7f51cf0ae700 1 -- 172.21.15.84:0/3348414497 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f51ac06a580 msgr2=0x7f51ac06ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:57.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.962+0000 7f51cf0ae700 1 --2- 172.21.15.84:0/3348414497 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f51ac06a580 0x7f51ac06ca40 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f51bc0099d0 tx=0x7f51bc008040 comp rx=0 tx=0).stop 2023-09-13T08:25:57.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.962+0000 7f51cf0ae700 1 -- 172.21.15.84:0/3348414497 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51c80cc340 msgr2=0x7f51c80b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:57.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.962+0000 7f51cf0ae700 1 --2- 172.21.15.84:0/3348414497 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51c80cc340 0x7f51c80b4dc0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f51b400c450 tx=0x7f51b400c760 comp rx=0 tx=0).stop 2023-09-13T08:25:57.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.962+0000 7f51cf0ae700 1 -- 172.21.15.84:0/3348414497 shutdown_connections 2023-09-13T08:25:57.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.962+0000 7f51cf0ae700 1 --2- 172.21.15.84:0/3348414497 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f51ac06a580 0x7f51ac06ca40 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:57.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.962+0000 7f51cf0ae700 1 --2- 172.21.15.84:0/3348414497 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f51c815eb80 0x7f51c80b5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:57.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.962+0000 7f51cf0ae700 1 --2- 172.21.15.84:0/3348414497 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f51c80718f0 0x7f51c81f1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:57.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.962+0000 7f51cf0ae700 1 --2- 172.21.15.84:0/3348414497 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51c80cc340 0x7f51c80b4dc0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:57.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.962+0000 7f51cf0ae700 1 -- 172.21.15.84:0/3348414497 >> 172.21.15.84:0/3348414497 conn(0x7f51c80d00c0 msgr2=0x7f51c815a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:57.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.962+0000 7f51cf0ae700 1 -- 172.21.15.84:0/3348414497 shutdown_connections 2023-09-13T08:25:57.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:57.962+0000 7f51cf0ae700 1 -- 172.21.15.84:0/3348414497 wait complete. 2023-09-13T08:25:57.975 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T08:25:58.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.099+0000 7fdd8993a700 1 Processor -- start 2023-09-13T08:25:58.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.099+0000 7fdd8993a700 1 -- start start 2023-09-13T08:25:58.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.100+0000 7fdd8993a700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fdd8406c4f0 0x7fdd840b1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:58.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.100+0000 7fdd8993a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fdd840702c0 0x7fdd840706d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:58.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.100+0000 7fdd8993a700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd8415b690 con 0x7fdd8415b2b0 2023-09-13T08:25:58.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.100+0000 7fdd8993a700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd84070c10 con 0x7fdd840702c0 2023-09-13T08:25:58.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.100+0000 7fdd8993a700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd8406c980 con 0x7fdd8406c4f0 2023-09-13T08:25:58.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.100+0000 7fdd837fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fdd840702c0 0x7fdd840706d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:58.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.100+0000 7fdd837fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fdd840702c0 0x7fdd840706d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45674/0 (socket says 172.21.15.84:45674) 2023-09-13T08:25:58.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.100+0000 7fdd837fe700 1 -- 172.21.15.84:0/3793407674 learned_addr learned my addr 172.21.15.84:0/3793407674 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:58.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.100+0000 7fdd827fc700 1 --2- 172.21.15.84:0/3793407674 >> v2:172.21.15.161:3300/0 conn(0x7fdd8406c4f0 0x7fdd840b1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:58.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.100+0000 7fdd837fe700 1 -- 172.21.15.84:0/3793407674 >> v2:172.21.15.161:3300/0 conn(0x7fdd8406c4f0 msgr2=0x7fdd840b1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:58.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.100+0000 7fdd837fe700 1 --2- 172.21.15.84:0/3793407674 >> v2:172.21.15.161:3300/0 conn(0x7fdd8406c4f0 0x7fdd840b1d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:58.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.100+0000 7fdd837fe700 1 -- 172.21.15.84:0/3793407674 >> v1:172.21.15.161:6789/0 conn(0x7fdd8415b2b0 legacy=0x7fdd84072160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:58.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.100+0000 7fdd837fe700 1 -- 172.21.15.84:0/3793407674 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd8406cc60 con 0x7fdd840702c0 2023-09-13T08:25:58.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.100+0000 7fdd837fe700 1 --2- 172.21.15.84:0/3793407674 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd840702c0 0x7fdd840706d0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fdd84071910 tx=0x7fdd7c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=904c6b915124ec1e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:58.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.101+0000 7fdd81ffb700 1 -- 172.21.15.84:0/3793407674 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd7c00e070 con 0x7fdd840702c0 2023-09-13T08:25:58.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.101+0000 7fdd81ffb700 1 -- 172.21.15.84:0/3793407674 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd7c00b9c0 con 0x7fdd840702c0 2023-09-13T08:25:58.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.101+0000 7fdd81ffb700 1 -- 172.21.15.84:0/3793407674 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd7c00bd70 con 0x7fdd840702c0 2023-09-13T08:25:58.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.101+0000 7fdd8993a700 1 -- 172.21.15.84:0/3793407674 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd840702c0 msgr2=0x7fdd840706d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:58.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.101+0000 7fdd8993a700 1 --2- 172.21.15.84:0/3793407674 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd840702c0 0x7fdd840706d0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fdd84071910 tx=0x7fdd7c00b330 comp rx=0 tx=0).stop 2023-09-13T08:25:58.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.101+0000 7fdd8993a700 1 -- 172.21.15.84:0/3793407674 shutdown_connections 2023-09-13T08:25:58.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.101+0000 7fdd8993a700 1 --2- 172.21.15.84:0/3793407674 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd840702c0 0x7fdd840706d0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:58.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.101+0000 7fdd8993a700 1 --2- 172.21.15.84:0/3793407674 >> v2:172.21.15.161:3300/0 conn(0x7fdd8406c4f0 0x7fdd840b1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:58.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.101+0000 7fdd8993a700 1 -- 172.21.15.84:0/3793407674 >> 172.21.15.84:0/3793407674 conn(0x7fdd840b0a20 msgr2=0x7fdd840b0e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:58.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.101+0000 7fdd8993a700 1 -- 172.21.15.84:0/3793407674 shutdown_connections 2023-09-13T08:25:58.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.101+0000 7fdd8993a700 1 -- 172.21.15.84:0/3793407674 wait complete. 2023-09-13T08:25:58.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.102+0000 7fdd8993a700 1 Processor -- start 2023-09-13T08:25:58.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.102+0000 7fdd8993a700 1 -- start start 2023-09-13T08:25:58.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.103+0000 7fdd8993a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd840702c0 0x7fdd841eff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:58.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.103+0000 7fdd8993a700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdd8415b2b0 0x7fdd840c56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:58.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.103+0000 7fdd8993a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd840c3460 0x7fdd840aeca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:58.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.103+0000 7fdd8993a700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd841f0480 con 0x7fdd840702c0 2023-09-13T08:25:58.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.103+0000 7fdd8993a700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd84157710 con 0x7fdd840c3460 2023-09-13T08:25:58.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.103+0000 7fdd8993a700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd84156b00 con 0x7fdd8415b2b0 2023-09-13T08:25:58.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.103+0000 7fdd82ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd840702c0 0x7fdd841eff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:58.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.103+0000 7fdd82ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd840702c0 0x7fdd841eff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45678/0 (socket says 172.21.15.84:45678) 2023-09-13T08:25:58.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.103+0000 7fdd82ffd700 1 -- 172.21.15.84:0/325144192 learned_addr learned my addr 172.21.15.84:0/325144192 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:58.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.103+0000 7fdd827fc700 1 --2- 172.21.15.84:0/325144192 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdd8415b2b0 0x7fdd840c56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:58.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.103+0000 7fdd837fe700 1 --2- 172.21.15.84:0/325144192 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd840c3460 0x7fdd840aeca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:58.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.104+0000 7fdd82ffd700 1 -- 172.21.15.84:0/325144192 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdd8415b2b0 msgr2=0x7fdd840c56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:58.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.104+0000 7fdd82ffd700 1 --2- 172.21.15.84:0/325144192 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdd8415b2b0 0x7fdd840c56f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:58.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.104+0000 7fdd82ffd700 1 -- 172.21.15.84:0/325144192 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd840c3460 msgr2=0x7fdd840aeca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:58.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.104+0000 7fdd82ffd700 1 --2- 172.21.15.84:0/325144192 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd840c3460 0x7fdd840aeca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:58.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.104+0000 7fdd82ffd700 1 -- 172.21.15.84:0/325144192 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd7c009b30 con 0x7fdd840702c0 2023-09-13T08:25:58.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.104+0000 7fdd827fc700 1 --2- 172.21.15.84:0/325144192 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdd8415b2b0 0x7fdd840c56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T08:25:58.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.104+0000 7fdd82ffd700 1 --2- 172.21.15.84:0/325144192 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd840702c0 0x7fdd841eff40 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fdd7800c4e0 tx=0x7fdd7800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:58.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.104+0000 7fdd6bfff700 1 -- 172.21.15.84:0/325144192 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd780052d0 con 0x7fdd840702c0 2023-09-13T08:25:58.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.104+0000 7fdd6bfff700 1 -- 172.21.15.84:0/325144192 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd78005430 con 0x7fdd840702c0 2023-09-13T08:25:58.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.104+0000 7fdd8993a700 1 -- 172.21.15.84:0/325144192 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd84156de0 con 0x7fdd840702c0 2023-09-13T08:25:58.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.104+0000 7fdd6bfff700 1 -- 172.21.15.84:0/325144192 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd780038c0 con 0x7fdd840702c0 2023-09-13T08:25:58.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.104+0000 7fdd8993a700 1 -- 172.21.15.84:0/325144192 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd841573a0 con 0x7fdd840702c0 2023-09-13T08:25:58.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.105+0000 7fdd8993a700 1 -- 172.21.15.84:0/325144192 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd8404e9b0 con 0x7fdd840702c0 2023-09-13T08:25:58.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.106+0000 7fdd6bfff700 1 -- 172.21.15.84:0/325144192 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fdd78003a20 con 0x7fdd840702c0 2023-09-13T08:25:58.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.106+0000 7fdd6bfff700 1 --2- 172.21.15.84:0/325144192 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fdd7006a580 0x7fdd7006ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:58.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.106+0000 7fdd6bfff700 1 -- 172.21.15.84:0/325144192 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fdd780880a0 con 0x7fdd840702c0 2023-09-13T08:25:58.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.106+0000 7fdd827fc700 1 --2- 172.21.15.84:0/325144192 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fdd7006a580 0x7fdd7006ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:58.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.106+0000 7fdd827fc700 1 --2- 172.21.15.84:0/325144192 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fdd7006a580 0x7fdd7006ca40 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fdd841567f0 tx=0x7fdd74008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:58.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.110+0000 7fdd6bfff700 1 -- 172.21.15.84:0/325144192 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fdd78053910 con 0x7fdd840702c0 2023-09-13T08:25:58.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.301+0000 7fdd8993a700 1 -- 172.21.15.84:0/325144192 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdd840cb480 con 0x7fdd840702c0 2023-09-13T08:25:58.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.302+0000 7fdd6bfff700 1 -- 172.21.15.84:0/325144192 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+13038 (secure 0 0 0) 0x7fdd78017090 con 0x7fdd840702c0 2023-09-13T08:25:58.302 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:25:58.302 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":34,"fsid":"0107440b-b634-42c5-a643-5d31ea826116","created":"2023-09-13T08:24:16.931917+0000","modified":"2023-09-13T08:25:55.010657+0000","last_up_change":"2023-09-13T08:24:28.422631+0000","last_in_change":"2023-09-13T08:24:19.425578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T08:24:28.583720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4a53ec12-1469-4356-b4e1-2b8fc9b7c0f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6817","nonce":1599532366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6819","nonce":1599532366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6823","nonce":1599532366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6821","nonce":1599532366}]},"public_addr":"172.21.15.84:6817/1599532366","cluster_addr":"172.21.15.84:6819/1599532366","heartbeat_back_addr":"172.21.15.84:6823/1599532366","heartbeat_front_addr":"172.21.15.84:6821/1599532366","state":["exists","up"]},{"osd":1,"uuid":"11e964a0-b80c-4afc-bfbf-e2067969db29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6825","nonce":461860977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6827","nonce":461860977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6831","nonce":461860977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6829","nonce":461860977}]},"public_addr":"172.21.15.84:6825/461860977","cluster_addr":"172.21.15.84:6827/461860977","heartbeat_back_addr":"172.21.15.84:6831/461860977","heartbeat_front_addr":"172.21.15.84:6829/461860977","state":["exists","up"]},{"osd":2,"uuid":"3ce74529-4dd1-44c7-9576-968f5fdc0c25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6809","nonce":1168316165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6811","nonce":1168316165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6815","nonce":1168316165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6813","nonce":1168316165}]},"public_addr":"172.21.15.84:6809/1168316165","cluster_addr":"172.21.15.84:6811/1168316165","heartbeat_back_addr":"172.21.15.84:6815/1168316165","heartbeat_front_addr":"172.21.15.84:6813/1168316165","state":["exists","up"]},{"osd":3,"uuid":"460cb5c5-590a-4d06-a4d9-5bac2fdf33b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6801","nonce":1661609810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6803","nonce":1661609810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6807","nonce":1661609810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6805","nonce":1661609810}]},"public_addr":"172.21.15.84:6801/1661609810","cluster_addr":"172.21.15.84:6803/1661609810","heartbeat_back_addr":"172.21.15.84:6807/1661609810","heartbeat_front_addr":"172.21.15.84:6805/1661609810","state":["exists","up"]},{"osd":4,"uuid":"bf237dd0-3ebd-44b5-8078-24a63e00d792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6801","nonce":1303562374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6803","nonce":1303562374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6807","nonce":1303562374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6805","nonce":1303562374}]},"public_addr":"172.21.15.161:6801/1303562374","cluster_addr":"172.21.15.161:6803/1303562374","heartbeat_back_addr":"172.21.15.161:6807/1303562374","heartbeat_front_addr":"172.21.15.161:6805/1303562374","state":["exists","up"]},{"osd":5,"uuid":"e1e538e0-5844-456b-8c6e-434d3a914af1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6818","nonce":961120854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6822","nonce":961120854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6830","nonce":961120854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6826","nonce":961120854}]},"public_addr":"172.21.15.161:6818/961120854","cluster_addr":"172.21.15.161:6822/961120854","heartbeat_back_addr":"172.21.15.161:6830/961120854","heartbeat_front_addr":"172.21.15.161:6826/961120854","state":["exists","up"]},{"osd":6,"uuid":"5cb1785e-960f-4dd4-b295-9e21b2c3f875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6809","nonce":980533466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6811","nonce":980533466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6815","nonce":980533466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6813","nonce":980533466}]},"public_addr":"172.21.15.161:6809/980533466","cluster_addr":"172.21.15.161:6811/980533466","heartbeat_back_addr":"172.21.15.161:6815/980533466","heartbeat_front_addr":"172.21.15.161:6813/980533466","state":["exists","up"]},{"osd":7,"uuid":"5acb6619-e933-4b46-b1c2-60af30acb839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6817","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6819","nonce":2479691549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6821","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6823","nonce":2479691549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6829","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6831","nonce":2479691549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6825","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6827","nonce":2479691549}]},"public_addr":"172.21.15.161:6819/2479691549","cluster_addr":"172.21.15.161:6823/2479691549","heartbeat_back_addr":"172.21.15.161:6831/2479691549","heartbeat_front_addr":"172.21.15.161:6827/2479691549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.678857+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.685341+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.613603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.634940+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.564387+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.697347+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.637437+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.619397+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T08:25:58.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.304+0000 7fdd8993a700 1 -- 172.21.15.84:0/325144192 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fdd7006a580 msgr2=0x7fdd7006ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:58.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.304+0000 7fdd8993a700 1 --2- 172.21.15.84:0/325144192 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fdd7006a580 0x7fdd7006ca40 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fdd841567f0 tx=0x7fdd74008040 comp rx=0 tx=0).stop 2023-09-13T08:25:58.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.304+0000 7fdd8993a700 1 -- 172.21.15.84:0/325144192 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd840702c0 msgr2=0x7fdd841eff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:58.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.304+0000 7fdd8993a700 1 --2- 172.21.15.84:0/325144192 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd840702c0 0x7fdd841eff40 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fdd7800c4e0 tx=0x7fdd7800c8a0 comp rx=0 tx=0).stop 2023-09-13T08:25:58.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.304+0000 7fdd8993a700 1 -- 172.21.15.84:0/325144192 shutdown_connections 2023-09-13T08:25:58.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.304+0000 7fdd8993a700 1 --2- 172.21.15.84:0/325144192 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fdd7006a580 0x7fdd7006ca40 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:58.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.304+0000 7fdd8993a700 1 --2- 172.21.15.84:0/325144192 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd840c3460 0x7fdd840aeca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:58.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.304+0000 7fdd8993a700 1 --2- 172.21.15.84:0/325144192 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd840702c0 0x7fdd841eff40 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:58.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.304+0000 7fdd8993a700 1 --2- 172.21.15.84:0/325144192 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdd8415b2b0 0x7fdd840c56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:58.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.304+0000 7fdd8993a700 1 -- 172.21.15.84:0/325144192 >> 172.21.15.84:0/325144192 conn(0x7fdd840b0a20 msgr2=0x7fdd840b0310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:58.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.304+0000 7fdd8993a700 1 -- 172.21.15.84:0/325144192 shutdown_connections 2023-09-13T08:25:58.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.304+0000 7fdd8993a700 1 -- 172.21.15.84:0/325144192 wait complete. 2023-09-13T08:25:58.316 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T08:24:28.583720+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-13T08:25:58.317 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T08:25:58.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.441+0000 7fe382903700 1 Processor -- start 2023-09-13T08:25:58.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.441+0000 7fe382903700 1 -- start start 2023-09-13T08:25:58.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.442+0000 7fe382903700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe37c0ca8e0 0x7fe37c0cf570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:58.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.442+0000 7fe382903700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe37c15e910 0x7fe37c0cacc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:58.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.442+0000 7fe382903700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe37c15e480 con 0x7fe37c0cd590 2023-09-13T08:25:58.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.442+0000 7fe382903700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe37c0cb200 con 0x7fe37c15e910 2023-09-13T08:25:58.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.442+0000 7fe382903700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe37c0cfbe0 con 0x7fe37c0ca8e0 2023-09-13T08:25:58.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.442+0000 7fe37b7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe37c15e910 0x7fe37c0cacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:58.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.442+0000 7fe380ea0700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fe37c0cd590 0x7fe37c161150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:48336/0 (socket says 172.21.15.84:48336) 2023-09-13T08:25:58.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.442+0000 7fe380ea0700 1 -- 172.21.15.84:0/1096300568 learned_addr learned my addr 172.21.15.84:0/1096300568 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:25:58.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.442+0000 7fe37bfff700 1 --2- 172.21.15.84:0/1096300568 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe37c0ca8e0 0x7fe37c0cf570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:58.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.442+0000 7fe37b7fe700 1 -- 172.21.15.84:0/1096300568 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe37c0ca8e0 msgr2=0x7fe37c0cf570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:58.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.442+0000 7fe37b7fe700 1 --2- 172.21.15.84:0/1096300568 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe37c0ca8e0 0x7fe37c0cf570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:58.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.442+0000 7fe37b7fe700 1 -- 172.21.15.84:0/1096300568 >> v1:172.21.15.84:6789/0 conn(0x7fe37c0cd590 legacy=0x7fe37c161150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:58.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.442+0000 7fe37affd700 1 -- 172.21.15.84:0/1096300568 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1005663658 0 0) 0x7fe37c15e480 con 0x7fe37c0cd590 2023-09-13T08:25:58.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.442+0000 7fe37b7fe700 1 -- 172.21.15.84:0/1096300568 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe37c15de30 con 0x7fe37c15e910 2023-09-13T08:25:58.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.442+0000 7fe37b7fe700 1 --2- 172.21.15.84:0/1096300568 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe37c15e910 0x7fe37c0cacc0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fe36c009840 tx=0x7fe36c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eeae94d1d4a241ab server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:58.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.443+0000 7fe37affd700 1 -- 172.21.15.84:0/1096300568 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe36c011830 con 0x7fe37c15e910 2023-09-13T08:25:58.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.443+0000 7fe37affd700 1 -- 172.21.15.84:0/1096300568 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe36c011990 con 0x7fe37c15e910 2023-09-13T08:25:58.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.443+0000 7fe37affd700 1 -- 172.21.15.84:0/1096300568 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe36c011d20 con 0x7fe37c15e910 2023-09-13T08:25:58.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.443+0000 7fe382903700 1 -- 172.21.15.84:0/1096300568 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe37c15e910 msgr2=0x7fe37c0cacc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:58.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.443+0000 7fe382903700 1 --2- 172.21.15.84:0/1096300568 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe37c15e910 0x7fe37c0cacc0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fe36c009840 tx=0x7fe36c009b50 comp rx=0 tx=0).stop 2023-09-13T08:25:58.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.443+0000 7fe382903700 1 -- 172.21.15.84:0/1096300568 shutdown_connections 2023-09-13T08:25:58.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.443+0000 7fe382903700 1 --2- 172.21.15.84:0/1096300568 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe37c0ca8e0 0x7fe37c0cf570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:58.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.443+0000 7fe382903700 1 --2- 172.21.15.84:0/1096300568 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe37c15e910 0x7fe37c0cacc0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:58.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.443+0000 7fe382903700 1 -- 172.21.15.84:0/1096300568 >> 172.21.15.84:0/1096300568 conn(0x7fe37c0cca70 msgr2=0x7fe37c0cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:58.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.443+0000 7fe382903700 1 -- 172.21.15.84:0/1096300568 shutdown_connections 2023-09-13T08:25:58.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.443+0000 7fe382903700 1 -- 172.21.15.84:0/1096300568 wait complete. 2023-09-13T08:25:58.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.444+0000 7fe382903700 1 Processor -- start 2023-09-13T08:25:58.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.445+0000 7fe382903700 1 -- start start 2023-09-13T08:25:58.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.445+0000 7fe382903700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe37c0ca8e0 0x7fe37c15aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:58.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.445+0000 7fe382903700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe37c0cd590 0x7fe37c0c3d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:58.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.445+0000 7fe382903700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe37c15e910 0x7fe37c0b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:58.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.445+0000 7fe382903700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe37c0c6540 con 0x7fe37c15e910 2023-09-13T08:25:58.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.445+0000 7fe382903700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe37c0acc30 con 0x7fe37c0ca8e0 2023-09-13T08:25:58.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.445+0000 7fe382903700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe37c0acf10 con 0x7fe37c0cd590 2023-09-13T08:25:58.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.445+0000 7fe380ea0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe37c15e910 0x7fe37c0b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:58.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.445+0000 7fe380ea0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe37c15e910 0x7fe37c0b4e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45696/0 (socket says 172.21.15.84:45696) 2023-09-13T08:25:58.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.445+0000 7fe380ea0700 1 -- 172.21.15.84:0/130519510 learned_addr learned my addr 172.21.15.84:0/130519510 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:58.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.446+0000 7fe37b7fe700 1 --2- 172.21.15.84:0/130519510 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe37c0cd590 0x7fe37c0c3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:58.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.446+0000 7fe37bfff700 1 --2- 172.21.15.84:0/130519510 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe37c0ca8e0 0x7fe37c15aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:58.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.446+0000 7fe380ea0700 1 -- 172.21.15.84:0/130519510 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe37c0cd590 msgr2=0x7fe37c0c3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:58.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.446+0000 7fe380ea0700 1 --2- 172.21.15.84:0/130519510 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe37c0cd590 0x7fe37c0c3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:58.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.446+0000 7fe380ea0700 1 -- 172.21.15.84:0/130519510 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe37c0ca8e0 msgr2=0x7fe37c15aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:58.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.446+0000 7fe380ea0700 1 --2- 172.21.15.84:0/130519510 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe37c0ca8e0 0x7fe37c15aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:58.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.446+0000 7fe380ea0700 1 -- 172.21.15.84:0/130519510 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe36c0094a0 con 0x7fe37c15e910 2023-09-13T08:25:58.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.446+0000 7fe37b7fe700 1 --2- 172.21.15.84:0/130519510 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe37c0cd590 0x7fe37c0c3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T08:25:58.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.446+0000 7fe37bfff700 1 --2- 172.21.15.84:0/130519510 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe37c0ca8e0 0x7fe37c15aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T08:25:58.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.446+0000 7fe380ea0700 1 --2- 172.21.15.84:0/130519510 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe37c15e910 0x7fe37c0b4e20 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fe374002230 tx=0x7fe37400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:58.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.446+0000 7fe378ff9700 1 -- 172.21.15.84:0/130519510 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe37400ac20 con 0x7fe37c15e910 2023-09-13T08:25:58.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.446+0000 7fe378ff9700 1 -- 172.21.15.84:0/130519510 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe37400ada0 con 0x7fe37c15e910 2023-09-13T08:25:58.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.446+0000 7fe382903700 1 -- 172.21.15.84:0/130519510 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe37c0ad1f0 con 0x7fe37c15e910 2023-09-13T08:25:58.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.446+0000 7fe378ff9700 1 -- 172.21.15.84:0/130519510 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe374007310 con 0x7fe37c15e910 2023-09-13T08:25:58.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.446+0000 7fe382903700 1 -- 172.21.15.84:0/130519510 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe37c0ad7b0 con 0x7fe37c15e910 2023-09-13T08:25:58.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.447+0000 7fe382903700 1 -- 172.21.15.84:0/130519510 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe37c0cb980 con 0x7fe37c15e910 2023-09-13T08:25:58.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.448+0000 7fe378ff9700 1 -- 172.21.15.84:0/130519510 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fe374007470 con 0x7fe37c15e910 2023-09-13T08:25:58.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.448+0000 7fe378ff9700 1 --2- 172.21.15.84:0/130519510 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fe36806a580 0x7fe36806ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:58.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.448+0000 7fe378ff9700 1 -- 172.21.15.84:0/130519510 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fe374088a30 con 0x7fe37c15e910 2023-09-13T08:25:58.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.448+0000 7fe37bfff700 1 --2- 172.21.15.84:0/130519510 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fe36806a580 0x7fe36806ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:58.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.449+0000 7fe37bfff700 1 --2- 172.21.15.84:0/130519510 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fe36806a580 0x7fe36806ca40 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe37c1f6a40 tx=0x7fe370008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:58.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.452+0000 7fe378ff9700 1 -- 172.21.15.84:0/130519510 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fe374054230 con 0x7fe37c15e910 2023-09-13T08:25:58.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.643+0000 7fe382903700 1 -- 172.21.15.84:0/130519510 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe37c04f200 con 0x7fe37c15e910 2023-09-13T08:25:58.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.643+0000 7fe378ff9700 1 -- 172.21.15.84:0/130519510 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v34) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe374018020 con 0x7fe37c15e910 2023-09-13T08:25:58.644 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-09-13T08:25:58.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.645+0000 7fe382903700 1 -- 172.21.15.84:0/130519510 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fe36806a580 msgr2=0x7fe36806ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:58.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.645+0000 7fe382903700 1 --2- 172.21.15.84:0/130519510 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fe36806a580 0x7fe36806ca40 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe37c1f6a40 tx=0x7fe370008040 comp rx=0 tx=0).stop 2023-09-13T08:25:58.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.645+0000 7fe382903700 1 -- 172.21.15.84:0/130519510 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe37c15e910 msgr2=0x7fe37c0b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:58.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.645+0000 7fe382903700 1 --2- 172.21.15.84:0/130519510 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe37c15e910 0x7fe37c0b4e20 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fe374002230 tx=0x7fe37400a060 comp rx=0 tx=0).stop 2023-09-13T08:25:58.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.645+0000 7fe382903700 1 -- 172.21.15.84:0/130519510 shutdown_connections 2023-09-13T08:25:58.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.645+0000 7fe382903700 1 --2- 172.21.15.84:0/130519510 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe37c15e910 0x7fe37c0b4e20 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:58.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.645+0000 7fe382903700 1 --2- 172.21.15.84:0/130519510 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fe36806a580 0x7fe36806ca40 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:58.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.645+0000 7fe382903700 1 --2- 172.21.15.84:0/130519510 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe37c0ca8e0 0x7fe37c15aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:58.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.645+0000 7fe382903700 1 --2- 172.21.15.84:0/130519510 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe37c0cd590 0x7fe37c0c3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:58.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.645+0000 7fe382903700 1 -- 172.21.15.84:0/130519510 >> 172.21.15.84:0/130519510 conn(0x7fe37c0cca70 msgr2=0x7fe37c0b0d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:58.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.645+0000 7fe382903700 1 -- 172.21.15.84:0/130519510 shutdown_connections 2023-09-13T08:25:58.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.645+0000 7fe382903700 1 -- 172.21.15.84:0/130519510 wait complete. 2023-09-13T08:25:58.657 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-09-13T08:25:58.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.778+0000 7f89093e0700 1 Processor -- start 2023-09-13T08:25:58.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.779+0000 7f89093e0700 1 -- start start 2023-09-13T08:25:58.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.779+0000 7f89093e0700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f890415d6e0 0x7f89040b8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:58.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.779+0000 7f89093e0700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89040d3060 con 0x7f89040d2bf0 2023-09-13T08:25:58.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.779+0000 7f89093e0700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89040d1b50 con 0x7f89040cdfe0 2023-09-13T08:25:58.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.779+0000 7f89093e0700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89040d1e30 con 0x7f890415d6e0 2023-09-13T08:25:58.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.779+0000 7f89037fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f89040d2bf0 0x7f89040d1300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:48350/0 (socket says 172.21.15.84:48350) 2023-09-13T08:25:58.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.780+0000 7f89037fe700 1 -- 172.21.15.84:0/3411677133 learned_addr learned my addr 172.21.15.84:0/3411677133 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:25:58.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.780+0000 7f89027fc700 1 --2- 172.21.15.84:0/3411677133 >> v2:172.21.15.161:3300/0 conn(0x7f890415d6e0 0x7f89040b8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:58.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.780+0000 7f8901ffb700 1 -- 172.21.15.84:0/3411677133 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1736484181 0 0) 0x7f89040d3060 con 0x7f89040d2bf0 2023-09-13T08:25:58.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.780+0000 7f8901ffb700 1 -- 172.21.15.84:0/3411677133 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88ec0035b0 con 0x7f89040d2bf0 2023-09-13T08:25:58.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.780+0000 7f8901ffb700 1 -- 172.21.15.84:0/3411677133 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3853150896 0 0) 0x7f88ec0035b0 con 0x7f89040d2bf0 2023-09-13T08:25:58.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.780+0000 7f8901ffb700 1 -- 172.21.15.84:0/3411677133 >> v2:172.21.15.161:3300/0 conn(0x7f890415d6e0 msgr2=0x7f89040b8ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:58.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.780+0000 7f8901ffb700 1 --2- 172.21.15.84:0/3411677133 >> v2:172.21.15.161:3300/0 conn(0x7f890415d6e0 0x7f89040b8ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:58.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.780+0000 7f8901ffb700 1 -- 172.21.15.84:0/3411677133 >> v1:172.21.15.161:6789/0 conn(0x7f89040cdfe0 legacy=0x7f89040ce3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:58.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.780+0000 7f8901ffb700 1 -- 172.21.15.84:0/3411677133 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89040d2110 con 0x7f89040d2bf0 2023-09-13T08:25:58.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.780+0000 7f8901ffb700 1 -- 172.21.15.84:0/3411677133 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2302733408 0 0) 0x7f88fc0019f0 con 0x7f89040d2bf0 2023-09-13T08:25:58.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.780+0000 7f8901ffb700 1 -- 172.21.15.84:0/3411677133 >> v1:172.21.15.84:6789/0 conn(0x7f89040d2bf0 legacy=0x7f89040d1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:58.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.780+0000 7f8901ffb700 1 --2- 172.21.15.84:0/3411677133 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f88ec003a00 0x7f88ec003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:58.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.780+0000 7f8901ffb700 1 --2- 172.21.15.84:0/3411677133 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88ec004850 0x7f88ec004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:58.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.780+0000 7f8901ffb700 1 --2- 172.21.15.84:0/3411677133 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88ec005210 0x7f88ec00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:58.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.780+0000 7f8901ffb700 1 -- 172.21.15.84:0/3411677133 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89040d1e30 con 0x7f88ec005210 2023-09-13T08:25:58.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.780+0000 7f8901ffb700 1 -- 172.21.15.84:0/3411677133 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88ec00c0c0 con 0x7f88ec004850 2023-09-13T08:25:58.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.780+0000 7f8901ffb700 1 -- 172.21.15.84:0/3411677133 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88ec00c280 con 0x7f88ec003a00 2023-09-13T08:25:58.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.780+0000 7f89037fe700 1 --2- 172.21.15.84:0/3411677133 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88ec005210 0x7f88ec00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:58.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.780+0000 7f89027fc700 1 --2- 172.21.15.84:0/3411677133 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88ec004850 0x7f88ec004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:58.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.780+0000 7f8902ffd700 1 --2- 172.21.15.84:0/3411677133 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f88ec003a00 0x7f88ec003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:58.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.780+0000 7f89037fe700 1 -- 172.21.15.84:0/3411677133 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f88ec003a00 msgr2=0x7f88ec003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:58.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.780+0000 7f89037fe700 1 --2- 172.21.15.84:0/3411677133 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f88ec003a00 0x7f88ec003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:58.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.780+0000 7f89037fe700 1 -- 172.21.15.84:0/3411677133 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88ec004850 msgr2=0x7f88ec004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:58.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.780+0000 7f89037fe700 1 --2- 172.21.15.84:0/3411677133 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88ec004850 0x7f88ec004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:58.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.780+0000 7f89037fe700 1 -- 172.21.15.84:0/3411677133 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88ec0035b0 con 0x7f88ec005210 2023-09-13T08:25:58.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.780+0000 7f8902ffd700 1 --2- 172.21.15.84:0/3411677133 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f88ec003a00 0x7f88ec003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T08:25:58.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.781+0000 7f89037fe700 1 -- 172.21.15.84:0/3411677133 reap_dead start 2023-09-13T08:25:58.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.781+0000 7f89037fe700 1 --2- 172.21.15.84:0/3411677133 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88ec005210 0x7f88ec00ba10 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f88fc00a830 tx=0x7f88ec005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfecf80b3d7067e2 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:58.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.781+0000 7f8901ffb700 1 -- 172.21.15.84:0/3411677133 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88fc00a2f0 con 0x7f88ec005210 2023-09-13T08:25:58.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.781+0000 7f8901ffb700 1 -- 172.21.15.84:0/3411677133 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88fc012620 con 0x7f88ec005210 2023-09-13T08:25:58.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.781+0000 7f8901ffb700 1 -- 172.21.15.84:0/3411677133 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88fc0129d0 con 0x7f88ec005210 2023-09-13T08:25:58.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.781+0000 7f89093e0700 1 -- 172.21.15.84:0/3411677133 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88ec005210 msgr2=0x7f88ec00ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:58.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.781+0000 7f89093e0700 1 --2- 172.21.15.84:0/3411677133 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88ec005210 0x7f88ec00ba10 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f88fc00a830 tx=0x7f88ec005880 comp rx=0 tx=0).stop 2023-09-13T08:25:58.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.781+0000 7f89093e0700 1 -- 172.21.15.84:0/3411677133 shutdown_connections 2023-09-13T08:25:58.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.781+0000 7f89093e0700 1 --2- 172.21.15.84:0/3411677133 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88ec005210 0x7f88ec00ba10 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:58.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.781+0000 7f89093e0700 1 -- 172.21.15.84:0/3411677133 >> 172.21.15.84:0/3411677133 conn(0x7f890406b110 msgr2=0x7f890406b4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:58.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.781+0000 7f89093e0700 1 -- 172.21.15.84:0/3411677133 shutdown_connections 2023-09-13T08:25:58.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.781+0000 7f89093e0700 1 -- 172.21.15.84:0/3411677133 wait complete. 2023-09-13T08:25:58.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.783+0000 7f89093e0700 1 Processor -- start 2023-09-13T08:25:58.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.783+0000 7f89093e0700 1 -- start start 2023-09-13T08:25:58.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.783+0000 7f89093e0700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88ec005210 0x7f89041f54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:58.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.784+0000 7f89093e0700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f89040b4460 0x7f89040aa150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:58.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.784+0000 7f89093e0700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89040aa690 0x7f89040aaaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:58.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.784+0000 7f89093e0700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89041f2780 con 0x7f89040aa690 2023-09-13T08:25:58.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.784+0000 7f89093e0700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89040b49b0 con 0x7f88ec005210 2023-09-13T08:25:58.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.784+0000 7f89093e0700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89040b4c90 con 0x7f89040b4460 2023-09-13T08:25:58.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.784+0000 7f89037fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89040aa690 0x7f89040aaaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:58.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.784+0000 7f89037fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89040aa690 0x7f89040aaaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45716/0 (socket says 172.21.15.84:45716) 2023-09-13T08:25:58.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.784+0000 7f89037fe700 1 -- 172.21.15.84:0/35766285 learned_addr learned my addr 172.21.15.84:0/35766285 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:58.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.784+0000 7f8902ffd700 1 --2- 172.21.15.84:0/35766285 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88ec005210 0x7f89041f54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:58.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.784+0000 7f89027fc700 1 --2- 172.21.15.84:0/35766285 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f89040b4460 0x7f89040aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:58.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.784+0000 7f89037fe700 1 -- 172.21.15.84:0/35766285 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f89040b4460 msgr2=0x7f89040aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:58.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.784+0000 7f89037fe700 1 --2- 172.21.15.84:0/35766285 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f89040b4460 0x7f89040aa150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:58.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.784+0000 7f89037fe700 1 -- 172.21.15.84:0/35766285 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88ec005210 msgr2=0x7f89041f54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:58.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.784+0000 7f89037fe700 1 --2- 172.21.15.84:0/35766285 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88ec005210 0x7f89041f54e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:58.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.784+0000 7f89037fe700 1 -- 172.21.15.84:0/35766285 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89040b4f70 con 0x7f89040aa690 2023-09-13T08:25:58.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.784+0000 7f89037fe700 1 --2- 172.21.15.84:0/35766285 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89040aa690 0x7f89040aaaf0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f89040d1090 tx=0x7f88fc001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:58.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.784+0000 7f88eb7fe700 1 -- 172.21.15.84:0/35766285 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88fc012ba0 con 0x7f89040aa690 2023-09-13T08:25:58.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.784+0000 7f88eb7fe700 1 -- 172.21.15.84:0/35766285 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88fc012d20 con 0x7f89040aa690 2023-09-13T08:25:58.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.784+0000 7f88eb7fe700 1 -- 172.21.15.84:0/35766285 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88fc01d660 con 0x7f89040aa690 2023-09-13T08:25:58.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.784+0000 7f89093e0700 1 -- 172.21.15.84:0/35766285 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89040b5250 con 0x7f89040aa690 2023-09-13T08:25:58.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.784+0000 7f89093e0700 1 -- 172.21.15.84:0/35766285 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89040a9e20 con 0x7f89040aa690 2023-09-13T08:25:58.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.785+0000 7f89093e0700 1 -- 172.21.15.84:0/35766285 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89040b4dd0 con 0x7f89040aa690 2023-09-13T08:25:58.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.786+0000 7f88eb7fe700 1 -- 172.21.15.84:0/35766285 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f88fc01d7c0 con 0x7f89040aa690 2023-09-13T08:25:58.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.786+0000 7f88eb7fe700 1 --2- 172.21.15.84:0/35766285 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f88f006a580 0x7f88f006ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:58.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.786+0000 7f88eb7fe700 1 -- 172.21.15.84:0/35766285 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f88fc08a820 con 0x7f89040aa690 2023-09-13T08:25:58.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.786+0000 7f8902ffd700 1 --2- 172.21.15.84:0/35766285 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f88f006a580 0x7f88f006ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:58.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.786+0000 7f8902ffd700 1 --2- 172.21.15.84:0/35766285 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f88f006a580 0x7f88f006ca40 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f88f8000c00 tx=0x7f88f8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:58.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.790+0000 7f88eb7fe700 1 -- 172.21.15.84:0/35766285 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f89040b4dd0 con 0x7f89040aa690 2023-09-13T08:25:58.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.984+0000 7f89093e0700 1 -- 172.21.15.84:0/35766285 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f89040b4dd0 con 0x7f89040aa690 2023-09-13T08:25:58.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.984+0000 7f88eb7fe700 1 -- 172.21.15.84:0/35766285 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v34) v1 ==== 84+0+65 (secure 0 0 0) 0x7f89040b4dd0 con 0x7f89040aa690 2023-09-13T08:25:58.984 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:25:58.985 INFO:teuthology.orchestra.run.smithi084.stdout:[ 2023-09-13T08:25:58.985 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-09-13T08:25:58.985 INFO:teuthology.orchestra.run.smithi084.stdout: "poolnum": 1, 2023-09-13T08:25:58.985 INFO:teuthology.orchestra.run.smithi084.stdout: "poolname": ".mgr" 2023-09-13T08:25:58.985 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-09-13T08:25:58.986 INFO:teuthology.orchestra.run.smithi084.stdout:] 2023-09-13T08:25:58.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.986+0000 7f89093e0700 1 -- 172.21.15.84:0/35766285 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f88f006a580 msgr2=0x7f88f006ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:58.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.986+0000 7f89093e0700 1 --2- 172.21.15.84:0/35766285 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f88f006a580 0x7f88f006ca40 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f88f8000c00 tx=0x7f88f8009040 comp rx=0 tx=0).stop 2023-09-13T08:25:58.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.986+0000 7f89093e0700 1 -- 172.21.15.84:0/35766285 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89040aa690 msgr2=0x7f89040aaaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:58.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.986+0000 7f89093e0700 1 --2- 172.21.15.84:0/35766285 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89040aa690 0x7f89040aaaf0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f89040d1090 tx=0x7f88fc001d80 comp rx=0 tx=0).stop 2023-09-13T08:25:58.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.986+0000 7f89093e0700 1 -- 172.21.15.84:0/35766285 shutdown_connections 2023-09-13T08:25:58.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.986+0000 7f89093e0700 1 --2- 172.21.15.84:0/35766285 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89040aa690 0x7f89040aaaf0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:58.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.986+0000 7f89093e0700 1 --2- 172.21.15.84:0/35766285 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f88f006a580 0x7f88f006ca40 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:58.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.986+0000 7f89093e0700 1 --2- 172.21.15.84:0/35766285 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88ec005210 0x7f89041f54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:58.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.986+0000 7f89093e0700 1 --2- 172.21.15.84:0/35766285 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f89040b4460 0x7f89040aa150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:58.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.986+0000 7f89093e0700 1 -- 172.21.15.84:0/35766285 >> 172.21.15.84:0/35766285 conn(0x7f890406b110 msgr2=0x7f89040cc380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:58.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.986+0000 7f89093e0700 1 -- 172.21.15.84:0/35766285 shutdown_connections 2023-09-13T08:25:58.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:58.986+0000 7f89093e0700 1 -- 172.21.15.84:0/35766285 wait complete. 2023-09-13T08:25:58.998 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-09-13T08:25:58.998 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-09-13T08:25:59.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:59.124+0000 7fef66498700 1 Processor -- start 2023-09-13T08:25:59.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:59.124+0000 7fef66498700 1 -- start start 2023-09-13T08:25:59.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:59.125+0000 7fef66498700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fef60071410 0x7fef6006e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:59.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:59.125+0000 7fef66498700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fef6006e9a0 0x7fef600717f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:59.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:59.125+0000 7fef66498700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef600cdca0 con 0x7fef600caec0 2023-09-13T08:25:59.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:59.125+0000 7fef66498700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef600ce260 con 0x7fef6006e9a0 2023-09-13T08:25:59.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:59.125+0000 7fef66498700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef60071d30 con 0x7fef60071410 2023-09-13T08:25:59.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:59.125+0000 7fef5ffff700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fef60071410 0x7fef6006e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:59.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:59.125+0000 7fef5f7fe700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fef6006e9a0 0x7fef600717f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:59.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:59.125+0000 7fef5ffff700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fef60071410 0x7fef6006e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.84:55584/0 (socket says 172.21.15.84:55584) 2023-09-13T08:25:59.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:59.125+0000 7fef5ffff700 1 -- 172.21.15.84:0/1753325657 learned_addr learned my addr 172.21.15.84:0/1753325657 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:59.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:59.125+0000 7fef5ffff700 1 -- 172.21.15.84:0/1753325657 >> v2:172.21.15.161:3300/0 conn(0x7fef6006e9a0 msgr2=0x7fef600717f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:25:59.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:59.125+0000 7fef5ffff700 1 --2- 172.21.15.84:0/1753325657 >> v2:172.21.15.161:3300/0 conn(0x7fef6006e9a0 0x7fef600717f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:59.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:59.126+0000 7fef5ffff700 1 -- 172.21.15.84:0/1753325657 >> v1:172.21.15.161:6789/0 conn(0x7fef600caec0 legacy=0x7fef600ce6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:59.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:59.126+0000 7fef5ffff700 1 -- 172.21.15.84:0/1753325657 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef6006ddf0 con 0x7fef60071410 2023-09-13T08:25:59.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:59.126+0000 7fef5ffff700 1 --2- 172.21.15.84:0/1753325657 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fef60071410 0x7fef6006e3b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fef540098f0 tx=0x7fef54009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27d1c903dc835d4 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:59.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:59.126+0000 7fef5effd700 1 -- 172.21.15.84:0/1753325657 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef54011830 con 0x7fef60071410 2023-09-13T08:25:59.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:59.126+0000 7fef5effd700 1 -- 172.21.15.84:0/1753325657 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef54011990 con 0x7fef60071410 2023-09-13T08:25:59.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:59.126+0000 7fef5effd700 1 -- 172.21.15.84:0/1753325657 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef54011d20 con 0x7fef60071410 2023-09-13T08:25:59.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:59.126+0000 7fef66498700 1 -- 172.21.15.84:0/1753325657 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fef60071410 msgr2=0x7fef6006e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:59.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:59.126+0000 7fef66498700 1 --2- 172.21.15.84:0/1753325657 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fef60071410 0x7fef6006e3b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fef540098f0 tx=0x7fef54009c00 comp rx=0 tx=0).stop 2023-09-13T08:25:59.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:59.126+0000 7fef66498700 1 -- 172.21.15.84:0/1753325657 shutdown_connections 2023-09-13T08:25:59.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:59.126+0000 7fef66498700 1 --2- 172.21.15.84:0/1753325657 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fef60071410 0x7fef6006e3b0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:59.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:59.126+0000 7fef66498700 1 --2- 172.21.15.84:0/1753325657 >> v2:172.21.15.161:3300/0 conn(0x7fef6006e9a0 0x7fef600717f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:59.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:59.126+0000 7fef66498700 1 -- 172.21.15.84:0/1753325657 >> 172.21.15.84:0/1753325657 conn(0x7fef600d00d0 msgr2=0x7fef600d04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:25:59.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:59.127+0000 7fef66498700 1 -- 172.21.15.84:0/1753325657 shutdown_connections 2023-09-13T08:25:59.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:59.127+0000 7fef66498700 1 -- 172.21.15.84:0/1753325657 wait complete. 2023-09-13T08:25:59.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:59.128+0000 7fef66498700 1 Processor -- start 2023-09-13T08:25:59.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:59.128+0000 7fef66498700 1 -- start start 2023-09-13T08:25:59.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:59.129+0000 7fef66498700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fef6006e9a0 0x7fef600b1460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:59.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:59.129+0000 7fef66498700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef60071410 0x7fef601512b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:59.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:59.129+0000 7fef66498700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fef600caec0 0x7fef60166320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:59.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:59.129+0000 7fef66498700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef60166860 con 0x7fef60071410 2023-09-13T08:25:59.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:59.129+0000 7fef66498700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef601676a0 con 0x7fef6006e9a0 2023-09-13T08:25:59.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:59.129+0000 7fef66498700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef60166a90 con 0x7fef600caec0 2023-09-13T08:25:59.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:59.129+0000 7fef5f7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef60071410 0x7fef601512b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:59.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:59.129+0000 7fef5f7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef60071410 0x7fef601512b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45728/0 (socket says 172.21.15.84:45728) 2023-09-13T08:25:59.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:59.129+0000 7fef5f7fe700 1 -- 172.21.15.84:0/3037078959 learned_addr learned my addr 172.21.15.84:0/3037078959 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:25:59.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:59.129+0000 7fef5ffff700 1 --2- 172.21.15.84:0/3037078959 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fef6006e9a0 0x7fef600b1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:59.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:59.129+0000 7fef64a35700 1 --2- 172.21.15.84:0/3037078959 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fef600caec0 0x7fef60166320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:59.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:59.129+0000 7fef5f7fe700 1 -- 172.21.15.84:0/3037078959 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fef600caec0 msgr2=0x7fef60166320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:59.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:59.129+0000 7fef5f7fe700 1 --2- 172.21.15.84:0/3037078959 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fef600caec0 0x7fef60166320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:59.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:59.129+0000 7fef5f7fe700 1 -- 172.21.15.84:0/3037078959 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fef6006e9a0 msgr2=0x7fef600b1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:25:59.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:59.129+0000 7fef5f7fe700 1 --2- 172.21.15.84:0/3037078959 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fef6006e9a0 0x7fef600b1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:25:59.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:59.129+0000 7fef5f7fe700 1 -- 172.21.15.84:0/3037078959 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef54009550 con 0x7fef60071410 2023-09-13T08:25:59.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:59.129+0000 7fef5ffff700 1 --2- 172.21.15.84:0/3037078959 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fef6006e9a0 0x7fef600b1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T08:25:59.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:59.129+0000 7fef5f7fe700 1 --2- 172.21.15.84:0/3037078959 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef60071410 0x7fef601512b0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fef5000e840 tx=0x7fef5000ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:59.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:59.129+0000 7fef5cff9700 1 -- 172.21.15.84:0/3037078959 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef50009590 con 0x7fef60071410 2023-09-13T08:25:59.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:59.129+0000 7fef5cff9700 1 -- 172.21.15.84:0/3037078959 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef50013680 con 0x7fef60071410 2023-09-13T08:25:59.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:59.129+0000 7fef66498700 1 -- 172.21.15.84:0/3037078959 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef60166d70 con 0x7fef60071410 2023-09-13T08:25:59.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:59.129+0000 7fef5cff9700 1 -- 172.21.15.84:0/3037078959 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef50013a30 con 0x7fef60071410 2023-09-13T08:25:59.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:59.129+0000 7fef66498700 1 -- 172.21.15.84:0/3037078959 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef60167330 con 0x7fef60071410 2023-09-13T08:25:59.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:59.130+0000 7fef66498700 1 -- 172.21.15.84:0/3037078959 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef60167810 con 0x7fef60071410 2023-09-13T08:25:59.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:59.131+0000 7fef5cff9700 1 -- 172.21.15.84:0/3037078959 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fef50013b90 con 0x7fef60071410 2023-09-13T08:25:59.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:59.131+0000 7fef5cff9700 1 --2- 172.21.15.84:0/3037078959 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fef4c06a580 0x7fef4c06ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:25:59.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:59.131+0000 7fef5cff9700 1 -- 172.21.15.84:0/3037078959 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fef500886c0 con 0x7fef60071410 2023-09-13T08:25:59.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:59.131+0000 7fef5ffff700 1 --2- 172.21.15.84:0/3037078959 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fef4c06a580 0x7fef4c06ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:25:59.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:59.131+0000 7fef5ffff700 1 --2- 172.21.15.84:0/3037078959 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fef4c06a580 0x7fef4c06ca40 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fef54009c40 tx=0x7fef54008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:25:59.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:59.135+0000 7fef5cff9700 1 -- 172.21.15.84:0/3037078959 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fef50053ee0 con 0x7fef60071410 2023-09-13T08:25:59.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:25:59.328+0000 7fef66498700 1 -- 172.21.15.84:0/3037078959 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fef6004e9b0 con 0x7fef60071410 2023-09-13T08:26:00.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:00.027+0000 7fef5cff9700 1 -- 172.21.15.84:0/3037078959 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v35) v1 ==== 138+0+0 (secure 0 0 0) 0x7fef50057500 con 0x7fef60071410 2023-09-13T08:26:00.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:00.030+0000 7fef66498700 1 -- 172.21.15.84:0/3037078959 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fef4c06a580 msgr2=0x7fef4c06ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:00.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:00.030+0000 7fef66498700 1 --2- 172.21.15.84:0/3037078959 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fef4c06a580 0x7fef4c06ca40 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fef54009c40 tx=0x7fef54008030 comp rx=0 tx=0).stop 2023-09-13T08:26:00.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:00.030+0000 7fef66498700 1 -- 172.21.15.84:0/3037078959 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef60071410 msgr2=0x7fef601512b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:00.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:00.030+0000 7fef66498700 1 --2- 172.21.15.84:0/3037078959 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef60071410 0x7fef601512b0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fef5000e840 tx=0x7fef5000ec00 comp rx=0 tx=0).stop 2023-09-13T08:26:00.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:00.030+0000 7fef66498700 1 -- 172.21.15.84:0/3037078959 shutdown_connections 2023-09-13T08:26:00.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:00.030+0000 7fef66498700 1 --2- 172.21.15.84:0/3037078959 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fef600caec0 0x7fef60166320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:00.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:00.030+0000 7fef66498700 1 --2- 172.21.15.84:0/3037078959 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fef4c06a580 0x7fef4c06ca40 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:00.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:00.030+0000 7fef66498700 1 --2- 172.21.15.84:0/3037078959 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fef6006e9a0 0x7fef600b1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:00.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:00.030+0000 7fef66498700 1 --2- 172.21.15.84:0/3037078959 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef60071410 0x7fef601512b0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:00.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:00.031+0000 7fef66498700 1 -- 172.21.15.84:0/3037078959 >> 172.21.15.84:0/3037078959 conn(0x7fef600d00d0 msgr2=0x7fef600cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:26:00.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:00.031+0000 7fef66498700 1 -- 172.21.15.84:0/3037078959 shutdown_connections 2023-09-13T08:26:00.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:00.031+0000 7fef66498700 1 -- 172.21.15.84:0/3037078959 wait complete. 2023-09-13T08:26:00.034 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_metadata' created 2023-09-13T08:26:00.048 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-09-13T08:26:00.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:00.181+0000 7fa80d1d5700 1 Processor -- start 2023-09-13T08:26:00.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:00.181+0000 7fa80d1d5700 1 -- start start 2023-09-13T08:26:00.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:00.182+0000 7fa80d1d5700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa8080ced40 0x7fa8080cda40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:00.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:00.182+0000 7fa80d1d5700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa8080cdf80 0x7fa80815f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:00.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:00.182+0000 7fa80d1d5700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8080cd170 con 0x7fa80815ea00 2023-09-13T08:26:00.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:00.182+0000 7fa80d1d5700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8080ce410 con 0x7fa8080ced40 2023-09-13T08:26:00.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:00.182+0000 7fa80d1d5700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8080cc8d0 con 0x7fa8080cdf80 2023-09-13T08:26:00.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:00.182+0000 7fa80659c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa8080ced40 0x7fa8080cda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:00.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:00.182+0000 7fa80659c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa8080ced40 0x7fa8080cda40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45736/0 (socket says 172.21.15.84:45736) 2023-09-13T08:26:00.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:00.182+0000 7fa80659c700 1 -- 172.21.15.84:0/3556033856 learned_addr learned my addr 172.21.15.84:0/3556033856 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:26:00.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:00.182+0000 7fa806d9d700 1 --1- 172.21.15.84:0/3556033856 >> v1:172.21.15.84:6789/0 conn(0x7fa80815ea00 0x7fa8080cbd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:48380/0 (socket says 172.21.15.84:48380) 2023-09-13T08:26:00.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:00.182+0000 7fa80659c700 1 -- 172.21.15.84:0/3556033856 >> v2:172.21.15.161:3300/0 conn(0x7fa8080cdf80 msgr2=0x7fa80815f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:26:00.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:00.182+0000 7fa80659c700 1 --2- 172.21.15.84:0/3556033856 >> v2:172.21.15.161:3300/0 conn(0x7fa8080cdf80 0x7fa80815f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:00.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:00.182+0000 7fa80659c700 1 -- 172.21.15.84:0/3556033856 >> v1:172.21.15.84:6789/0 conn(0x7fa80815ea00 legacy=0x7fa8080cbd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:00.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:00.182+0000 7fa80659c700 1 -- 172.21.15.84:0/3556033856 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8080ccbb0 con 0x7fa8080ced40 2023-09-13T08:26:00.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:00.182+0000 7fa805d9b700 1 -- 172.21.15.84:0/3556033856 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1526957534 0 0) 0x7fa8080cd170 con 0x7fa80815ea00 2023-09-13T08:26:00.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:00.183+0000 7fa80659c700 1 --2- 172.21.15.84:0/3556033856 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8080ced40 0x7fa8080cda40 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fa8080cb850 tx=0x7fa7fc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8c9036bc6de0bf4 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:26:00.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:00.183+0000 7fa805d9b700 1 -- 172.21.15.84:0/3556033856 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7fc00b870 con 0x7fa8080ced40 2023-09-13T08:26:00.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:00.183+0000 7fa805d9b700 1 -- 172.21.15.84:0/3556033856 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7fc00b9d0 con 0x7fa8080ced40 2023-09-13T08:26:00.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:00.183+0000 7fa805d9b700 1 -- 172.21.15.84:0/3556033856 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7fc00bd60 con 0x7fa8080ced40 2023-09-13T08:26:00.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:00.183+0000 7fa80d1d5700 1 -- 172.21.15.84:0/3556033856 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8080ced40 msgr2=0x7fa8080cda40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:00.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:00.183+0000 7fa80d1d5700 1 --2- 172.21.15.84:0/3556033856 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8080ced40 0x7fa8080cda40 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fa8080cb850 tx=0x7fa7fc009bd0 comp rx=0 tx=0).stop 2023-09-13T08:26:00.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:00.183+0000 7fa80d1d5700 1 -- 172.21.15.84:0/3556033856 shutdown_connections 2023-09-13T08:26:00.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:00.183+0000 7fa80d1d5700 1 --2- 172.21.15.84:0/3556033856 >> v2:172.21.15.161:3300/0 conn(0x7fa8080cdf80 0x7fa80815f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:00.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:00.183+0000 7fa80d1d5700 1 --2- 172.21.15.84:0/3556033856 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8080ced40 0x7fa8080cda40 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:00.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:00.183+0000 7fa80d1d5700 1 -- 172.21.15.84:0/3556033856 >> 172.21.15.84:0/3556033856 conn(0x7fa80809a470 msgr2=0x7fa8080d1170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:26:00.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:00.183+0000 7fa80d1d5700 1 -- 172.21.15.84:0/3556033856 shutdown_connections 2023-09-13T08:26:00.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:00.183+0000 7fa80d1d5700 1 -- 172.21.15.84:0/3556033856 wait complete. 2023-09-13T08:26:00.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:00.185+0000 7fa80d1d5700 1 Processor -- start 2023-09-13T08:26:00.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:00.185+0000 7fa80d1d5700 1 -- start start 2023-09-13T08:26:00.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:00.186+0000 7fa80d1d5700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa8080cdf80 0x7fa8081f1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:00.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:00.186+0000 7fa80d1d5700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8080ced40 0x7fa8080b6550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:00.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:00.186+0000 7fa80d1d5700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa80815ea00 0x7fa8080b6a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:00.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:00.186+0000 7fa80d1d5700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa80815cee0 con 0x7fa8080ced40 2023-09-13T08:26:00.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:00.186+0000 7fa80d1d5700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8081f10f0 con 0x7fa80815ea00 2023-09-13T08:26:00.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:00.186+0000 7fa80d1d5700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa80815bff0 con 0x7fa8080cdf80 2023-09-13T08:26:00.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:00.186+0000 7fa80659c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8080ced40 0x7fa8080b6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:00.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:00.186+0000 7fa80659c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8080ced40 0x7fa8080b6550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45742/0 (socket says 172.21.15.84:45742) 2023-09-13T08:26:00.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:00.186+0000 7fa80659c700 1 -- 172.21.15.84:0/2025663719 learned_addr learned my addr 172.21.15.84:0/2025663719 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:26:00.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:00.186+0000 7fa80759e700 1 --2- 172.21.15.84:0/2025663719 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa80815ea00 0x7fa8080b6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:00.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:00.187+0000 7fa806d9d700 1 --2- 172.21.15.84:0/2025663719 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa8080cdf80 0x7fa8081f1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:00.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:00.187+0000 7fa80659c700 1 -- 172.21.15.84:0/2025663719 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa8080cdf80 msgr2=0x7fa8081f1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:00.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:00.187+0000 7fa80659c700 1 --2- 172.21.15.84:0/2025663719 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa8080cdf80 0x7fa8081f1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:00.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:00.187+0000 7fa80659c700 1 -- 172.21.15.84:0/2025663719 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa80815ea00 msgr2=0x7fa8080b6a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:00.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:00.187+0000 7fa80659c700 1 --2- 172.21.15.84:0/2025663719 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa80815ea00 0x7fa8080b6a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:00.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:00.187+0000 7fa80659c700 1 -- 172.21.15.84:0/2025663719 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7fc009550 con 0x7fa8080ced40 2023-09-13T08:26:00.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:00.187+0000 7fa806d9d700 1 --2- 172.21.15.84:0/2025663719 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa8080cdf80 0x7fa8081f1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T08:26:00.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:00.187+0000 7fa80659c700 1 --2- 172.21.15.84:0/2025663719 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8080ced40 0x7fa8080b6550 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc000c00 tx=0x7fa7fc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:26:00.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:00.187+0000 7fa7ef7fe700 1 -- 172.21.15.84:0/2025663719 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7fc004500 con 0x7fa8080ced40 2023-09-13T08:26:00.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:00.187+0000 7fa7ef7fe700 1 -- 172.21.15.84:0/2025663719 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7fc0036a0 con 0x7fa8080ced40 2023-09-13T08:26:00.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:00.187+0000 7fa80d1d5700 1 -- 172.21.15.84:0/2025663719 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa80815c2d0 con 0x7fa8080ced40 2023-09-13T08:26:00.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:00.187+0000 7fa7ef7fe700 1 -- 172.21.15.84:0/2025663719 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7fc003a30 con 0x7fa8080ced40 2023-09-13T08:26:00.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:00.187+0000 7fa80d1d5700 1 -- 172.21.15.84:0/2025663719 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa80815c890 con 0x7fa8080ced40 2023-09-13T08:26:00.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:00.188+0000 7fa80d1d5700 1 -- 172.21.15.84:0/2025663719 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa80815d050 con 0x7fa8080ced40 2023-09-13T08:26:00.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:00.188+0000 7fa7ef7fe700 1 -- 172.21.15.84:0/2025663719 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fa7fc003b90 con 0x7fa8080ced40 2023-09-13T08:26:00.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:00.189+0000 7fa7ef7fe700 1 --2- 172.21.15.84:0/2025663719 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fa7f406a580 0x7fa7f406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:00.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:00.189+0000 7fa7ef7fe700 1 -- 172.21.15.84:0/2025663719 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5547+0+0 (secure 0 0 0) 0x7fa7fc08a070 con 0x7fa8080ced40 2023-09-13T08:26:00.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:00.189+0000 7fa806d9d700 1 --2- 172.21.15.84:0/2025663719 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fa7f406a580 0x7fa7f406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:00.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:00.189+0000 7fa806d9d700 1 --2- 172.21.15.84:0/2025663719 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fa7f406a580 0x7fa7f406ca40 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa808159b40 tx=0x7fa7f8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:26:00.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:00.193+0000 7fa7ef7fe700 1 -- 172.21.15.84:0/2025663719 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fa7fc0556a0 con 0x7fa8080ced40 2023-09-13T08:26:00.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:00.382+0000 7fa80d1d5700 1 -- 172.21.15.84:0/2025663719 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fa8080b0a40 con 0x7fa8080ced40 2023-09-13T08:26:01.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:01.036+0000 7fa7ef7fe700 1 -- 172.21.15.84:0/2025663719 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v36) v1 ==== 170+0+0 (secure 0 0 0) 0x7fa7fc058cc0 con 0x7fa8080ced40 2023-09-13T08:26:01.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:01.040+0000 7fa80d1d5700 1 -- 172.21.15.84:0/2025663719 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fa7f406a580 msgr2=0x7fa7f406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:01.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:01.040+0000 7fa80d1d5700 1 --2- 172.21.15.84:0/2025663719 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fa7f406a580 0x7fa7f406ca40 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa808159b40 tx=0x7fa7f8009040 comp rx=0 tx=0).stop 2023-09-13T08:26:01.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:01.040+0000 7fa80d1d5700 1 -- 172.21.15.84:0/2025663719 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8080ced40 msgr2=0x7fa8080b6550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:01.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:01.040+0000 7fa80d1d5700 1 --2- 172.21.15.84:0/2025663719 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8080ced40 0x7fa8080b6550 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc000c00 tx=0x7fa7fc004750 comp rx=0 tx=0).stop 2023-09-13T08:26:01.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:01.040+0000 7fa80d1d5700 1 -- 172.21.15.84:0/2025663719 shutdown_connections 2023-09-13T08:26:01.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:01.040+0000 7fa80d1d5700 1 --2- 172.21.15.84:0/2025663719 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fa7f406a580 0x7fa7f406ca40 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:01.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:01.040+0000 7fa80d1d5700 1 --2- 172.21.15.84:0/2025663719 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa80815ea00 0x7fa8080b6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:01.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:01.040+0000 7fa80d1d5700 1 --2- 172.21.15.84:0/2025663719 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa8080cdf80 0x7fa8081f1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:01.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:01.040+0000 7fa80d1d5700 1 --2- 172.21.15.84:0/2025663719 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8080ced40 0x7fa8080b6550 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:01.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:01.040+0000 7fa80d1d5700 1 -- 172.21.15.84:0/2025663719 >> 172.21.15.84:0/2025663719 conn(0x7fa80809a470 msgr2=0x7fa8080cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:26:01.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:01.041+0000 7fa80d1d5700 1 -- 172.21.15.84:0/2025663719 shutdown_connections 2023-09-13T08:26:01.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:01.041+0000 7fa80d1d5700 1 -- 172.21.15.84:0/2025663719 wait complete. 2023-09-13T08:26:01.043 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_data' created 2023-09-13T08:26:01.064 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-09-13T08:26:01.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:01.192+0000 7f7378da3700 1 Processor -- start 2023-09-13T08:26:01.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:01.192+0000 7f7378da3700 1 -- start start 2023-09-13T08:26:01.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:01.193+0000 7f7378da3700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f737415ea00 0x7f73740cbd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:01.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:01.193+0000 7f7378da3700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73740cd170 con 0x7f73740ced40 2023-09-13T08:26:01.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:01.193+0000 7f7378da3700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73740cc8d0 con 0x7f73740ce150 2023-09-13T08:26:01.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:01.193+0000 7f7378da3700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73740ccbb0 con 0x7f737415ea00 2023-09-13T08:26:01.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:01.193+0000 7f7371d9b700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f73740ced40 0x7f73740cda40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:48396/0 (socket says 172.21.15.84:48396) 2023-09-13T08:26:01.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:01.193+0000 7f7371d9b700 1 -- 172.21.15.84:0/1280949226 learned_addr learned my addr 172.21.15.84:0/1280949226 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:26:01.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:01.193+0000 7f737259c700 1 --2- 172.21.15.84:0/1280949226 >> v2:172.21.15.161:3300/0 conn(0x7f737415ea00 0x7f73740cbd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:01.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:01.193+0000 7f737159a700 1 -- 172.21.15.84:0/1280949226 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3476266933 0 0) 0x7f73740cd170 con 0x7f73740ced40 2023-09-13T08:26:01.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:01.193+0000 7f737159a700 1 -- 172.21.15.84:0/1280949226 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f735c0035b0 con 0x7f73740ced40 2023-09-13T08:26:01.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:01.193+0000 7f737159a700 1 -- 172.21.15.84:0/1280949226 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1672012573 0 0) 0x7f735c0035b0 con 0x7f73740ced40 2023-09-13T08:26:01.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:01.193+0000 7f737159a700 1 -- 172.21.15.84:0/1280949226 >> v2:172.21.15.161:3300/0 conn(0x7f737415ea00 msgr2=0x7f73740cbd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:26:01.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:01.193+0000 7f737159a700 1 --2- 172.21.15.84:0/1280949226 >> v2:172.21.15.161:3300/0 conn(0x7f737415ea00 0x7f73740cbd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:01.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:01.193+0000 7f737159a700 1 -- 172.21.15.84:0/1280949226 >> v1:172.21.15.161:6789/0 conn(0x7f73740ce150 legacy=0x7f737415f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:01.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:01.193+0000 7f737159a700 1 -- 172.21.15.84:0/1280949226 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73740cce90 con 0x7f73740ced40 2023-09-13T08:26:01.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:01.193+0000 7f737159a700 1 -- 172.21.15.84:0/1280949226 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2302733408 0 0) 0x7f7368001670 con 0x7f73740ced40 2023-09-13T08:26:01.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:01.194+0000 7f737159a700 1 -- 172.21.15.84:0/1280949226 >> v1:172.21.15.84:6789/0 conn(0x7f73740ced40 legacy=0x7f73740cda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:01.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:01.194+0000 7f737159a700 1 --2- 172.21.15.84:0/1280949226 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f735c003a00 0x7f735c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:01.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:01.194+0000 7f737159a700 1 --2- 172.21.15.84:0/1280949226 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f735c004850 0x7f735c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:01.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:01.194+0000 7f737159a700 1 --2- 172.21.15.84:0/1280949226 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f735c005210 0x7f735c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:01.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:01.194+0000 7f737159a700 1 -- 172.21.15.84:0/1280949226 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73740ccbb0 con 0x7f735c004850 2023-09-13T08:26:01.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:01.194+0000 7f737159a700 1 -- 172.21.15.84:0/1280949226 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f735c00c1b0 con 0x7f735c003a00 2023-09-13T08:26:01.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:01.194+0000 7f737159a700 1 -- 172.21.15.84:0/1280949226 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f735c00c370 con 0x7f735c005210 2023-09-13T08:26:01.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:01.194+0000 7f7371d9b700 1 --2- 172.21.15.84:0/1280949226 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f735c004850 0x7f735c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:01.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:01.194+0000 7f737259c700 1 --2- 172.21.15.84:0/1280949226 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f735c003a00 0x7f735c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:01.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:01.194+0000 7f7372d9d700 1 --2- 172.21.15.84:0/1280949226 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f735c005210 0x7f735c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:01.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:01.194+0000 7f7371d9b700 1 -- 172.21.15.84:0/1280949226 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f735c005210 msgr2=0x7f735c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:26:01.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:01.194+0000 7f7371d9b700 1 --2- 172.21.15.84:0/1280949226 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f735c005210 0x7f735c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:01.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:01.194+0000 7f7371d9b700 1 -- 172.21.15.84:0/1280949226 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f735c003a00 msgr2=0x7f735c003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:26:01.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:01.194+0000 7f7371d9b700 1 --2- 172.21.15.84:0/1280949226 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f735c003a00 0x7f735c003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:01.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:01.194+0000 7f7371d9b700 1 -- 172.21.15.84:0/1280949226 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f735c0035b0 con 0x7f735c004850 2023-09-13T08:26:01.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:01.194+0000 7f7372d9d700 1 -- 172.21.15.84:0/1280949226 reap_dead start 2023-09-13T08:26:01.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:01.194+0000 7f7371d9b700 1 --2- 172.21.15.84:0/1280949226 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f735c004850 0x7f735c004cd0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f736800c240 tx=0x7f735c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94a5c96bce0122f server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:26:01.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:01.194+0000 7f737159a700 1 -- 172.21.15.84:0/1280949226 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7368007c10 con 0x7f735c004850 2023-09-13T08:26:01.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:01.194+0000 7f737159a700 1 -- 172.21.15.84:0/1280949226 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f736800cde0 con 0x7f735c004850 2023-09-13T08:26:01.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:01.194+0000 7f737159a700 1 -- 172.21.15.84:0/1280949226 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7368005ba0 con 0x7f735c004850 2023-09-13T08:26:01.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:01.195+0000 7f7378da3700 1 -- 172.21.15.84:0/1280949226 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f735c004850 msgr2=0x7f735c004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:01.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:01.195+0000 7f7378da3700 1 --2- 172.21.15.84:0/1280949226 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f735c004850 0x7f735c004cd0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f736800c240 tx=0x7f735c005880 comp rx=0 tx=0).stop 2023-09-13T08:26:01.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:01.195+0000 7f7378da3700 1 -- 172.21.15.84:0/1280949226 shutdown_connections 2023-09-13T08:26:01.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:01.195+0000 7f7378da3700 1 --2- 172.21.15.84:0/1280949226 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f735c004850 0x7f735c004cd0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:01.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:01.195+0000 7f7378da3700 1 -- 172.21.15.84:0/1280949226 >> 172.21.15.84:0/1280949226 conn(0x7f737409a470 msgr2=0x7f73740d1170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:26:01.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:01.195+0000 7f7378da3700 1 -- 172.21.15.84:0/1280949226 shutdown_connections 2023-09-13T08:26:01.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:01.195+0000 7f7378da3700 1 -- 172.21.15.84:0/1280949226 wait complete. 2023-09-13T08:26:01.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:01.196+0000 7f7378da3700 1 Processor -- start 2023-09-13T08:26:01.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:01.196+0000 7f7378da3700 1 -- start start 2023-09-13T08:26:01.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:01.197+0000 7f7378da3700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f735c004850 0x7f73740b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:01.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:01.197+0000 7f7378da3700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73740c6a50 0x7f73740b2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:01.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:01.197+0000 7f7378da3700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f737415c260 0x7f73741580e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:01.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:01.197+0000 7f7378da3700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73740b53e0 con 0x7f73740c6a50 2023-09-13T08:26:01.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:01.197+0000 7f7378da3700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f737415cbd0 con 0x7f735c004850 2023-09-13T08:26:01.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:01.197+0000 7f7378da3700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f737415ceb0 con 0x7f737415c260 2023-09-13T08:26:01.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:01.197+0000 7f7371d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73740c6a50 0x7f73740b2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:01.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:01.197+0000 7f7371d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73740c6a50 0x7f73740b2c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45762/0 (socket says 172.21.15.84:45762) 2023-09-13T08:26:01.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:01.197+0000 7f7371d9b700 1 -- 172.21.15.84:0/2825121877 learned_addr learned my addr 172.21.15.84:0/2825121877 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:26:01.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:01.197+0000 7f737259c700 1 --2- 172.21.15.84:0/2825121877 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f735c004850 0x7f73740b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:01.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:01.197+0000 7f7372d9d700 1 --2- 172.21.15.84:0/2825121877 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f737415c260 0x7f73741580e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:01.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:01.197+0000 7f7371d9b700 1 -- 172.21.15.84:0/2825121877 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f737415c260 msgr2=0x7f73741580e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:01.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:01.197+0000 7f7371d9b700 1 --2- 172.21.15.84:0/2825121877 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f737415c260 0x7f73741580e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:01.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:01.197+0000 7f7371d9b700 1 -- 172.21.15.84:0/2825121877 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f735c004850 msgr2=0x7f73740b4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:01.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:01.197+0000 7f7371d9b700 1 --2- 172.21.15.84:0/2825121877 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f735c004850 0x7f73740b4ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:01.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:01.197+0000 7f7371d9b700 1 -- 172.21.15.84:0/2825121877 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f737415d190 con 0x7f73740c6a50 2023-09-13T08:26:01.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:01.197+0000 7f737259c700 1 --2- 172.21.15.84:0/2825121877 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f735c004850 0x7f73740b4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T08:26:01.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:01.197+0000 7f7371d9b700 1 --2- 172.21.15.84:0/2825121877 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73740c6a50 0x7f73740b2c70 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f735c00c180 tx=0x7f7368001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:26:01.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:01.198+0000 7f7362ffd700 1 -- 172.21.15.84:0/2825121877 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7368001640 con 0x7f73740c6a50 2023-09-13T08:26:01.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:01.198+0000 7f7362ffd700 1 -- 172.21.15.84:0/2825121877 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73680070d0 con 0x7f73740c6a50 2023-09-13T08:26:01.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:01.198+0000 7f7362ffd700 1 -- 172.21.15.84:0/2825121877 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7368007440 con 0x7f73740c6a50 2023-09-13T08:26:01.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:01.198+0000 7f7378da3700 1 -- 172.21.15.84:0/2825121877 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f737415d470 con 0x7f73740c6a50 2023-09-13T08:26:01.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:01.198+0000 7f7378da3700 1 -- 172.21.15.84:0/2825121877 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73740b31b0 con 0x7f73740c6a50 2023-09-13T08:26:01.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:01.199+0000 7f7378da3700 1 -- 172.21.15.84:0/2825121877 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f737415aa30 con 0x7f73740c6a50 2023-09-13T08:26:01.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:01.199+0000 7f7362ffd700 1 -- 172.21.15.84:0/2825121877 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f73680075a0 con 0x7f73740c6a50 2023-09-13T08:26:01.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:01.199+0000 7f7362ffd700 1 --2- 172.21.15.84:0/2825121877 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f735406a580 0x7f735406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:01.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:01.199+0000 7f7362ffd700 1 -- 172.21.15.84:0/2825121877 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5929+0+0 (secure 0 0 0) 0x7f7368089b20 con 0x7f73740c6a50 2023-09-13T08:26:01.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:01.199+0000 7f737259c700 1 --2- 172.21.15.84:0/2825121877 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f735406a580 0x7f735406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:01.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:01.200+0000 7f737259c700 1 --2- 172.21.15.84:0/2825121877 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f735406a580 0x7f735406ca40 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f73740b3970 tx=0x7f7364008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:26:01.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:01.204+0000 7f7362ffd700 1 -- 172.21.15.84:0/2825121877 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f737415aa30 con 0x7f73740c6a50 2023-09-13T08:26:01.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:01.436+0000 7f7378da3700 1 -- 172.21.15.84:0/2825121877 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f737415aa30 con 0x7f73740c6a50 2023-09-13T08:26:02.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.036+0000 7f7362ffd700 1 -- 172.21.15.84:0/2825121877 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7f737415aa30 con 0x7f73740c6a50 2023-09-13T08:26:02.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.038+0000 7f7378da3700 1 -- 172.21.15.84:0/2825121877 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f735406a580 msgr2=0x7f735406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:02.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.038+0000 7f7378da3700 1 --2- 172.21.15.84:0/2825121877 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f735406a580 0x7f735406ca40 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f73740b3970 tx=0x7f7364008040 comp rx=0 tx=0).stop 2023-09-13T08:26:02.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.038+0000 7f7378da3700 1 -- 172.21.15.84:0/2825121877 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73740c6a50 msgr2=0x7f73740b2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:02.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.038+0000 7f7378da3700 1 --2- 172.21.15.84:0/2825121877 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73740c6a50 0x7f73740b2c70 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f735c00c180 tx=0x7f7368001a00 comp rx=0 tx=0).stop 2023-09-13T08:26:02.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.038+0000 7f7378da3700 1 -- 172.21.15.84:0/2825121877 shutdown_connections 2023-09-13T08:26:02.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.038+0000 7f7378da3700 1 --2- 172.21.15.84:0/2825121877 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f737415c260 0x7f73741580e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:02.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.038+0000 7f7378da3700 1 --2- 172.21.15.84:0/2825121877 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f735406a580 0x7f735406ca40 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:02.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.038+0000 7f7378da3700 1 --2- 172.21.15.84:0/2825121877 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f735c004850 0x7f73740b4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:02.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.038+0000 7f7378da3700 1 --2- 172.21.15.84:0/2825121877 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73740c6a50 0x7f73740b2c70 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:02.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.038+0000 7f7378da3700 1 -- 172.21.15.84:0/2825121877 >> 172.21.15.84:0/2825121877 conn(0x7f737409a470 msgr2=0x7f73740cfe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:26:02.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.038+0000 7f7378da3700 1 -- 172.21.15.84:0/2825121877 shutdown_connections 2023-09-13T08:26:02.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.038+0000 7f7378da3700 1 -- 172.21.15.84:0/2825121877 wait complete. 2023-09-13T08:26:02.042 INFO:teuthology.orchestra.run.smithi084.stderr:new fs with metadata pool 5 and data pool 6 2023-09-13T08:26:02.054 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T08:26:02.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.176+0000 7f564c6f7700 1 Processor -- start 2023-09-13T08:26:02.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.176+0000 7f564c6f7700 1 -- start start 2023-09-13T08:26:02.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.177+0000 7f564c6f7700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f56440cdcd0 0x7f56440b0050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:02.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.177+0000 7f564c6f7700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f564406cfb0 0x7f56440d1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:02.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.177+0000 7f564c6f7700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f564406cb20 con 0x7f56440ce0b0 2023-09-13T08:26:02.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.177+0000 7f564c6f7700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f564406c7f0 con 0x7f56440cdcd0 2023-09-13T08:26:02.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.177+0000 7f564c6f7700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56440cfb20 con 0x7f564406cfb0 2023-09-13T08:26:02.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.178+0000 7f564a493700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f56440cdcd0 0x7f56440b0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:02.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.178+0000 7f5649c92700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f564406cfb0 0x7f56440d1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:02.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.178+0000 7f564a493700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f56440cdcd0 0x7f56440b0050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.84:41540/0 (socket says 172.21.15.84:41540) 2023-09-13T08:26:02.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.178+0000 7f5649c92700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f564406cfb0 0x7f56440d1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.84:55632/0 (socket says 172.21.15.84:55632) 2023-09-13T08:26:02.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.178+0000 7f564a493700 1 -- 172.21.15.84:0/809636085 learned_addr learned my addr 172.21.15.84:0/809636085 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:26:02.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.178+0000 7f564a493700 1 -- 172.21.15.84:0/809636085 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f564406cfb0 msgr2=0x7f56440d1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:26:02.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.178+0000 7f564a493700 1 --2- 172.21.15.84:0/809636085 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f564406cfb0 0x7f56440d1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:02.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.178+0000 7f564a493700 1 -- 172.21.15.84:0/809636085 >> v1:172.21.15.161:6789/0 conn(0x7f56440ce0b0 legacy=0x7f56440b0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:02.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.178+0000 7f564a493700 1 -- 172.21.15.84:0/809636085 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56440cfe00 con 0x7f56440cdcd0 2023-09-13T08:26:02.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.178+0000 7f5649c92700 1 --2- 172.21.15.84:0/809636085 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f564406cfb0 0x7f56440d1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T08:26:02.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.178+0000 7f564a493700 1 --2- 172.21.15.84:0/809636085 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f56440cdcd0 0x7f56440b0050 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f56340098f0 tx=0x7f5634009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c68fef9d0d5fdd6 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:26:02.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.178+0000 7f5649491700 1 -- 172.21.15.84:0/809636085 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5634011830 con 0x7f56440cdcd0 2023-09-13T08:26:02.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.178+0000 7f5649491700 1 -- 172.21.15.84:0/809636085 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5634011990 con 0x7f56440cdcd0 2023-09-13T08:26:02.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.178+0000 7f5649491700 1 -- 172.21.15.84:0/809636085 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5634011d20 con 0x7f56440cdcd0 2023-09-13T08:26:02.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.179+0000 7f564c6f7700 1 -- 172.21.15.84:0/809636085 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f56440cdcd0 msgr2=0x7f56440b0050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:02.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.179+0000 7f564c6f7700 1 --2- 172.21.15.84:0/809636085 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f56440cdcd0 0x7f56440b0050 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f56340098f0 tx=0x7f5634009c00 comp rx=0 tx=0).stop 2023-09-13T08:26:02.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.179+0000 7f564c6f7700 1 -- 172.21.15.84:0/809636085 shutdown_connections 2023-09-13T08:26:02.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.179+0000 7f564c6f7700 1 --2- 172.21.15.84:0/809636085 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f56440cdcd0 0x7f56440b0050 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:02.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.179+0000 7f564c6f7700 1 --2- 172.21.15.84:0/809636085 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f564406cfb0 0x7f56440d1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:02.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.179+0000 7f564c6f7700 1 -- 172.21.15.84:0/809636085 >> 172.21.15.84:0/809636085 conn(0x7f564409a4a0 msgr2=0x7f56440d1170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:26:02.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.179+0000 7f564c6f7700 1 -- 172.21.15.84:0/809636085 shutdown_connections 2023-09-13T08:26:02.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.179+0000 7f564c6f7700 1 -- 172.21.15.84:0/809636085 wait complete. 2023-09-13T08:26:02.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.180+0000 7f564c6f7700 1 Processor -- start 2023-09-13T08:26:02.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.180+0000 7f564c6f7700 1 -- start start 2023-09-13T08:26:02.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.181+0000 7f564c6f7700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f564406cfb0 0x7f56440c9750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:02.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.181+0000 7f564c6f7700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f56440cdcd0 0x7f5644151450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:02.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.181+0000 7f564c6f7700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f56440ce0b0 0x7f56440ca5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:02.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.181+0000 7f564c6f7700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56440c9330 con 0x7f564406cfb0 2023-09-13T08:26:02.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.181+0000 7f564c6f7700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56440c9c90 con 0x7f56440cdcd0 2023-09-13T08:26:02.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.181+0000 7f564c6f7700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56440c86b0 con 0x7f56440ce0b0 2023-09-13T08:26:02.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.181+0000 7f564a493700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f564406cfb0 0x7f56440c9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:02.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.181+0000 7f564a493700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f564406cfb0 0x7f56440c9750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45776/0 (socket says 172.21.15.84:45776) 2023-09-13T08:26:02.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.181+0000 7f564a493700 1 -- 172.21.15.84:0/764374610 learned_addr learned my addr 172.21.15.84:0/764374610 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:26:02.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.181+0000 7f5649c92700 1 --2- 172.21.15.84:0/764374610 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f56440cdcd0 0x7f5644151450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:02.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.181+0000 7f564ac94700 1 --2- 172.21.15.84:0/764374610 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f56440ce0b0 0x7f56440ca5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:02.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.181+0000 7f564a493700 1 -- 172.21.15.84:0/764374610 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f56440ce0b0 msgr2=0x7f56440ca5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:02.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.181+0000 7f564a493700 1 --2- 172.21.15.84:0/764374610 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f56440ce0b0 0x7f56440ca5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:02.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.181+0000 7f564a493700 1 -- 172.21.15.84:0/764374610 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f56440cdcd0 msgr2=0x7f5644151450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:02.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.181+0000 7f564a493700 1 --2- 172.21.15.84:0/764374610 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f56440cdcd0 0x7f5644151450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:02.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.181+0000 7f564a493700 1 -- 172.21.15.84:0/764374610 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56400094a0 con 0x7f564406cfb0 2023-09-13T08:26:02.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.181+0000 7f5649c92700 1 --2- 172.21.15.84:0/764374610 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f56440cdcd0 0x7f5644151450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T08:26:02.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.182+0000 7f564a493700 1 --2- 172.21.15.84:0/764374610 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f564406cfb0 0x7f56440c9750 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f5634000c00 tx=0x7f5634004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:26:02.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.182+0000 7f563affd700 1 -- 172.21.15.84:0/764374610 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5634004570 con 0x7f564406cfb0 2023-09-13T08:26:02.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.182+0000 7f563affd700 1 -- 172.21.15.84:0/764374610 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f563401f070 con 0x7f564406cfb0 2023-09-13T08:26:02.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.182+0000 7f564c6f7700 1 -- 172.21.15.84:0/764374610 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5634009550 con 0x7f564406cfb0 2023-09-13T08:26:02.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.182+0000 7f563affd700 1 -- 172.21.15.84:0/764374610 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56340038c0 con 0x7f564406cfb0 2023-09-13T08:26:02.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.182+0000 7f564c6f7700 1 -- 172.21.15.84:0/764374610 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56440c8c70 con 0x7f564406cfb0 2023-09-13T08:26:02.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.183+0000 7f564c6f7700 1 -- 172.21.15.84:0/764374610 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56440c9470 con 0x7f564406cfb0 2023-09-13T08:26:02.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.183+0000 7f563affd700 1 -- 172.21.15.84:0/764374610 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f5634021030 con 0x7f564406cfb0 2023-09-13T08:26:02.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.184+0000 7f563affd700 1 --2- 172.21.15.84:0/764374610 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f562806a580 0x7f562806ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:02.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.184+0000 7f5649c92700 1 --2- 172.21.15.84:0/764374610 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f562806a580 0x7f562806ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:02.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.184+0000 7f563affd700 1 -- 172.21.15.84:0/764374610 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f5634089fb0 con 0x7f564406cfb0 2023-09-13T08:26:02.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.184+0000 7f5649c92700 1 --2- 172.21.15.84:0/764374610 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f562806a580 0x7f562806ca40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f564415b090 tx=0x7f5640008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:26:02.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.188+0000 7f563affd700 1 -- 172.21.15.84:0/764374610 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f56340bc9b0 con 0x7f564406cfb0 2023-09-13T08:26:02.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.379+0000 7f564c6f7700 1 -- 172.21.15.84:0/764374610 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f56440d1170 con 0x7f564406cfb0 2023-09-13T08:26:02.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.380+0000 7f563affd700 1 -- 172.21.15.84:0/764374610 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+16763 (secure 0 0 0) 0x7f5634015090 con 0x7f564406cfb0 2023-09-13T08:26:02.380 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:26:02.381 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":37,"fsid":"0107440b-b634-42c5-a643-5d31ea826116","created":"2023-09-13T08:24:16.931917+0000","modified":"2023-09-13T08:26:01.437341+0000","last_up_change":"2023-09-13T08:24:28.422631+0000","last_in_change":"2023-09-13T08:24:19.425578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T08:24:28.583720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-09-13T08:25:59.346523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-09-13T08:26:00.400448+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4a53ec12-1469-4356-b4e1-2b8fc9b7c0f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6817","nonce":1599532366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6819","nonce":1599532366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6823","nonce":1599532366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6821","nonce":1599532366}]},"public_addr":"172.21.15.84:6817/1599532366","cluster_addr":"172.21.15.84:6819/1599532366","heartbeat_back_addr":"172.21.15.84:6823/1599532366","heartbeat_front_addr":"172.21.15.84:6821/1599532366","state":["exists","up"]},{"osd":1,"uuid":"11e964a0-b80c-4afc-bfbf-e2067969db29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6825","nonce":461860977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6827","nonce":461860977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6831","nonce":461860977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6829","nonce":461860977}]},"public_addr":"172.21.15.84:6825/461860977","cluster_addr":"172.21.15.84:6827/461860977","heartbeat_back_addr":"172.21.15.84:6831/461860977","heartbeat_front_addr":"172.21.15.84:6829/461860977","state":["exists","up"]},{"osd":2,"uuid":"3ce74529-4dd1-44c7-9576-968f5fdc0c25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6809","nonce":1168316165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6811","nonce":1168316165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6815","nonce":1168316165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6813","nonce":1168316165}]},"public_addr":"172.21.15.84:6809/1168316165","cluster_addr":"172.21.15.84:6811/1168316165","heartbeat_back_addr":"172.21.15.84:6815/1168316165","heartbeat_front_addr":"172.21.15.84:6813/1168316165","state":["exists","up"]},{"osd":3,"uuid":"460cb5c5-590a-4d06-a4d9-5bac2fdf33b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6801","nonce":1661609810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6803","nonce":1661609810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6807","nonce":1661609810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6805","nonce":1661609810}]},"public_addr":"172.21.15.84:6801/1661609810","cluster_addr":"172.21.15.84:6803/1661609810","heartbeat_back_addr":"172.21.15.84:6807/1661609810","heartbeat_front_addr":"172.21.15.84:6805/1661609810","state":["exists","up"]},{"osd":4,"uuid":"bf237dd0-3ebd-44b5-8078-24a63e00d792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6801","nonce":1303562374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6803","nonce":1303562374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6807","nonce":1303562374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6805","nonce":1303562374}]},"public_addr":"172.21.15.161:6801/1303562374","cluster_addr":"172.21.15.161:6803/1303562374","heartbeat_back_addr":"172.21.15.161:6807/1303562374","heartbeat_front_addr":"172.21.15.161:6805/1303562374","state":["exists","up"]},{"osd":5,"uuid":"e1e538e0-5844-456b-8c6e-434d3a914af1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6818","nonce":961120854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6822","nonce":961120854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6830","nonce":961120854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6826","nonce":961120854}]},"public_addr":"172.21.15.161:6818/961120854","cluster_addr":"172.21.15.161:6822/961120854","heartbeat_back_addr":"172.21.15.161:6830/961120854","heartbeat_front_addr":"172.21.15.161:6826/961120854","state":["exists","up"]},{"osd":6,"uuid":"5cb1785e-960f-4dd4-b295-9e21b2c3f875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6809","nonce":980533466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6811","nonce":980533466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6815","nonce":980533466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6813","nonce":980533466}]},"public_addr":"172.21.15.161:6809/980533466","cluster_addr":"172.21.15.161:6811/980533466","heartbeat_back_addr":"172.21.15.161:6815/980533466","heartbeat_front_addr":"172.21.15.161:6813/980533466","state":["exists","up"]},{"osd":7,"uuid":"5acb6619-e933-4b46-b1c2-60af30acb839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6817","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6819","nonce":2479691549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6821","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6823","nonce":2479691549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6829","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6831","nonce":2479691549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6825","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6827","nonce":2479691549}]},"public_addr":"172.21.15.161:6819/2479691549","cluster_addr":"172.21.15.161:6823/2479691549","heartbeat_back_addr":"172.21.15.161:6831/2479691549","heartbeat_front_addr":"172.21.15.161:6827/2479691549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.678857+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.685341+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.613603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.634940+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.564387+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.697347+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.637437+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.619397+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T08:26:02.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.382+0000 7f564c6f7700 1 -- 172.21.15.84:0/764374610 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f562806a580 msgr2=0x7f562806ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:02.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.382+0000 7f564c6f7700 1 --2- 172.21.15.84:0/764374610 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f562806a580 0x7f562806ca40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f564415b090 tx=0x7f5640008040 comp rx=0 tx=0).stop 2023-09-13T08:26:02.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.382+0000 7f564c6f7700 1 -- 172.21.15.84:0/764374610 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f564406cfb0 msgr2=0x7f56440c9750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:02.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.382+0000 7f564c6f7700 1 --2- 172.21.15.84:0/764374610 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f564406cfb0 0x7f56440c9750 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f5634000c00 tx=0x7f5634004750 comp rx=0 tx=0).stop 2023-09-13T08:26:02.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.383+0000 7f564c6f7700 1 -- 172.21.15.84:0/764374610 shutdown_connections 2023-09-13T08:26:02.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.383+0000 7f564c6f7700 1 --2- 172.21.15.84:0/764374610 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f56440ce0b0 0x7f56440ca5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:02.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.383+0000 7f564c6f7700 1 --2- 172.21.15.84:0/764374610 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f564406cfb0 0x7f56440c9750 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:02.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.383+0000 7f564c6f7700 1 --2- 172.21.15.84:0/764374610 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f562806a580 0x7f562806ca40 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:02.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.383+0000 7f564c6f7700 1 --2- 172.21.15.84:0/764374610 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f56440cdcd0 0x7f5644151450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:02.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.383+0000 7f564c6f7700 1 -- 172.21.15.84:0/764374610 >> 172.21.15.84:0/764374610 conn(0x7f564409a4a0 msgr2=0x7f56440afe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:26:02.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.383+0000 7f564c6f7700 1 -- 172.21.15.84:0/764374610 shutdown_connections 2023-09-13T08:26:02.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.383+0000 7f564c6f7700 1 -- 172.21.15.84:0/764374610 wait complete. 2023-09-13T08:26:02.395 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T08:26:02.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.515+0000 7f58a9917700 1 Processor -- start 2023-09-13T08:26:02.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.515+0000 7f58a9917700 1 -- start start 2023-09-13T08:26:02.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.516+0000 7f58a9917700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f58a4160e30 0x7f58a406bad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:02.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.516+0000 7f58a9917700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f58a40b1530 0x7f58a406c040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:02.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.516+0000 7f58a9917700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58a40b1d80 con 0x7f58a406c580 2023-09-13T08:26:02.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.516+0000 7f58a9917700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58a406ca10 con 0x7f58a4160e30 2023-09-13T08:26:02.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.516+0000 7f58a9917700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58a40b2060 con 0x7f58a40b1530 2023-09-13T08:26:02.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.516+0000 7f58a2ffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f58a4160e30 0x7f58a406bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:02.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.516+0000 7f58a2ffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f58a4160e30 0x7f58a406bad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45782/0 (socket says 172.21.15.84:45782) 2023-09-13T08:26:02.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.516+0000 7f58a2ffd700 1 -- 172.21.15.84:0/2946086853 learned_addr learned my addr 172.21.15.84:0/2946086853 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:26:02.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.516+0000 7f58a27fc700 1 --2- 172.21.15.84:0/2946086853 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f58a40b1530 0x7f58a406c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:02.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.516+0000 7f58a2ffd700 1 -- 172.21.15.84:0/2946086853 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f58a40b1530 msgr2=0x7f58a406c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:26:02.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.516+0000 7f58a2ffd700 1 --2- 172.21.15.84:0/2946086853 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f58a40b1530 0x7f58a406c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:02.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.516+0000 7f58a2ffd700 1 -- 172.21.15.84:0/2946086853 >> v1:172.21.15.161:6789/0 conn(0x7f58a406c580 legacy=0x7f58a40cf400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:26:02.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.516+0000 7f58a2ffd700 1 -- 172.21.15.84:0/2946086853 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58a40b2340 con 0x7f58a4160e30 2023-09-13T08:26:02.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.517+0000 7f58a2ffd700 1 --2- 172.21.15.84:0/2946086853 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58a4160e30 0x7f58a406bad0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f58980098f0 tx=0x7f5898009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ea45212917fe3fd server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:26:02.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.517+0000 7f58a1ffb700 1 -- 172.21.15.84:0/2946086853 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5898004230 con 0x7f58a4160e30 2023-09-13T08:26:02.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.517+0000 7f58a1ffb700 1 -- 172.21.15.84:0/2946086853 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5898004390 con 0x7f58a4160e30 2023-09-13T08:26:02.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.517+0000 7f58a1ffb700 1 -- 172.21.15.84:0/2946086853 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58980036a0 con 0x7f58a4160e30 2023-09-13T08:26:02.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.517+0000 7f58a9917700 1 -- 172.21.15.84:0/2946086853 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58a4160e30 msgr2=0x7f58a406bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:02.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.517+0000 7f58a9917700 1 --2- 172.21.15.84:0/2946086853 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58a4160e30 0x7f58a406bad0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f58980098f0 tx=0x7f5898009c00 comp rx=0 tx=0).stop 2023-09-13T08:26:02.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.517+0000 7f58a9917700 1 -- 172.21.15.84:0/2946086853 shutdown_connections 2023-09-13T08:26:02.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.517+0000 7f58a9917700 1 --2- 172.21.15.84:0/2946086853 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58a4160e30 0x7f58a406bad0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:02.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.517+0000 7f58a9917700 1 --2- 172.21.15.84:0/2946086853 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f58a40b1530 0x7f58a406c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:02.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.517+0000 7f58a9917700 1 -- 172.21.15.84:0/2946086853 >> 172.21.15.84:0/2946086853 conn(0x7f58a40d11c0 msgr2=0x7f58a40d15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:26:02.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.517+0000 7f58a9917700 1 -- 172.21.15.84:0/2946086853 shutdown_connections 2023-09-13T08:26:02.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.517+0000 7f58a9917700 1 -- 172.21.15.84:0/2946086853 wait complete. 2023-09-13T08:26:02.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.518+0000 7f58a9917700 1 Processor -- start 2023-09-13T08:26:02.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.519+0000 7f58a9917700 1 -- start start 2023-09-13T08:26:02.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.519+0000 7f58a9917700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f58a406c580 0x7f58a40b0250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:02.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.519+0000 7f58a9917700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f58a40b1530 0x7f58a41563e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:02.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.519+0000 7f58a9917700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58a4160e30 0x7f58a41e6f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:02.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.519+0000 7f58a9917700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a40af130 con 0x7f58a4160e30 2023-09-13T08:26:02.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.519+0000 7f58a9917700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a40b0790 con 0x7f58a40b1530 2023-09-13T08:26:02.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.519+0000 7f58a9917700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58a4155620 con 0x7f58a406c580 2023-09-13T08:26:02.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.519+0000 7f58a37fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58a4160e30 0x7f58a41e6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:02.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.520+0000 7f58a37fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58a4160e30 0x7f58a41e6f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45792/0 (socket says 172.21.15.84:45792) 2023-09-13T08:26:02.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.520+0000 7f58a37fe700 1 -- 172.21.15.84:0/2570842832 learned_addr learned my addr 172.21.15.84:0/2570842832 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:26:02.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.520+0000 7f58a2ffd700 1 --2- 172.21.15.84:0/2570842832 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f58a406c580 0x7f58a40b0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:02.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.520+0000 7f58a27fc700 1 --2- 172.21.15.84:0/2570842832 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f58a40b1530 0x7f58a41563e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:02.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.520+0000 7f58a37fe700 1 -- 172.21.15.84:0/2570842832 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f58a406c580 msgr2=0x7f58a40b0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:02.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.520+0000 7f58a37fe700 1 --2- 172.21.15.84:0/2570842832 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f58a406c580 0x7f58a40b0250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:02.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.520+0000 7f58a37fe700 1 -- 172.21.15.84:0/2570842832 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f58a40b1530 msgr2=0x7f58a41563e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:02.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.520+0000 7f58a37fe700 1 --2- 172.21.15.84:0/2570842832 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f58a40b1530 0x7f58a41563e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:02.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.520+0000 7f58a37fe700 1 -- 172.21.15.84:0/2570842832 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5898009550 con 0x7f58a4160e30 2023-09-13T08:26:02.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.520+0000 7f58a2ffd700 1 --2- 172.21.15.84:0/2570842832 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f58a406c580 0x7f58a40b0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T08:26:02.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.520+0000 7f58a37fe700 1 --2- 172.21.15.84:0/2570842832 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58a4160e30 0x7f58a41e6f70 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f589c00b970 tx=0x7f589c00bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:26:02.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.520+0000 7f588bfff700 1 -- 172.21.15.84:0/2570842832 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f589c00c9b0 con 0x7f58a4160e30 2023-09-13T08:26:02.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.520+0000 7f588bfff700 1 -- 172.21.15.84:0/2570842832 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f589c00cb10 con 0x7f58a4160e30 2023-09-13T08:26:02.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.520+0000 7f58a9917700 1 -- 172.21.15.84:0/2570842832 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58a4155900 con 0x7f58a4160e30 2023-09-13T08:26:02.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.520+0000 7f588bfff700 1 -- 172.21.15.84:0/2570842832 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f589c014440 con 0x7f58a4160e30 2023-09-13T08:26:02.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.520+0000 7f58a9917700 1 -- 172.21.15.84:0/2570842832 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58a4155ec0 con 0x7f58a4160e30 2023-09-13T08:26:02.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.521+0000 7f58a9917700 1 -- 172.21.15.84:0/2570842832 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58a404e9b0 con 0x7f58a4160e30 2023-09-13T08:26:02.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.522+0000 7f588bfff700 1 -- 172.21.15.84:0/2570842832 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f589c01d3b0 con 0x7f58a4160e30 2023-09-13T08:26:02.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.522+0000 7f588bfff700 1 --2- 172.21.15.84:0/2570842832 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f589006a580 0x7f589006ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:02.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.522+0000 7f588bfff700 1 -- 172.21.15.84:0/2570842832 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f589c088740 con 0x7f58a4160e30 2023-09-13T08:26:02.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.522+0000 7f58a2ffd700 1 --2- 172.21.15.84:0/2570842832 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f589006a580 0x7f589006ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:02.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.522+0000 7f58a2ffd700 1 --2- 172.21.15.84:0/2570842832 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f589006a580 0x7f589006ca40 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f58a4160840 tx=0x7f5898008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:26:02.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.526+0000 7f588bfff700 1 -- 172.21.15.84:0/2570842832 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f589c053c10 con 0x7f58a4160e30 2023-09-13T08:26:02.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.717+0000 7f58a9917700 1 -- 172.21.15.84:0/2570842832 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f58a40b0b00 con 0x7f58a4160e30 2023-09-13T08:26:02.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.718+0000 7f588bfff700 1 -- 172.21.15.84:0/2570842832 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+16763 (secure 0 0 0) 0x7f589c057230 con 0x7f58a4160e30 2023-09-13T08:26:02.718 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:26:02.719 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":37,"fsid":"0107440b-b634-42c5-a643-5d31ea826116","created":"2023-09-13T08:24:16.931917+0000","modified":"2023-09-13T08:26:01.437341+0000","last_up_change":"2023-09-13T08:24:28.422631+0000","last_in_change":"2023-09-13T08:24:19.425578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T08:24:28.583720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-09-13T08:25:59.346523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-09-13T08:26:00.400448+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4a53ec12-1469-4356-b4e1-2b8fc9b7c0f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6817","nonce":1599532366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6819","nonce":1599532366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6823","nonce":1599532366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6821","nonce":1599532366}]},"public_addr":"172.21.15.84:6817/1599532366","cluster_addr":"172.21.15.84:6819/1599532366","heartbeat_back_addr":"172.21.15.84:6823/1599532366","heartbeat_front_addr":"172.21.15.84:6821/1599532366","state":["exists","up"]},{"osd":1,"uuid":"11e964a0-b80c-4afc-bfbf-e2067969db29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6825","nonce":461860977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6827","nonce":461860977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6831","nonce":461860977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6829","nonce":461860977}]},"public_addr":"172.21.15.84:6825/461860977","cluster_addr":"172.21.15.84:6827/461860977","heartbeat_back_addr":"172.21.15.84:6831/461860977","heartbeat_front_addr":"172.21.15.84:6829/461860977","state":["exists","up"]},{"osd":2,"uuid":"3ce74529-4dd1-44c7-9576-968f5fdc0c25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6809","nonce":1168316165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6811","nonce":1168316165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6815","nonce":1168316165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6813","nonce":1168316165}]},"public_addr":"172.21.15.84:6809/1168316165","cluster_addr":"172.21.15.84:6811/1168316165","heartbeat_back_addr":"172.21.15.84:6815/1168316165","heartbeat_front_addr":"172.21.15.84:6813/1168316165","state":["exists","up"]},{"osd":3,"uuid":"460cb5c5-590a-4d06-a4d9-5bac2fdf33b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6801","nonce":1661609810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6803","nonce":1661609810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6807","nonce":1661609810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6805","nonce":1661609810}]},"public_addr":"172.21.15.84:6801/1661609810","cluster_addr":"172.21.15.84:6803/1661609810","heartbeat_back_addr":"172.21.15.84:6807/1661609810","heartbeat_front_addr":"172.21.15.84:6805/1661609810","state":["exists","up"]},{"osd":4,"uuid":"bf237dd0-3ebd-44b5-8078-24a63e00d792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6801","nonce":1303562374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6803","nonce":1303562374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6807","nonce":1303562374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6805","nonce":1303562374}]},"public_addr":"172.21.15.161:6801/1303562374","cluster_addr":"172.21.15.161:6803/1303562374","heartbeat_back_addr":"172.21.15.161:6807/1303562374","heartbeat_front_addr":"172.21.15.161:6805/1303562374","state":["exists","up"]},{"osd":5,"uuid":"e1e538e0-5844-456b-8c6e-434d3a914af1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6818","nonce":961120854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6822","nonce":961120854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6830","nonce":961120854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6826","nonce":961120854}]},"public_addr":"172.21.15.161:6818/961120854","cluster_addr":"172.21.15.161:6822/961120854","heartbeat_back_addr":"172.21.15.161:6830/961120854","heartbeat_front_addr":"172.21.15.161:6826/961120854","state":["exists","up"]},{"osd":6,"uuid":"5cb1785e-960f-4dd4-b295-9e21b2c3f875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6809","nonce":980533466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6811","nonce":980533466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6815","nonce":980533466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6813","nonce":980533466}]},"public_addr":"172.21.15.161:6809/980533466","cluster_addr":"172.21.15.161:6811/980533466","heartbeat_back_addr":"172.21.15.161:6815/980533466","heartbeat_front_addr":"172.21.15.161:6813/980533466","state":["exists","up"]},{"osd":7,"uuid":"5acb6619-e933-4b46-b1c2-60af30acb839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6817","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6819","nonce":2479691549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6821","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6823","nonce":2479691549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6829","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6831","nonce":2479691549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6825","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6827","nonce":2479691549}]},"public_addr":"172.21.15.161:6819/2479691549","cluster_addr":"172.21.15.161:6823/2479691549","heartbeat_back_addr":"172.21.15.161:6831/2479691549","heartbeat_front_addr":"172.21.15.161:6827/2479691549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.678857+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.685341+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.613603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.634940+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.564387+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.697347+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.637437+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.619397+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T08:26:02.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.720+0000 7f58a9917700 1 -- 172.21.15.84:0/2570842832 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f589006a580 msgr2=0x7f589006ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:02.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.720+0000 7f58a9917700 1 --2- 172.21.15.84:0/2570842832 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f589006a580 0x7f589006ca40 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f58a4160840 tx=0x7f5898008030 comp rx=0 tx=0).stop 2023-09-13T08:26:02.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.720+0000 7f58a9917700 1 -- 172.21.15.84:0/2570842832 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58a4160e30 msgr2=0x7f58a41e6f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:02.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.720+0000 7f58a9917700 1 --2- 172.21.15.84:0/2570842832 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58a4160e30 0x7f58a41e6f70 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f589c00b970 tx=0x7f589c00bd30 comp rx=0 tx=0).stop 2023-09-13T08:26:02.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.720+0000 7f58a9917700 1 -- 172.21.15.84:0/2570842832 shutdown_connections 2023-09-13T08:26:02.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.720+0000 7f58a9917700 1 --2- 172.21.15.84:0/2570842832 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58a4160e30 0x7f58a41e6f70 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:02.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.720+0000 7f58a9917700 1 --2- 172.21.15.84:0/2570842832 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f58a406c580 0x7f58a40b0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:02.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.720+0000 7f58a9917700 1 --2- 172.21.15.84:0/2570842832 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f589006a580 0x7f589006ca40 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:02.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.720+0000 7f58a9917700 1 --2- 172.21.15.84:0/2570842832 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f58a40b1530 0x7f58a41563e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:02.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.720+0000 7f58a9917700 1 -- 172.21.15.84:0/2570842832 >> 172.21.15.84:0/2570842832 conn(0x7f58a40d11c0 msgr2=0x7f58a415ff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:26:02.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.721+0000 7f58a9917700 1 -- 172.21.15.84:0/2570842832 shutdown_connections 2023-09-13T08:26:02.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.721+0000 7f58a9917700 1 -- 172.21.15.84:0/2570842832 wait complete. 2023-09-13T08:26:02.734 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-09-13T08:26:02.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.858+0000 7f3aca21a700 1 Processor -- start 2023-09-13T08:26:02.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.858+0000 7f3aca21a700 1 -- start start 2023-09-13T08:26:02.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.858+0000 7f3aca21a700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f3ac40ced40 0x7f3ac40cda40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:02.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.858+0000 7f3aca21a700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ac40cd170 con 0x7f3ac415ea00 2023-09-13T08:26:02.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.858+0000 7f3aca21a700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ac40cc8d0 con 0x7f3ac40cdf80 2023-09-13T08:26:02.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.858+0000 7f3aca21a700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ac40ce410 con 0x7f3ac40ced40 2023-09-13T08:26:02.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.859+0000 7f3ac37fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f3ac415ea00 0x7f3ac40cbd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:48442/0 (socket says 172.21.15.84:48442) 2023-09-13T08:26:02.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.859+0000 7f3ac37fe700 1 -- 172.21.15.84:0/3731330398 learned_addr learned my addr 172.21.15.84:0/3731330398 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:26:02.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.859+0000 7f3ac27fc700 1 -- 172.21.15.84:0/3731330398 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2193553587 0 0) 0x7f3ac40cd170 con 0x7f3ac415ea00 2023-09-13T08:26:02.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.859+0000 7f3ac27fc700 1 -- 172.21.15.84:0/3731330398 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3aac0035b0 con 0x7f3ac415ea00 2023-09-13T08:26:02.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.859+0000 7f3ac2ffd700 1 --2- 172.21.15.84:0/3731330398 >> v2:172.21.15.161:3300/0 conn(0x7f3ac40ced40 0x7f3ac40cda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:02.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.859+0000 7f3ac27fc700 1 -- 172.21.15.84:0/3731330398 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1571808248 0 0) 0x7f3aac0035b0 con 0x7f3ac415ea00 2023-09-13T08:26:02.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.859+0000 7f3ac27fc700 1 -- 172.21.15.84:0/3731330398 >> v2:172.21.15.161:3300/0 conn(0x7f3ac40ced40 msgr2=0x7f3ac40cda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:26:02.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.859+0000 7f3ac27fc700 1 --2- 172.21.15.84:0/3731330398 >> v2:172.21.15.161:3300/0 conn(0x7f3ac40ced40 0x7f3ac40cda40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:02.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.859+0000 7f3ac27fc700 1 -- 172.21.15.84:0/3731330398 >> v1:172.21.15.161:6789/0 conn(0x7f3ac40cdf80 legacy=0x7f3ac415f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:02.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.859+0000 7f3ac27fc700 1 -- 172.21.15.84:0/3731330398 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ac40ccbb0 con 0x7f3ac415ea00 2023-09-13T08:26:02.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.859+0000 7f3ac27fc700 1 -- 172.21.15.84:0/3731330398 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2302733408 0 0) 0x7f3ab40017f0 con 0x7f3ac415ea00 2023-09-13T08:26:02.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.859+0000 7f3ac27fc700 1 -- 172.21.15.84:0/3731330398 >> v1:172.21.15.84:6789/0 conn(0x7f3ac415ea00 legacy=0x7f3ac40cbd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:02.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.859+0000 7f3ac27fc700 1 --2- 172.21.15.84:0/3731330398 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3aac003a00 0x7f3aac003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:02.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.859+0000 7f3ac27fc700 1 --2- 172.21.15.84:0/3731330398 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3aac004850 0x7f3aac004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:02.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.859+0000 7f3ac27fc700 1 --2- 172.21.15.84:0/3731330398 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3aac005210 0x7f3aac00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:02.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.859+0000 7f3ac27fc700 1 -- 172.21.15.84:0/3731330398 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac40ce410 con 0x7f3aac003a00 2023-09-13T08:26:02.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.859+0000 7f3ac27fc700 1 -- 172.21.15.84:0/3731330398 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aac00c1b0 con 0x7f3aac005210 2023-09-13T08:26:02.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.859+0000 7f3ac27fc700 1 -- 172.21.15.84:0/3731330398 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3aac00c370 con 0x7f3aac004850 2023-09-13T08:26:02.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.859+0000 7f3ac37fe700 1 --2- 172.21.15.84:0/3731330398 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3aac003a00 0x7f3aac003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:02.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.859+0000 7f3ac2ffd700 1 --2- 172.21.15.84:0/3731330398 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3aac004850 0x7f3aac004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:02.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.859+0000 7f3ac3fff700 1 --2- 172.21.15.84:0/3731330398 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3aac005210 0x7f3aac00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:02.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.860+0000 7f3ac37fe700 1 -- 172.21.15.84:0/3731330398 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3aac004850 msgr2=0x7f3aac004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:26:02.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.860+0000 7f3ac37fe700 1 --2- 172.21.15.84:0/3731330398 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3aac004850 0x7f3aac004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:02.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.860+0000 7f3ac37fe700 1 -- 172.21.15.84:0/3731330398 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3aac005210 msgr2=0x7f3aac00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:26:02.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.860+0000 7f3ac37fe700 1 --2- 172.21.15.84:0/3731330398 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3aac005210 0x7f3aac00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:02.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.860+0000 7f3ac37fe700 1 -- 172.21.15.84:0/3731330398 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aac0035b0 con 0x7f3aac003a00 2023-09-13T08:26:02.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.860+0000 7f3ac3fff700 1 --2- 172.21.15.84:0/3731330398 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3aac005210 0x7f3aac00ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T08:26:02.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.860+0000 7f3ac3fff700 1 -- 172.21.15.84:0/3731330398 reap_dead start 2023-09-13T08:26:02.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.860+0000 7f3ac37fe700 1 --2- 172.21.15.84:0/3731330398 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3aac003a00 0x7f3aac003e20 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f3ab400c240 tx=0x7f3aac005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0bc9e199b6f8259 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:26:02.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.860+0000 7f3ac27fc700 1 -- 172.21.15.84:0/3731330398 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab400cde0 con 0x7f3aac003a00 2023-09-13T08:26:02.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.860+0000 7f3ac27fc700 1 -- 172.21.15.84:0/3731330398 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ab4007b80 con 0x7f3aac003a00 2023-09-13T08:26:02.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.860+0000 7f3ac27fc700 1 -- 172.21.15.84:0/3731330398 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab40072d0 con 0x7f3aac003a00 2023-09-13T08:26:02.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.860+0000 7f3aca21a700 1 -- 172.21.15.84:0/3731330398 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3aac003a00 msgr2=0x7f3aac003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:02.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.860+0000 7f3aca21a700 1 --2- 172.21.15.84:0/3731330398 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3aac003a00 0x7f3aac003e20 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f3ab400c240 tx=0x7f3aac005880 comp rx=0 tx=0).stop 2023-09-13T08:26:02.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.860+0000 7f3aca21a700 1 -- 172.21.15.84:0/3731330398 shutdown_connections 2023-09-13T08:26:02.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.860+0000 7f3aca21a700 1 --2- 172.21.15.84:0/3731330398 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3aac003a00 0x7f3aac003e20 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:02.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.860+0000 7f3aca21a700 1 -- 172.21.15.84:0/3731330398 >> 172.21.15.84:0/3731330398 conn(0x7f3ac409a470 msgr2=0x7f3ac40d1170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:26:02.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.860+0000 7f3aca21a700 1 -- 172.21.15.84:0/3731330398 shutdown_connections 2023-09-13T08:26:02.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.860+0000 7f3aca21a700 1 -- 172.21.15.84:0/3731330398 wait complete. 2023-09-13T08:26:02.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.862+0000 7f3aca21a700 1 Processor -- start 2023-09-13T08:26:02.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.862+0000 7f3aca21a700 1 -- start start 2023-09-13T08:26:02.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.862+0000 7f3aca21a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3aac003a00 0x7f3ac414e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:02.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.862+0000 7f3aca21a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ac40c6e70 0x7f3ac40c72f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:02.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.862+0000 7f3aca21a700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3ac40c8d80 0x7f3ac40c9200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:02.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.863+0000 7f3aca21a700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac414ebb0 con 0x7f3aac003a00 2023-09-13T08:26:02.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.863+0000 7f3aca21a700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac40c7830 con 0x7f3ac40c6e70 2023-09-13T08:26:02.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.863+0000 7f3aca21a700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac40c88f0 con 0x7f3ac40c8d80 2023-09-13T08:26:02.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.863+0000 7f3ac37fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3aac003a00 0x7f3ac414e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:02.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.863+0000 7f3ac37fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3aac003a00 0x7f3ac414e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45808/0 (socket says 172.21.15.84:45808) 2023-09-13T08:26:02.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.863+0000 7f3ac37fe700 1 -- 172.21.15.84:0/3381192125 learned_addr learned my addr 172.21.15.84:0/3381192125 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:26:02.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.863+0000 7f3ac2ffd700 1 --2- 172.21.15.84:0/3381192125 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ac40c6e70 0x7f3ac40c72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:02.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.863+0000 7f3ac3fff700 1 --2- 172.21.15.84:0/3381192125 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3ac40c8d80 0x7f3ac40c9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:02.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.863+0000 7f3ac37fe700 1 -- 172.21.15.84:0/3381192125 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3ac40c8d80 msgr2=0x7f3ac40c9200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:02.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.863+0000 7f3ac37fe700 1 --2- 172.21.15.84:0/3381192125 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3ac40c8d80 0x7f3ac40c9200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:02.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.863+0000 7f3ac37fe700 1 -- 172.21.15.84:0/3381192125 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ac40c6e70 msgr2=0x7f3ac40c72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:02.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.863+0000 7f3ac37fe700 1 --2- 172.21.15.84:0/3381192125 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ac40c6e70 0x7f3ac40c72f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:02.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.863+0000 7f3ac37fe700 1 -- 172.21.15.84:0/3381192125 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ac40b4040 con 0x7f3aac003a00 2023-09-13T08:26:02.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.863+0000 7f3ac2ffd700 1 --2- 172.21.15.84:0/3381192125 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ac40c6e70 0x7f3ac40c72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T08:26:02.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.863+0000 7f3ac37fe700 1 --2- 172.21.15.84:0/3381192125 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3aac003a00 0x7f3ac414e670 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f3ab4007d30 tx=0x7f3ab4001b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:26:02.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.863+0000 7f3aabfff700 1 -- 172.21.15.84:0/3381192125 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab4005a30 con 0x7f3aac003a00 2023-09-13T08:26:02.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.863+0000 7f3aabfff700 1 -- 172.21.15.84:0/3381192125 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ab4005b90 con 0x7f3aac003a00 2023-09-13T08:26:02.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.863+0000 7f3aabfff700 1 -- 172.21.15.84:0/3381192125 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab4000f70 con 0x7f3aac003a00 2023-09-13T08:26:02.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.863+0000 7f3aca21a700 1 -- 172.21.15.84:0/3381192125 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ac40c82e0 con 0x7f3aac003a00 2023-09-13T08:26:02.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.863+0000 7f3aca21a700 1 -- 172.21.15.84:0/3381192125 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ac40c8580 con 0x7f3aac003a00 2023-09-13T08:26:02.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.864+0000 7f3aca21a700 1 -- 172.21.15.84:0/3381192125 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ac40c8bd0 con 0x7f3aac003a00 2023-09-13T08:26:02.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.865+0000 7f3aabfff700 1 -- 172.21.15.84:0/3381192125 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f3ab401e430 con 0x7f3aac003a00 2023-09-13T08:26:02.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.865+0000 7f3aabfff700 1 --2- 172.21.15.84:0/3381192125 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f3ab006a580 0x7f3ab006ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:02.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.865+0000 7f3aabfff700 1 -- 172.21.15.84:0/3381192125 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f3ab4089e50 con 0x7f3aac003a00 2023-09-13T08:26:02.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.865+0000 7f3ac2ffd700 1 --2- 172.21.15.84:0/3381192125 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f3ab006a580 0x7f3ab006ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:02.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.865+0000 7f3ac2ffd700 1 --2- 172.21.15.84:0/3381192125 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f3ab006a580 0x7f3ab006ca40 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3ac40ca740 tx=0x7f3ab8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:26:02.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:02.869+0000 7f3aabfff700 1 -- 172.21.15.84:0/3381192125 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f3ab4055320 con 0x7f3aac003a00 2023-09-13T08:26:03.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:03.105+0000 7f3aca21a700 1 -- 172.21.15.84:0/3381192125 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f3ac40cce60 con 0x7f3aac003a00 2023-09-13T08:26:04.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:04.060+0000 7f3aabfff700 1 -- 172.21.15.84:0/3381192125 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) v1 ==== 118+0+0 (secure 0 0 0) 0x7f3ab4058940 con 0x7f3aac003a00 2023-09-13T08:26:04.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:04.063+0000 7f3aca21a700 1 -- 172.21.15.84:0/3381192125 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f3ab006a580 msgr2=0x7f3ab006ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:04.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:04.063+0000 7f3aca21a700 1 --2- 172.21.15.84:0/3381192125 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f3ab006a580 0x7f3ab006ca40 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3ac40ca740 tx=0x7f3ab8008040 comp rx=0 tx=0).stop 2023-09-13T08:26:04.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:04.063+0000 7f3aca21a700 1 -- 172.21.15.84:0/3381192125 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3aac003a00 msgr2=0x7f3ac414e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:04.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:04.063+0000 7f3aca21a700 1 --2- 172.21.15.84:0/3381192125 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3aac003a00 0x7f3ac414e670 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f3ab4007d30 tx=0x7f3ab4001b80 comp rx=0 tx=0).stop 2023-09-13T08:26:04.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:04.063+0000 7f3aca21a700 1 -- 172.21.15.84:0/3381192125 shutdown_connections 2023-09-13T08:26:04.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:04.063+0000 7f3aca21a700 1 --2- 172.21.15.84:0/3381192125 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3ac40c8d80 0x7f3ac40c9200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:04.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:04.063+0000 7f3aca21a700 1 --2- 172.21.15.84:0/3381192125 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3aac003a00 0x7f3ac414e670 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:04.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:04.063+0000 7f3aca21a700 1 --2- 172.21.15.84:0/3381192125 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f3ab006a580 0x7f3ab006ca40 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:04.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:04.063+0000 7f3aca21a700 1 --2- 172.21.15.84:0/3381192125 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ac40c6e70 0x7f3ac40c72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:04.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:04.063+0000 7f3aca21a700 1 -- 172.21.15.84:0/3381192125 >> 172.21.15.84:0/3381192125 conn(0x7f3ac409a470 msgr2=0x7f3ac40cd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:26:04.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:04.063+0000 7f3aca21a700 1 -- 172.21.15.84:0/3381192125 shutdown_connections 2023-09-13T08:26:04.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:04.063+0000 7f3aca21a700 1 -- 172.21.15.84:0/3381192125 wait complete. 2023-09-13T08:26:04.077 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-09-13T08:26:04.078 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-09-13T08:26:04.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:04.208+0000 7f2a25df8700 1 Processor -- start 2023-09-13T08:26:04.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:04.208+0000 7f2a25df8700 1 -- start start 2023-09-13T08:26:04.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:04.208+0000 7f2a25df8700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f2a200ca8e0 0x7f2a200cf570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:04.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:04.208+0000 7f2a25df8700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2a2015e910 0x7f2a200cacc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:04.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:04.208+0000 7f2a25df8700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a2015e480 con 0x7f2a200cd590 2023-09-13T08:26:04.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:04.208+0000 7f2a25df8700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a200cb200 con 0x7f2a200ca8e0 2023-09-13T08:26:04.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:04.208+0000 7f2a25df8700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a200cfbe0 con 0x7f2a2015e910 2023-09-13T08:26:04.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:04.209+0000 7f2a1f7fe700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f2a200ca8e0 0x7f2a200cf570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:04.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:04.209+0000 7f2a1effd700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2a2015e910 0x7f2a200cacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:04.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:04.209+0000 7f2a1f7fe700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f2a200ca8e0 0x7f2a200cf570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.84:41588/0 (socket says 172.21.15.84:41588) 2023-09-13T08:26:04.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:04.209+0000 7f2a1f7fe700 1 -- 172.21.15.84:0/798391286 learned_addr learned my addr 172.21.15.84:0/798391286 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:26:04.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:04.209+0000 7f2a1effd700 1 -- 172.21.15.84:0/798391286 >> v2:172.21.15.161:3300/0 conn(0x7f2a200ca8e0 msgr2=0x7f2a200cf570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:26:04.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:04.209+0000 7f2a1effd700 1 --2- 172.21.15.84:0/798391286 >> v2:172.21.15.161:3300/0 conn(0x7f2a200ca8e0 0x7f2a200cf570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:04.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:04.209+0000 7f2a1effd700 1 -- 172.21.15.84:0/798391286 >> v1:172.21.15.161:6789/0 conn(0x7f2a200cd590 legacy=0x7f2a20161150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:04.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:04.209+0000 7f2a1effd700 1 -- 172.21.15.84:0/798391286 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a2015de30 con 0x7f2a2015e910 2023-09-13T08:26:04.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:04.209+0000 7f2a1f7fe700 1 --2- 172.21.15.84:0/798391286 >> v2:172.21.15.161:3300/0 conn(0x7f2a200ca8e0 0x7f2a200cf570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T08:26:04.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:04.209+0000 7f2a1effd700 1 --2- 172.21.15.84:0/798391286 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2a2015e910 0x7f2a200cacc0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2a08009840 tx=0x7f2a08009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8db7f89b1b678ab7 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:26:04.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:04.210+0000 7f2a1e7fc700 1 -- 172.21.15.84:0/798391286 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a08004230 con 0x7f2a2015e910 2023-09-13T08:26:04.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:04.210+0000 7f2a1e7fc700 1 -- 172.21.15.84:0/798391286 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a08004390 con 0x7f2a2015e910 2023-09-13T08:26:04.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:04.210+0000 7f2a1e7fc700 1 -- 172.21.15.84:0/798391286 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a080036a0 con 0x7f2a2015e910 2023-09-13T08:26:04.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:04.210+0000 7f2a25df8700 1 -- 172.21.15.84:0/798391286 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2a2015e910 msgr2=0x7f2a200cacc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:04.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:04.210+0000 7f2a25df8700 1 --2- 172.21.15.84:0/798391286 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2a2015e910 0x7f2a200cacc0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2a08009840 tx=0x7f2a08009b50 comp rx=0 tx=0).stop 2023-09-13T08:26:04.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:04.210+0000 7f2a25df8700 1 -- 172.21.15.84:0/798391286 shutdown_connections 2023-09-13T08:26:04.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:04.210+0000 7f2a25df8700 1 --2- 172.21.15.84:0/798391286 >> v2:172.21.15.161:3300/0 conn(0x7f2a200ca8e0 0x7f2a200cf570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:04.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:04.210+0000 7f2a25df8700 1 --2- 172.21.15.84:0/798391286 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2a2015e910 0x7f2a200cacc0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:04.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:04.210+0000 7f2a25df8700 1 -- 172.21.15.84:0/798391286 >> 172.21.15.84:0/798391286 conn(0x7f2a200cca70 msgr2=0x7f2a200cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:26:04.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:04.210+0000 7f2a25df8700 1 -- 172.21.15.84:0/798391286 shutdown_connections 2023-09-13T08:26:04.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:04.210+0000 7f2a25df8700 1 -- 172.21.15.84:0/798391286 wait complete. 2023-09-13T08:26:04.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:04.211+0000 7f2a25df8700 1 Processor -- start 2023-09-13T08:26:04.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:04.212+0000 7f2a25df8700 1 -- start start 2023-09-13T08:26:04.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:04.212+0000 7f2a25df8700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2a200ca8e0 0x7f2a200c7e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:04.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:04.212+0000 7f2a25df8700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2a200cd590 0x7f2a2006e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:04.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:04.212+0000 7f2a25df8700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a2015e910 0x7f2a2006edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:04.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:04.212+0000 7f2a25df8700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a20158de0 con 0x7f2a2015e910 2023-09-13T08:26:04.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:04.212+0000 7f2a25df8700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a200ade30 con 0x7f2a200ca8e0 2023-09-13T08:26:04.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:04.212+0000 7f2a25df8700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a200c88a0 con 0x7f2a200cd590 2023-09-13T08:26:04.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:04.213+0000 7f2a1ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a2015e910 0x7f2a2006edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:04.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:04.213+0000 7f2a1ffff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a2015e910 0x7f2a2006edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45826/0 (socket says 172.21.15.84:45826) 2023-09-13T08:26:04.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:04.213+0000 7f2a1ffff700 1 -- 172.21.15.84:0/2876948847 learned_addr learned my addr 172.21.15.84:0/2876948847 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:26:04.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:04.213+0000 7f2a1f7fe700 1 --2- 172.21.15.84:0/2876948847 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2a200ca8e0 0x7f2a200c7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:04.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:04.213+0000 7f2a1effd700 1 --2- 172.21.15.84:0/2876948847 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2a200cd590 0x7f2a2006e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:04.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:04.213+0000 7f2a1ffff700 1 -- 172.21.15.84:0/2876948847 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2a200cd590 msgr2=0x7f2a2006e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:04.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:04.213+0000 7f2a1ffff700 1 --2- 172.21.15.84:0/2876948847 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2a200cd590 0x7f2a2006e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:04.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:04.213+0000 7f2a1ffff700 1 -- 172.21.15.84:0/2876948847 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2a200ca8e0 msgr2=0x7f2a200c7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:04.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:04.213+0000 7f2a1ffff700 1 --2- 172.21.15.84:0/2876948847 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2a200ca8e0 0x7f2a200c7e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:04.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:04.213+0000 7f2a1ffff700 1 -- 172.21.15.84:0/2876948847 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a10009550 con 0x7f2a2015e910 2023-09-13T08:26:04.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:04.213+0000 7f2a1f7fe700 1 --2- 172.21.15.84:0/2876948847 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2a200ca8e0 0x7f2a200c7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T08:26:04.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:04.213+0000 7f2a1ffff700 1 --2- 172.21.15.84:0/2876948847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a2015e910 0x7f2a2006edd0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f2a1800caf0 tx=0x7f2a1800ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:26:04.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:04.213+0000 7f2a17fff700 1 -- 172.21.15.84:0/2876948847 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a18003e30 con 0x7f2a2015e910 2023-09-13T08:26:04.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:04.213+0000 7f2a17fff700 1 -- 172.21.15.84:0/2876948847 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a18005070 con 0x7f2a2015e910 2023-09-13T08:26:04.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:04.213+0000 7f2a25df8700 1 -- 172.21.15.84:0/2876948847 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a080094a0 con 0x7f2a2015e910 2023-09-13T08:26:04.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:04.213+0000 7f2a17fff700 1 -- 172.21.15.84:0/2876948847 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a18005420 con 0x7f2a2015e910 2023-09-13T08:26:04.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:04.213+0000 7f2a25df8700 1 -- 172.21.15.84:0/2876948847 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a200ae3d0 con 0x7f2a2015e910 2023-09-13T08:26:04.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:04.214+0000 7f2a25df8700 1 -- 172.21.15.84:0/2876948847 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a2004f200 con 0x7f2a2015e910 2023-09-13T08:26:04.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:04.215+0000 7f2a17fff700 1 -- 172.21.15.84:0/2876948847 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f2a18005580 con 0x7f2a2015e910 2023-09-13T08:26:04.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:04.215+0000 7f2a17fff700 1 --2- 172.21.15.84:0/2876948847 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f2a0006a580 0x7f2a0006ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:04.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:04.215+0000 7f2a17fff700 1 -- 172.21.15.84:0/2876948847 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f2a18088350 con 0x7f2a2015e910 2023-09-13T08:26:04.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:04.215+0000 7f2a1f7fe700 1 --2- 172.21.15.84:0/2876948847 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f2a0006a580 0x7f2a0006ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:04.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:04.215+0000 7f2a1f7fe700 1 --2- 172.21.15.84:0/2876948847 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f2a0006a580 0x7f2a0006ca40 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2a10009ce0 tx=0x7f2a10008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:26:04.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:04.219+0000 7f2a17fff700 1 -- 172.21.15.84:0/2876948847 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f2a180572b0 con 0x7f2a2015e910 2023-09-13T08:26:04.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:04.455+0000 7f2a25df8700 1 -- 172.21.15.84:0/2876948847 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f2a200ca380 con 0x7f2a2015e910 2023-09-13T08:26:05.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.065+0000 7f2a17fff700 1 -- 172.21.15.84:0/2876948847 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7f2a180170c0 con 0x7f2a2015e910 2023-09-13T08:26:05.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.068+0000 7f2a25df8700 1 -- 172.21.15.84:0/2876948847 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f2a0006a580 msgr2=0x7f2a0006ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:05.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.068+0000 7f2a25df8700 1 --2- 172.21.15.84:0/2876948847 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f2a0006a580 0x7f2a0006ca40 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2a10009ce0 tx=0x7f2a10008040 comp rx=0 tx=0).stop 2023-09-13T08:26:05.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.068+0000 7f2a25df8700 1 -- 172.21.15.84:0/2876948847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a2015e910 msgr2=0x7f2a2006edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:05.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.068+0000 7f2a25df8700 1 --2- 172.21.15.84:0/2876948847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a2015e910 0x7f2a2006edd0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f2a1800caf0 tx=0x7f2a1800ceb0 comp rx=0 tx=0).stop 2023-09-13T08:26:05.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.068+0000 7f2a25df8700 1 -- 172.21.15.84:0/2876948847 shutdown_connections 2023-09-13T08:26:05.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.068+0000 7f2a25df8700 1 --2- 172.21.15.84:0/2876948847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a2015e910 0x7f2a2006edd0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:05.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.068+0000 7f2a25df8700 1 --2- 172.21.15.84:0/2876948847 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f2a0006a580 0x7f2a0006ca40 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:05.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.068+0000 7f2a25df8700 1 --2- 172.21.15.84:0/2876948847 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2a200ca8e0 0x7f2a200c7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:05.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.068+0000 7f2a25df8700 1 --2- 172.21.15.84:0/2876948847 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2a200cd590 0x7f2a2006e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:05.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.068+0000 7f2a25df8700 1 -- 172.21.15.84:0/2876948847 >> 172.21.15.84:0/2876948847 conn(0x7f2a200cca70 msgr2=0x7f2a200b0ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:26:05.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.068+0000 7f2a25df8700 1 -- 172.21.15.84:0/2876948847 shutdown_connections 2023-09-13T08:26:05.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.068+0000 7f2a25df8700 1 -- 172.21.15.84:0/2876948847 wait complete. 2023-09-13T08:26:05.082 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-09-13T08:26:05.082 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T08:26:05.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.207+0000 7f053b88c700 1 Processor -- start 2023-09-13T08:26:05.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.207+0000 7f053b88c700 1 -- start start 2023-09-13T08:26:05.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.208+0000 7f053b88c700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f053415b200 0x7f053415de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:05.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.208+0000 7f053b88c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f05340cc900 0x7f05340ccd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:05.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.208+0000 7f053b88c700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0534151800 con 0x7f05340ce920 2023-09-13T08:26:05.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.208+0000 7f053b88c700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f053415ad70 con 0x7f05340cc900 2023-09-13T08:26:05.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.208+0000 7f053b88c700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f053415edd0 con 0x7f053415b200 2023-09-13T08:26:05.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.208+0000 7f0539e29700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f05340cc900 0x7f05340ccd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:05.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.208+0000 7f0539628700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f05340ce920 0x7f05340ced00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:48476/0 (socket says 172.21.15.84:48476) 2023-09-13T08:26:05.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.208+0000 7f0539628700 1 -- 172.21.15.84:0/1768786956 learned_addr learned my addr 172.21.15.84:0/1768786956 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:26:05.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.208+0000 7f0538e27700 1 --2- 172.21.15.84:0/1768786956 >> v2:172.21.15.161:3300/0 conn(0x7f053415b200 0x7f053415de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:05.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.208+0000 7f0539e29700 1 -- 172.21.15.84:0/1768786956 >> v2:172.21.15.161:3300/0 conn(0x7f053415b200 msgr2=0x7f053415de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:26:05.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.208+0000 7f0539e29700 1 --2- 172.21.15.84:0/1768786956 >> v2:172.21.15.161:3300/0 conn(0x7f053415b200 0x7f053415de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:05.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.208+0000 7f0539e29700 1 -- 172.21.15.84:0/1768786956 >> v1:172.21.15.84:6789/0 conn(0x7f05340ce920 legacy=0x7f05340ced00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:05.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.208+0000 7f0539e29700 1 -- 172.21.15.84:0/1768786956 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f053415e810 con 0x7f05340cc900 2023-09-13T08:26:05.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.208+0000 7f052bfff700 1 -- 172.21.15.84:0/1768786956 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 832197594 0 0) 0x7f0530001110 con 0x7f05340ce920 2023-09-13T08:26:05.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.208+0000 7f0538e27700 1 --2- 172.21.15.84:0/1768786956 >> v2:172.21.15.161:3300/0 conn(0x7f053415b200 0x7f053415de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T08:26:05.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.208+0000 7f0539e29700 1 --2- 172.21.15.84:0/1768786956 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f05340cc900 0x7f05340ccd90 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f05340d1110 tx=0x7f052c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fc710eced3583f0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:26:05.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.209+0000 7f052bfff700 1 -- 172.21.15.84:0/1768786956 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052c00e070 con 0x7f05340cc900 2023-09-13T08:26:05.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.209+0000 7f052bfff700 1 -- 172.21.15.84:0/1768786956 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f052c00bbd0 con 0x7f05340cc900 2023-09-13T08:26:05.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.209+0000 7f052bfff700 1 -- 172.21.15.84:0/1768786956 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052c012430 con 0x7f05340cc900 2023-09-13T08:26:05.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.209+0000 7f053b88c700 1 -- 172.21.15.84:0/1768786956 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f05340cc900 msgr2=0x7f05340ccd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:05.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.209+0000 7f053b88c700 1 --2- 172.21.15.84:0/1768786956 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f05340cc900 0x7f05340ccd90 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f05340d1110 tx=0x7f052c00b330 comp rx=0 tx=0).stop 2023-09-13T08:26:05.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.209+0000 7f053b88c700 1 -- 172.21.15.84:0/1768786956 shutdown_connections 2023-09-13T08:26:05.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.209+0000 7f053b88c700 1 --2- 172.21.15.84:0/1768786956 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f05340cc900 0x7f05340ccd90 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:05.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.209+0000 7f053b88c700 1 --2- 172.21.15.84:0/1768786956 >> v2:172.21.15.161:3300/0 conn(0x7f053415b200 0x7f053415de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:05.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.209+0000 7f053b88c700 1 -- 172.21.15.84:0/1768786956 >> 172.21.15.84:0/1768786956 conn(0x7f05340b1b80 msgr2=0x7f05340b1f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:26:05.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.209+0000 7f053b88c700 1 -- 172.21.15.84:0/1768786956 shutdown_connections 2023-09-13T08:26:05.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.209+0000 7f053b88c700 1 -- 172.21.15.84:0/1768786956 wait complete. 2023-09-13T08:26:05.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.210+0000 7f053b88c700 1 Processor -- start 2023-09-13T08:26:05.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.210+0000 7f053b88c700 1 -- start start 2023-09-13T08:26:05.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.211+0000 7f053b88c700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f05340cc900 0x7f05340b2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:05.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.211+0000 7f053b88c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f05340ce920 0x7f05340aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:05.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.211+0000 7f053b88c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f053415b200 0x7f05340b52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:05.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.211+0000 7f053b88c700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05340ad3a0 con 0x7f05340ce920 2023-09-13T08:26:05.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.211+0000 7f053b88c700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05340b3540 con 0x7f053415b200 2023-09-13T08:26:05.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.211+0000 7f053b88c700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05340b3820 con 0x7f05340cc900 2023-09-13T08:26:05.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.211+0000 7f0538e27700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f05340ce920 0x7f05340aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:05.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.211+0000 7f0538e27700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f05340ce920 0x7f05340aedb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45838/0 (socket says 172.21.15.84:45838) 2023-09-13T08:26:05.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.211+0000 7f0538e27700 1 -- 172.21.15.84:0/1773184657 learned_addr learned my addr 172.21.15.84:0/1773184657 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:26:05.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.211+0000 7f0539628700 1 --2- 172.21.15.84:0/1773184657 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f05340cc900 0x7f05340b2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:05.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.211+0000 7f0539e29700 1 --2- 172.21.15.84:0/1773184657 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f053415b200 0x7f05340b52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:05.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.211+0000 7f0538e27700 1 -- 172.21.15.84:0/1773184657 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f05340cc900 msgr2=0x7f05340b2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:05.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.211+0000 7f0538e27700 1 --2- 172.21.15.84:0/1773184657 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f05340cc900 0x7f05340b2eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:05.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.211+0000 7f0538e27700 1 -- 172.21.15.84:0/1773184657 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f053415b200 msgr2=0x7f05340b52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:05.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.211+0000 7f0538e27700 1 --2- 172.21.15.84:0/1773184657 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f053415b200 0x7f05340b52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:05.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.211+0000 7f0538e27700 1 -- 172.21.15.84:0/1773184657 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f052c009a70 con 0x7f05340ce920 2023-09-13T08:26:05.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.211+0000 7f0539628700 1 --2- 172.21.15.84:0/1773184657 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f05340cc900 0x7f05340b2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T08:26:05.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.212+0000 7f0538e27700 1 --2- 172.21.15.84:0/1773184657 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f05340ce920 0x7f05340aedb0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f052400c750 tx=0x7f052400cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:26:05.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.212+0000 7f0529ffb700 1 -- 172.21.15.84:0/1773184657 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0524011800 con 0x7f05340ce920 2023-09-13T08:26:05.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.212+0000 7f0529ffb700 1 -- 172.21.15.84:0/1773184657 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0524011960 con 0x7f05340ce920 2023-09-13T08:26:05.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.212+0000 7f053b88c700 1 -- 172.21.15.84:0/1773184657 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05340ad030 con 0x7f05340ce920 2023-09-13T08:26:05.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.212+0000 7f0529ffb700 1 -- 172.21.15.84:0/1773184657 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0524011cd0 con 0x7f05340ce920 2023-09-13T08:26:05.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.212+0000 7f053b88c700 1 -- 172.21.15.84:0/1773184657 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05340b5820 con 0x7f05340ce920 2023-09-13T08:26:05.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.213+0000 7f053b88c700 1 -- 172.21.15.84:0/1773184657 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05340ace90 con 0x7f05340ce920 2023-09-13T08:26:05.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.213+0000 7f0529ffb700 1 -- 172.21.15.84:0/1773184657 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f0524021350 con 0x7f05340ce920 2023-09-13T08:26:05.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.214+0000 7f0529ffb700 1 --2- 172.21.15.84:0/1773184657 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f051806a580 0x7f051806ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:05.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.214+0000 7f0529ffb700 1 -- 172.21.15.84:0/1773184657 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f0524088be0 con 0x7f05340ce920 2023-09-13T08:26:05.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.214+0000 7f0539628700 1 --2- 172.21.15.84:0/1773184657 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f051806a580 0x7f051806ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:05.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.214+0000 7f0539628700 1 --2- 172.21.15.84:0/1773184657 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f051806a580 0x7f051806ca40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0530000f60 tx=0x7f0530007ae0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:26:05.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.218+0000 7f0529ffb700 1 -- 172.21.15.84:0/1773184657 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f05340ace90 con 0x7f05340ce920 2023-09-13T08:26:05.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.451+0000 7f053b88c700 1 -- 172.21.15.84:0/1773184657 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f05340ace90 con 0x7f05340ce920 2023-09-13T08:26:05.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.451+0000 7f0529ffb700 1 -- 172.21.15.84:0/1773184657 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f05340ace90 con 0x7f05340ce920 2023-09-13T08:26:05.452 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:26:05.452 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4829,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6834/654446786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":654446786},{"type":"v1","addr":"172.21.15.161:6834","nonce":654446786}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5041,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/359639686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":359639686},{"type":"v1","addr":"172.21.15.84:6837","nonce":359639686}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5358,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/3026578524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3026578524},{"type":"v1","addr":"172.21.15.84:6836","nonce":3026578524}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T08:26:01.437659+0000","modified":"2023-09-13T08:26:04.457230+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5373},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5373":{"gid":5373,"name":"d","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.161:6835/3356746418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6833","nonce":3356746418},{"type":"v1","addr":"172.21.15.161:6835","nonce":3356746418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-09-13T08:26:05.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.453+0000 7f053b88c700 1 -- 172.21.15.84:0/1773184657 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f051806a580 msgr2=0x7f051806ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:05.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.453+0000 7f053b88c700 1 --2- 172.21.15.84:0/1773184657 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f051806a580 0x7f051806ca40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0530000f60 tx=0x7f0530007ae0 comp rx=0 tx=0).stop 2023-09-13T08:26:05.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.453+0000 7f053b88c700 1 -- 172.21.15.84:0/1773184657 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f05340ce920 msgr2=0x7f05340aedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:05.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.453+0000 7f053b88c700 1 --2- 172.21.15.84:0/1773184657 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f05340ce920 0x7f05340aedb0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f052400c750 tx=0x7f052400cb10 comp rx=0 tx=0).stop 2023-09-13T08:26:05.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.453+0000 7f053b88c700 1 -- 172.21.15.84:0/1773184657 shutdown_connections 2023-09-13T08:26:05.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.453+0000 7f053b88c700 1 --2- 172.21.15.84:0/1773184657 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f051806a580 0x7f051806ca40 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:05.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.453+0000 7f053b88c700 1 --2- 172.21.15.84:0/1773184657 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f053415b200 0x7f05340b52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:05.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.453+0000 7f053b88c700 1 --2- 172.21.15.84:0/1773184657 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f05340cc900 0x7f05340b2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:05.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.453+0000 7f053b88c700 1 --2- 172.21.15.84:0/1773184657 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f05340ce920 0x7f05340aedb0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:05.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.453+0000 7f053b88c700 1 -- 172.21.15.84:0/1773184657 >> 172.21.15.84:0/1773184657 conn(0x7f05340b1b80 msgr2=0x7f05340732c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:26:05.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.454+0000 7f053b88c700 1 -- 172.21.15.84:0/1773184657 shutdown_connections 2023-09-13T08:26:05.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.454+0000 7f053b88c700 1 -- 172.21.15.84:0/1773184657 wait complete. 2023-09-13T08:26:05.456 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 18 2023-09-13T08:26:05.465 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T08:26:05.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.586+0000 7f6cd606a700 1 Processor -- start 2023-09-13T08:26:05.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.586+0000 7f6cd606a700 1 -- start start 2023-09-13T08:26:05.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.587+0000 7f6cd606a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6cd00cc340 0x7f6cd00713b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:05.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.587+0000 7f6cd606a700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cd015b690 con 0x7f6cd00718f0 2023-09-13T08:26:05.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.587+0000 7f6cd606a700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cd015e0a0 con 0x7f6cd015eb80 2023-09-13T08:26:05.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.587+0000 7f6cd606a700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cd015b970 con 0x7f6cd00cc340 2023-09-13T08:26:05.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.588+0000 7f6ccf7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6cd00cc340 0x7f6cd00713b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:05.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.588+0000 7f6ccffff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f6cd00718f0 0x7f6cd00cdc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:48494/0 (socket says 172.21.15.84:48494) 2023-09-13T08:26:05.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.588+0000 7f6ccffff700 1 -- 172.21.15.84:0/1452773590 learned_addr learned my addr 172.21.15.84:0/1452773590 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:26:05.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.588+0000 7f6ccf7fe700 1 -- 172.21.15.84:0/1452773590 >> v1:172.21.15.161:6789/0 conn(0x7f6cd015eb80 legacy=0x7f6cd015a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:26:05.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.588+0000 7f6ccf7fe700 1 -- 172.21.15.84:0/1452773590 >> v1:172.21.15.84:6789/0 conn(0x7f6cd00718f0 legacy=0x7f6cd00cdc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:05.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.588+0000 7f6ccf7fe700 1 -- 172.21.15.84:0/1452773590 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cd015e380 con 0x7f6cd00cc340 2023-09-13T08:26:05.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.588+0000 7f6ccf7fe700 1 --2- 172.21.15.84:0/1452773590 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cd00cc340 0x7f6cd00713b0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f6cb8009870 tx=0x7f6cb8009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbe8190e15ef49d server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:26:05.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.588+0000 7f6cce7fc700 1 -- 172.21.15.84:0/1452773590 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb8004230 con 0x7f6cd00cc340 2023-09-13T08:26:05.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.588+0000 7f6cce7fc700 1 -- 172.21.15.84:0/1452773590 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cb8004390 con 0x7f6cd00cc340 2023-09-13T08:26:05.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.588+0000 7f6cce7fc700 1 -- 172.21.15.84:0/1452773590 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb80036a0 con 0x7f6cd00cc340 2023-09-13T08:26:05.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.589+0000 7f6cd606a700 1 -- 172.21.15.84:0/1452773590 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cd00cc340 msgr2=0x7f6cd00713b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:05.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.589+0000 7f6cd606a700 1 --2- 172.21.15.84:0/1452773590 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cd00cc340 0x7f6cd00713b0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f6cb8009870 tx=0x7f6cb8009b80 comp rx=0 tx=0).stop 2023-09-13T08:26:05.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.589+0000 7f6cd606a700 1 -- 172.21.15.84:0/1452773590 shutdown_connections 2023-09-13T08:26:05.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.589+0000 7f6cd606a700 1 --2- 172.21.15.84:0/1452773590 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cd00cc340 0x7f6cd00713b0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:05.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.589+0000 7f6cd606a700 1 -- 172.21.15.84:0/1452773590 >> 172.21.15.84:0/1452773590 conn(0x7f6cd00d00c0 msgr2=0x7f6cd00d04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:26:05.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.589+0000 7f6cd606a700 1 -- 172.21.15.84:0/1452773590 shutdown_connections 2023-09-13T08:26:05.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.589+0000 7f6cd606a700 1 -- 172.21.15.84:0/1452773590 wait complete. 2023-09-13T08:26:05.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.590+0000 7f6cd606a700 1 Processor -- start 2023-09-13T08:26:05.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.590+0000 7f6cd606a700 1 -- start start 2023-09-13T08:26:05.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.591+0000 7f6cd606a700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6cd00718f0 0x7f6cd01593e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:05.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.591+0000 7f6cd606a700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cd00cc340 0x7f6cd0159920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:05.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.591+0000 7f6cd606a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6cd015eb80 0x7f6cd00b03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:05.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.591+0000 7f6cd606a700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd01f5fc0 con 0x7f6cd00cc340 2023-09-13T08:26:05.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.591+0000 7f6cd606a700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd01f6860 con 0x7f6cd015eb80 2023-09-13T08:26:05.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.591+0000 7f6cd606a700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd00b10b0 con 0x7f6cd00718f0 2023-09-13T08:26:05.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.591+0000 7f6cceffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cd00cc340 0x7f6cd0159920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:05.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.591+0000 7f6cceffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cd00cc340 0x7f6cd0159920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45852/0 (socket says 172.21.15.84:45852) 2023-09-13T08:26:05.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.591+0000 7f6cceffd700 1 -- 172.21.15.84:0/2607700713 learned_addr learned my addr 172.21.15.84:0/2607700713 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:26:05.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.591+0000 7f6ccf7fe700 1 --2- 172.21.15.84:0/2607700713 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6cd00718f0 0x7f6cd01593e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:05.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.591+0000 7f6ccffff700 1 --2- 172.21.15.84:0/2607700713 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6cd015eb80 0x7f6cd00b03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:05.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.591+0000 7f6cceffd700 1 -- 172.21.15.84:0/2607700713 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6cd00718f0 msgr2=0x7f6cd01593e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:05.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.591+0000 7f6cceffd700 1 --2- 172.21.15.84:0/2607700713 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6cd00718f0 0x7f6cd01593e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:05.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.591+0000 7f6cceffd700 1 -- 172.21.15.84:0/2607700713 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6cd015eb80 msgr2=0x7f6cd00b03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:05.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.591+0000 7f6cceffd700 1 --2- 172.21.15.84:0/2607700713 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6cd015eb80 0x7f6cd00b03f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:05.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.591+0000 7f6cceffd700 1 -- 172.21.15.84:0/2607700713 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cb80094a0 con 0x7f6cd00cc340 2023-09-13T08:26:05.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.591+0000 7f6ccf7fe700 1 --2- 172.21.15.84:0/2607700713 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6cd00718f0 0x7f6cd01593e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T08:26:05.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.591+0000 7f6ccffff700 1 --2- 172.21.15.84:0/2607700713 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6cd015eb80 0x7f6cd00b03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T08:26:05.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.591+0000 7f6cceffd700 1 --2- 172.21.15.84:0/2607700713 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cd00cc340 0x7f6cd0159920 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f6cc000b470 tx=0x7f6cc000b830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:26:05.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.592+0000 7f6cc7fff700 1 -- 172.21.15.84:0/2607700713 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc0011830 con 0x7f6cd00cc340 2023-09-13T08:26:05.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.592+0000 7f6cc7fff700 1 -- 172.21.15.84:0/2607700713 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cc0011990 con 0x7f6cd00cc340 2023-09-13T08:26:05.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.592+0000 7f6cc7fff700 1 -- 172.21.15.84:0/2607700713 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc0011d40 con 0x7f6cd00cc340 2023-09-13T08:26:05.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.592+0000 7f6cd606a700 1 -- 172.21.15.84:0/2607700713 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cd01f6210 con 0x7f6cd00cc340 2023-09-13T08:26:05.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.592+0000 7f6cd606a700 1 -- 172.21.15.84:0/2607700713 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cd01f6cf0 con 0x7f6cd00cc340 2023-09-13T08:26:05.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.592+0000 7f6cd606a700 1 -- 172.21.15.84:0/2607700713 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cd01f6a10 con 0x7f6cd00cc340 2023-09-13T08:26:05.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.593+0000 7f6cc7fff700 1 -- 172.21.15.84:0/2607700713 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f6cc001a400 con 0x7f6cd00cc340 2023-09-13T08:26:05.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.593+0000 7f6cc7fff700 1 --2- 172.21.15.84:0/2607700713 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f6cb006a580 0x7f6cb006ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:05.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.593+0000 7f6cc7fff700 1 -- 172.21.15.84:0/2607700713 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f6cc0088c10 con 0x7f6cd00cc340 2023-09-13T08:26:05.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.593+0000 7f6ccf7fe700 1 --2- 172.21.15.84:0/2607700713 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f6cb006a580 0x7f6cb006ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:05.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.594+0000 7f6ccf7fe700 1 --2- 172.21.15.84:0/2607700713 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f6cb006a580 0x7f6cb006ca40 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6cd015d4b0 tx=0x7f6cb8008000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:26:05.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.598+0000 7f6cc7fff700 1 -- 172.21.15.84:0/2607700713 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f6cd01f6a10 con 0x7f6cd00cc340 2023-09-13T08:26:05.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.788+0000 7f6cd606a700 1 -- 172.21.15.84:0/2607700713 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6cd0154e30 con 0x7f6cd00cc340 2023-09-13T08:26:05.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.789+0000 7f6cc7fff700 1 -- 172.21.15.84:0/2607700713 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+16750 (secure 0 0 0) 0x7f6cd0154e30 con 0x7f6cd00cc340 2023-09-13T08:26:05.789 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:26:05.790 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":38,"fsid":"0107440b-b634-42c5-a643-5d31ea826116","created":"2023-09-13T08:24:16.931917+0000","modified":"2023-09-13T08:26:02.719404+0000","last_up_change":"2023-09-13T08:24:28.422631+0000","last_in_change":"2023-09-13T08:24:19.425578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T08:24:28.583720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-09-13T08:25:59.346523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-09-13T08:26:00.400448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4a53ec12-1469-4356-b4e1-2b8fc9b7c0f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6817","nonce":1599532366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6819","nonce":1599532366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6823","nonce":1599532366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6821","nonce":1599532366}]},"public_addr":"172.21.15.84:6817/1599532366","cluster_addr":"172.21.15.84:6819/1599532366","heartbeat_back_addr":"172.21.15.84:6823/1599532366","heartbeat_front_addr":"172.21.15.84:6821/1599532366","state":["exists","up"]},{"osd":1,"uuid":"11e964a0-b80c-4afc-bfbf-e2067969db29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6825","nonce":461860977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6827","nonce":461860977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6831","nonce":461860977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6829","nonce":461860977}]},"public_addr":"172.21.15.84:6825/461860977","cluster_addr":"172.21.15.84:6827/461860977","heartbeat_back_addr":"172.21.15.84:6831/461860977","heartbeat_front_addr":"172.21.15.84:6829/461860977","state":["exists","up"]},{"osd":2,"uuid":"3ce74529-4dd1-44c7-9576-968f5fdc0c25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6809","nonce":1168316165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6811","nonce":1168316165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6815","nonce":1168316165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6813","nonce":1168316165}]},"public_addr":"172.21.15.84:6809/1168316165","cluster_addr":"172.21.15.84:6811/1168316165","heartbeat_back_addr":"172.21.15.84:6815/1168316165","heartbeat_front_addr":"172.21.15.84:6813/1168316165","state":["exists","up"]},{"osd":3,"uuid":"460cb5c5-590a-4d06-a4d9-5bac2fdf33b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6801","nonce":1661609810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6803","nonce":1661609810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6807","nonce":1661609810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6805","nonce":1661609810}]},"public_addr":"172.21.15.84:6801/1661609810","cluster_addr":"172.21.15.84:6803/1661609810","heartbeat_back_addr":"172.21.15.84:6807/1661609810","heartbeat_front_addr":"172.21.15.84:6805/1661609810","state":["exists","up"]},{"osd":4,"uuid":"bf237dd0-3ebd-44b5-8078-24a63e00d792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6801","nonce":1303562374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6803","nonce":1303562374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6807","nonce":1303562374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6805","nonce":1303562374}]},"public_addr":"172.21.15.161:6801/1303562374","cluster_addr":"172.21.15.161:6803/1303562374","heartbeat_back_addr":"172.21.15.161:6807/1303562374","heartbeat_front_addr":"172.21.15.161:6805/1303562374","state":["exists","up"]},{"osd":5,"uuid":"e1e538e0-5844-456b-8c6e-434d3a914af1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6818","nonce":961120854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6822","nonce":961120854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6830","nonce":961120854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6826","nonce":961120854}]},"public_addr":"172.21.15.161:6818/961120854","cluster_addr":"172.21.15.161:6822/961120854","heartbeat_back_addr":"172.21.15.161:6830/961120854","heartbeat_front_addr":"172.21.15.161:6826/961120854","state":["exists","up"]},{"osd":6,"uuid":"5cb1785e-960f-4dd4-b295-9e21b2c3f875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6809","nonce":980533466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6811","nonce":980533466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6815","nonce":980533466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6813","nonce":980533466}]},"public_addr":"172.21.15.161:6809/980533466","cluster_addr":"172.21.15.161:6811/980533466","heartbeat_back_addr":"172.21.15.161:6815/980533466","heartbeat_front_addr":"172.21.15.161:6813/980533466","state":["exists","up"]},{"osd":7,"uuid":"5acb6619-e933-4b46-b1c2-60af30acb839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6817","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6819","nonce":2479691549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6821","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6823","nonce":2479691549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6829","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6831","nonce":2479691549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6825","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6827","nonce":2479691549}]},"public_addr":"172.21.15.161:6819/2479691549","cluster_addr":"172.21.15.161:6823/2479691549","heartbeat_back_addr":"172.21.15.161:6831/2479691549","heartbeat_front_addr":"172.21.15.161:6827/2479691549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.678857+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.685341+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.613603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.634940+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.564387+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.697347+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.637437+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.619397+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T08:26:05.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.792+0000 7f6cd606a700 1 -- 172.21.15.84:0/2607700713 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f6cb006a580 msgr2=0x7f6cb006ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:05.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.792+0000 7f6cd606a700 1 --2- 172.21.15.84:0/2607700713 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f6cb006a580 0x7f6cb006ca40 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6cd015d4b0 tx=0x7f6cb8008000 comp rx=0 tx=0).stop 2023-09-13T08:26:05.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.792+0000 7f6cd606a700 1 -- 172.21.15.84:0/2607700713 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cd00cc340 msgr2=0x7f6cd0159920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:05.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.792+0000 7f6cd606a700 1 --2- 172.21.15.84:0/2607700713 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cd00cc340 0x7f6cd0159920 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f6cc000b470 tx=0x7f6cc000b830 comp rx=0 tx=0).stop 2023-09-13T08:26:05.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.792+0000 7f6cd606a700 1 -- 172.21.15.84:0/2607700713 shutdown_connections 2023-09-13T08:26:05.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.792+0000 7f6cd606a700 1 --2- 172.21.15.84:0/2607700713 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f6cb006a580 0x7f6cb006ca40 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:05.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.792+0000 7f6cd606a700 1 --2- 172.21.15.84:0/2607700713 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6cd015eb80 0x7f6cd00b03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:05.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.792+0000 7f6cd606a700 1 --2- 172.21.15.84:0/2607700713 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6cd00718f0 0x7f6cd01593e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:05.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.792+0000 7f6cd606a700 1 --2- 172.21.15.84:0/2607700713 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cd00cc340 0x7f6cd0159920 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:05.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.792+0000 7f6cd606a700 1 -- 172.21.15.84:0/2607700713 >> 172.21.15.84:0/2607700713 conn(0x7f6cd00d00c0 msgr2=0x7f6cd00cf0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:26:05.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.792+0000 7f6cd606a700 1 -- 172.21.15.84:0/2607700713 shutdown_connections 2023-09-13T08:26:05.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.792+0000 7f6cd606a700 1 -- 172.21.15.84:0/2607700713 wait complete. 2023-09-13T08:26:05.804 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-09-13T08:26:05.804 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-13T08:26:05.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.924+0000 7ff192945700 1 Processor -- start 2023-09-13T08:26:05.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.924+0000 7ff192945700 1 -- start start 2023-09-13T08:26:05.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.925+0000 7ff192945700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff18c0cb730 0x7ff18c15d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:05.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.925+0000 7ff192945700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff18c159e30 con 0x7ff18c15d520 2023-09-13T08:26:05.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.925+0000 7ff192945700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff18c15e090 con 0x7ff18c159a50 2023-09-13T08:26:05.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.925+0000 7ff192945700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff18c0b0560 con 0x7ff18c0cb730 2023-09-13T08:26:05.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.925+0000 7ff18b7fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7ff18c15d520 0x7ff18c0cb020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:48506/0 (socket says 172.21.15.84:48506) 2023-09-13T08:26:05.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.925+0000 7ff18b7fe700 1 -- 172.21.15.84:0/743598610 learned_addr learned my addr 172.21.15.84:0/743598610 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:26:05.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.925+0000 7ff18affd700 1 -- 172.21.15.84:0/743598610 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1465847796 0 0) 0x7ff18c159e30 con 0x7ff18c15d520 2023-09-13T08:26:05.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.925+0000 7ff18affd700 1 -- 172.21.15.84:0/743598610 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1740035b0 con 0x7ff18c15d520 2023-09-13T08:26:05.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.925+0000 7ff190ee2700 1 --2- 172.21.15.84:0/743598610 >> v2:172.21.15.161:3300/0 conn(0x7ff18c0cb730 0x7ff18c15d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:05.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.925+0000 7ff18affd700 1 -- 172.21.15.84:0/743598610 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1123990753 0 0) 0x7ff1740035b0 con 0x7ff18c15d520 2023-09-13T08:26:05.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.925+0000 7ff18affd700 1 -- 172.21.15.84:0/743598610 >> v2:172.21.15.161:3300/0 conn(0x7ff18c0cb730 msgr2=0x7ff18c15d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:26:05.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.925+0000 7ff18affd700 1 --2- 172.21.15.84:0/743598610 >> v2:172.21.15.161:3300/0 conn(0x7ff18c0cb730 0x7ff18c15d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:05.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.925+0000 7ff18affd700 1 -- 172.21.15.84:0/743598610 >> v1:172.21.15.161:6789/0 conn(0x7ff18c159a50 legacy=0x7ff18c0b1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:05.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.925+0000 7ff18affd700 1 -- 172.21.15.84:0/743598610 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff18c0b0840 con 0x7ff18c15d520 2023-09-13T08:26:05.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.925+0000 7ff18affd700 1 -- 172.21.15.84:0/743598610 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2302733408 0 0) 0x7ff17c001670 con 0x7ff18c15d520 2023-09-13T08:26:05.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.926+0000 7ff18affd700 1 -- 172.21.15.84:0/743598610 >> v1:172.21.15.84:6789/0 conn(0x7ff18c15d520 legacy=0x7ff18c0cb020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:05.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.926+0000 7ff18affd700 1 --2- 172.21.15.84:0/743598610 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff174003a00 0x7ff174003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:05.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.926+0000 7ff18affd700 1 --2- 172.21.15.84:0/743598610 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff174004850 0x7ff174004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:05.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.926+0000 7ff18affd700 1 --2- 172.21.15.84:0/743598610 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff174005210 0x7ff17400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:05.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.926+0000 7ff18affd700 1 -- 172.21.15.84:0/743598610 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff18c0b0560 con 0x7ff174004850 2023-09-13T08:26:05.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.926+0000 7ff18affd700 1 -- 172.21.15.84:0/743598610 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff17400c0b0 con 0x7ff174003a00 2023-09-13T08:26:05.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.926+0000 7ff18affd700 1 -- 172.21.15.84:0/743598610 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff17400c270 con 0x7ff174005210 2023-09-13T08:26:05.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.926+0000 7ff18b7fe700 1 --2- 172.21.15.84:0/743598610 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff174004850 0x7ff174004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:05.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.926+0000 7ff18bfff700 1 --2- 172.21.15.84:0/743598610 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff174003a00 0x7ff174003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:05.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.926+0000 7ff190ee2700 1 --2- 172.21.15.84:0/743598610 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff174005210 0x7ff17400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:05.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.926+0000 7ff18b7fe700 1 -- 172.21.15.84:0/743598610 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff174005210 msgr2=0x7ff17400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:26:05.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.926+0000 7ff18b7fe700 1 --2- 172.21.15.84:0/743598610 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff174005210 0x7ff17400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:05.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.926+0000 7ff18b7fe700 1 -- 172.21.15.84:0/743598610 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff174003a00 msgr2=0x7ff174003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:26:05.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.926+0000 7ff18b7fe700 1 --2- 172.21.15.84:0/743598610 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff174003a00 0x7ff174003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:05.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.926+0000 7ff18b7fe700 1 -- 172.21.15.84:0/743598610 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1740035b0 con 0x7ff174004850 2023-09-13T08:26:05.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.926+0000 7ff190ee2700 1 --2- 172.21.15.84:0/743598610 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff174005210 0x7ff17400ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T08:26:05.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.926+0000 7ff190ee2700 1 -- 172.21.15.84:0/743598610 reap_dead start 2023-09-13T08:26:05.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.926+0000 7ff18b7fe700 1 --2- 172.21.15.84:0/743598610 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff174004850 0x7ff174004cd0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7ff17c00c240 tx=0x7ff174005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed8aa38f1bc93a21 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:26:05.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.926+0000 7ff18affd700 1 -- 172.21.15.84:0/743598610 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff17c007c10 con 0x7ff174004850 2023-09-13T08:26:05.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.926+0000 7ff18affd700 1 -- 172.21.15.84:0/743598610 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff17c00cde0 con 0x7ff174004850 2023-09-13T08:26:05.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.926+0000 7ff18affd700 1 -- 172.21.15.84:0/743598610 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff17c005ba0 con 0x7ff174004850 2023-09-13T08:26:05.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.927+0000 7ff192945700 1 -- 172.21.15.84:0/743598610 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff174004850 msgr2=0x7ff174004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:05.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.927+0000 7ff192945700 1 --2- 172.21.15.84:0/743598610 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff174004850 0x7ff174004cd0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7ff17c00c240 tx=0x7ff174005880 comp rx=0 tx=0).stop 2023-09-13T08:26:05.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.927+0000 7ff192945700 1 -- 172.21.15.84:0/743598610 shutdown_connections 2023-09-13T08:26:05.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.927+0000 7ff192945700 1 --2- 172.21.15.84:0/743598610 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff174004850 0x7ff174004cd0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:05.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.927+0000 7ff192945700 1 -- 172.21.15.84:0/743598610 >> 172.21.15.84:0/743598610 conn(0x7ff18c0cc230 msgr2=0x7ff18c0cc640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:26:05.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.927+0000 7ff192945700 1 -- 172.21.15.84:0/743598610 shutdown_connections 2023-09-13T08:26:05.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.927+0000 7ff192945700 1 -- 172.21.15.84:0/743598610 wait complete. 2023-09-13T08:26:05.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.928+0000 7ff192945700 1 Processor -- start 2023-09-13T08:26:05.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.928+0000 7ff192945700 1 -- start start 2023-09-13T08:26:05.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.929+0000 7ff192945700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff174004850 0x7ff18c0c90b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:05.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.929+0000 7ff192945700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff18c151960 0x7ff18c151de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:05.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.929+0000 7ff192945700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff18c150d80 0x7ff18c151210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:05.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.929+0000 7ff192945700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff18c151750 con 0x7ff18c151960 2023-09-13T08:26:05.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.929+0000 7ff192945700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff18c0b3310 con 0x7ff18c150d80 2023-09-13T08:26:05.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.929+0000 7ff192945700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff18c0c6bf0 con 0x7ff174004850 2023-09-13T08:26:05.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.929+0000 7ff18b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff18c151960 0x7ff18c151de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:05.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.929+0000 7ff18b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff18c151960 0x7ff18c151de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45872/0 (socket says 172.21.15.84:45872) 2023-09-13T08:26:05.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.929+0000 7ff18b7fe700 1 -- 172.21.15.84:0/2155196566 learned_addr learned my addr 172.21.15.84:0/2155196566 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:26:05.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.929+0000 7ff18bfff700 1 --2- 172.21.15.84:0/2155196566 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff174004850 0x7ff18c0c90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:05.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.929+0000 7ff190ee2700 1 --2- 172.21.15.84:0/2155196566 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff18c150d80 0x7ff18c151210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:05.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.929+0000 7ff18b7fe700 1 -- 172.21.15.84:0/2155196566 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff174004850 msgr2=0x7ff18c0c90b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:05.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.929+0000 7ff18b7fe700 1 --2- 172.21.15.84:0/2155196566 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff174004850 0x7ff18c0c90b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:05.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.929+0000 7ff18b7fe700 1 -- 172.21.15.84:0/2155196566 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff18c150d80 msgr2=0x7ff18c151210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:05.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.929+0000 7ff18b7fe700 1 --2- 172.21.15.84:0/2155196566 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff18c150d80 0x7ff18c151210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:05.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.929+0000 7ff18b7fe700 1 -- 172.21.15.84:0/2155196566 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff18c0c7270 con 0x7ff18c151960 2023-09-13T08:26:05.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.929+0000 7ff190ee2700 1 --2- 172.21.15.84:0/2155196566 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff18c150d80 0x7ff18c151210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T08:26:05.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.929+0000 7ff18b7fe700 1 --2- 172.21.15.84:0/2155196566 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff18c151960 0x7ff18c151de0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7ff17400c080 tx=0x7ff17c001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:26:05.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.930+0000 7ff188ff9700 1 -- 172.21.15.84:0/2155196566 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff17c001640 con 0x7ff18c151960 2023-09-13T08:26:05.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.930+0000 7ff188ff9700 1 -- 172.21.15.84:0/2155196566 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff17c0070d0 con 0x7ff18c151960 2023-09-13T08:26:05.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.930+0000 7ff192945700 1 -- 172.21.15.84:0/2155196566 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff18c151750 con 0x7ff18c151960 2023-09-13T08:26:05.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.930+0000 7ff188ff9700 1 -- 172.21.15.84:0/2155196566 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff17c007480 con 0x7ff18c151960 2023-09-13T08:26:05.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.930+0000 7ff192945700 1 -- 172.21.15.84:0/2155196566 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff18c0c7830 con 0x7ff18c151960 2023-09-13T08:26:05.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.931+0000 7ff192945700 1 -- 172.21.15.84:0/2155196566 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff18c0b3480 con 0x7ff18c151960 2023-09-13T08:26:05.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.931+0000 7ff188ff9700 1 -- 172.21.15.84:0/2155196566 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7ff17c0075e0 con 0x7ff18c151960 2023-09-13T08:26:05.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.931+0000 7ff188ff9700 1 --2- 172.21.15.84:0/2155196566 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7ff17806a580 0x7ff17806ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:05.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.932+0000 7ff18bfff700 1 --2- 172.21.15.84:0/2155196566 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7ff17806a580 0x7ff17806ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:05.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.932+0000 7ff188ff9700 1 -- 172.21.15.84:0/2155196566 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff17c089d00 con 0x7ff18c151960 2023-09-13T08:26:05.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.932+0000 7ff18bfff700 1 --2- 172.21.15.84:0/2155196566 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7ff17806a580 0x7ff17806ca40 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff18c15ce50 tx=0x7ff180009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:26:05.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:05.936+0000 7ff188ff9700 1 -- 172.21.15.84:0/2155196566 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7ff18c0b3480 con 0x7ff18c151960 2023-09-13T08:26:06.013 INFO:tasks.ceph.mds.d.smithi161.stderr:2023-09-13T08:26:06.013+0000 7f3b9713b700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-09-13T08:26:06.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.123+0000 7ff192945700 1 -- 172.21.15.84:0/2155196566 --> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff18c06de60 con 0x7ff17806a580 2023-09-13T08:26:06.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.131+0000 7ff188ff9700 1 -- 172.21.15.84:0/2155196566 <== mgr.4104 v2:172.21.15.84:6832/3568908055 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289241 (secure 0 0 0) 0x7ff180001d50 con 0x7ff17806a580 2023-09-13T08:26:06.136 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:26:06.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.134+0000 7ff192945700 1 -- 172.21.15.84:0/2155196566 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7ff17806a580 msgr2=0x7ff17806ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:06.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.134+0000 7ff192945700 1 --2- 172.21.15.84:0/2155196566 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7ff17806a580 0x7ff17806ca40 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff18c15ce50 tx=0x7ff180009040 comp rx=0 tx=0).stop 2023-09-13T08:26:06.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.134+0000 7ff192945700 1 -- 172.21.15.84:0/2155196566 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff18c151960 msgr2=0x7ff18c151de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:06.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.134+0000 7ff192945700 1 --2- 172.21.15.84:0/2155196566 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff18c151960 0x7ff18c151de0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7ff17400c080 tx=0x7ff17c001a00 comp rx=0 tx=0).stop 2023-09-13T08:26:06.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.134+0000 7ff192945700 1 -- 172.21.15.84:0/2155196566 shutdown_connections 2023-09-13T08:26:06.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.134+0000 7ff192945700 1 --2- 172.21.15.84:0/2155196566 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7ff17806a580 0x7ff17806ca40 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:06.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.134+0000 7ff192945700 1 --2- 172.21.15.84:0/2155196566 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff18c150d80 0x7ff18c151210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:06.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.134+0000 7ff192945700 1 --2- 172.21.15.84:0/2155196566 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff174004850 0x7ff18c0c90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:06.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.134+0000 7ff192945700 1 --2- 172.21.15.84:0/2155196566 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff18c151960 0x7ff18c151de0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:06.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.134+0000 7ff192945700 1 -- 172.21.15.84:0/2155196566 >> 172.21.15.84:0/2155196566 conn(0x7ff18c0cc230 msgr2=0x7ff18c06cd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:26:06.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.134+0000 7ff192945700 1 -- 172.21.15.84:0/2155196566 shutdown_connections 2023-09-13T08:26:06.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.134+0000 7ff192945700 1 -- 172.21.15.84:0/2155196566 wait complete. 2023-09-13T08:26:06.141 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-09-13T08:26:06.146 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":79,"stamp":"2023-09-13T08:26:04.561144+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":128,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220768,"kb_used_data":4564,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753952,"statfs":{"total":773094113280,"available":772868046848,"internally_reserved":0,"allocated":4673536,"data_stored":2654616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.534113"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-13T08:26:01.738538+0000","last_change":"2023-09-13T08:26:01.733717+0000","last_active":"2023-09-13T08:26:01.738538+0000","last_peered":"2023-09-13T08:26:01.738538+0000","last_clean":"2023-09-13T08:26:01.738538+0000","last_became_active":"2023-09-13T08:26:01.733367+0000","last_became_peered":"2023-09-13T08:26:01.733367+0000","last_unstale":"2023-09-13T08:26:01.738538+0000","last_undegraded":"2023-09-13T08:26:01.738538+0000","last_fullsized":"2023-09-13T08:26:01.738538+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:41:27.059574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-13T08:26:01.739422+0000","last_change":"2023-09-13T08:26:01.733835+0000","last_active":"2023-09-13T08:26:01.739422+0000","last_peered":"2023-09-13T08:26:01.739422+0000","last_clean":"2023-09-13T08:26:01.739422+0000","last_became_active":"2023-09-13T08:26:01.733588+0000","last_became_peered":"2023-09-13T08:26:01.733588+0000","last_unstale":"2023-09-13T08:26:01.739422+0000","last_undegraded":"2023-09-13T08:26:01.739422+0000","last_fullsized":"2023-09-13T08:26:01.739422+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:45:47.220002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-13T08:26:01.736499+0000","last_change":"2023-09-13T08:26:01.734282+0000","last_active":"2023-09-13T08:26:01.736499+0000","last_peered":"2023-09-13T08:26:01.736499+0000","last_clean":"2023-09-13T08:26:01.736499+0000","last_became_active":"2023-09-13T08:26:01.734015+0000","last_became_peered":"2023-09-13T08:26:01.734015+0000","last_unstale":"2023-09-13T08:26:01.736499+0000","last_undegraded":"2023-09-13T08:26:01.736499+0000","last_fullsized":"2023-09-13T08:26:01.736499+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:07:56.968040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:02.724793+0000","last_change":"2023-09-13T08:26:01.732893+0000","last_active":"2023-09-13T08:26:02.724793+0000","last_peered":"2023-09-13T08:26:02.724793+0000","last_clean":"2023-09-13T08:26:02.724793+0000","last_became_active":"2023-09-13T08:26:01.732644+0000","last_became_peered":"2023-09-13T08:26:01.732644+0000","last_unstale":"2023-09-13T08:26:02.724793+0000","last_undegraded":"2023-09-13T08:26:02.724793+0000","last_fullsized":"2023-09-13T08:26:02.724793+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:09:30.453232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:02.725004+0000","last_change":"2023-09-13T08:26:01.733331+0000","last_active":"2023-09-13T08:26:02.725004+0000","last_peered":"2023-09-13T08:26:02.725004+0000","last_clean":"2023-09-13T08:26:02.725004+0000","last_became_active":"2023-09-13T08:26:01.732978+0000","last_became_peered":"2023-09-13T08:26:01.732978+0000","last_unstale":"2023-09-13T08:26:02.725004+0000","last_undegraded":"2023-09-13T08:26:02.725004+0000","last_fullsized":"2023-09-13T08:26:02.725004+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:05:53.120350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-13T08:26:01.738485+0000","last_change":"2023-09-13T08:26:01.731681+0000","last_active":"2023-09-13T08:26:01.738485+0000","last_peered":"2023-09-13T08:26:01.738485+0000","last_clean":"2023-09-13T08:26:01.738485+0000","last_became_active":"2023-09-13T08:26:01.731352+0000","last_became_peered":"2023-09-13T08:26:01.731352+0000","last_unstale":"2023-09-13T08:26:01.738485+0000","last_undegraded":"2023-09-13T08:26:01.738485+0000","last_fullsized":"2023-09-13T08:26:01.738485+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T19:30:06.974598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:02.724264+0000","last_change":"2023-09-13T08:26:01.732448+0000","last_active":"2023-09-13T08:26:02.724264+0000","last_peered":"2023-09-13T08:26:02.724264+0000","last_clean":"2023-09-13T08:26:02.724264+0000","last_became_active":"2023-09-13T08:26:01.732118+0000","last_became_peered":"2023-09-13T08:26:01.732118+0000","last_unstale":"2023-09-13T08:26:02.724264+0000","last_undegraded":"2023-09-13T08:26:02.724264+0000","last_fullsized":"2023-09-13T08:26:02.724264+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:22:59.139845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-13T08:26:01.739563+0000","last_change":"2023-09-13T08:26:01.738108+0000","last_active":"2023-09-13T08:26:01.739563+0000","last_peered":"2023-09-13T08:26:01.739563+0000","last_clean":"2023-09-13T08:26:01.739563+0000","last_became_active":"2023-09-13T08:26:01.737850+0000","last_became_peered":"2023-09-13T08:26:01.737850+0000","last_unstale":"2023-09-13T08:26:01.739563+0000","last_undegraded":"2023-09-13T08:26:01.739563+0000","last_fullsized":"2023-09-13T08:26:01.739563+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:47:51.519894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-13T08:26:01.734166+0000","last_change":"2023-09-13T08:26:01.729732+0000","last_active":"2023-09-13T08:26:01.734166+0000","last_peered":"2023-09-13T08:26:01.734166+0000","last_clean":"2023-09-13T08:26:01.734166+0000","last_became_active":"2023-09-13T08:26:01.729461+0000","last_became_peered":"2023-09-13T08:26:01.729461+0000","last_unstale":"2023-09-13T08:26:01.734166+0000","last_undegraded":"2023-09-13T08:26:01.734166+0000","last_fullsized":"2023-09-13T08:26:01.734166+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:08:09.589011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:02.724050+0000","last_change":"2023-09-13T08:26:01.741137+0000","last_active":"2023-09-13T08:26:02.724050+0000","last_peered":"2023-09-13T08:26:02.724050+0000","last_clean":"2023-09-13T08:26:02.724050+0000","last_became_active":"2023-09-13T08:26:01.740856+0000","last_became_peered":"2023-09-13T08:26:01.740856+0000","last_unstale":"2023-09-13T08:26:02.724050+0000","last_undegraded":"2023-09-13T08:26:02.724050+0000","last_fullsized":"2023-09-13T08:26:02.724050+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:38:08.520198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:02.724328+0000","last_change":"2023-09-13T08:26:01.736055+0000","last_active":"2023-09-13T08:26:02.724328+0000","last_peered":"2023-09-13T08:26:02.724328+0000","last_clean":"2023-09-13T08:26:02.724328+0000","last_became_active":"2023-09-13T08:26:01.735707+0000","last_became_peered":"2023-09-13T08:26:01.735707+0000","last_unstale":"2023-09-13T08:26:02.724328+0000","last_undegraded":"2023-09-13T08:26:02.724328+0000","last_fullsized":"2023-09-13T08:26:02.724328+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:23:05.904970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-13T08:26:01.736265+0000","last_change":"2023-09-13T08:26:01.730685+0000","last_active":"2023-09-13T08:26:01.736265+0000","last_peered":"2023-09-13T08:26:01.736265+0000","last_clean":"2023-09-13T08:26:01.736265+0000","last_became_active":"2023-09-13T08:26:01.730422+0000","last_became_peered":"2023-09-13T08:26:01.730422+0000","last_unstale":"2023-09-13T08:26:01.736265+0000","last_undegraded":"2023-09-13T08:26:01.736265+0000","last_fullsized":"2023-09-13T08:26:01.736265+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:32:27.872315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:02.723610+0000","last_change":"2023-09-13T08:26:01.736835+0000","last_active":"2023-09-13T08:26:02.723610+0000","last_peered":"2023-09-13T08:26:02.723610+0000","last_clean":"2023-09-13T08:26:02.723610+0000","last_became_active":"2023-09-13T08:26:01.736511+0000","last_became_peered":"2023-09-13T08:26:01.736511+0000","last_unstale":"2023-09-13T08:26:02.723610+0000","last_undegraded":"2023-09-13T08:26:02.723610+0000","last_fullsized":"2023-09-13T08:26:02.723610+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:34:56.037414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:03.025157+0000","last_change":"2023-09-13T08:26:01.744264+0000","last_active":"2023-09-13T08:26:03.025157+0000","last_peered":"2023-09-13T08:26:03.025157+0000","last_clean":"2023-09-13T08:26:03.025157+0000","last_became_active":"2023-09-13T08:26:01.743991+0000","last_became_peered":"2023-09-13T08:26:01.743991+0000","last_unstale":"2023-09-13T08:26:03.025157+0000","last_undegraded":"2023-09-13T08:26:03.025157+0000","last_fullsized":"2023-09-13T08:26:03.025157+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:25:28.867284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:02.723518+0000","last_change":"2023-09-13T08:26:01.742272+0000","last_active":"2023-09-13T08:26:02.723518+0000","last_peered":"2023-09-13T08:26:02.723518+0000","last_clean":"2023-09-13T08:26:02.723518+0000","last_became_active":"2023-09-13T08:26:01.741987+0000","last_became_peered":"2023-09-13T08:26:01.741987+0000","last_unstale":"2023-09-13T08:26:02.723518+0000","last_undegraded":"2023-09-13T08:26:02.723518+0000","last_fullsized":"2023-09-13T08:26:02.723518+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:44:07.674488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:02.722955+0000","last_change":"2023-09-13T08:26:01.738181+0000","last_active":"2023-09-13T08:26:02.722955+0000","last_peered":"2023-09-13T08:26:02.722955+0000","last_clean":"2023-09-13T08:26:02.722955+0000","last_became_active":"2023-09-13T08:26:01.737877+0000","last_became_peered":"2023-09-13T08:26:01.737877+0000","last_unstale":"2023-09-13T08:26:02.722955+0000","last_undegraded":"2023-09-13T08:26:02.722955+0000","last_fullsized":"2023-09-13T08:26:02.722955+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:29:51.388005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:02.723841+0000","last_change":"2023-09-13T08:26:01.737813+0000","last_active":"2023-09-13T08:26:02.723841+0000","last_peered":"2023-09-13T08:26:02.723841+0000","last_clean":"2023-09-13T08:26:02.723841+0000","last_became_active":"2023-09-13T08:26:01.737552+0000","last_became_peered":"2023-09-13T08:26:01.737552+0000","last_unstale":"2023-09-13T08:26:02.723841+0000","last_undegraded":"2023-09-13T08:26:02.723841+0000","last_fullsized":"2023-09-13T08:26:02.723841+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:15:17.319095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:03.201033+0000","last_change":"2023-09-13T08:26:01.741697+0000","last_active":"2023-09-13T08:26:03.201033+0000","last_peered":"2023-09-13T08:26:03.201033+0000","last_clean":"2023-09-13T08:26:03.201033+0000","last_became_active":"2023-09-13T08:26:01.741439+0000","last_became_peered":"2023-09-13T08:26:01.741439+0000","last_unstale":"2023-09-13T08:26:03.201033+0000","last_undegraded":"2023-09-13T08:26:03.201033+0000","last_fullsized":"2023-09-13T08:26:03.201033+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:41:27.059574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:02.724722+0000","last_change":"2023-09-13T08:26:01.727795+0000","last_active":"2023-09-13T08:26:02.724722+0000","last_peered":"2023-09-13T08:26:02.724722+0000","last_clean":"2023-09-13T08:26:02.724722+0000","last_became_active":"2023-09-13T08:26:01.727516+0000","last_became_peered":"2023-09-13T08:26:01.727516+0000","last_unstale":"2023-09-13T08:26:02.724722+0000","last_undegraded":"2023-09-13T08:26:02.724722+0000","last_fullsized":"2023-09-13T08:26:02.724722+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:08:09.589011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:03.200892+0000","last_change":"2023-09-13T08:26:01.735152+0000","last_active":"2023-09-13T08:26:03.200892+0000","last_peered":"2023-09-13T08:26:03.200892+0000","last_clean":"2023-09-13T08:26:03.200892+0000","last_became_active":"2023-09-13T08:26:01.734895+0000","last_became_peered":"2023-09-13T08:26:01.734895+0000","last_unstale":"2023-09-13T08:26:03.200892+0000","last_undegraded":"2023-09-13T08:26:03.200892+0000","last_fullsized":"2023-09-13T08:26:03.200892+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:47:51.519894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:02.723766+0000","last_change":"2023-09-13T08:26:01.737301+0000","last_active":"2023-09-13T08:26:02.723766+0000","last_peered":"2023-09-13T08:26:02.723766+0000","last_clean":"2023-09-13T08:26:02.723766+0000","last_became_active":"2023-09-13T08:26:01.737041+0000","last_became_peered":"2023-09-13T08:26:01.737041+0000","last_unstale":"2023-09-13T08:26:02.723766+0000","last_undegraded":"2023-09-13T08:26:02.723766+0000","last_fullsized":"2023-09-13T08:26:02.723766+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:15:17.319095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:03.025299+0000","last_change":"2023-09-13T08:26:01.739688+0000","last_active":"2023-09-13T08:26:03.025299+0000","last_peered":"2023-09-13T08:26:03.025299+0000","last_clean":"2023-09-13T08:26:03.025299+0000","last_became_active":"2023-09-13T08:26:01.739292+0000","last_became_peered":"2023-09-13T08:26:01.739292+0000","last_unstale":"2023-09-13T08:26:03.025299+0000","last_undegraded":"2023-09-13T08:26:03.025299+0000","last_fullsized":"2023-09-13T08:26:03.025299+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:30:18.262953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:02.723374+0000","last_change":"2023-09-13T08:26:01.736039+0000","last_active":"2023-09-13T08:26:02.723374+0000","last_peered":"2023-09-13T08:26:02.723374+0000","last_clean":"2023-09-13T08:26:02.723374+0000","last_became_active":"2023-09-13T08:26:01.735754+0000","last_became_peered":"2023-09-13T08:26:01.735754+0000","last_unstale":"2023-09-13T08:26:02.723374+0000","last_undegraded":"2023-09-13T08:26:02.723374+0000","last_fullsized":"2023-09-13T08:26:02.723374+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:34:56.037414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:02.724639+0000","last_change":"2023-09-13T08:26:01.726204+0000","last_active":"2023-09-13T08:26:02.724639+0000","last_peered":"2023-09-13T08:26:02.724639+0000","last_clean":"2023-09-13T08:26:02.724639+0000","last_became_active":"2023-09-13T08:26:01.725910+0000","last_became_peered":"2023-09-13T08:26:01.725910+0000","last_unstale":"2023-09-13T08:26:02.724639+0000","last_undegraded":"2023-09-13T08:26:02.724639+0000","last_fullsized":"2023-09-13T08:26:02.724639+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:32:08.154597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:03.200981+0000","last_change":"2023-09-13T08:26:01.741014+0000","last_active":"2023-09-13T08:26:03.200981+0000","last_peered":"2023-09-13T08:26:03.200981+0000","last_clean":"2023-09-13T08:26:03.200981+0000","last_became_active":"2023-09-13T08:26:01.740707+0000","last_became_peered":"2023-09-13T08:26:01.740707+0000","last_unstale":"2023-09-13T08:26:03.200981+0000","last_undegraded":"2023-09-13T08:26:03.200981+0000","last_fullsized":"2023-09-13T08:26:03.200981+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:25:28.867284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-13T08:26:01.738909+0000","last_change":"2023-09-13T08:26:01.736031+0000","last_active":"2023-09-13T08:26:01.738909+0000","last_peered":"2023-09-13T08:26:01.738909+0000","last_clean":"2023-09-13T08:26:01.738909+0000","last_became_active":"2023-09-13T08:26:01.735767+0000","last_became_peered":"2023-09-13T08:26:01.735767+0000","last_unstale":"2023-09-13T08:26:01.738909+0000","last_undegraded":"2023-09-13T08:26:01.738909+0000","last_fullsized":"2023-09-13T08:26:01.738909+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:05:53.120350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:03.201043+0000","last_change":"2023-09-13T08:26:01.741085+0000","last_active":"2023-09-13T08:26:03.201043+0000","last_peered":"2023-09-13T08:26:03.201043+0000","last_clean":"2023-09-13T08:26:03.201043+0000","last_became_active":"2023-09-13T08:26:01.740764+0000","last_became_peered":"2023-09-13T08:26:01.740764+0000","last_unstale":"2023-09-13T08:26:03.201043+0000","last_undegraded":"2023-09-13T08:26:03.201043+0000","last_fullsized":"2023-09-13T08:26:03.201043+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:30:18.262953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:02.724041+0000","last_change":"2023-09-13T08:26:01.735325+0000","last_active":"2023-09-13T08:26:02.724041+0000","last_peered":"2023-09-13T08:26:02.724041+0000","last_clean":"2023-09-13T08:26:02.724041+0000","last_became_active":"2023-09-13T08:26:01.735045+0000","last_became_peered":"2023-09-13T08:26:01.735045+0000","last_unstale":"2023-09-13T08:26:02.724041+0000","last_undegraded":"2023-09-13T08:26:02.724041+0000","last_fullsized":"2023-09-13T08:26:02.724041+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:45:56.799141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:03.200896+0000","last_change":"2023-09-13T08:26:01.741302+0000","last_active":"2023-09-13T08:26:03.200896+0000","last_peered":"2023-09-13T08:26:03.200896+0000","last_clean":"2023-09-13T08:26:03.200896+0000","last_became_active":"2023-09-13T08:26:01.740955+0000","last_became_peered":"2023-09-13T08:26:01.740955+0000","last_unstale":"2023-09-13T08:26:03.200896+0000","last_undegraded":"2023-09-13T08:26:03.200896+0000","last_fullsized":"2023-09-13T08:26:03.200896+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:31:01.290048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:03.200781+0000","last_change":"2023-09-13T08:26:01.741204+0000","last_active":"2023-09-13T08:26:03.200781+0000","last_peered":"2023-09-13T08:26:03.200781+0000","last_clean":"2023-09-13T08:26:03.200781+0000","last_became_active":"2023-09-13T08:26:01.740815+0000","last_became_peered":"2023-09-13T08:26:01.740815+0000","last_unstale":"2023-09-13T08:26:03.200781+0000","last_undegraded":"2023-09-13T08:26:03.200781+0000","last_fullsized":"2023-09-13T08:26:03.200781+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:52:21.046807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:02.723161+0000","last_change":"2023-09-13T08:26:01.734665+0000","last_active":"2023-09-13T08:26:02.723161+0000","last_peered":"2023-09-13T08:26:02.723161+0000","last_clean":"2023-09-13T08:26:02.723161+0000","last_became_active":"2023-09-13T08:26:01.734355+0000","last_became_peered":"2023-09-13T08:26:01.734355+0000","last_unstale":"2023-09-13T08:26:02.723161+0000","last_undegraded":"2023-09-13T08:26:02.723161+0000","last_fullsized":"2023-09-13T08:26:02.723161+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:01:08.911581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-13T08:26:01.738357+0000","last_change":"2023-09-13T08:26:01.731690+0000","last_active":"2023-09-13T08:26:01.738357+0000","last_peered":"2023-09-13T08:26:01.738357+0000","last_clean":"2023-09-13T08:26:01.738357+0000","last_became_active":"2023-09-13T08:26:01.731383+0000","last_became_peered":"2023-09-13T08:26:01.731383+0000","last_unstale":"2023-09-13T08:26:01.738357+0000","last_undegraded":"2023-09-13T08:26:01.738357+0000","last_fullsized":"2023-09-13T08:26:01.738357+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:32:08.154597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:02.723989+0000","last_change":"2023-09-13T08:26:01.739213+0000","last_active":"2023-09-13T08:26:02.723989+0000","last_peered":"2023-09-13T08:26:02.723989+0000","last_clean":"2023-09-13T08:26:02.723989+0000","last_became_active":"2023-09-13T08:26:01.738969+0000","last_became_peered":"2023-09-13T08:26:01.738969+0000","last_unstale":"2023-09-13T08:26:02.723989+0000","last_undegraded":"2023-09-13T08:26:02.723989+0000","last_fullsized":"2023-09-13T08:26:02.723989+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:45:56.799141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"37'4","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:03.201015+0000","last_change":"2023-09-13T08:26:01.055036+0000","last_active":"2023-09-13T08:26:03.201015+0000","last_peered":"2023-09-13T08:26:03.201015+0000","last_clean":"2023-09-13T08:26:03.201015+0000","last_became_active":"2023-09-13T08:26:01.054694+0000","last_became_peered":"2023-09-13T08:26:01.054694+0000","last_unstale":"2023-09-13T08:26:03.201015+0000","last_undegraded":"2023-09-13T08:26:03.201015+0000","last_fullsized":"2023-09-13T08:26:03.201015+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_clean_scrub_stamp":"2023-09-13T08:26:00.019012+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:07:55.959995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-13T08:26:01.741195+0000","last_change":"2023-09-13T08:26:01.738462+0000","last_active":"2023-09-13T08:26:01.741195+0000","last_peered":"2023-09-13T08:26:01.741195+0000","last_clean":"2023-09-13T08:26:01.741195+0000","last_became_active":"2023-09-13T08:26:01.738240+0000","last_became_peered":"2023-09-13T08:26:01.738240+0000","last_unstale":"2023-09-13T08:26:01.741195+0000","last_undegraded":"2023-09-13T08:26:01.741195+0000","last_fullsized":"2023-09-13T08:26:01.741195+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:07:56.968040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"37'1","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-13T08:26:02.049387+0000","last_change":"2023-09-13T08:26:01.055626+0000","last_active":"2023-09-13T08:26:02.049387+0000","last_peered":"2023-09-13T08:26:02.049387+0000","last_clean":"2023-09-13T08:26:02.049387+0000","last_became_active":"2023-09-13T08:26:01.055330+0000","last_became_peered":"2023-09-13T08:26:01.055330+0000","last_unstale":"2023-09-13T08:26:02.049387+0000","last_undegraded":"2023-09-13T08:26:02.049387+0000","last_fullsized":"2023-09-13T08:26:02.049387+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_clean_scrub_stamp":"2023-09-13T08:26:00.019012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:25:27.859239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:03.025487+0000","last_change":"2023-09-13T08:26:01.744357+0000","last_active":"2023-09-13T08:26:03.025487+0000","last_peered":"2023-09-13T08:26:03.025487+0000","last_clean":"2023-09-13T08:26:03.025487+0000","last_became_active":"2023-09-13T08:26:01.744027+0000","last_became_peered":"2023-09-13T08:26:01.744027+0000","last_unstale":"2023-09-13T08:26:03.025487+0000","last_undegraded":"2023-09-13T08:26:03.025487+0000","last_fullsized":"2023-09-13T08:26:03.025487+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:38:02.347407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"37'2","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-13T08:26:02.047875+0000","last_change":"2023-09-13T08:26:01.047332+0000","last_active":"2023-09-13T08:26:02.047875+0000","last_peered":"2023-09-13T08:26:02.047875+0000","last_clean":"2023-09-13T08:26:02.047875+0000","last_became_active":"2023-09-13T08:26:01.047070+0000","last_became_peered":"2023-09-13T08:26:01.047070+0000","last_unstale":"2023-09-13T08:26:02.047875+0000","last_undegraded":"2023-09-13T08:26:02.047875+0000","last_fullsized":"2023-09-13T08:26:02.047875+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_clean_scrub_stamp":"2023-09-13T08:26:00.019012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:06:07.858870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-13T08:26:01.747466+0000","last_change":"2023-09-13T08:26:01.741977+0000","last_active":"2023-09-13T08:26:01.747466+0000","last_peered":"2023-09-13T08:26:01.747466+0000","last_clean":"2023-09-13T08:26:01.747466+0000","last_became_active":"2023-09-13T08:26:01.741688+0000","last_became_peered":"2023-09-13T08:26:01.741688+0000","last_unstale":"2023-09-13T08:26:01.747466+0000","last_undegraded":"2023-09-13T08:26:01.747466+0000","last_fullsized":"2023-09-13T08:26:01.747466+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:25:28.867284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"37'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:03.025239+0000","last_change":"2023-09-13T08:26:01.052635+0000","last_active":"2023-09-13T08:26:03.025239+0000","last_peered":"2023-09-13T08:26:03.025239+0000","last_clean":"2023-09-13T08:26:03.025239+0000","last_became_active":"2023-09-13T08:26:01.052337+0000","last_became_peered":"2023-09-13T08:26:01.052337+0000","last_unstale":"2023-09-13T08:26:03.025239+0000","last_undegraded":"2023-09-13T08:26:03.025239+0000","last_fullsized":"2023-09-13T08:26:03.025239+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_clean_scrub_stamp":"2023-09-13T08:26:00.019012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:02:23.724888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-13T08:26:01.734548+0000","last_change":"2023-09-13T08:26:01.729886+0000","last_active":"2023-09-13T08:26:01.734548+0000","last_peered":"2023-09-13T08:26:01.734548+0000","last_clean":"2023-09-13T08:26:01.734548+0000","last_became_active":"2023-09-13T08:26:01.729381+0000","last_became_peered":"2023-09-13T08:26:01.729381+0000","last_unstale":"2023-09-13T08:26:01.734548+0000","last_undegraded":"2023-09-13T08:26:01.734548+0000","last_fullsized":"2023-09-13T08:26:01.734548+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:09:30.453232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"37'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:02.723873+0000","last_change":"2023-09-13T08:26:01.054325+0000","last_active":"2023-09-13T08:26:02.723873+0000","last_peered":"2023-09-13T08:26:02.723873+0000","last_clean":"2023-09-13T08:26:02.723873+0000","last_became_active":"2023-09-13T08:26:01.053990+0000","last_became_peered":"2023-09-13T08:26:01.053990+0000","last_unstale":"2023-09-13T08:26:02.723873+0000","last_undegraded":"2023-09-13T08:26:02.723873+0000","last_fullsized":"2023-09-13T08:26:02.723873+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_clean_scrub_stamp":"2023-09-13T08:26:00.019012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:18:18.835695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:02.723677+0000","last_change":"2023-09-13T08:26:01.733260+0000","last_active":"2023-09-13T08:26:02.723677+0000","last_peered":"2023-09-13T08:26:02.723677+0000","last_clean":"2023-09-13T08:26:02.723677+0000","last_became_active":"2023-09-13T08:26:01.732978+0000","last_became_peered":"2023-09-13T08:26:01.732978+0000","last_unstale":"2023-09-13T08:26:02.723677+0000","last_undegraded":"2023-09-13T08:26:02.723677+0000","last_fullsized":"2023-09-13T08:26:02.723677+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:39:45.862923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"37'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:02.723778+0000","last_change":"2023-09-13T08:26:01.053519+0000","last_active":"2023-09-13T08:26:02.723778+0000","last_peered":"2023-09-13T08:26:02.723778+0000","last_clean":"2023-09-13T08:26:02.723778+0000","last_became_active":"2023-09-13T08:26:01.053238+0000","last_became_peered":"2023-09-13T08:26:01.053238+0000","last_unstale":"2023-09-13T08:26:02.723778+0000","last_undegraded":"2023-09-13T08:26:02.723778+0000","last_fullsized":"2023-09-13T08:26:02.723778+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_clean_scrub_stamp":"2023-09-13T08:26:00.019012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:47:37.567753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:03.025343+0000","last_change":"2023-09-13T08:26:01.740421+0000","last_active":"2023-09-13T08:26:03.025343+0000","last_peered":"2023-09-13T08:26:03.025343+0000","last_clean":"2023-09-13T08:26:03.025343+0000","last_became_active":"2023-09-13T08:26:01.740022+0000","last_became_peered":"2023-09-13T08:26:01.740022+0000","last_unstale":"2023-09-13T08:26:03.025343+0000","last_undegraded":"2023-09-13T08:26:03.025343+0000","last_fullsized":"2023-09-13T08:26:03.025343+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:41:27.059574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-13T08:26:01.726518+0000","last_change":"2023-09-13T08:26:01.054807+0000","last_active":"2023-09-13T08:26:01.726518+0000","last_peered":"2023-09-13T08:26:01.726518+0000","last_clean":"2023-09-13T08:26:01.726518+0000","last_became_active":"2023-09-13T08:26:01.054507+0000","last_became_peered":"2023-09-13T08:26:01.054507+0000","last_unstale":"2023-09-13T08:26:01.726518+0000","last_undegraded":"2023-09-13T08:26:01.726518+0000","last_fullsized":"2023-09-13T08:26:01.726518+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_clean_scrub_stamp":"2023-09-13T08:26:00.019012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:09:29.445187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-13T08:26:01.744678+0000","last_change":"2023-09-13T08:26:01.739740+0000","last_active":"2023-09-13T08:26:01.744678+0000","last_peered":"2023-09-13T08:26:01.744678+0000","last_clean":"2023-09-13T08:26:01.744678+0000","last_became_active":"2023-09-13T08:26:01.739494+0000","last_became_peered":"2023-09-13T08:26:01.739494+0000","last_unstale":"2023-09-13T08:26:01.744678+0000","last_undegraded":"2023-09-13T08:26:01.744678+0000","last_fullsized":"2023-09-13T08:26:01.744678+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:44:07.674488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:03.024981+0000","last_change":"2023-09-13T08:26:01.057195+0000","last_active":"2023-09-13T08:26:03.024981+0000","last_peered":"2023-09-13T08:26:03.024981+0000","last_clean":"2023-09-13T08:26:03.024981+0000","last_became_active":"2023-09-13T08:26:01.056925+0000","last_became_peered":"2023-09-13T08:26:01.056925+0000","last_unstale":"2023-09-13T08:26:03.024981+0000","last_undegraded":"2023-09-13T08:26:03.024981+0000","last_fullsized":"2023-09-13T08:26:03.024981+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_clean_scrub_stamp":"2023-09-13T08:26:00.019012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:07:55.959995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:02.724864+0000","last_change":"2023-09-13T08:26:01.734118+0000","last_active":"2023-09-13T08:26:02.724864+0000","last_peered":"2023-09-13T08:26:02.724864+0000","last_clean":"2023-09-13T08:26:02.724864+0000","last_became_active":"2023-09-13T08:26:01.733598+0000","last_became_peered":"2023-09-13T08:26:01.733598+0000","last_unstale":"2023-09-13T08:26:02.724864+0000","last_undegraded":"2023-09-13T08:26:02.724864+0000","last_fullsized":"2023-09-13T08:26:02.724864+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:07:56.968040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-13T08:26:01.728249+0000","last_change":"2023-09-13T08:26:01.046527+0000","last_active":"2023-09-13T08:26:01.728249+0000","last_peered":"2023-09-13T08:26:01.728249+0000","last_clean":"2023-09-13T08:26:01.728249+0000","last_became_active":"2023-09-13T08:26:01.046255+0000","last_became_peered":"2023-09-13T08:26:01.046255+0000","last_unstale":"2023-09-13T08:26:01.728249+0000","last_undegraded":"2023-09-13T08:26:01.728249+0000","last_fullsized":"2023-09-13T08:26:01.728249+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_clean_scrub_stamp":"2023-09-13T08:26:00.019012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:29:50.379960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:02.723936+0000","last_change":"2023-09-13T08:26:01.742314+0000","last_active":"2023-09-13T08:26:02.723936+0000","last_peered":"2023-09-13T08:26:02.723936+0000","last_clean":"2023-09-13T08:26:02.723936+0000","last_became_active":"2023-09-13T08:26:01.741839+0000","last_became_peered":"2023-09-13T08:26:01.741839+0000","last_unstale":"2023-09-13T08:26:02.723936+0000","last_undegraded":"2023-09-13T08:26:02.723936+0000","last_fullsized":"2023-09-13T08:26:02.723936+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:12:21.335640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:02.724247+0000","last_change":"2023-09-13T08:26:01.063004+0000","last_active":"2023-09-13T08:26:02.724247+0000","last_peered":"2023-09-13T08:26:02.724247+0000","last_clean":"2023-09-13T08:26:02.724247+0000","last_became_active":"2023-09-13T08:26:01.062795+0000","last_became_peered":"2023-09-13T08:26:01.062795+0000","last_unstale":"2023-09-13T08:26:02.724247+0000","last_undegraded":"2023-09-13T08:26:02.724247+0000","last_fullsized":"2023-09-13T08:26:02.724247+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_clean_scrub_stamp":"2023-09-13T08:26:00.019012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:25:27.859239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-13T08:26:01.736231+0000","last_change":"2023-09-13T08:26:01.731498+0000","last_active":"2023-09-13T08:26:01.736231+0000","last_peered":"2023-09-13T08:26:01.736231+0000","last_clean":"2023-09-13T08:26:01.736231+0000","last_became_active":"2023-09-13T08:26:01.731251+0000","last_became_peered":"2023-09-13T08:26:01.731251+0000","last_unstale":"2023-09-13T08:26:01.736231+0000","last_undegraded":"2023-09-13T08:26:01.736231+0000","last_fullsized":"2023-09-13T08:26:01.736231+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:06:08.866915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"37'3","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:02.724395+0000","last_change":"2023-09-13T08:26:01.056936+0000","last_active":"2023-09-13T08:26:02.724395+0000","last_peered":"2023-09-13T08:26:02.724395+0000","last_clean":"2023-09-13T08:26:02.724395+0000","last_became_active":"2023-09-13T08:26:01.056641+0000","last_became_peered":"2023-09-13T08:26:01.056641+0000","last_unstale":"2023-09-13T08:26:02.724395+0000","last_undegraded":"2023-09-13T08:26:02.724395+0000","last_fullsized":"2023-09-13T08:26:02.724395+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_clean_scrub_stamp":"2023-09-13T08:26:00.019012+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:45:46.211956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:03.025475+0000","last_change":"2023-09-13T08:26:01.738674+0000","last_active":"2023-09-13T08:26:03.025475+0000","last_peered":"2023-09-13T08:26:03.025475+0000","last_clean":"2023-09-13T08:26:03.025475+0000","last_became_active":"2023-09-13T08:26:01.738387+0000","last_became_peered":"2023-09-13T08:26:01.738387+0000","last_unstale":"2023-09-13T08:26:03.025475+0000","last_undegraded":"2023-09-13T08:26:03.025475+0000","last_fullsized":"2023-09-13T08:26:03.025475+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:04:45.898112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"37'6","reported_seq":17,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-13T08:26:02.053722+0000","last_change":"2023-09-13T08:26:01.057668+0000","last_active":"2023-09-13T08:26:02.053722+0000","last_peered":"2023-09-13T08:26:02.053722+0000","last_clean":"2023-09-13T08:26:02.053722+0000","last_became_active":"2023-09-13T08:26:01.057402+0000","last_became_peered":"2023-09-13T08:26:01.057402+0000","last_unstale":"2023-09-13T08:26:02.053722+0000","last_undegraded":"2023-09-13T08:26:02.053722+0000","last_fullsized":"2023-09-13T08:26:02.053722+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_clean_scrub_stamp":"2023-09-13T08:26:00.019012+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:18:18.835695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-13T08:26:01.734567+0000","last_change":"2023-09-13T08:26:01.729921+0000","last_active":"2023-09-13T08:26:01.734567+0000","last_peered":"2023-09-13T08:26:01.734567+0000","last_clean":"2023-09-13T08:26:01.734567+0000","last_became_active":"2023-09-13T08:26:01.729662+0000","last_became_peered":"2023-09-13T08:26:01.729662+0000","last_unstale":"2023-09-13T08:26:01.734567+0000","last_undegraded":"2023-09-13T08:26:01.734567+0000","last_fullsized":"2023-09-13T08:26:01.734567+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:02:24.732933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"37'2","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-13T08:26:02.049626+0000","last_change":"2023-09-13T08:26:01.054062+0000","last_active":"2023-09-13T08:26:02.049626+0000","last_peered":"2023-09-13T08:26:02.049626+0000","last_clean":"2023-09-13T08:26:02.049626+0000","last_became_active":"2023-09-13T08:26:01.053761+0000","last_became_peered":"2023-09-13T08:26:01.053761+0000","last_unstale":"2023-09-13T08:26:02.049626+0000","last_undegraded":"2023-09-13T08:26:02.049626+0000","last_fullsized":"2023-09-13T08:26:02.049626+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_clean_scrub_stamp":"2023-09-13T08:26:00.019012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:34:55.029369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-13T08:26:01.735120+0000","last_change":"2023-09-13T08:26:01.732435+0000","last_active":"2023-09-13T08:26:01.735120+0000","last_peered":"2023-09-13T08:26:01.735120+0000","last_clean":"2023-09-13T08:26:01.735120+0000","last_became_active":"2023-09-13T08:26:01.732112+0000","last_became_peered":"2023-09-13T08:26:01.732112+0000","last_unstale":"2023-09-13T08:26:01.735120+0000","last_undegraded":"2023-09-13T08:26:01.735120+0000","last_fullsized":"2023-09-13T08:26:01.735120+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:52:21.046807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-13T08:26:01.726803+0000","last_change":"2023-09-13T08:26:01.054920+0000","last_active":"2023-09-13T08:26:01.726803+0000","last_peered":"2023-09-13T08:26:01.726803+0000","last_clean":"2023-09-13T08:26:01.726803+0000","last_became_active":"2023-09-13T08:26:01.054521+0000","last_became_peered":"2023-09-13T08:26:01.054521+0000","last_unstale":"2023-09-13T08:26:01.726803+0000","last_undegraded":"2023-09-13T08:26:01.726803+0000","last_fullsized":"2023-09-13T08:26:01.726803+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_clean_scrub_stamp":"2023-09-13T08:26:00.019012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:02:23.724888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:02.723674+0000","last_change":"2023-09-13T08:26:01.734292+0000","last_active":"2023-09-13T08:26:02.723674+0000","last_peered":"2023-09-13T08:26:02.723674+0000","last_clean":"2023-09-13T08:26:02.723674+0000","last_became_active":"2023-09-13T08:26:01.733942+0000","last_became_peered":"2023-09-13T08:26:01.733942+0000","last_unstale":"2023-09-13T08:26:02.723674+0000","last_undegraded":"2023-09-13T08:26:02.723674+0000","last_fullsized":"2023-09-13T08:26:02.723674+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:39:45.862923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:03.200694+0000","last_change":"2023-09-13T08:26:01.055564+0000","last_active":"2023-09-13T08:26:03.200694+0000","last_peered":"2023-09-13T08:26:03.200694+0000","last_clean":"2023-09-13T08:26:03.200694+0000","last_became_active":"2023-09-13T08:26:01.055316+0000","last_became_peered":"2023-09-13T08:26:01.055316+0000","last_unstale":"2023-09-13T08:26:03.200694+0000","last_undegraded":"2023-09-13T08:26:03.200694+0000","last_fullsized":"2023-09-13T08:26:03.200694+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_clean_scrub_stamp":"2023-09-13T08:26:00.019012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:09:29.445187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-13T08:26:01.738409+0000","last_change":"2023-09-13T08:26:01.733591+0000","last_active":"2023-09-13T08:26:01.738409+0000","last_peered":"2023-09-13T08:26:01.738409+0000","last_clean":"2023-09-13T08:26:01.738409+0000","last_became_active":"2023-09-13T08:26:01.733308+0000","last_became_peered":"2023-09-13T08:26:01.733308+0000","last_unstale":"2023-09-13T08:26:01.738409+0000","last_undegraded":"2023-09-13T08:26:01.738409+0000","last_fullsized":"2023-09-13T08:26:01.738409+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:01:08.911581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"37'8","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:02.723063+0000","last_change":"2023-09-13T08:26:01.054947+0000","last_active":"2023-09-13T08:26:02.723063+0000","last_peered":"2023-09-13T08:26:02.723063+0000","last_clean":"2023-09-13T08:26:02.723063+0000","last_became_active":"2023-09-13T08:26:01.054676+0000","last_became_peered":"2023-09-13T08:26:01.054676+0000","last_unstale":"2023-09-13T08:26:02.723063+0000","last_undegraded":"2023-09-13T08:26:02.723063+0000","last_fullsized":"2023-09-13T08:26:02.723063+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_clean_scrub_stamp":"2023-09-13T08:26:00.019012+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:32:26.864270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-13T08:26:01.747484+0000","last_change":"2023-09-13T08:26:01.743612+0000","last_active":"2023-09-13T08:26:01.747484+0000","last_peered":"2023-09-13T08:26:01.747484+0000","last_clean":"2023-09-13T08:26:01.747484+0000","last_became_active":"2023-09-13T08:26:01.743410+0000","last_became_peered":"2023-09-13T08:26:01.743410+0000","last_unstale":"2023-09-13T08:26:01.747484+0000","last_undegraded":"2023-09-13T08:26:01.747484+0000","last_fullsized":"2023-09-13T08:26:01.747484+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:04:45.898112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:02.724562+0000","last_change":"2023-09-13T08:26:01.059780+0000","last_active":"2023-09-13T08:26:02.724562+0000","last_peered":"2023-09-13T08:26:02.724562+0000","last_clean":"2023-09-13T08:26:02.724562+0000","last_became_active":"2023-09-13T08:26:01.059453+0000","last_became_peered":"2023-09-13T08:26:01.059453+0000","last_unstale":"2023-09-13T08:26:02.724562+0000","last_undegraded":"2023-09-13T08:26:02.724562+0000","last_fullsized":"2023-09-13T08:26:02.724562+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_clean_scrub_stamp":"2023-09-13T08:26:00.019012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:47:50.511849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:02.724416+0000","last_change":"2023-09-13T08:26:01.733245+0000","last_active":"2023-09-13T08:26:02.724416+0000","last_peered":"2023-09-13T08:26:02.724416+0000","last_clean":"2023-09-13T08:26:02.724416+0000","last_became_active":"2023-09-13T08:26:01.732948+0000","last_became_peered":"2023-09-13T08:26:01.732948+0000","last_unstale":"2023-09-13T08:26:02.724416+0000","last_undegraded":"2023-09-13T08:26:02.724416+0000","last_fullsized":"2023-09-13T08:26:02.724416+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:42:14.467719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"37'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:03.025455+0000","last_change":"2023-09-13T08:26:01.055117+0000","last_active":"2023-09-13T08:26:03.025455+0000","last_peered":"2023-09-13T08:26:03.025455+0000","last_clean":"2023-09-13T08:26:03.025455+0000","last_became_active":"2023-09-13T08:26:01.054824+0000","last_became_peered":"2023-09-13T08:26:01.054824+0000","last_unstale":"2023-09-13T08:26:03.025455+0000","last_undegraded":"2023-09-13T08:26:03.025455+0000","last_fullsized":"2023-09-13T08:26:03.025455+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_clean_scrub_stamp":"2023-09-13T08:26:00.019012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:32:26.864270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:03.025568+0000","last_change":"2023-09-13T08:26:01.739097+0000","last_active":"2023-09-13T08:26:03.025568+0000","last_peered":"2023-09-13T08:26:03.025568+0000","last_clean":"2023-09-13T08:26:03.025568+0000","last_became_active":"2023-09-13T08:26:01.734486+0000","last_became_peered":"2023-09-13T08:26:01.734486+0000","last_unstale":"2023-09-13T08:26:03.025568+0000","last_undegraded":"2023-09-13T08:26:03.025568+0000","last_fullsized":"2023-09-13T08:26:03.025568+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:45:47.220002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"37'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:02.724766+0000","last_change":"2023-09-13T08:26:01.054844+0000","last_active":"2023-09-13T08:26:02.724766+0000","last_peered":"2023-09-13T08:26:02.724766+0000","last_clean":"2023-09-13T08:26:02.724766+0000","last_became_active":"2023-09-13T08:26:01.054060+0000","last_became_peered":"2023-09-13T08:26:01.054060+0000","last_unstale":"2023-09-13T08:26:02.724766+0000","last_undegraded":"2023-09-13T08:26:02.724766+0000","last_fullsized":"2023-09-13T08:26:02.724766+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_clean_scrub_stamp":"2023-09-13T08:26:00.019012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T19:03:25.317258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:02.724981+0000","last_change":"2023-09-13T08:26:01.734363+0000","last_active":"2023-09-13T08:26:02.724981+0000","last_peered":"2023-09-13T08:26:02.724981+0000","last_clean":"2023-09-13T08:26:02.724981+0000","last_became_active":"2023-09-13T08:26:01.734114+0000","last_became_peered":"2023-09-13T08:26:01.734114+0000","last_unstale":"2023-09-13T08:26:02.724981+0000","last_undegraded":"2023-09-13T08:26:02.724981+0000","last_fullsized":"2023-09-13T08:26:02.724981+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:47:38.575798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-13T08:26:01.726750+0000","last_change":"2023-09-13T08:26:01.047368+0000","last_active":"2023-09-13T08:26:01.726750+0000","last_peered":"2023-09-13T08:26:01.726750+0000","last_clean":"2023-09-13T08:26:01.726750+0000","last_became_active":"2023-09-13T08:26:01.047110+0000","last_became_peered":"2023-09-13T08:26:01.047110+0000","last_unstale":"2023-09-13T08:26:01.726750+0000","last_undegraded":"2023-09-13T08:26:01.726750+0000","last_fullsized":"2023-09-13T08:26:01.726750+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_clean_scrub_stamp":"2023-09-13T08:26:00.019012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:47:37.567753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:02.723368+0000","last_change":"2023-09-13T08:26:01.734856+0000","last_active":"2023-09-13T08:26:02.723368+0000","last_peered":"2023-09-13T08:26:02.723368+0000","last_clean":"2023-09-13T08:26:02.723368+0000","last_became_active":"2023-09-13T08:26:01.734576+0000","last_became_peered":"2023-09-13T08:26:01.734576+0000","last_unstale":"2023-09-13T08:26:02.723368+0000","last_undegraded":"2023-09-13T08:26:02.723368+0000","last_fullsized":"2023-09-13T08:26:02.723368+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:44:07.674488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"37'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:02.724663+0000","last_change":"2023-09-13T08:26:01.056732+0000","last_active":"2023-09-13T08:26:02.724663+0000","last_peered":"2023-09-13T08:26:02.724663+0000","last_clean":"2023-09-13T08:26:02.724663+0000","last_became_active":"2023-09-13T08:26:01.056389+0000","last_became_peered":"2023-09-13T08:26:01.056389+0000","last_unstale":"2023-09-13T08:26:02.724663+0000","last_undegraded":"2023-09-13T08:26:02.724663+0000","last_fullsized":"2023-09-13T08:26:02.724663+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_clean_scrub_stamp":"2023-09-13T08:26:00.019012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:08:49.086873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-13T08:26:01.736167+0000","last_change":"2023-09-13T08:26:01.730585+0000","last_active":"2023-09-13T08:26:01.736167+0000","last_peered":"2023-09-13T08:26:01.736167+0000","last_clean":"2023-09-13T08:26:01.736167+0000","last_became_active":"2023-09-13T08:26:01.730332+0000","last_became_peered":"2023-09-13T08:26:01.730332+0000","last_unstale":"2023-09-13T08:26:01.736167+0000","last_undegraded":"2023-09-13T08:26:01.736167+0000","last_fullsized":"2023-09-13T08:26:01.736167+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:47:38.575798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:02.724721+0000","last_change":"2023-09-13T08:26:01.051739+0000","last_active":"2023-09-13T08:26:02.724721+0000","last_peered":"2023-09-13T08:26:02.724721+0000","last_clean":"2023-09-13T08:26:02.724721+0000","last_became_active":"2023-09-13T08:26:01.051133+0000","last_became_peered":"2023-09-13T08:26:01.051133+0000","last_unstale":"2023-09-13T08:26:02.724721+0000","last_undegraded":"2023-09-13T08:26:02.724721+0000","last_fullsized":"2023-09-13T08:26:02.724721+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_clean_scrub_stamp":"2023-09-13T08:26:00.019012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:17:49.059630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:02.723885+0000","last_change":"2023-09-13T08:26:01.742294+0000","last_active":"2023-09-13T08:26:02.723885+0000","last_peered":"2023-09-13T08:26:02.723885+0000","last_clean":"2023-09-13T08:26:02.723885+0000","last_became_active":"2023-09-13T08:26:01.742042+0000","last_became_peered":"2023-09-13T08:26:01.742042+0000","last_unstale":"2023-09-13T08:26:02.723885+0000","last_undegraded":"2023-09-13T08:26:02.723885+0000","last_fullsized":"2023-09-13T08:26:02.723885+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:12:21.335640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:02.723465+0000","last_change":"2023-09-13T08:26:01.056899+0000","last_active":"2023-09-13T08:26:02.723465+0000","last_peered":"2023-09-13T08:26:02.723465+0000","last_clean":"2023-09-13T08:26:02.723465+0000","last_became_active":"2023-09-13T08:26:01.056616+0000","last_became_peered":"2023-09-13T08:26:01.056616+0000","last_unstale":"2023-09-13T08:26:02.723465+0000","last_undegraded":"2023-09-13T08:26:02.723465+0000","last_fullsized":"2023-09-13T08:26:02.723465+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_clean_scrub_stamp":"2023-09-13T08:26:00.019012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:18:18.835695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-13T08:26:01.744658+0000","last_change":"2023-09-13T08:26:01.739722+0000","last_active":"2023-09-13T08:26:01.744658+0000","last_peered":"2023-09-13T08:26:01.744658+0000","last_clean":"2023-09-13T08:26:01.744658+0000","last_became_active":"2023-09-13T08:26:01.739472+0000","last_became_peered":"2023-09-13T08:26:01.739472+0000","last_unstale":"2023-09-13T08:26:01.744658+0000","last_undegraded":"2023-09-13T08:26:01.744658+0000","last_fullsized":"2023-09-13T08:26:01.744658+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:38:02.347407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:02.724493+0000","last_change":"2023-09-13T08:26:01.056672+0000","last_active":"2023-09-13T08:26:02.724493+0000","last_peered":"2023-09-13T08:26:02.724493+0000","last_clean":"2023-09-13T08:26:02.724493+0000","last_became_active":"2023-09-13T08:26:01.056349+0000","last_became_peered":"2023-09-13T08:26:01.056349+0000","last_unstale":"2023-09-13T08:26:02.724493+0000","last_undegraded":"2023-09-13T08:26:02.724493+0000","last_fullsized":"2023-09-13T08:26:02.724493+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_clean_scrub_stamp":"2023-09-13T08:26:00.019012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:07:01.340902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-13T08:26:01.738578+0000","last_change":"2023-09-13T08:26:01.733565+0000","last_active":"2023-09-13T08:26:01.738578+0000","last_peered":"2023-09-13T08:26:01.738578+0000","last_clean":"2023-09-13T08:26:01.738578+0000","last_became_active":"2023-09-13T08:26:01.733301+0000","last_became_peered":"2023-09-13T08:26:01.733301+0000","last_unstale":"2023-09-13T08:26:01.738578+0000","last_undegraded":"2023-09-13T08:26:01.738578+0000","last_fullsized":"2023-09-13T08:26:01.738578+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:08:09.589011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"37'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:02.724612+0000","last_change":"2023-09-13T08:26:01.059579+0000","last_active":"2023-09-13T08:26:02.724612+0000","last_peered":"2023-09-13T08:26:02.724612+0000","last_clean":"2023-09-13T08:26:02.724612+0000","last_became_active":"2023-09-13T08:26:01.057201+0000","last_became_peered":"2023-09-13T08:26:01.057201+0000","last_unstale":"2023-09-13T08:26:02.724612+0000","last_undegraded":"2023-09-13T08:26:02.724612+0000","last_fullsized":"2023-09-13T08:26:02.724612+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_clean_scrub_stamp":"2023-09-13T08:26:00.019012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:31:00.282003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:02.724096+0000","last_change":"2023-09-13T08:26:01.744914+0000","last_active":"2023-09-13T08:26:02.724096+0000","last_peered":"2023-09-13T08:26:02.724096+0000","last_clean":"2023-09-13T08:26:02.724096+0000","last_became_active":"2023-09-13T08:26:01.744663+0000","last_became_peered":"2023-09-13T08:26:01.744663+0000","last_unstale":"2023-09-13T08:26:02.724096+0000","last_undegraded":"2023-09-13T08:26:02.724096+0000","last_fullsized":"2023-09-13T08:26:02.724096+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:38:08.520198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:02.725024+0000","last_change":"2023-09-13T08:26:01.055883+0000","last_active":"2023-09-13T08:26:02.725024+0000","last_peered":"2023-09-13T08:26:02.725024+0000","last_clean":"2023-09-13T08:26:02.725024+0000","last_became_active":"2023-09-13T08:26:01.055583+0000","last_became_peered":"2023-09-13T08:26:01.055583+0000","last_unstale":"2023-09-13T08:26:02.725024+0000","last_undegraded":"2023-09-13T08:26:02.725024+0000","last_fullsized":"2023-09-13T08:26:02.725024+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_clean_scrub_stamp":"2023-09-13T08:26:00.019012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:04:36.970333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-13T08:26:01.744713+0000","last_change":"2023-09-13T08:26:01.740229+0000","last_active":"2023-09-13T08:26:01.744713+0000","last_peered":"2023-09-13T08:26:01.744713+0000","last_clean":"2023-09-13T08:26:01.744713+0000","last_became_active":"2023-09-13T08:26:01.740010+0000","last_became_peered":"2023-09-13T08:26:01.740010+0000","last_unstale":"2023-09-13T08:26:01.744713+0000","last_undegraded":"2023-09-13T08:26:01.744713+0000","last_fullsized":"2023-09-13T08:26:01.744713+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:30:18.262953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-13T08:26:01.724763+0000","last_change":"2023-09-13T08:26:01.058721+0000","last_active":"2023-09-13T08:26:01.724763+0000","last_peered":"2023-09-13T08:26:01.724763+0000","last_clean":"2023-09-13T08:26:01.724763+0000","last_became_active":"2023-09-13T08:26:01.058475+0000","last_became_peered":"2023-09-13T08:26:01.058475+0000","last_unstale":"2023-09-13T08:26:01.724763+0000","last_undegraded":"2023-09-13T08:26:01.724763+0000","last_fullsized":"2023-09-13T08:26:01.724763+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_clean_scrub_stamp":"2023-09-13T08:26:00.019012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:47:50.511849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-13T08:26:01.737981+0000","last_change":"2023-09-13T08:26:01.735901+0000","last_active":"2023-09-13T08:26:01.737981+0000","last_peered":"2023-09-13T08:26:01.737981+0000","last_clean":"2023-09-13T08:26:01.737981+0000","last_became_active":"2023-09-13T08:26:01.735363+0000","last_became_peered":"2023-09-13T08:26:01.735363+0000","last_unstale":"2023-09-13T08:26:01.737981+0000","last_undegraded":"2023-09-13T08:26:01.737981+0000","last_fullsized":"2023-09-13T08:26:01.737981+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:52:21.046807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-13T08:26:01.724813+0000","last_change":"2023-09-13T08:26:01.056584+0000","last_active":"2023-09-13T08:26:01.724813+0000","last_peered":"2023-09-13T08:26:01.724813+0000","last_clean":"2023-09-13T08:26:01.724813+0000","last_became_active":"2023-09-13T08:26:01.056316+0000","last_became_peered":"2023-09-13T08:26:01.056316+0000","last_unstale":"2023-09-13T08:26:01.724813+0000","last_undegraded":"2023-09-13T08:26:01.724813+0000","last_fullsized":"2023-09-13T08:26:01.724813+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_clean_scrub_stamp":"2023-09-13T08:26:00.019012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:31:00.282003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-13T08:26:01.746526+0000","last_change":"2023-09-13T08:26:01.741874+0000","last_active":"2023-09-13T08:26:01.746526+0000","last_peered":"2023-09-13T08:26:01.746526+0000","last_clean":"2023-09-13T08:26:01.746526+0000","last_became_active":"2023-09-13T08:26:01.741668+0000","last_became_peered":"2023-09-13T08:26:01.741668+0000","last_unstale":"2023-09-13T08:26:01.746526+0000","last_undegraded":"2023-09-13T08:26:01.746526+0000","last_fullsized":"2023-09-13T08:26:01.746526+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:03:10.132906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:03.200787+0000","last_change":"2023-09-13T08:26:01.054929+0000","last_active":"2023-09-13T08:26:03.200787+0000","last_peered":"2023-09-13T08:26:03.200787+0000","last_clean":"2023-09-13T08:26:03.200787+0000","last_became_active":"2023-09-13T08:26:01.054629+0000","last_became_peered":"2023-09-13T08:26:01.054629+0000","last_unstale":"2023-09-13T08:26:03.200787+0000","last_undegraded":"2023-09-13T08:26:03.200787+0000","last_fullsized":"2023-09-13T08:26:03.200787+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_clean_scrub_stamp":"2023-09-13T08:26:00.019012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:47:37.567753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:03.025505+0000","last_change":"2023-09-13T08:26:01.739418+0000","last_active":"2023-09-13T08:26:03.025505+0000","last_peered":"2023-09-13T08:26:03.025505+0000","last_clean":"2023-09-13T08:26:03.025505+0000","last_became_active":"2023-09-13T08:26:01.738169+0000","last_became_peered":"2023-09-13T08:26:01.738169+0000","last_unstale":"2023-09-13T08:26:03.025505+0000","last_undegraded":"2023-09-13T08:26:03.025505+0000","last_fullsized":"2023-09-13T08:26:03.025505+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:18:19.843741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:03.024994+0000","last_change":"2023-09-13T08:26:01.052439+0000","last_active":"2023-09-13T08:26:03.024994+0000","last_peered":"2023-09-13T08:26:03.024994+0000","last_clean":"2023-09-13T08:26:03.024994+0000","last_became_active":"2023-09-13T08:26:01.052150+0000","last_became_peered":"2023-09-13T08:26:01.052150+0000","last_unstale":"2023-09-13T08:26:03.024994+0000","last_undegraded":"2023-09-13T08:26:03.024994+0000","last_fullsized":"2023-09-13T08:26:03.024994+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_clean_scrub_stamp":"2023-09-13T08:26:00.019012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:32:07.146552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:02.724154+0000","last_change":"2023-09-13T08:26:01.742165+0000","last_active":"2023-09-13T08:26:02.724154+0000","last_peered":"2023-09-13T08:26:02.724154+0000","last_clean":"2023-09-13T08:26:02.724154+0000","last_became_active":"2023-09-13T08:26:01.741848+0000","last_became_peered":"2023-09-13T08:26:01.741848+0000","last_unstale":"2023-09-13T08:26:02.724154+0000","last_undegraded":"2023-09-13T08:26:02.724154+0000","last_fullsized":"2023-09-13T08:26:02.724154+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:22:59.139845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-13T08:26:01.725811+0000","last_change":"2023-09-13T08:26:01.046544+0000","last_active":"2023-09-13T08:26:01.725811+0000","last_peered":"2023-09-13T08:26:01.725811+0000","last_clean":"2023-09-13T08:26:01.725811+0000","last_became_active":"2023-09-13T08:26:01.046267+0000","last_became_peered":"2023-09-13T08:26:01.046267+0000","last_unstale":"2023-09-13T08:26:01.725811+0000","last_undegraded":"2023-09-13T08:26:01.725811+0000","last_fullsized":"2023-09-13T08:26:01.725811+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_clean_scrub_stamp":"2023-09-13T08:26:00.019012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:31:00.282003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:02.724530+0000","last_change":"2023-09-13T08:26:01.736209+0000","last_active":"2023-09-13T08:26:02.724530+0000","last_peered":"2023-09-13T08:26:02.724530+0000","last_clean":"2023-09-13T08:26:02.724530+0000","last_became_active":"2023-09-13T08:26:01.735902+0000","last_became_peered":"2023-09-13T08:26:01.735902+0000","last_unstale":"2023-09-13T08:26:02.724530+0000","last_undegraded":"2023-09-13T08:26:02.724530+0000","last_fullsized":"2023-09-13T08:26:02.724530+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T19:02:51.233158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:02.724050+0000","last_change":"2023-09-13T08:26:01.054253+0000","last_active":"2023-09-13T08:26:02.724050+0000","last_peered":"2023-09-13T08:26:02.724050+0000","last_clean":"2023-09-13T08:26:02.724050+0000","last_became_active":"2023-09-13T08:26:01.053982+0000","last_became_peered":"2023-09-13T08:26:01.053982+0000","last_unstale":"2023-09-13T08:26:02.724050+0000","last_undegraded":"2023-09-13T08:26:02.724050+0000","last_fullsized":"2023-09-13T08:26:02.724050+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_clean_scrub_stamp":"2023-09-13T08:26:00.019012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:02:23.724888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":183,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-13T08:26:01.729286+0000","last_change":"2023-09-13T08:24:30.608284+0000","last_active":"2023-09-13T08:26:01.729286+0000","last_peered":"2023-09-13T08:26:01.729286+0000","last_clean":"2023-09-13T08:26:01.729286+0000","last_became_active":"2023-09-13T08:24:30.607240+0000","last_became_peered":"2023-09-13T08:24:30.607240+0000","last_unstale":"2023-09-13T08:26:01.729286+0000","last_undegraded":"2023-09-13T08:26:01.729286+0000","last_fullsized":"2023-09-13T08:26:01.729286+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:29.424755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:29.424755+0000","last_clean_scrub_stamp":"2023-09-13T08:24:29.424755+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:57:43.427279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574870,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28044,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343796,"statfs":{"total":96636764160,"available":96608047104,"internally_reserved":0,"allocated":1048576,"data_stored":781475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 08:25:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.54600000000000004}]},{"osd":1,"last update":"Wed Sep 13 08:25:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.438},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.70099999999999996}]},{"osd":2,"last update":"Wed Sep 13 08:25:30 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.49199999999999999}]},{"osd":3,"last update":"Wed Sep 13 08:25:30 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.60399999999999998}]},{"osd":4,"last update":"Wed Sep 13 08:25:30 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.66100000000000003}]},{"osd":5,"last update":"Wed Sep 13 08:25:30 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.67300000000000004}]},{"osd":6,"last update":"Wed Sep 13 08:25:30 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.61899999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574872,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":430080,"data_stored":183387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 08:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.79300000000000004}]},{"osd":1,"last update":"Wed Sep 13 08:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.84399999999999997}]},{"osd":2,"last update":"Wed Sep 13 08:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.82699999999999996}]},{"osd":3,"last update":"Wed Sep 13 08:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.68000000000000005}]},{"osd":4,"last update":"Wed Sep 13 08:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.69699999999999995}]},{"osd":5,"last update":"Wed Sep 13 08:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.745},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.55000000000000004}]},{"osd":7,"last update":"Wed Sep 13 08:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.629},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.85799999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":430080,"data_stored":182895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 08:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"last":0.376}]},{"osd":2,"last update":"Wed Sep 13 08:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.317}]},{"osd":3,"last update":"Wed Sep 13 08:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.33600000000000002}]},{"osd":4,"last update":"Wed Sep 13 08:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.53300000000000003}]},{"osd":5,"last update":"Wed Sep 13 08:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.52300000000000002}]},{"osd":6,"last update":"Wed Sep 13 08:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.502},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.59699999999999998}]},{"osd":7,"last update":"Wed Sep 13 08:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.48899999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574871,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28016,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343824,"statfs":{"total":96636764160,"available":96608075776,"internally_reserved":0,"allocated":1024000,"data_stored":773207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 13 08:25:28 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":7.3490000000000002,"5min":7.3490000000000002,"15min":7.3490000000000002},"last":0.23499999999999999},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.34000000000000002}]},{"osd":2,"last update":"Wed Sep 13 08:25:28 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":11.343999999999999,"5min":11.343999999999999,"15min":11.343999999999999},"last":0.26700000000000002}]},{"osd":3,"last update":"Wed Sep 13 08:25:28 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":7.3040000000000003,"5min":7.3040000000000003,"15min":7.3040000000000003},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.36199999999999999}]},{"osd":4,"last update":"Wed Sep 13 08:25:28 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":7.4109999999999996,"5min":7.4109999999999996,"15min":7.4109999999999996},"last":0.442},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.51500000000000001}]},{"osd":5,"last update":"Wed Sep 13 08:25:28 2023","interfaces":[{"interface":"back","average":{"1min":1.175,"5min":1.175,"15min":1.175},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":11.613,"5min":11.613,"15min":11.613},"last":0.57199999999999995},{"interface":"front","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":7.3840000000000003,"5min":7.3840000000000003,"15min":7.3840000000000003},"last":0.42099999999999999}]},{"osd":6,"last update":"Wed Sep 13 08:25:28 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.42999999999999999},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":11.457000000000001,"5min":11.457000000000001,"15min":11.457000000000001},"last":0.496}]},{"osd":7,"last update":"Wed Sep 13 08:25:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":11.497999999999999,"5min":11.497999999999999,"15min":11.497999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":7.4390000000000001,"5min":7.4390000000000001,"15min":7.4390000000000001},"last":0.58699999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":430080,"data_stored":182875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 08:25:30 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":3.802,"5min":3.802,"15min":3.802},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.34699999999999998}]},{"osd":1,"last update":"Wed Sep 13 08:25:30 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":7.8529999999999998,"5min":7.8529999999999998,"15min":7.8529999999999998},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.438,"5min":0.438,"15min":0.438},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.378}]},{"osd":3,"last update":"Wed Sep 13 08:25:30 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.316}]},{"osd":4,"last update":"Wed Sep 13 08:25:30 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.52100000000000002}]},{"osd":5,"last update":"Wed Sep 13 08:25:30 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.497}]},{"osd":6,"last update":"Wed Sep 13 08:25:30 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.442},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.54600000000000004}]},{"osd":7,"last update":"Wed Sep 13 08:25:30 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.46000000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":442368,"data_stored":184451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 08:25:28 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":7.0359999999999996,"5min":7.0359999999999996,"15min":7.0359999999999996},"last":0.23499999999999999},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":5.8399999999999999,"5min":5.8399999999999999,"15min":5.8399999999999999},"last":0.32200000000000001}]},{"osd":1,"last update":"Wed Sep 13 08:25:28 2023","interfaces":[{"interface":"back","average":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":25.963999999999999,"5min":25.963999999999999,"15min":25.963999999999999},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":7.1779999999999999,"5min":7.1779999999999999,"15min":7.1779999999999999},"last":0.47899999999999998}]},{"osd":2,"last update":"Wed Sep 13 08:25:28 2023","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":15.307,"5min":15.307,"15min":15.307},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":7.1470000000000002,"5min":7.1470000000000002,"15min":7.1470000000000002},"last":0.39200000000000002}]},{"osd":4,"last update":"Wed Sep 13 08:25:28 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.113,"15min":1.113},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":10.952,"5min":10.952,"15min":10.952},"last":0.41299999999999998},{"interface":"front","average":{"1min":1.363,"5min":1.363,"15min":1.363},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":15.276,"5min":15.276,"15min":15.276},"last":0.56499999999999995}]},{"osd":5,"last update":"Wed Sep 13 08:25:28 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":15.243,"5min":15.243,"15min":15.243},"last":1.665},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":7.0860000000000003,"5min":7.0860000000000003,"15min":7.0860000000000003},"last":0.75}]},{"osd":6,"last update":"Wed Sep 13 08:25:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":10.994999999999999,"5min":10.994999999999999,"15min":10.994999999999999},"last":0.504},{"interface":"front","average":{"1min":1.373,"5min":1.373,"15min":1.373},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":15.189,"5min":15.189,"15min":15.189},"last":0.52300000000000002}]},{"osd":7,"last update":"Wed Sep 13 08:25:28 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":7.1150000000000002,"5min":7.1150000000000002,"15min":7.1150000000000002},"last":0.44},{"interface":"front","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":11.026,"5min":11.026,"15min":11.026},"last":0.54700000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":434176,"data_stored":183409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 08:25:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.40999999999999998}]},{"osd":1,"last update":"Wed Sep 13 08:25:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.433}]},{"osd":2,"last update":"Wed Sep 13 08:25:31 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.48599999999999999}]},{"osd":3,"last update":"Wed Sep 13 08:25:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.54400000000000004}]},{"osd":5,"last update":"Wed Sep 13 08:25:31 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.505}]},{"osd":6,"last update":"Wed Sep 13 08:25:31 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.57499999999999996}]},{"osd":7,"last update":"Wed Sep 13 08:25:31 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.76100000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574872,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":434176,"data_stored":182917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 08:25:29 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":2.649,"5min":2.649,"15min":2.649},"last":0.60599999999999998}]},{"osd":1,"last update":"Wed Sep 13 08:25:29 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":2.5489999999999999,"5min":2.5489999999999999,"15min":2.5489999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.50700000000000001}]},{"osd":2,"last update":"Wed Sep 13 08:25:29 2023","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.232,"15min":1.232},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":11.641999999999999,"5min":11.641999999999999,"15min":11.641999999999999},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.44500000000000001}]},{"osd":3,"last update":"Wed Sep 13 08:25:29 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":8.6069999999999993,"5min":8.6069999999999993,"15min":8.6069999999999993},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.53700000000000003}]},{"osd":4,"last update":"Wed Sep 13 08:25:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.55200000000000005}]},{"osd":6,"last update":"Wed Sep 13 08:25:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.56799999999999995}]},{"osd":7,"last update":"Wed Sep 13 08:25:29 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.59199999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-13T08:26:06.154 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-13T08:26:06.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.307+0000 7fef258af700 1 Processor -- start 2023-09-13T08:26:06.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.307+0000 7fef258af700 1 -- start start 2023-09-13T08:26:06.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.308+0000 7fef258af700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fef200d0450 0x7fef200b6d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:06.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.308+0000 7fef258af700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef200b6870 con 0x7fef200d3e50 2023-09-13T08:26:06.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.308+0000 7fef258af700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef200ceef0 con 0x7fef2015d6d0 2023-09-13T08:26:06.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.308+0000 7fef258af700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef200cf1d0 con 0x7fef200d0450 2023-09-13T08:26:06.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.308+0000 7fef1f7fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fef200d3e50 0x7fef200b7240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:48526/0 (socket says 172.21.15.84:48526) 2023-09-13T08:26:06.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.308+0000 7fef1f7fe700 1 -- 172.21.15.84:0/3387608829 learned_addr learned my addr 172.21.15.84:0/3387608829 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:26:06.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.308+0000 7fef1e7fc700 1 --2- 172.21.15.84:0/3387608829 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fef200d0450 0x7fef200b6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:06.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.308+0000 7fef1dffb700 1 -- 172.21.15.84:0/3387608829 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 859029270 0 0) 0x7fef200b6870 con 0x7fef200d3e50 2023-09-13T08:26:06.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.308+0000 7fef1dffb700 1 -- 172.21.15.84:0/3387608829 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef080035b0 con 0x7fef200d3e50 2023-09-13T08:26:06.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.309+0000 7fef1dffb700 1 -- 172.21.15.84:0/3387608829 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1478797029 0 0) 0x7fef200ceef0 con 0x7fef2015d6d0 2023-09-13T08:26:06.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.309+0000 7fef1dffb700 1 -- 172.21.15.84:0/3387608829 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef200b6870 con 0x7fef2015d6d0 2023-09-13T08:26:06.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.309+0000 7fef1dffb700 1 -- 172.21.15.84:0/3387608829 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2818280424 0 0) 0x7fef080035b0 con 0x7fef200d3e50 2023-09-13T08:26:06.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.309+0000 7fef1dffb700 1 -- 172.21.15.84:0/3387608829 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fef200d0450 msgr2=0x7fef200b6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:26:06.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.309+0000 7fef1dffb700 1 --2- 172.21.15.84:0/3387608829 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fef200d0450 0x7fef200b6d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:06.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.309+0000 7fef1dffb700 1 -- 172.21.15.84:0/3387608829 >> v1:172.21.15.161:6789/0 conn(0x7fef2015d6d0 legacy=0x7fef200cfd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:06.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.309+0000 7fef1dffb700 1 -- 172.21.15.84:0/3387608829 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef200b6220 con 0x7fef200d3e50 2023-09-13T08:26:06.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.309+0000 7fef1dffb700 1 -- 172.21.15.84:0/3387608829 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2302733408 0 0) 0x7fef180019f0 con 0x7fef200d3e50 2023-09-13T08:26:06.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.309+0000 7fef1dffb700 1 -- 172.21.15.84:0/3387608829 >> v1:172.21.15.84:6789/0 conn(0x7fef200d3e50 legacy=0x7fef200b7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:06.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.309+0000 7fef1dffb700 1 --2- 172.21.15.84:0/3387608829 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef08003bc0 0x7fef08003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:06.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.309+0000 7fef1dffb700 1 --2- 172.21.15.84:0/3387608829 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fef200d0450 0x7fef08004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:06.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.309+0000 7fef1dffb700 1 --2- 172.21.15.84:0/3387608829 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fef08004d90 0x7fef08005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:06.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.309+0000 7fef1dffb700 1 -- 172.21.15.84:0/3387608829 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef200cf1d0 con 0x7fef08003bc0 2023-09-13T08:26:06.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.309+0000 7fef1dffb700 1 -- 172.21.15.84:0/3387608829 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef0800bac0 con 0x7fef08004d90 2023-09-13T08:26:06.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.309+0000 7fef1dffb700 1 -- 172.21.15.84:0/3387608829 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef0800bc30 con 0x7fef200d0450 2023-09-13T08:26:06.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.309+0000 7fef1effd700 1 --2- 172.21.15.84:0/3387608829 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef08003bc0 0x7fef08003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:06.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.309+0000 7fef1e7fc700 1 --2- 172.21.15.84:0/3387608829 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fef200d0450 0x7fef08004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:06.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.309+0000 7fef1f7fe700 1 --2- 172.21.15.84:0/3387608829 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fef08004d90 0x7fef08005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:06.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.309+0000 7fef1effd700 1 -- 172.21.15.84:0/3387608829 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fef200d0450 msgr2=0x7fef08004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:26:06.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.309+0000 7fef1effd700 1 --2- 172.21.15.84:0/3387608829 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fef200d0450 0x7fef08004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:06.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.309+0000 7fef1effd700 1 -- 172.21.15.84:0/3387608829 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fef08004d90 msgr2=0x7fef08005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:26:06.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.309+0000 7fef1effd700 1 --2- 172.21.15.84:0/3387608829 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fef08004d90 0x7fef08005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:06.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.309+0000 7fef1effd700 1 -- 172.21.15.84:0/3387608829 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef080035b0 con 0x7fef08003bc0 2023-09-13T08:26:06.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.309+0000 7fef1f7fe700 1 --2- 172.21.15.84:0/3387608829 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fef08004d90 0x7fef08005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T08:26:06.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.309+0000 7fef1effd700 1 --2- 172.21.15.84:0/3387608829 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef08003bc0 0x7fef08003fc0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fef14001940 tx=0x7fef08005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e87f4814d6b1140b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:26:06.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.309+0000 7fef1dffb700 1 -- 172.21.15.84:0/3387608829 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef14001430 con 0x7fef08003bc0 2023-09-13T08:26:06.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.309+0000 7fef1dffb700 1 -- 172.21.15.84:0/3387608829 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef14001d70 con 0x7fef08003bc0 2023-09-13T08:26:06.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.309+0000 7fef1dffb700 1 -- 172.21.15.84:0/3387608829 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef14005510 con 0x7fef08003bc0 2023-09-13T08:26:06.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.310+0000 7fef258af700 1 -- 172.21.15.84:0/3387608829 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef08003bc0 msgr2=0x7fef08003fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:06.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.310+0000 7fef258af700 1 --2- 172.21.15.84:0/3387608829 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef08003bc0 0x7fef08003fc0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fef14001940 tx=0x7fef08005880 comp rx=0 tx=0).stop 2023-09-13T08:26:06.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.310+0000 7fef1f7fe700 1 -- 172.21.15.84:0/3387608829 reap_dead start 2023-09-13T08:26:06.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.310+0000 7fef258af700 1 -- 172.21.15.84:0/3387608829 shutdown_connections 2023-09-13T08:26:06.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.310+0000 7fef258af700 1 -- 172.21.15.84:0/3387608829 >> 172.21.15.84:0/3387608829 conn(0x7fef200d3330 msgr2=0x7fef200d3740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:26:06.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.310+0000 7fef258af700 1 -- 172.21.15.84:0/3387608829 shutdown_connections 2023-09-13T08:26:06.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.310+0000 7fef258af700 1 -- 172.21.15.84:0/3387608829 wait complete. 2023-09-13T08:26:06.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.312+0000 7fef258af700 1 Processor -- start 2023-09-13T08:26:06.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.312+0000 7fef258af700 1 -- start start 2023-09-13T08:26:06.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.313+0000 7fef258af700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fef08003bc0 0x7fef2014f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:06.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.313+0000 7fef258af700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fef200cc5d0 0x7fef200cca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:06.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.313+0000 7fef258af700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef200a0100 0x7fef200a0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:06.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.313+0000 7fef258af700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef200c7960 con 0x7fef200a0100 2023-09-13T08:26:06.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.313+0000 7fef258af700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef200c6db0 con 0x7fef08003bc0 2023-09-13T08:26:06.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.313+0000 7fef258af700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef200ccf90 con 0x7fef200cc5d0 2023-09-13T08:26:06.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.313+0000 7fef1f7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef200a0100 0x7fef200a0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:06.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.313+0000 7fef1f7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef200a0100 0x7fef200a0580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45894/0 (socket says 172.21.15.84:45894) 2023-09-13T08:26:06.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.313+0000 7fef1f7fe700 1 -- 172.21.15.84:0/945898381 learned_addr learned my addr 172.21.15.84:0/945898381 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:26:06.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.313+0000 7fef1effd700 1 --2- 172.21.15.84:0/945898381 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fef08003bc0 0x7fef2014f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:06.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.313+0000 7fef1e7fc700 1 --2- 172.21.15.84:0/945898381 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fef200cc5d0 0x7fef200cca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:06.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.313+0000 7fef1f7fe700 1 -- 172.21.15.84:0/945898381 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fef200cc5d0 msgr2=0x7fef200cca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:06.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.313+0000 7fef1f7fe700 1 --2- 172.21.15.84:0/945898381 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fef200cc5d0 0x7fef200cca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:06.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.313+0000 7fef1f7fe700 1 -- 172.21.15.84:0/945898381 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fef08003bc0 msgr2=0x7fef2014f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:06.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.313+0000 7fef1f7fe700 1 --2- 172.21.15.84:0/945898381 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fef08003bc0 0x7fef2014f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:06.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.313+0000 7fef1f7fe700 1 -- 172.21.15.84:0/945898381 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef2014fdf0 con 0x7fef200a0100 2023-09-13T08:26:06.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.313+0000 7fef1f7fe700 1 --2- 172.21.15.84:0/945898381 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef200a0100 0x7fef200a0580 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fef18001330 tx=0x7fef18007c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:26:06.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.313+0000 7fef07fff700 1 -- 172.21.15.84:0/945898381 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef1800eb70 con 0x7fef200a0100 2023-09-13T08:26:06.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.313+0000 7fef07fff700 1 -- 172.21.15.84:0/945898381 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef1800ecf0 con 0x7fef200a0100 2023-09-13T08:26:06.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.313+0000 7fef258af700 1 -- 172.21.15.84:0/945898381 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef200c6fc0 con 0x7fef200a0100 2023-09-13T08:26:06.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.313+0000 7fef07fff700 1 -- 172.21.15.84:0/945898381 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef18013660 con 0x7fef200a0100 2023-09-13T08:26:06.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.313+0000 7fef258af700 1 -- 172.21.15.84:0/945898381 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef200c7580 con 0x7fef200a0100 2023-09-13T08:26:06.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.314+0000 7fef258af700 1 -- 172.21.15.84:0/945898381 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef2004e9b0 con 0x7fef200a0100 2023-09-13T08:26:06.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.315+0000 7fef07fff700 1 -- 172.21.15.84:0/945898381 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fef180137c0 con 0x7fef200a0100 2023-09-13T08:26:06.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.315+0000 7fef07fff700 1 --2- 172.21.15.84:0/945898381 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fef0c06a580 0x7fef0c06ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:06.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.315+0000 7fef07fff700 1 -- 172.21.15.84:0/945898381 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fef18089080 con 0x7fef200a0100 2023-09-13T08:26:06.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.315+0000 7fef1effd700 1 --2- 172.21.15.84:0/945898381 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fef0c06a580 0x7fef0c06ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:06.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.316+0000 7fef1effd700 1 --2- 172.21.15.84:0/945898381 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fef0c06a580 0x7fef0c06ca40 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fef14015040 tx=0x7fef1400a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:26:06.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.320+0000 7fef07fff700 1 -- 172.21.15.84:0/945898381 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fef180544c0 con 0x7fef200a0100 2023-09-13T08:26:06.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.503+0000 7fef258af700 1 -- 172.21.15.84:0/945898381 --> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fef200d10c0 con 0x7fef0c06a580 2023-09-13T08:26:06.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.511+0000 7fef07fff700 1 -- 172.21.15.84:0/945898381 <== mgr.4104 v2:172.21.15.84:6832/3568908055 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289241 (secure 0 0 0) 0x7fef140051d0 con 0x7fef0c06a580 2023-09-13T08:26:06.514 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:26:06.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.514+0000 7fef258af700 1 -- 172.21.15.84:0/945898381 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fef0c06a580 msgr2=0x7fef0c06ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:06.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.514+0000 7fef258af700 1 --2- 172.21.15.84:0/945898381 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fef0c06a580 0x7fef0c06ca40 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fef14015040 tx=0x7fef1400a000 comp rx=0 tx=0).stop 2023-09-13T08:26:06.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.514+0000 7fef258af700 1 -- 172.21.15.84:0/945898381 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef200a0100 msgr2=0x7fef200a0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:06.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.514+0000 7fef258af700 1 --2- 172.21.15.84:0/945898381 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef200a0100 0x7fef200a0580 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fef18001330 tx=0x7fef18007c90 comp rx=0 tx=0).stop 2023-09-13T08:26:06.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.514+0000 7fef258af700 1 -- 172.21.15.84:0/945898381 shutdown_connections 2023-09-13T08:26:06.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.514+0000 7fef258af700 1 --2- 172.21.15.84:0/945898381 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef200a0100 0x7fef200a0580 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:06.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.514+0000 7fef258af700 1 --2- 172.21.15.84:0/945898381 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fef0c06a580 0x7fef0c06ca40 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:06.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.514+0000 7fef258af700 1 --2- 172.21.15.84:0/945898381 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fef08003bc0 0x7fef2014f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:06.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.514+0000 7fef258af700 1 --2- 172.21.15.84:0/945898381 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fef200cc5d0 0x7fef200cca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:06.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.514+0000 7fef258af700 1 -- 172.21.15.84:0/945898381 >> 172.21.15.84:0/945898381 conn(0x7fef200d3330 msgr2=0x7fef2006cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:26:06.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.514+0000 7fef258af700 1 -- 172.21.15.84:0/945898381 shutdown_connections 2023-09-13T08:26:06.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.514+0000 7fef258af700 1 -- 172.21.15.84:0/945898381 wait complete. 2023-09-13T08:26:06.523 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-09-13T08:26:06.526 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":79,"stamp":"2023-09-13T08:26:04.561144+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":128,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220768,"kb_used_data":4564,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753952,"statfs":{"total":773094113280,"available":772868046848,"internally_reserved":0,"allocated":4673536,"data_stored":2654616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.534113"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-13T08:26:01.738538+0000","last_change":"2023-09-13T08:26:01.733717+0000","last_active":"2023-09-13T08:26:01.738538+0000","last_peered":"2023-09-13T08:26:01.738538+0000","last_clean":"2023-09-13T08:26:01.738538+0000","last_became_active":"2023-09-13T08:26:01.733367+0000","last_became_peered":"2023-09-13T08:26:01.733367+0000","last_unstale":"2023-09-13T08:26:01.738538+0000","last_undegraded":"2023-09-13T08:26:01.738538+0000","last_fullsized":"2023-09-13T08:26:01.738538+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:41:27.059574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-13T08:26:01.739422+0000","last_change":"2023-09-13T08:26:01.733835+0000","last_active":"2023-09-13T08:26:01.739422+0000","last_peered":"2023-09-13T08:26:01.739422+0000","last_clean":"2023-09-13T08:26:01.739422+0000","last_became_active":"2023-09-13T08:26:01.733588+0000","last_became_peered":"2023-09-13T08:26:01.733588+0000","last_unstale":"2023-09-13T08:26:01.739422+0000","last_undegraded":"2023-09-13T08:26:01.739422+0000","last_fullsized":"2023-09-13T08:26:01.739422+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:45:47.220002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-13T08:26:01.736499+0000","last_change":"2023-09-13T08:26:01.734282+0000","last_active":"2023-09-13T08:26:01.736499+0000","last_peered":"2023-09-13T08:26:01.736499+0000","last_clean":"2023-09-13T08:26:01.736499+0000","last_became_active":"2023-09-13T08:26:01.734015+0000","last_became_peered":"2023-09-13T08:26:01.734015+0000","last_unstale":"2023-09-13T08:26:01.736499+0000","last_undegraded":"2023-09-13T08:26:01.736499+0000","last_fullsized":"2023-09-13T08:26:01.736499+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:07:56.968040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:02.724793+0000","last_change":"2023-09-13T08:26:01.732893+0000","last_active":"2023-09-13T08:26:02.724793+0000","last_peered":"2023-09-13T08:26:02.724793+0000","last_clean":"2023-09-13T08:26:02.724793+0000","last_became_active":"2023-09-13T08:26:01.732644+0000","last_became_peered":"2023-09-13T08:26:01.732644+0000","last_unstale":"2023-09-13T08:26:02.724793+0000","last_undegraded":"2023-09-13T08:26:02.724793+0000","last_fullsized":"2023-09-13T08:26:02.724793+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:09:30.453232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:02.725004+0000","last_change":"2023-09-13T08:26:01.733331+0000","last_active":"2023-09-13T08:26:02.725004+0000","last_peered":"2023-09-13T08:26:02.725004+0000","last_clean":"2023-09-13T08:26:02.725004+0000","last_became_active":"2023-09-13T08:26:01.732978+0000","last_became_peered":"2023-09-13T08:26:01.732978+0000","last_unstale":"2023-09-13T08:26:02.725004+0000","last_undegraded":"2023-09-13T08:26:02.725004+0000","last_fullsized":"2023-09-13T08:26:02.725004+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:05:53.120350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-13T08:26:01.738485+0000","last_change":"2023-09-13T08:26:01.731681+0000","last_active":"2023-09-13T08:26:01.738485+0000","last_peered":"2023-09-13T08:26:01.738485+0000","last_clean":"2023-09-13T08:26:01.738485+0000","last_became_active":"2023-09-13T08:26:01.731352+0000","last_became_peered":"2023-09-13T08:26:01.731352+0000","last_unstale":"2023-09-13T08:26:01.738485+0000","last_undegraded":"2023-09-13T08:26:01.738485+0000","last_fullsized":"2023-09-13T08:26:01.738485+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T19:30:06.974598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:02.724264+0000","last_change":"2023-09-13T08:26:01.732448+0000","last_active":"2023-09-13T08:26:02.724264+0000","last_peered":"2023-09-13T08:26:02.724264+0000","last_clean":"2023-09-13T08:26:02.724264+0000","last_became_active":"2023-09-13T08:26:01.732118+0000","last_became_peered":"2023-09-13T08:26:01.732118+0000","last_unstale":"2023-09-13T08:26:02.724264+0000","last_undegraded":"2023-09-13T08:26:02.724264+0000","last_fullsized":"2023-09-13T08:26:02.724264+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:22:59.139845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-13T08:26:01.739563+0000","last_change":"2023-09-13T08:26:01.738108+0000","last_active":"2023-09-13T08:26:01.739563+0000","last_peered":"2023-09-13T08:26:01.739563+0000","last_clean":"2023-09-13T08:26:01.739563+0000","last_became_active":"2023-09-13T08:26:01.737850+0000","last_became_peered":"2023-09-13T08:26:01.737850+0000","last_unstale":"2023-09-13T08:26:01.739563+0000","last_undegraded":"2023-09-13T08:26:01.739563+0000","last_fullsized":"2023-09-13T08:26:01.739563+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:47:51.519894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-13T08:26:01.734166+0000","last_change":"2023-09-13T08:26:01.729732+0000","last_active":"2023-09-13T08:26:01.734166+0000","last_peered":"2023-09-13T08:26:01.734166+0000","last_clean":"2023-09-13T08:26:01.734166+0000","last_became_active":"2023-09-13T08:26:01.729461+0000","last_became_peered":"2023-09-13T08:26:01.729461+0000","last_unstale":"2023-09-13T08:26:01.734166+0000","last_undegraded":"2023-09-13T08:26:01.734166+0000","last_fullsized":"2023-09-13T08:26:01.734166+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:08:09.589011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:02.724050+0000","last_change":"2023-09-13T08:26:01.741137+0000","last_active":"2023-09-13T08:26:02.724050+0000","last_peered":"2023-09-13T08:26:02.724050+0000","last_clean":"2023-09-13T08:26:02.724050+0000","last_became_active":"2023-09-13T08:26:01.740856+0000","last_became_peered":"2023-09-13T08:26:01.740856+0000","last_unstale":"2023-09-13T08:26:02.724050+0000","last_undegraded":"2023-09-13T08:26:02.724050+0000","last_fullsized":"2023-09-13T08:26:02.724050+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:38:08.520198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:02.724328+0000","last_change":"2023-09-13T08:26:01.736055+0000","last_active":"2023-09-13T08:26:02.724328+0000","last_peered":"2023-09-13T08:26:02.724328+0000","last_clean":"2023-09-13T08:26:02.724328+0000","last_became_active":"2023-09-13T08:26:01.735707+0000","last_became_peered":"2023-09-13T08:26:01.735707+0000","last_unstale":"2023-09-13T08:26:02.724328+0000","last_undegraded":"2023-09-13T08:26:02.724328+0000","last_fullsized":"2023-09-13T08:26:02.724328+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:23:05.904970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-13T08:26:01.736265+0000","last_change":"2023-09-13T08:26:01.730685+0000","last_active":"2023-09-13T08:26:01.736265+0000","last_peered":"2023-09-13T08:26:01.736265+0000","last_clean":"2023-09-13T08:26:01.736265+0000","last_became_active":"2023-09-13T08:26:01.730422+0000","last_became_peered":"2023-09-13T08:26:01.730422+0000","last_unstale":"2023-09-13T08:26:01.736265+0000","last_undegraded":"2023-09-13T08:26:01.736265+0000","last_fullsized":"2023-09-13T08:26:01.736265+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:32:27.872315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:02.723610+0000","last_change":"2023-09-13T08:26:01.736835+0000","last_active":"2023-09-13T08:26:02.723610+0000","last_peered":"2023-09-13T08:26:02.723610+0000","last_clean":"2023-09-13T08:26:02.723610+0000","last_became_active":"2023-09-13T08:26:01.736511+0000","last_became_peered":"2023-09-13T08:26:01.736511+0000","last_unstale":"2023-09-13T08:26:02.723610+0000","last_undegraded":"2023-09-13T08:26:02.723610+0000","last_fullsized":"2023-09-13T08:26:02.723610+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:34:56.037414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:03.025157+0000","last_change":"2023-09-13T08:26:01.744264+0000","last_active":"2023-09-13T08:26:03.025157+0000","last_peered":"2023-09-13T08:26:03.025157+0000","last_clean":"2023-09-13T08:26:03.025157+0000","last_became_active":"2023-09-13T08:26:01.743991+0000","last_became_peered":"2023-09-13T08:26:01.743991+0000","last_unstale":"2023-09-13T08:26:03.025157+0000","last_undegraded":"2023-09-13T08:26:03.025157+0000","last_fullsized":"2023-09-13T08:26:03.025157+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:25:28.867284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:02.723518+0000","last_change":"2023-09-13T08:26:01.742272+0000","last_active":"2023-09-13T08:26:02.723518+0000","last_peered":"2023-09-13T08:26:02.723518+0000","last_clean":"2023-09-13T08:26:02.723518+0000","last_became_active":"2023-09-13T08:26:01.741987+0000","last_became_peered":"2023-09-13T08:26:01.741987+0000","last_unstale":"2023-09-13T08:26:02.723518+0000","last_undegraded":"2023-09-13T08:26:02.723518+0000","last_fullsized":"2023-09-13T08:26:02.723518+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:44:07.674488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:02.722955+0000","last_change":"2023-09-13T08:26:01.738181+0000","last_active":"2023-09-13T08:26:02.722955+0000","last_peered":"2023-09-13T08:26:02.722955+0000","last_clean":"2023-09-13T08:26:02.722955+0000","last_became_active":"2023-09-13T08:26:01.737877+0000","last_became_peered":"2023-09-13T08:26:01.737877+0000","last_unstale":"2023-09-13T08:26:02.722955+0000","last_undegraded":"2023-09-13T08:26:02.722955+0000","last_fullsized":"2023-09-13T08:26:02.722955+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:29:51.388005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:02.723841+0000","last_change":"2023-09-13T08:26:01.737813+0000","last_active":"2023-09-13T08:26:02.723841+0000","last_peered":"2023-09-13T08:26:02.723841+0000","last_clean":"2023-09-13T08:26:02.723841+0000","last_became_active":"2023-09-13T08:26:01.737552+0000","last_became_peered":"2023-09-13T08:26:01.737552+0000","last_unstale":"2023-09-13T08:26:02.723841+0000","last_undegraded":"2023-09-13T08:26:02.723841+0000","last_fullsized":"2023-09-13T08:26:02.723841+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:15:17.319095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:03.201033+0000","last_change":"2023-09-13T08:26:01.741697+0000","last_active":"2023-09-13T08:26:03.201033+0000","last_peered":"2023-09-13T08:26:03.201033+0000","last_clean":"2023-09-13T08:26:03.201033+0000","last_became_active":"2023-09-13T08:26:01.741439+0000","last_became_peered":"2023-09-13T08:26:01.741439+0000","last_unstale":"2023-09-13T08:26:03.201033+0000","last_undegraded":"2023-09-13T08:26:03.201033+0000","last_fullsized":"2023-09-13T08:26:03.201033+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:41:27.059574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:02.724722+0000","last_change":"2023-09-13T08:26:01.727795+0000","last_active":"2023-09-13T08:26:02.724722+0000","last_peered":"2023-09-13T08:26:02.724722+0000","last_clean":"2023-09-13T08:26:02.724722+0000","last_became_active":"2023-09-13T08:26:01.727516+0000","last_became_peered":"2023-09-13T08:26:01.727516+0000","last_unstale":"2023-09-13T08:26:02.724722+0000","last_undegraded":"2023-09-13T08:26:02.724722+0000","last_fullsized":"2023-09-13T08:26:02.724722+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:08:09.589011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:03.200892+0000","last_change":"2023-09-13T08:26:01.735152+0000","last_active":"2023-09-13T08:26:03.200892+0000","last_peered":"2023-09-13T08:26:03.200892+0000","last_clean":"2023-09-13T08:26:03.200892+0000","last_became_active":"2023-09-13T08:26:01.734895+0000","last_became_peered":"2023-09-13T08:26:01.734895+0000","last_unstale":"2023-09-13T08:26:03.200892+0000","last_undegraded":"2023-09-13T08:26:03.200892+0000","last_fullsized":"2023-09-13T08:26:03.200892+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:47:51.519894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:02.723766+0000","last_change":"2023-09-13T08:26:01.737301+0000","last_active":"2023-09-13T08:26:02.723766+0000","last_peered":"2023-09-13T08:26:02.723766+0000","last_clean":"2023-09-13T08:26:02.723766+0000","last_became_active":"2023-09-13T08:26:01.737041+0000","last_became_peered":"2023-09-13T08:26:01.737041+0000","last_unstale":"2023-09-13T08:26:02.723766+0000","last_undegraded":"2023-09-13T08:26:02.723766+0000","last_fullsized":"2023-09-13T08:26:02.723766+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:15:17.319095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:03.025299+0000","last_change":"2023-09-13T08:26:01.739688+0000","last_active":"2023-09-13T08:26:03.025299+0000","last_peered":"2023-09-13T08:26:03.025299+0000","last_clean":"2023-09-13T08:26:03.025299+0000","last_became_active":"2023-09-13T08:26:01.739292+0000","last_became_peered":"2023-09-13T08:26:01.739292+0000","last_unstale":"2023-09-13T08:26:03.025299+0000","last_undegraded":"2023-09-13T08:26:03.025299+0000","last_fullsized":"2023-09-13T08:26:03.025299+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:30:18.262953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:02.723374+0000","last_change":"2023-09-13T08:26:01.736039+0000","last_active":"2023-09-13T08:26:02.723374+0000","last_peered":"2023-09-13T08:26:02.723374+0000","last_clean":"2023-09-13T08:26:02.723374+0000","last_became_active":"2023-09-13T08:26:01.735754+0000","last_became_peered":"2023-09-13T08:26:01.735754+0000","last_unstale":"2023-09-13T08:26:02.723374+0000","last_undegraded":"2023-09-13T08:26:02.723374+0000","last_fullsized":"2023-09-13T08:26:02.723374+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:34:56.037414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:02.724639+0000","last_change":"2023-09-13T08:26:01.726204+0000","last_active":"2023-09-13T08:26:02.724639+0000","last_peered":"2023-09-13T08:26:02.724639+0000","last_clean":"2023-09-13T08:26:02.724639+0000","last_became_active":"2023-09-13T08:26:01.725910+0000","last_became_peered":"2023-09-13T08:26:01.725910+0000","last_unstale":"2023-09-13T08:26:02.724639+0000","last_undegraded":"2023-09-13T08:26:02.724639+0000","last_fullsized":"2023-09-13T08:26:02.724639+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:32:08.154597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:03.200981+0000","last_change":"2023-09-13T08:26:01.741014+0000","last_active":"2023-09-13T08:26:03.200981+0000","last_peered":"2023-09-13T08:26:03.200981+0000","last_clean":"2023-09-13T08:26:03.200981+0000","last_became_active":"2023-09-13T08:26:01.740707+0000","last_became_peered":"2023-09-13T08:26:01.740707+0000","last_unstale":"2023-09-13T08:26:03.200981+0000","last_undegraded":"2023-09-13T08:26:03.200981+0000","last_fullsized":"2023-09-13T08:26:03.200981+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:25:28.867284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-13T08:26:01.738909+0000","last_change":"2023-09-13T08:26:01.736031+0000","last_active":"2023-09-13T08:26:01.738909+0000","last_peered":"2023-09-13T08:26:01.738909+0000","last_clean":"2023-09-13T08:26:01.738909+0000","last_became_active":"2023-09-13T08:26:01.735767+0000","last_became_peered":"2023-09-13T08:26:01.735767+0000","last_unstale":"2023-09-13T08:26:01.738909+0000","last_undegraded":"2023-09-13T08:26:01.738909+0000","last_fullsized":"2023-09-13T08:26:01.738909+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:05:53.120350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:03.201043+0000","last_change":"2023-09-13T08:26:01.741085+0000","last_active":"2023-09-13T08:26:03.201043+0000","last_peered":"2023-09-13T08:26:03.201043+0000","last_clean":"2023-09-13T08:26:03.201043+0000","last_became_active":"2023-09-13T08:26:01.740764+0000","last_became_peered":"2023-09-13T08:26:01.740764+0000","last_unstale":"2023-09-13T08:26:03.201043+0000","last_undegraded":"2023-09-13T08:26:03.201043+0000","last_fullsized":"2023-09-13T08:26:03.201043+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:30:18.262953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:02.724041+0000","last_change":"2023-09-13T08:26:01.735325+0000","last_active":"2023-09-13T08:26:02.724041+0000","last_peered":"2023-09-13T08:26:02.724041+0000","last_clean":"2023-09-13T08:26:02.724041+0000","last_became_active":"2023-09-13T08:26:01.735045+0000","last_became_peered":"2023-09-13T08:26:01.735045+0000","last_unstale":"2023-09-13T08:26:02.724041+0000","last_undegraded":"2023-09-13T08:26:02.724041+0000","last_fullsized":"2023-09-13T08:26:02.724041+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:45:56.799141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:03.200896+0000","last_change":"2023-09-13T08:26:01.741302+0000","last_active":"2023-09-13T08:26:03.200896+0000","last_peered":"2023-09-13T08:26:03.200896+0000","last_clean":"2023-09-13T08:26:03.200896+0000","last_became_active":"2023-09-13T08:26:01.740955+0000","last_became_peered":"2023-09-13T08:26:01.740955+0000","last_unstale":"2023-09-13T08:26:03.200896+0000","last_undegraded":"2023-09-13T08:26:03.200896+0000","last_fullsized":"2023-09-13T08:26:03.200896+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:31:01.290048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:03.200781+0000","last_change":"2023-09-13T08:26:01.741204+0000","last_active":"2023-09-13T08:26:03.200781+0000","last_peered":"2023-09-13T08:26:03.200781+0000","last_clean":"2023-09-13T08:26:03.200781+0000","last_became_active":"2023-09-13T08:26:01.740815+0000","last_became_peered":"2023-09-13T08:26:01.740815+0000","last_unstale":"2023-09-13T08:26:03.200781+0000","last_undegraded":"2023-09-13T08:26:03.200781+0000","last_fullsized":"2023-09-13T08:26:03.200781+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:52:21.046807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:02.723161+0000","last_change":"2023-09-13T08:26:01.734665+0000","last_active":"2023-09-13T08:26:02.723161+0000","last_peered":"2023-09-13T08:26:02.723161+0000","last_clean":"2023-09-13T08:26:02.723161+0000","last_became_active":"2023-09-13T08:26:01.734355+0000","last_became_peered":"2023-09-13T08:26:01.734355+0000","last_unstale":"2023-09-13T08:26:02.723161+0000","last_undegraded":"2023-09-13T08:26:02.723161+0000","last_fullsized":"2023-09-13T08:26:02.723161+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:01:08.911581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-13T08:26:01.738357+0000","last_change":"2023-09-13T08:26:01.731690+0000","last_active":"2023-09-13T08:26:01.738357+0000","last_peered":"2023-09-13T08:26:01.738357+0000","last_clean":"2023-09-13T08:26:01.738357+0000","last_became_active":"2023-09-13T08:26:01.731383+0000","last_became_peered":"2023-09-13T08:26:01.731383+0000","last_unstale":"2023-09-13T08:26:01.738357+0000","last_undegraded":"2023-09-13T08:26:01.738357+0000","last_fullsized":"2023-09-13T08:26:01.738357+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:32:08.154597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:02.723989+0000","last_change":"2023-09-13T08:26:01.739213+0000","last_active":"2023-09-13T08:26:02.723989+0000","last_peered":"2023-09-13T08:26:02.723989+0000","last_clean":"2023-09-13T08:26:02.723989+0000","last_became_active":"2023-09-13T08:26:01.738969+0000","last_became_peered":"2023-09-13T08:26:01.738969+0000","last_unstale":"2023-09-13T08:26:02.723989+0000","last_undegraded":"2023-09-13T08:26:02.723989+0000","last_fullsized":"2023-09-13T08:26:02.723989+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:45:56.799141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"37'4","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:03.201015+0000","last_change":"2023-09-13T08:26:01.055036+0000","last_active":"2023-09-13T08:26:03.201015+0000","last_peered":"2023-09-13T08:26:03.201015+0000","last_clean":"2023-09-13T08:26:03.201015+0000","last_became_active":"2023-09-13T08:26:01.054694+0000","last_became_peered":"2023-09-13T08:26:01.054694+0000","last_unstale":"2023-09-13T08:26:03.201015+0000","last_undegraded":"2023-09-13T08:26:03.201015+0000","last_fullsized":"2023-09-13T08:26:03.201015+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_clean_scrub_stamp":"2023-09-13T08:26:00.019012+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:07:55.959995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-13T08:26:01.741195+0000","last_change":"2023-09-13T08:26:01.738462+0000","last_active":"2023-09-13T08:26:01.741195+0000","last_peered":"2023-09-13T08:26:01.741195+0000","last_clean":"2023-09-13T08:26:01.741195+0000","last_became_active":"2023-09-13T08:26:01.738240+0000","last_became_peered":"2023-09-13T08:26:01.738240+0000","last_unstale":"2023-09-13T08:26:01.741195+0000","last_undegraded":"2023-09-13T08:26:01.741195+0000","last_fullsized":"2023-09-13T08:26:01.741195+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:07:56.968040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"37'1","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-13T08:26:02.049387+0000","last_change":"2023-09-13T08:26:01.055626+0000","last_active":"2023-09-13T08:26:02.049387+0000","last_peered":"2023-09-13T08:26:02.049387+0000","last_clean":"2023-09-13T08:26:02.049387+0000","last_became_active":"2023-09-13T08:26:01.055330+0000","last_became_peered":"2023-09-13T08:26:01.055330+0000","last_unstale":"2023-09-13T08:26:02.049387+0000","last_undegraded":"2023-09-13T08:26:02.049387+0000","last_fullsized":"2023-09-13T08:26:02.049387+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_clean_scrub_stamp":"2023-09-13T08:26:00.019012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:25:27.859239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:03.025487+0000","last_change":"2023-09-13T08:26:01.744357+0000","last_active":"2023-09-13T08:26:03.025487+0000","last_peered":"2023-09-13T08:26:03.025487+0000","last_clean":"2023-09-13T08:26:03.025487+0000","last_became_active":"2023-09-13T08:26:01.744027+0000","last_became_peered":"2023-09-13T08:26:01.744027+0000","last_unstale":"2023-09-13T08:26:03.025487+0000","last_undegraded":"2023-09-13T08:26:03.025487+0000","last_fullsized":"2023-09-13T08:26:03.025487+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:38:02.347407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"37'2","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-13T08:26:02.047875+0000","last_change":"2023-09-13T08:26:01.047332+0000","last_active":"2023-09-13T08:26:02.047875+0000","last_peered":"2023-09-13T08:26:02.047875+0000","last_clean":"2023-09-13T08:26:02.047875+0000","last_became_active":"2023-09-13T08:26:01.047070+0000","last_became_peered":"2023-09-13T08:26:01.047070+0000","last_unstale":"2023-09-13T08:26:02.047875+0000","last_undegraded":"2023-09-13T08:26:02.047875+0000","last_fullsized":"2023-09-13T08:26:02.047875+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_clean_scrub_stamp":"2023-09-13T08:26:00.019012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:06:07.858870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-13T08:26:01.747466+0000","last_change":"2023-09-13T08:26:01.741977+0000","last_active":"2023-09-13T08:26:01.747466+0000","last_peered":"2023-09-13T08:26:01.747466+0000","last_clean":"2023-09-13T08:26:01.747466+0000","last_became_active":"2023-09-13T08:26:01.741688+0000","last_became_peered":"2023-09-13T08:26:01.741688+0000","last_unstale":"2023-09-13T08:26:01.747466+0000","last_undegraded":"2023-09-13T08:26:01.747466+0000","last_fullsized":"2023-09-13T08:26:01.747466+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:25:28.867284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"37'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:03.025239+0000","last_change":"2023-09-13T08:26:01.052635+0000","last_active":"2023-09-13T08:26:03.025239+0000","last_peered":"2023-09-13T08:26:03.025239+0000","last_clean":"2023-09-13T08:26:03.025239+0000","last_became_active":"2023-09-13T08:26:01.052337+0000","last_became_peered":"2023-09-13T08:26:01.052337+0000","last_unstale":"2023-09-13T08:26:03.025239+0000","last_undegraded":"2023-09-13T08:26:03.025239+0000","last_fullsized":"2023-09-13T08:26:03.025239+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_clean_scrub_stamp":"2023-09-13T08:26:00.019012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:02:23.724888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-13T08:26:01.734548+0000","last_change":"2023-09-13T08:26:01.729886+0000","last_active":"2023-09-13T08:26:01.734548+0000","last_peered":"2023-09-13T08:26:01.734548+0000","last_clean":"2023-09-13T08:26:01.734548+0000","last_became_active":"2023-09-13T08:26:01.729381+0000","last_became_peered":"2023-09-13T08:26:01.729381+0000","last_unstale":"2023-09-13T08:26:01.734548+0000","last_undegraded":"2023-09-13T08:26:01.734548+0000","last_fullsized":"2023-09-13T08:26:01.734548+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:09:30.453232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"37'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:02.723873+0000","last_change":"2023-09-13T08:26:01.054325+0000","last_active":"2023-09-13T08:26:02.723873+0000","last_peered":"2023-09-13T08:26:02.723873+0000","last_clean":"2023-09-13T08:26:02.723873+0000","last_became_active":"2023-09-13T08:26:01.053990+0000","last_became_peered":"2023-09-13T08:26:01.053990+0000","last_unstale":"2023-09-13T08:26:02.723873+0000","last_undegraded":"2023-09-13T08:26:02.723873+0000","last_fullsized":"2023-09-13T08:26:02.723873+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_clean_scrub_stamp":"2023-09-13T08:26:00.019012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:18:18.835695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:02.723677+0000","last_change":"2023-09-13T08:26:01.733260+0000","last_active":"2023-09-13T08:26:02.723677+0000","last_peered":"2023-09-13T08:26:02.723677+0000","last_clean":"2023-09-13T08:26:02.723677+0000","last_became_active":"2023-09-13T08:26:01.732978+0000","last_became_peered":"2023-09-13T08:26:01.732978+0000","last_unstale":"2023-09-13T08:26:02.723677+0000","last_undegraded":"2023-09-13T08:26:02.723677+0000","last_fullsized":"2023-09-13T08:26:02.723677+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:39:45.862923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"37'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:02.723778+0000","last_change":"2023-09-13T08:26:01.053519+0000","last_active":"2023-09-13T08:26:02.723778+0000","last_peered":"2023-09-13T08:26:02.723778+0000","last_clean":"2023-09-13T08:26:02.723778+0000","last_became_active":"2023-09-13T08:26:01.053238+0000","last_became_peered":"2023-09-13T08:26:01.053238+0000","last_unstale":"2023-09-13T08:26:02.723778+0000","last_undegraded":"2023-09-13T08:26:02.723778+0000","last_fullsized":"2023-09-13T08:26:02.723778+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_clean_scrub_stamp":"2023-09-13T08:26:00.019012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:47:37.567753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:03.025343+0000","last_change":"2023-09-13T08:26:01.740421+0000","last_active":"2023-09-13T08:26:03.025343+0000","last_peered":"2023-09-13T08:26:03.025343+0000","last_clean":"2023-09-13T08:26:03.025343+0000","last_became_active":"2023-09-13T08:26:01.740022+0000","last_became_peered":"2023-09-13T08:26:01.740022+0000","last_unstale":"2023-09-13T08:26:03.025343+0000","last_undegraded":"2023-09-13T08:26:03.025343+0000","last_fullsized":"2023-09-13T08:26:03.025343+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:41:27.059574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-13T08:26:01.726518+0000","last_change":"2023-09-13T08:26:01.054807+0000","last_active":"2023-09-13T08:26:01.726518+0000","last_peered":"2023-09-13T08:26:01.726518+0000","last_clean":"2023-09-13T08:26:01.726518+0000","last_became_active":"2023-09-13T08:26:01.054507+0000","last_became_peered":"2023-09-13T08:26:01.054507+0000","last_unstale":"2023-09-13T08:26:01.726518+0000","last_undegraded":"2023-09-13T08:26:01.726518+0000","last_fullsized":"2023-09-13T08:26:01.726518+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_clean_scrub_stamp":"2023-09-13T08:26:00.019012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:09:29.445187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-13T08:26:01.744678+0000","last_change":"2023-09-13T08:26:01.739740+0000","last_active":"2023-09-13T08:26:01.744678+0000","last_peered":"2023-09-13T08:26:01.744678+0000","last_clean":"2023-09-13T08:26:01.744678+0000","last_became_active":"2023-09-13T08:26:01.739494+0000","last_became_peered":"2023-09-13T08:26:01.739494+0000","last_unstale":"2023-09-13T08:26:01.744678+0000","last_undegraded":"2023-09-13T08:26:01.744678+0000","last_fullsized":"2023-09-13T08:26:01.744678+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:44:07.674488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:03.024981+0000","last_change":"2023-09-13T08:26:01.057195+0000","last_active":"2023-09-13T08:26:03.024981+0000","last_peered":"2023-09-13T08:26:03.024981+0000","last_clean":"2023-09-13T08:26:03.024981+0000","last_became_active":"2023-09-13T08:26:01.056925+0000","last_became_peered":"2023-09-13T08:26:01.056925+0000","last_unstale":"2023-09-13T08:26:03.024981+0000","last_undegraded":"2023-09-13T08:26:03.024981+0000","last_fullsized":"2023-09-13T08:26:03.024981+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_clean_scrub_stamp":"2023-09-13T08:26:00.019012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:07:55.959995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:02.724864+0000","last_change":"2023-09-13T08:26:01.734118+0000","last_active":"2023-09-13T08:26:02.724864+0000","last_peered":"2023-09-13T08:26:02.724864+0000","last_clean":"2023-09-13T08:26:02.724864+0000","last_became_active":"2023-09-13T08:26:01.733598+0000","last_became_peered":"2023-09-13T08:26:01.733598+0000","last_unstale":"2023-09-13T08:26:02.724864+0000","last_undegraded":"2023-09-13T08:26:02.724864+0000","last_fullsized":"2023-09-13T08:26:02.724864+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:07:56.968040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-13T08:26:01.728249+0000","last_change":"2023-09-13T08:26:01.046527+0000","last_active":"2023-09-13T08:26:01.728249+0000","last_peered":"2023-09-13T08:26:01.728249+0000","last_clean":"2023-09-13T08:26:01.728249+0000","last_became_active":"2023-09-13T08:26:01.046255+0000","last_became_peered":"2023-09-13T08:26:01.046255+0000","last_unstale":"2023-09-13T08:26:01.728249+0000","last_undegraded":"2023-09-13T08:26:01.728249+0000","last_fullsized":"2023-09-13T08:26:01.728249+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_clean_scrub_stamp":"2023-09-13T08:26:00.019012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:29:50.379960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:02.723936+0000","last_change":"2023-09-13T08:26:01.742314+0000","last_active":"2023-09-13T08:26:02.723936+0000","last_peered":"2023-09-13T08:26:02.723936+0000","last_clean":"2023-09-13T08:26:02.723936+0000","last_became_active":"2023-09-13T08:26:01.741839+0000","last_became_peered":"2023-09-13T08:26:01.741839+0000","last_unstale":"2023-09-13T08:26:02.723936+0000","last_undegraded":"2023-09-13T08:26:02.723936+0000","last_fullsized":"2023-09-13T08:26:02.723936+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:12:21.335640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:02.724247+0000","last_change":"2023-09-13T08:26:01.063004+0000","last_active":"2023-09-13T08:26:02.724247+0000","last_peered":"2023-09-13T08:26:02.724247+0000","last_clean":"2023-09-13T08:26:02.724247+0000","last_became_active":"2023-09-13T08:26:01.062795+0000","last_became_peered":"2023-09-13T08:26:01.062795+0000","last_unstale":"2023-09-13T08:26:02.724247+0000","last_undegraded":"2023-09-13T08:26:02.724247+0000","last_fullsized":"2023-09-13T08:26:02.724247+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_clean_scrub_stamp":"2023-09-13T08:26:00.019012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:25:27.859239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-13T08:26:01.736231+0000","last_change":"2023-09-13T08:26:01.731498+0000","last_active":"2023-09-13T08:26:01.736231+0000","last_peered":"2023-09-13T08:26:01.736231+0000","last_clean":"2023-09-13T08:26:01.736231+0000","last_became_active":"2023-09-13T08:26:01.731251+0000","last_became_peered":"2023-09-13T08:26:01.731251+0000","last_unstale":"2023-09-13T08:26:01.736231+0000","last_undegraded":"2023-09-13T08:26:01.736231+0000","last_fullsized":"2023-09-13T08:26:01.736231+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:06:08.866915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"37'3","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:02.724395+0000","last_change":"2023-09-13T08:26:01.056936+0000","last_active":"2023-09-13T08:26:02.724395+0000","last_peered":"2023-09-13T08:26:02.724395+0000","last_clean":"2023-09-13T08:26:02.724395+0000","last_became_active":"2023-09-13T08:26:01.056641+0000","last_became_peered":"2023-09-13T08:26:01.056641+0000","last_unstale":"2023-09-13T08:26:02.724395+0000","last_undegraded":"2023-09-13T08:26:02.724395+0000","last_fullsized":"2023-09-13T08:26:02.724395+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_clean_scrub_stamp":"2023-09-13T08:26:00.019012+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:45:46.211956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:03.025475+0000","last_change":"2023-09-13T08:26:01.738674+0000","last_active":"2023-09-13T08:26:03.025475+0000","last_peered":"2023-09-13T08:26:03.025475+0000","last_clean":"2023-09-13T08:26:03.025475+0000","last_became_active":"2023-09-13T08:26:01.738387+0000","last_became_peered":"2023-09-13T08:26:01.738387+0000","last_unstale":"2023-09-13T08:26:03.025475+0000","last_undegraded":"2023-09-13T08:26:03.025475+0000","last_fullsized":"2023-09-13T08:26:03.025475+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:04:45.898112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"37'6","reported_seq":17,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-13T08:26:02.053722+0000","last_change":"2023-09-13T08:26:01.057668+0000","last_active":"2023-09-13T08:26:02.053722+0000","last_peered":"2023-09-13T08:26:02.053722+0000","last_clean":"2023-09-13T08:26:02.053722+0000","last_became_active":"2023-09-13T08:26:01.057402+0000","last_became_peered":"2023-09-13T08:26:01.057402+0000","last_unstale":"2023-09-13T08:26:02.053722+0000","last_undegraded":"2023-09-13T08:26:02.053722+0000","last_fullsized":"2023-09-13T08:26:02.053722+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_clean_scrub_stamp":"2023-09-13T08:26:00.019012+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:18:18.835695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-13T08:26:01.734567+0000","last_change":"2023-09-13T08:26:01.729921+0000","last_active":"2023-09-13T08:26:01.734567+0000","last_peered":"2023-09-13T08:26:01.734567+0000","last_clean":"2023-09-13T08:26:01.734567+0000","last_became_active":"2023-09-13T08:26:01.729662+0000","last_became_peered":"2023-09-13T08:26:01.729662+0000","last_unstale":"2023-09-13T08:26:01.734567+0000","last_undegraded":"2023-09-13T08:26:01.734567+0000","last_fullsized":"2023-09-13T08:26:01.734567+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:02:24.732933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"37'2","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-13T08:26:02.049626+0000","last_change":"2023-09-13T08:26:01.054062+0000","last_active":"2023-09-13T08:26:02.049626+0000","last_peered":"2023-09-13T08:26:02.049626+0000","last_clean":"2023-09-13T08:26:02.049626+0000","last_became_active":"2023-09-13T08:26:01.053761+0000","last_became_peered":"2023-09-13T08:26:01.053761+0000","last_unstale":"2023-09-13T08:26:02.049626+0000","last_undegraded":"2023-09-13T08:26:02.049626+0000","last_fullsized":"2023-09-13T08:26:02.049626+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_clean_scrub_stamp":"2023-09-13T08:26:00.019012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:34:55.029369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-13T08:26:01.735120+0000","last_change":"2023-09-13T08:26:01.732435+0000","last_active":"2023-09-13T08:26:01.735120+0000","last_peered":"2023-09-13T08:26:01.735120+0000","last_clean":"2023-09-13T08:26:01.735120+0000","last_became_active":"2023-09-13T08:26:01.732112+0000","last_became_peered":"2023-09-13T08:26:01.732112+0000","last_unstale":"2023-09-13T08:26:01.735120+0000","last_undegraded":"2023-09-13T08:26:01.735120+0000","last_fullsized":"2023-09-13T08:26:01.735120+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:52:21.046807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-13T08:26:01.726803+0000","last_change":"2023-09-13T08:26:01.054920+0000","last_active":"2023-09-13T08:26:01.726803+0000","last_peered":"2023-09-13T08:26:01.726803+0000","last_clean":"2023-09-13T08:26:01.726803+0000","last_became_active":"2023-09-13T08:26:01.054521+0000","last_became_peered":"2023-09-13T08:26:01.054521+0000","last_unstale":"2023-09-13T08:26:01.726803+0000","last_undegraded":"2023-09-13T08:26:01.726803+0000","last_fullsized":"2023-09-13T08:26:01.726803+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_clean_scrub_stamp":"2023-09-13T08:26:00.019012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:02:23.724888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:02.723674+0000","last_change":"2023-09-13T08:26:01.734292+0000","last_active":"2023-09-13T08:26:02.723674+0000","last_peered":"2023-09-13T08:26:02.723674+0000","last_clean":"2023-09-13T08:26:02.723674+0000","last_became_active":"2023-09-13T08:26:01.733942+0000","last_became_peered":"2023-09-13T08:26:01.733942+0000","last_unstale":"2023-09-13T08:26:02.723674+0000","last_undegraded":"2023-09-13T08:26:02.723674+0000","last_fullsized":"2023-09-13T08:26:02.723674+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:39:45.862923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:03.200694+0000","last_change":"2023-09-13T08:26:01.055564+0000","last_active":"2023-09-13T08:26:03.200694+0000","last_peered":"2023-09-13T08:26:03.200694+0000","last_clean":"2023-09-13T08:26:03.200694+0000","last_became_active":"2023-09-13T08:26:01.055316+0000","last_became_peered":"2023-09-13T08:26:01.055316+0000","last_unstale":"2023-09-13T08:26:03.200694+0000","last_undegraded":"2023-09-13T08:26:03.200694+0000","last_fullsized":"2023-09-13T08:26:03.200694+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_clean_scrub_stamp":"2023-09-13T08:26:00.019012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:09:29.445187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-13T08:26:01.738409+0000","last_change":"2023-09-13T08:26:01.733591+0000","last_active":"2023-09-13T08:26:01.738409+0000","last_peered":"2023-09-13T08:26:01.738409+0000","last_clean":"2023-09-13T08:26:01.738409+0000","last_became_active":"2023-09-13T08:26:01.733308+0000","last_became_peered":"2023-09-13T08:26:01.733308+0000","last_unstale":"2023-09-13T08:26:01.738409+0000","last_undegraded":"2023-09-13T08:26:01.738409+0000","last_fullsized":"2023-09-13T08:26:01.738409+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:01:08.911581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"37'8","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:02.723063+0000","last_change":"2023-09-13T08:26:01.054947+0000","last_active":"2023-09-13T08:26:02.723063+0000","last_peered":"2023-09-13T08:26:02.723063+0000","last_clean":"2023-09-13T08:26:02.723063+0000","last_became_active":"2023-09-13T08:26:01.054676+0000","last_became_peered":"2023-09-13T08:26:01.054676+0000","last_unstale":"2023-09-13T08:26:02.723063+0000","last_undegraded":"2023-09-13T08:26:02.723063+0000","last_fullsized":"2023-09-13T08:26:02.723063+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_clean_scrub_stamp":"2023-09-13T08:26:00.019012+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:32:26.864270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-13T08:26:01.747484+0000","last_change":"2023-09-13T08:26:01.743612+0000","last_active":"2023-09-13T08:26:01.747484+0000","last_peered":"2023-09-13T08:26:01.747484+0000","last_clean":"2023-09-13T08:26:01.747484+0000","last_became_active":"2023-09-13T08:26:01.743410+0000","last_became_peered":"2023-09-13T08:26:01.743410+0000","last_unstale":"2023-09-13T08:26:01.747484+0000","last_undegraded":"2023-09-13T08:26:01.747484+0000","last_fullsized":"2023-09-13T08:26:01.747484+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:04:45.898112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:02.724562+0000","last_change":"2023-09-13T08:26:01.059780+0000","last_active":"2023-09-13T08:26:02.724562+0000","last_peered":"2023-09-13T08:26:02.724562+0000","last_clean":"2023-09-13T08:26:02.724562+0000","last_became_active":"2023-09-13T08:26:01.059453+0000","last_became_peered":"2023-09-13T08:26:01.059453+0000","last_unstale":"2023-09-13T08:26:02.724562+0000","last_undegraded":"2023-09-13T08:26:02.724562+0000","last_fullsized":"2023-09-13T08:26:02.724562+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_clean_scrub_stamp":"2023-09-13T08:26:00.019012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:47:50.511849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:02.724416+0000","last_change":"2023-09-13T08:26:01.733245+0000","last_active":"2023-09-13T08:26:02.724416+0000","last_peered":"2023-09-13T08:26:02.724416+0000","last_clean":"2023-09-13T08:26:02.724416+0000","last_became_active":"2023-09-13T08:26:01.732948+0000","last_became_peered":"2023-09-13T08:26:01.732948+0000","last_unstale":"2023-09-13T08:26:02.724416+0000","last_undegraded":"2023-09-13T08:26:02.724416+0000","last_fullsized":"2023-09-13T08:26:02.724416+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:42:14.467719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"37'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:03.025455+0000","last_change":"2023-09-13T08:26:01.055117+0000","last_active":"2023-09-13T08:26:03.025455+0000","last_peered":"2023-09-13T08:26:03.025455+0000","last_clean":"2023-09-13T08:26:03.025455+0000","last_became_active":"2023-09-13T08:26:01.054824+0000","last_became_peered":"2023-09-13T08:26:01.054824+0000","last_unstale":"2023-09-13T08:26:03.025455+0000","last_undegraded":"2023-09-13T08:26:03.025455+0000","last_fullsized":"2023-09-13T08:26:03.025455+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_clean_scrub_stamp":"2023-09-13T08:26:00.019012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:32:26.864270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:03.025568+0000","last_change":"2023-09-13T08:26:01.739097+0000","last_active":"2023-09-13T08:26:03.025568+0000","last_peered":"2023-09-13T08:26:03.025568+0000","last_clean":"2023-09-13T08:26:03.025568+0000","last_became_active":"2023-09-13T08:26:01.734486+0000","last_became_peered":"2023-09-13T08:26:01.734486+0000","last_unstale":"2023-09-13T08:26:03.025568+0000","last_undegraded":"2023-09-13T08:26:03.025568+0000","last_fullsized":"2023-09-13T08:26:03.025568+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:45:47.220002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"37'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:02.724766+0000","last_change":"2023-09-13T08:26:01.054844+0000","last_active":"2023-09-13T08:26:02.724766+0000","last_peered":"2023-09-13T08:26:02.724766+0000","last_clean":"2023-09-13T08:26:02.724766+0000","last_became_active":"2023-09-13T08:26:01.054060+0000","last_became_peered":"2023-09-13T08:26:01.054060+0000","last_unstale":"2023-09-13T08:26:02.724766+0000","last_undegraded":"2023-09-13T08:26:02.724766+0000","last_fullsized":"2023-09-13T08:26:02.724766+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_clean_scrub_stamp":"2023-09-13T08:26:00.019012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T19:03:25.317258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:02.724981+0000","last_change":"2023-09-13T08:26:01.734363+0000","last_active":"2023-09-13T08:26:02.724981+0000","last_peered":"2023-09-13T08:26:02.724981+0000","last_clean":"2023-09-13T08:26:02.724981+0000","last_became_active":"2023-09-13T08:26:01.734114+0000","last_became_peered":"2023-09-13T08:26:01.734114+0000","last_unstale":"2023-09-13T08:26:02.724981+0000","last_undegraded":"2023-09-13T08:26:02.724981+0000","last_fullsized":"2023-09-13T08:26:02.724981+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:47:38.575798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-13T08:26:01.726750+0000","last_change":"2023-09-13T08:26:01.047368+0000","last_active":"2023-09-13T08:26:01.726750+0000","last_peered":"2023-09-13T08:26:01.726750+0000","last_clean":"2023-09-13T08:26:01.726750+0000","last_became_active":"2023-09-13T08:26:01.047110+0000","last_became_peered":"2023-09-13T08:26:01.047110+0000","last_unstale":"2023-09-13T08:26:01.726750+0000","last_undegraded":"2023-09-13T08:26:01.726750+0000","last_fullsized":"2023-09-13T08:26:01.726750+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_clean_scrub_stamp":"2023-09-13T08:26:00.019012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:47:37.567753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:02.723368+0000","last_change":"2023-09-13T08:26:01.734856+0000","last_active":"2023-09-13T08:26:02.723368+0000","last_peered":"2023-09-13T08:26:02.723368+0000","last_clean":"2023-09-13T08:26:02.723368+0000","last_became_active":"2023-09-13T08:26:01.734576+0000","last_became_peered":"2023-09-13T08:26:01.734576+0000","last_unstale":"2023-09-13T08:26:02.723368+0000","last_undegraded":"2023-09-13T08:26:02.723368+0000","last_fullsized":"2023-09-13T08:26:02.723368+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:44:07.674488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"37'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:02.724663+0000","last_change":"2023-09-13T08:26:01.056732+0000","last_active":"2023-09-13T08:26:02.724663+0000","last_peered":"2023-09-13T08:26:02.724663+0000","last_clean":"2023-09-13T08:26:02.724663+0000","last_became_active":"2023-09-13T08:26:01.056389+0000","last_became_peered":"2023-09-13T08:26:01.056389+0000","last_unstale":"2023-09-13T08:26:02.724663+0000","last_undegraded":"2023-09-13T08:26:02.724663+0000","last_fullsized":"2023-09-13T08:26:02.724663+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_clean_scrub_stamp":"2023-09-13T08:26:00.019012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:08:49.086873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-13T08:26:01.736167+0000","last_change":"2023-09-13T08:26:01.730585+0000","last_active":"2023-09-13T08:26:01.736167+0000","last_peered":"2023-09-13T08:26:01.736167+0000","last_clean":"2023-09-13T08:26:01.736167+0000","last_became_active":"2023-09-13T08:26:01.730332+0000","last_became_peered":"2023-09-13T08:26:01.730332+0000","last_unstale":"2023-09-13T08:26:01.736167+0000","last_undegraded":"2023-09-13T08:26:01.736167+0000","last_fullsized":"2023-09-13T08:26:01.736167+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:47:38.575798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:02.724721+0000","last_change":"2023-09-13T08:26:01.051739+0000","last_active":"2023-09-13T08:26:02.724721+0000","last_peered":"2023-09-13T08:26:02.724721+0000","last_clean":"2023-09-13T08:26:02.724721+0000","last_became_active":"2023-09-13T08:26:01.051133+0000","last_became_peered":"2023-09-13T08:26:01.051133+0000","last_unstale":"2023-09-13T08:26:02.724721+0000","last_undegraded":"2023-09-13T08:26:02.724721+0000","last_fullsized":"2023-09-13T08:26:02.724721+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_clean_scrub_stamp":"2023-09-13T08:26:00.019012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:17:49.059630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:02.723885+0000","last_change":"2023-09-13T08:26:01.742294+0000","last_active":"2023-09-13T08:26:02.723885+0000","last_peered":"2023-09-13T08:26:02.723885+0000","last_clean":"2023-09-13T08:26:02.723885+0000","last_became_active":"2023-09-13T08:26:01.742042+0000","last_became_peered":"2023-09-13T08:26:01.742042+0000","last_unstale":"2023-09-13T08:26:02.723885+0000","last_undegraded":"2023-09-13T08:26:02.723885+0000","last_fullsized":"2023-09-13T08:26:02.723885+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:12:21.335640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:02.723465+0000","last_change":"2023-09-13T08:26:01.056899+0000","last_active":"2023-09-13T08:26:02.723465+0000","last_peered":"2023-09-13T08:26:02.723465+0000","last_clean":"2023-09-13T08:26:02.723465+0000","last_became_active":"2023-09-13T08:26:01.056616+0000","last_became_peered":"2023-09-13T08:26:01.056616+0000","last_unstale":"2023-09-13T08:26:02.723465+0000","last_undegraded":"2023-09-13T08:26:02.723465+0000","last_fullsized":"2023-09-13T08:26:02.723465+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_clean_scrub_stamp":"2023-09-13T08:26:00.019012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:18:18.835695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-13T08:26:01.744658+0000","last_change":"2023-09-13T08:26:01.739722+0000","last_active":"2023-09-13T08:26:01.744658+0000","last_peered":"2023-09-13T08:26:01.744658+0000","last_clean":"2023-09-13T08:26:01.744658+0000","last_became_active":"2023-09-13T08:26:01.739472+0000","last_became_peered":"2023-09-13T08:26:01.739472+0000","last_unstale":"2023-09-13T08:26:01.744658+0000","last_undegraded":"2023-09-13T08:26:01.744658+0000","last_fullsized":"2023-09-13T08:26:01.744658+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:38:02.347407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:02.724493+0000","last_change":"2023-09-13T08:26:01.056672+0000","last_active":"2023-09-13T08:26:02.724493+0000","last_peered":"2023-09-13T08:26:02.724493+0000","last_clean":"2023-09-13T08:26:02.724493+0000","last_became_active":"2023-09-13T08:26:01.056349+0000","last_became_peered":"2023-09-13T08:26:01.056349+0000","last_unstale":"2023-09-13T08:26:02.724493+0000","last_undegraded":"2023-09-13T08:26:02.724493+0000","last_fullsized":"2023-09-13T08:26:02.724493+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_clean_scrub_stamp":"2023-09-13T08:26:00.019012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:07:01.340902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-13T08:26:01.738578+0000","last_change":"2023-09-13T08:26:01.733565+0000","last_active":"2023-09-13T08:26:01.738578+0000","last_peered":"2023-09-13T08:26:01.738578+0000","last_clean":"2023-09-13T08:26:01.738578+0000","last_became_active":"2023-09-13T08:26:01.733301+0000","last_became_peered":"2023-09-13T08:26:01.733301+0000","last_unstale":"2023-09-13T08:26:01.738578+0000","last_undegraded":"2023-09-13T08:26:01.738578+0000","last_fullsized":"2023-09-13T08:26:01.738578+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:08:09.589011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"37'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:02.724612+0000","last_change":"2023-09-13T08:26:01.059579+0000","last_active":"2023-09-13T08:26:02.724612+0000","last_peered":"2023-09-13T08:26:02.724612+0000","last_clean":"2023-09-13T08:26:02.724612+0000","last_became_active":"2023-09-13T08:26:01.057201+0000","last_became_peered":"2023-09-13T08:26:01.057201+0000","last_unstale":"2023-09-13T08:26:02.724612+0000","last_undegraded":"2023-09-13T08:26:02.724612+0000","last_fullsized":"2023-09-13T08:26:02.724612+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_clean_scrub_stamp":"2023-09-13T08:26:00.019012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:31:00.282003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:02.724096+0000","last_change":"2023-09-13T08:26:01.744914+0000","last_active":"2023-09-13T08:26:02.724096+0000","last_peered":"2023-09-13T08:26:02.724096+0000","last_clean":"2023-09-13T08:26:02.724096+0000","last_became_active":"2023-09-13T08:26:01.744663+0000","last_became_peered":"2023-09-13T08:26:01.744663+0000","last_unstale":"2023-09-13T08:26:02.724096+0000","last_undegraded":"2023-09-13T08:26:02.724096+0000","last_fullsized":"2023-09-13T08:26:02.724096+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:38:08.520198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:02.725024+0000","last_change":"2023-09-13T08:26:01.055883+0000","last_active":"2023-09-13T08:26:02.725024+0000","last_peered":"2023-09-13T08:26:02.725024+0000","last_clean":"2023-09-13T08:26:02.725024+0000","last_became_active":"2023-09-13T08:26:01.055583+0000","last_became_peered":"2023-09-13T08:26:01.055583+0000","last_unstale":"2023-09-13T08:26:02.725024+0000","last_undegraded":"2023-09-13T08:26:02.725024+0000","last_fullsized":"2023-09-13T08:26:02.725024+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_clean_scrub_stamp":"2023-09-13T08:26:00.019012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:04:36.970333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-13T08:26:01.744713+0000","last_change":"2023-09-13T08:26:01.740229+0000","last_active":"2023-09-13T08:26:01.744713+0000","last_peered":"2023-09-13T08:26:01.744713+0000","last_clean":"2023-09-13T08:26:01.744713+0000","last_became_active":"2023-09-13T08:26:01.740010+0000","last_became_peered":"2023-09-13T08:26:01.740010+0000","last_unstale":"2023-09-13T08:26:01.744713+0000","last_undegraded":"2023-09-13T08:26:01.744713+0000","last_fullsized":"2023-09-13T08:26:01.744713+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:30:18.262953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-13T08:26:01.724763+0000","last_change":"2023-09-13T08:26:01.058721+0000","last_active":"2023-09-13T08:26:01.724763+0000","last_peered":"2023-09-13T08:26:01.724763+0000","last_clean":"2023-09-13T08:26:01.724763+0000","last_became_active":"2023-09-13T08:26:01.058475+0000","last_became_peered":"2023-09-13T08:26:01.058475+0000","last_unstale":"2023-09-13T08:26:01.724763+0000","last_undegraded":"2023-09-13T08:26:01.724763+0000","last_fullsized":"2023-09-13T08:26:01.724763+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_clean_scrub_stamp":"2023-09-13T08:26:00.019012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:47:50.511849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-13T08:26:01.737981+0000","last_change":"2023-09-13T08:26:01.735901+0000","last_active":"2023-09-13T08:26:01.737981+0000","last_peered":"2023-09-13T08:26:01.737981+0000","last_clean":"2023-09-13T08:26:01.737981+0000","last_became_active":"2023-09-13T08:26:01.735363+0000","last_became_peered":"2023-09-13T08:26:01.735363+0000","last_unstale":"2023-09-13T08:26:01.737981+0000","last_undegraded":"2023-09-13T08:26:01.737981+0000","last_fullsized":"2023-09-13T08:26:01.737981+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:52:21.046807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-13T08:26:01.724813+0000","last_change":"2023-09-13T08:26:01.056584+0000","last_active":"2023-09-13T08:26:01.724813+0000","last_peered":"2023-09-13T08:26:01.724813+0000","last_clean":"2023-09-13T08:26:01.724813+0000","last_became_active":"2023-09-13T08:26:01.056316+0000","last_became_peered":"2023-09-13T08:26:01.056316+0000","last_unstale":"2023-09-13T08:26:01.724813+0000","last_undegraded":"2023-09-13T08:26:01.724813+0000","last_fullsized":"2023-09-13T08:26:01.724813+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_clean_scrub_stamp":"2023-09-13T08:26:00.019012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:31:00.282003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-13T08:26:01.746526+0000","last_change":"2023-09-13T08:26:01.741874+0000","last_active":"2023-09-13T08:26:01.746526+0000","last_peered":"2023-09-13T08:26:01.746526+0000","last_clean":"2023-09-13T08:26:01.746526+0000","last_became_active":"2023-09-13T08:26:01.741668+0000","last_became_peered":"2023-09-13T08:26:01.741668+0000","last_unstale":"2023-09-13T08:26:01.746526+0000","last_undegraded":"2023-09-13T08:26:01.746526+0000","last_fullsized":"2023-09-13T08:26:01.746526+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:03:10.132906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:03.200787+0000","last_change":"2023-09-13T08:26:01.054929+0000","last_active":"2023-09-13T08:26:03.200787+0000","last_peered":"2023-09-13T08:26:03.200787+0000","last_clean":"2023-09-13T08:26:03.200787+0000","last_became_active":"2023-09-13T08:26:01.054629+0000","last_became_peered":"2023-09-13T08:26:01.054629+0000","last_unstale":"2023-09-13T08:26:03.200787+0000","last_undegraded":"2023-09-13T08:26:03.200787+0000","last_fullsized":"2023-09-13T08:26:03.200787+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_clean_scrub_stamp":"2023-09-13T08:26:00.019012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:47:37.567753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:03.025505+0000","last_change":"2023-09-13T08:26:01.739418+0000","last_active":"2023-09-13T08:26:03.025505+0000","last_peered":"2023-09-13T08:26:03.025505+0000","last_clean":"2023-09-13T08:26:03.025505+0000","last_became_active":"2023-09-13T08:26:01.738169+0000","last_became_peered":"2023-09-13T08:26:01.738169+0000","last_unstale":"2023-09-13T08:26:03.025505+0000","last_undegraded":"2023-09-13T08:26:03.025505+0000","last_fullsized":"2023-09-13T08:26:03.025505+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:18:19.843741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:03.024994+0000","last_change":"2023-09-13T08:26:01.052439+0000","last_active":"2023-09-13T08:26:03.024994+0000","last_peered":"2023-09-13T08:26:03.024994+0000","last_clean":"2023-09-13T08:26:03.024994+0000","last_became_active":"2023-09-13T08:26:01.052150+0000","last_became_peered":"2023-09-13T08:26:01.052150+0000","last_unstale":"2023-09-13T08:26:03.024994+0000","last_undegraded":"2023-09-13T08:26:03.024994+0000","last_fullsized":"2023-09-13T08:26:03.024994+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_clean_scrub_stamp":"2023-09-13T08:26:00.019012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T08:32:07.146552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:02.724154+0000","last_change":"2023-09-13T08:26:01.742165+0000","last_active":"2023-09-13T08:26:02.724154+0000","last_peered":"2023-09-13T08:26:02.724154+0000","last_clean":"2023-09-13T08:26:02.724154+0000","last_became_active":"2023-09-13T08:26:01.741848+0000","last_became_peered":"2023-09-13T08:26:01.741848+0000","last_unstale":"2023-09-13T08:26:02.724154+0000","last_undegraded":"2023-09-13T08:26:02.724154+0000","last_fullsized":"2023-09-13T08:26:02.724154+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:22:59.139845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-13T08:26:01.725811+0000","last_change":"2023-09-13T08:26:01.046544+0000","last_active":"2023-09-13T08:26:01.725811+0000","last_peered":"2023-09-13T08:26:01.725811+0000","last_clean":"2023-09-13T08:26:01.725811+0000","last_became_active":"2023-09-13T08:26:01.046267+0000","last_became_peered":"2023-09-13T08:26:01.046267+0000","last_unstale":"2023-09-13T08:26:01.725811+0000","last_undegraded":"2023-09-13T08:26:01.725811+0000","last_fullsized":"2023-09-13T08:26:01.725811+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_clean_scrub_stamp":"2023-09-13T08:26:00.019012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:31:00.282003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:02.724530+0000","last_change":"2023-09-13T08:26:01.736209+0000","last_active":"2023-09-13T08:26:02.724530+0000","last_peered":"2023-09-13T08:26:02.724530+0000","last_clean":"2023-09-13T08:26:02.724530+0000","last_became_active":"2023-09-13T08:26:01.735902+0000","last_became_peered":"2023-09-13T08:26:01.735902+0000","last_unstale":"2023-09-13T08:26:02.724530+0000","last_undegraded":"2023-09-13T08:26:02.724530+0000","last_fullsized":"2023-09-13T08:26:02.724530+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:01.027057+0000","last_clean_scrub_stamp":"2023-09-13T08:26:01.027057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T19:02:51.233158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-13T08:26:02.724050+0000","last_change":"2023-09-13T08:26:01.054253+0000","last_active":"2023-09-13T08:26:02.724050+0000","last_peered":"2023-09-13T08:26:02.724050+0000","last_clean":"2023-09-13T08:26:02.724050+0000","last_became_active":"2023-09-13T08:26:01.053982+0000","last_became_peered":"2023-09-13T08:26:01.053982+0000","last_unstale":"2023-09-13T08:26:02.724050+0000","last_undegraded":"2023-09-13T08:26:02.724050+0000","last_fullsized":"2023-09-13T08:26:02.724050+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:26:00.019012+0000","last_clean_scrub_stamp":"2023-09-13T08:26:00.019012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:02:23.724888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":183,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-13T08:26:01.729286+0000","last_change":"2023-09-13T08:24:30.608284+0000","last_active":"2023-09-13T08:26:01.729286+0000","last_peered":"2023-09-13T08:26:01.729286+0000","last_clean":"2023-09-13T08:26:01.729286+0000","last_became_active":"2023-09-13T08:24:30.607240+0000","last_became_peered":"2023-09-13T08:24:30.607240+0000","last_unstale":"2023-09-13T08:26:01.729286+0000","last_undegraded":"2023-09-13T08:26:01.729286+0000","last_fullsized":"2023-09-13T08:26:01.729286+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T08:24:29.424755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T08:24:29.424755+0000","last_clean_scrub_stamp":"2023-09-13T08:24:29.424755+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:57:43.427279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574870,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28044,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343796,"statfs":{"total":96636764160,"available":96608047104,"internally_reserved":0,"allocated":1048576,"data_stored":781475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 08:25:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.54600000000000004}]},{"osd":1,"last update":"Wed Sep 13 08:25:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.438},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.70099999999999996}]},{"osd":2,"last update":"Wed Sep 13 08:25:30 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.49199999999999999}]},{"osd":3,"last update":"Wed Sep 13 08:25:30 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.60399999999999998}]},{"osd":4,"last update":"Wed Sep 13 08:25:30 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.66100000000000003}]},{"osd":5,"last update":"Wed Sep 13 08:25:30 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.67300000000000004}]},{"osd":6,"last update":"Wed Sep 13 08:25:30 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.61899999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574872,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":430080,"data_stored":183387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 08:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.79300000000000004}]},{"osd":1,"last update":"Wed Sep 13 08:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.84399999999999997}]},{"osd":2,"last update":"Wed Sep 13 08:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.82699999999999996}]},{"osd":3,"last update":"Wed Sep 13 08:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.68000000000000005}]},{"osd":4,"last update":"Wed Sep 13 08:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.69699999999999995}]},{"osd":5,"last update":"Wed Sep 13 08:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.745},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.55000000000000004}]},{"osd":7,"last update":"Wed Sep 13 08:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.629},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.85799999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":430080,"data_stored":182895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 08:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"last":0.376}]},{"osd":2,"last update":"Wed Sep 13 08:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.317}]},{"osd":3,"last update":"Wed Sep 13 08:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.33600000000000002}]},{"osd":4,"last update":"Wed Sep 13 08:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.53300000000000003}]},{"osd":5,"last update":"Wed Sep 13 08:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.52300000000000002}]},{"osd":6,"last update":"Wed Sep 13 08:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.502},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.59699999999999998}]},{"osd":7,"last update":"Wed Sep 13 08:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.48899999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574871,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28016,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343824,"statfs":{"total":96636764160,"available":96608075776,"internally_reserved":0,"allocated":1024000,"data_stored":773207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 13 08:25:28 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":7.3490000000000002,"5min":7.3490000000000002,"15min":7.3490000000000002},"last":0.23499999999999999},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.34000000000000002}]},{"osd":2,"last update":"Wed Sep 13 08:25:28 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":11.343999999999999,"5min":11.343999999999999,"15min":11.343999999999999},"last":0.26700000000000002}]},{"osd":3,"last update":"Wed Sep 13 08:25:28 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":7.3040000000000003,"5min":7.3040000000000003,"15min":7.3040000000000003},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.36199999999999999}]},{"osd":4,"last update":"Wed Sep 13 08:25:28 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":7.4109999999999996,"5min":7.4109999999999996,"15min":7.4109999999999996},"last":0.442},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.51500000000000001}]},{"osd":5,"last update":"Wed Sep 13 08:25:28 2023","interfaces":[{"interface":"back","average":{"1min":1.175,"5min":1.175,"15min":1.175},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":11.613,"5min":11.613,"15min":11.613},"last":0.57199999999999995},{"interface":"front","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":7.3840000000000003,"5min":7.3840000000000003,"15min":7.3840000000000003},"last":0.42099999999999999}]},{"osd":6,"last update":"Wed Sep 13 08:25:28 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.42999999999999999},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":11.457000000000001,"5min":11.457000000000001,"15min":11.457000000000001},"last":0.496}]},{"osd":7,"last update":"Wed Sep 13 08:25:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":11.497999999999999,"5min":11.497999999999999,"15min":11.497999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":7.4390000000000001,"5min":7.4390000000000001,"15min":7.4390000000000001},"last":0.58699999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":430080,"data_stored":182875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 08:25:30 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":3.802,"5min":3.802,"15min":3.802},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.34699999999999998}]},{"osd":1,"last update":"Wed Sep 13 08:25:30 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":7.8529999999999998,"5min":7.8529999999999998,"15min":7.8529999999999998},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.438,"5min":0.438,"15min":0.438},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.378}]},{"osd":3,"last update":"Wed Sep 13 08:25:30 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.316}]},{"osd":4,"last update":"Wed Sep 13 08:25:30 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.52100000000000002}]},{"osd":5,"last update":"Wed Sep 13 08:25:30 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.497}]},{"osd":6,"last update":"Wed Sep 13 08:25:30 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.442},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.54600000000000004}]},{"osd":7,"last update":"Wed Sep 13 08:25:30 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.46000000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":442368,"data_stored":184451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 08:25:28 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":7.0359999999999996,"5min":7.0359999999999996,"15min":7.0359999999999996},"last":0.23499999999999999},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":5.8399999999999999,"5min":5.8399999999999999,"15min":5.8399999999999999},"last":0.32200000000000001}]},{"osd":1,"last update":"Wed Sep 13 08:25:28 2023","interfaces":[{"interface":"back","average":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":25.963999999999999,"5min":25.963999999999999,"15min":25.963999999999999},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":7.1779999999999999,"5min":7.1779999999999999,"15min":7.1779999999999999},"last":0.47899999999999998}]},{"osd":2,"last update":"Wed Sep 13 08:25:28 2023","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":15.307,"5min":15.307,"15min":15.307},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":7.1470000000000002,"5min":7.1470000000000002,"15min":7.1470000000000002},"last":0.39200000000000002}]},{"osd":4,"last update":"Wed Sep 13 08:25:28 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.113,"15min":1.113},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":10.952,"5min":10.952,"15min":10.952},"last":0.41299999999999998},{"interface":"front","average":{"1min":1.363,"5min":1.363,"15min":1.363},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":15.276,"5min":15.276,"15min":15.276},"last":0.56499999999999995}]},{"osd":5,"last update":"Wed Sep 13 08:25:28 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":15.243,"5min":15.243,"15min":15.243},"last":1.665},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":7.0860000000000003,"5min":7.0860000000000003,"15min":7.0860000000000003},"last":0.75}]},{"osd":6,"last update":"Wed Sep 13 08:25:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":10.994999999999999,"5min":10.994999999999999,"15min":10.994999999999999},"last":0.504},{"interface":"front","average":{"1min":1.373,"5min":1.373,"15min":1.373},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":15.189,"5min":15.189,"15min":15.189},"last":0.52300000000000002}]},{"osd":7,"last update":"Wed Sep 13 08:25:28 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":7.1150000000000002,"5min":7.1150000000000002,"15min":7.1150000000000002},"last":0.44},{"interface":"front","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":11.026,"5min":11.026,"15min":11.026},"last":0.54700000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":434176,"data_stored":183409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 08:25:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.40999999999999998}]},{"osd":1,"last update":"Wed Sep 13 08:25:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.433}]},{"osd":2,"last update":"Wed Sep 13 08:25:31 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.48599999999999999}]},{"osd":3,"last update":"Wed Sep 13 08:25:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.54400000000000004}]},{"osd":5,"last update":"Wed Sep 13 08:25:31 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.505}]},{"osd":6,"last update":"Wed Sep 13 08:25:31 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.57499999999999996}]},{"osd":7,"last update":"Wed Sep 13 08:25:31 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.76100000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574872,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":434176,"data_stored":182917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 08:25:29 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":2.649,"5min":2.649,"15min":2.649},"last":0.60599999999999998}]},{"osd":1,"last update":"Wed Sep 13 08:25:29 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":2.5489999999999999,"5min":2.5489999999999999,"15min":2.5489999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.50700000000000001}]},{"osd":2,"last update":"Wed Sep 13 08:25:29 2023","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.232,"15min":1.232},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":11.641999999999999,"5min":11.641999999999999,"15min":11.641999999999999},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.44500000000000001}]},{"osd":3,"last update":"Wed Sep 13 08:25:29 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":8.6069999999999993,"5min":8.6069999999999993,"15min":8.6069999999999993},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.53700000000000003}]},{"osd":4,"last update":"Wed Sep 13 08:25:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.55200000000000005}]},{"osd":6,"last update":"Wed Sep 13 08:25:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.56799999999999995}]},{"osd":7,"last update":"Wed Sep 13 08:25:29 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.59199999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-13T08:26:06.536 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-09-13T08:26:06.536 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-09-13T08:26:06.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.695+0000 7f7f1442b700 1 Processor -- start 2023-09-13T08:26:06.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.695+0000 7f7f1442b700 1 -- start start 2023-09-13T08:26:06.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.696+0000 7f7f1442b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7f0c06ea90 0x7f7f0c06d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:06.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.696+0000 7f7f1442b700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f0c0aeef0 con 0x7f7f0c15a190 2023-09-13T08:26:06.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.696+0000 7f7f1442b700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f0c06dc50 con 0x7f7f0c0b47d0 2023-09-13T08:26:06.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.696+0000 7f7f1442b700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f0c15a570 con 0x7f7f0c06ea90 2023-09-13T08:26:06.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.696+0000 7f7f119c6700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7f0c06ea90 0x7f7f0c06d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:06.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.696+0000 7f7f121c7700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f7f0c15a190 0x7f7f0c06e380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:48546/0 (socket says 172.21.15.84:48546) 2023-09-13T08:26:06.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.696+0000 7f7f121c7700 1 -- 172.21.15.84:0/2482233927 learned_addr learned my addr 172.21.15.84:0/2482233927 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:26:06.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.696+0000 7f7f119c6700 1 -- 172.21.15.84:0/2482233927 >> v1:172.21.15.161:6789/0 conn(0x7f7f0c0b47d0 legacy=0x7f7f0c0b31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:26:06.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.696+0000 7f7f119c6700 1 -- 172.21.15.84:0/2482233927 >> v1:172.21.15.84:6789/0 conn(0x7f7f0c15a190 legacy=0x7f7f0c06e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:06.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.696+0000 7f7f111c5700 1 -- 172.21.15.84:0/2482233927 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1086728264 0 0) 0x7f7f0c0aeef0 con 0x7f7f0c15a190 2023-09-13T08:26:06.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.696+0000 7f7f119c6700 1 -- 172.21.15.84:0/2482233927 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f0c06df30 con 0x7f7f0c06ea90 2023-09-13T08:26:06.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.696+0000 7f7f119c6700 1 --2- 172.21.15.84:0/2482233927 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f0c06ea90 0x7f7f0c06d550 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f7efc009870 tx=0x7f7efc009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=708db6e70d90cf78 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:26:06.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.697+0000 7f7f111c5700 1 -- 172.21.15.84:0/2482233927 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7efc004230 con 0x7f7f0c06ea90 2023-09-13T08:26:06.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.697+0000 7f7f111c5700 1 -- 172.21.15.84:0/2482233927 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7efc004390 con 0x7f7f0c06ea90 2023-09-13T08:26:06.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.697+0000 7f7f111c5700 1 -- 172.21.15.84:0/2482233927 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7efc0036a0 con 0x7f7f0c06ea90 2023-09-13T08:26:06.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.697+0000 7f7f1442b700 1 -- 172.21.15.84:0/2482233927 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f0c06ea90 msgr2=0x7f7f0c06d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:06.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.697+0000 7f7f1442b700 1 --2- 172.21.15.84:0/2482233927 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f0c06ea90 0x7f7f0c06d550 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f7efc009870 tx=0x7f7efc009b80 comp rx=0 tx=0).stop 2023-09-13T08:26:06.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.697+0000 7f7f1442b700 1 -- 172.21.15.84:0/2482233927 shutdown_connections 2023-09-13T08:26:06.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.697+0000 7f7f1442b700 1 --2- 172.21.15.84:0/2482233927 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f0c06ea90 0x7f7f0c06d550 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:06.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.697+0000 7f7f1442b700 1 -- 172.21.15.84:0/2482233927 >> 172.21.15.84:0/2482233927 conn(0x7f7f0c0cf8f0 msgr2=0x7f7f0c0cfd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:26:06.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.697+0000 7f7f1442b700 1 -- 172.21.15.84:0/2482233927 shutdown_connections 2023-09-13T08:26:06.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.697+0000 7f7f1442b700 1 -- 172.21.15.84:0/2482233927 wait complete. 2023-09-13T08:26:06.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.698+0000 7f7f1442b700 1 Processor -- start 2023-09-13T08:26:06.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.699+0000 7f7f1442b700 1 -- start start 2023-09-13T08:26:06.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.699+0000 7f7f1442b700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7f0c06ea90 0x7f7f0c1411c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:06.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.699+0000 7f7f1442b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7f0c0b47d0 0x7f7f0c157780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:06.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.699+0000 7f7f1442b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f0c15a190 0x7f7f0c157cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:06.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.699+0000 7f7f1442b700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0c141700 con 0x7f7f0c15a190 2023-09-13T08:26:06.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.699+0000 7f7f1442b700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0c15bb20 con 0x7f7f0c0b47d0 2023-09-13T08:26:06.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.699+0000 7f7f1442b700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0c15b5b0 con 0x7f7f0c06ea90 2023-09-13T08:26:06.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.699+0000 7f7f129c8700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f0c15a190 0x7f7f0c157cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:06.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.699+0000 7f7f129c8700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f0c15a190 0x7f7f0c157cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45908/0 (socket says 172.21.15.84:45908) 2023-09-13T08:26:06.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.699+0000 7f7f129c8700 1 -- 172.21.15.84:0/3475110374 learned_addr learned my addr 172.21.15.84:0/3475110374 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:26:06.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.699+0000 7f7f121c7700 1 --2- 172.21.15.84:0/3475110374 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7f0c06ea90 0x7f7f0c1411c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:06.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.699+0000 7f7f119c6700 1 --2- 172.21.15.84:0/3475110374 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7f0c0b47d0 0x7f7f0c157780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:06.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.700+0000 7f7f129c8700 1 -- 172.21.15.84:0/3475110374 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7f0c06ea90 msgr2=0x7f7f0c1411c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:06.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.700+0000 7f7f129c8700 1 --2- 172.21.15.84:0/3475110374 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7f0c06ea90 0x7f7f0c1411c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:06.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.700+0000 7f7f129c8700 1 -- 172.21.15.84:0/3475110374 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7f0c0b47d0 msgr2=0x7f7f0c157780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:06.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.700+0000 7f7f129c8700 1 --2- 172.21.15.84:0/3475110374 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7f0c0b47d0 0x7f7f0c157780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:06.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.700+0000 7f7f129c8700 1 -- 172.21.15.84:0/3475110374 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7efc0094a0 con 0x7f7f0c15a190 2023-09-13T08:26:06.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.700+0000 7f7f129c8700 1 --2- 172.21.15.84:0/3475110374 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f0c15a190 0x7f7f0c157cc0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f7f0400c7a0 tx=0x7f7f0400cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:26:06.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.700+0000 7f7f02ffd700 1 -- 172.21.15.84:0/3475110374 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f04003e10 con 0x7f7f0c15a190 2023-09-13T08:26:06.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.700+0000 7f7f02ffd700 1 -- 172.21.15.84:0/3475110374 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f04005070 con 0x7f7f0c15a190 2023-09-13T08:26:06.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.700+0000 7f7f1442b700 1 -- 172.21.15.84:0/3475110374 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f0c15bd70 con 0x7f7f0c15a190 2023-09-13T08:26:06.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.700+0000 7f7f02ffd700 1 -- 172.21.15.84:0/3475110374 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f04005420 con 0x7f7f0c15a190 2023-09-13T08:26:06.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.700+0000 7f7f1442b700 1 -- 172.21.15.84:0/3475110374 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f0c15c330 con 0x7f7f0c15a190 2023-09-13T08:26:06.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.701+0000 7f7f1442b700 1 -- 172.21.15.84:0/3475110374 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f0c15c520 con 0x7f7f0c15a190 2023-09-13T08:26:06.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.701+0000 7f7f02ffd700 1 -- 172.21.15.84:0/3475110374 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f7f04005580 con 0x7f7f0c15a190 2023-09-13T08:26:06.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.702+0000 7f7f02ffd700 1 --2- 172.21.15.84:0/3475110374 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f7ef006a580 0x7f7ef006ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:06.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.702+0000 7f7f02ffd700 1 -- 172.21.15.84:0/3475110374 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f7f040880d0 con 0x7f7f0c15a190 2023-09-13T08:26:06.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.702+0000 7f7f121c7700 1 --2- 172.21.15.84:0/3475110374 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f7ef006a580 0x7f7ef006ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:06.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.702+0000 7f7f121c7700 1 --2- 172.21.15.84:0/3475110374 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f7ef006a580 0x7f7ef006ca40 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f7f08007fd0 tx=0x7f7f08007de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:26:06.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.706+0000 7f7f02ffd700 1 -- 172.21.15.84:0/3475110374 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f7f040535a0 con 0x7f7f0c15a190 2023-09-13T08:26:06.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.976+0000 7f7f1442b700 1 -- 172.21.15.84:0/3475110374 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f7f0c0b2690 con 0x7f7f0c15a190 2023-09-13T08:26:06.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.979+0000 7f7f02ffd700 1 -- 172.21.15.84:0/3475110374 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 190+0+147 (secure 0 0 0) 0x7f7f040170b0 con 0x7f7f0c15a190 2023-09-13T08:26:06.979 INFO:teuthology.orchestra.run.smithi084.stdout:[client.0] 2023-09-13T08:26:06.979 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQCPcQFlYASSJBAAizLV8EZeo+kCkamPephtLA== 2023-09-13T08:26:06.980 INFO:teuthology.orchestra.run.smithi084.stdout: caps mds = "allow" 2023-09-13T08:26:06.980 INFO:teuthology.orchestra.run.smithi084.stdout: caps mon = "allow r" 2023-09-13T08:26:06.980 INFO:teuthology.orchestra.run.smithi084.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-09-13T08:26:06.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.981+0000 7f7f1442b700 1 -- 172.21.15.84:0/3475110374 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f7ef006a580 msgr2=0x7f7ef006ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:06.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.982+0000 7f7f1442b700 1 --2- 172.21.15.84:0/3475110374 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f7ef006a580 0x7f7ef006ca40 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f7f08007fd0 tx=0x7f7f08007de0 comp rx=0 tx=0).stop 2023-09-13T08:26:06.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.982+0000 7f7f1442b700 1 -- 172.21.15.84:0/3475110374 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f0c15a190 msgr2=0x7f7f0c157cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:06.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.982+0000 7f7f1442b700 1 --2- 172.21.15.84:0/3475110374 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f0c15a190 0x7f7f0c157cc0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f7f0400c7a0 tx=0x7f7f0400cab0 comp rx=0 tx=0).stop 2023-09-13T08:26:06.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.982+0000 7f7f1442b700 1 -- 172.21.15.84:0/3475110374 shutdown_connections 2023-09-13T08:26:06.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.982+0000 7f7f1442b700 1 --2- 172.21.15.84:0/3475110374 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f0c15a190 0x7f7f0c157cc0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:06.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.982+0000 7f7f1442b700 1 --2- 172.21.15.84:0/3475110374 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7f0c06ea90 0x7f7f0c1411c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:06.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.982+0000 7f7f1442b700 1 --2- 172.21.15.84:0/3475110374 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f7ef006a580 0x7f7ef006ca40 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:06.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.982+0000 7f7f1442b700 1 --2- 172.21.15.84:0/3475110374 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7f0c0b47d0 0x7f7f0c157780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:06.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.982+0000 7f7f1442b700 1 -- 172.21.15.84:0/3475110374 >> 172.21.15.84:0/3475110374 conn(0x7f7f0c0cf8f0 msgr2=0x7f7f0c0b34b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:26:06.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.982+0000 7f7f1442b700 1 -- 172.21.15.84:0/3475110374 shutdown_connections 2023-09-13T08:26:06.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:06.982+0000 7f7f1442b700 1 -- 172.21.15.84:0/3475110374 wait complete. 2023-09-13T08:26:06.985 INFO:teuthology.orchestra.run.smithi084.stderr:updated caps for client.0 2023-09-13T08:26:06.994 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T08:26:07.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.115+0000 7f28aab41700 1 Processor -- start 2023-09-13T08:26:07.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.115+0000 7f28aab41700 1 -- start start 2023-09-13T08:26:07.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.115+0000 7f28aab41700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f28a40cc340 0x7f28a40713b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:07.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.115+0000 7f28aab41700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f28a40718f0 0x7f28a415afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:07.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.115+0000 7f28aab41700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28a415b690 con 0x7f28a415eb80 2023-09-13T08:26:07.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.115+0000 7f28aab41700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28a415b970 con 0x7f28a40718f0 2023-09-13T08:26:07.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.115+0000 7f28aab41700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28a40cc720 con 0x7f28a40cc340 2023-09-13T08:26:07.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.116+0000 7f28a90de700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f28a40718f0 0x7f28a415afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:07.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.116+0000 7f28a90de700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f28a40718f0 0x7f28a415afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45916/0 (socket says 172.21.15.84:45916) 2023-09-13T08:26:07.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.116+0000 7f28a90de700 1 -- 172.21.15.84:0/2178475868 learned_addr learned my addr 172.21.15.84:0/2178475868 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:26:07.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.116+0000 7f28a88dd700 1 --2- 172.21.15.84:0/2178475868 >> v2:172.21.15.161:3300/0 conn(0x7f28a40cc340 0x7f28a40713b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:07.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.116+0000 7f28a90de700 1 -- 172.21.15.84:0/2178475868 >> v2:172.21.15.161:3300/0 conn(0x7f28a40cc340 msgr2=0x7f28a40713b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:26:07.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.116+0000 7f28a90de700 1 --2- 172.21.15.84:0/2178475868 >> v2:172.21.15.161:3300/0 conn(0x7f28a40cc340 0x7f28a40713b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:07.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.116+0000 7f28a90de700 1 -- 172.21.15.84:0/2178475868 >> v1:172.21.15.161:6789/0 conn(0x7f28a415eb80 legacy=0x7f28a415a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:26:07.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.116+0000 7f28a90de700 1 -- 172.21.15.84:0/2178475868 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28a415e0a0 con 0x7f28a40718f0 2023-09-13T08:26:07.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.116+0000 7f28a88dd700 1 --2- 172.21.15.84:0/2178475868 >> v2:172.21.15.161:3300/0 conn(0x7f28a40cc340 0x7f28a40713b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T08:26:07.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.116+0000 7f28a90de700 1 --2- 172.21.15.84:0/2178475868 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28a40718f0 0x7f28a415afd0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f289c009e50 tx=0x7f289c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5adda88ab1533cfc server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:26:07.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.116+0000 7f28a37fe700 1 -- 172.21.15.84:0/2178475868 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f289c00e070 con 0x7f28a40718f0 2023-09-13T08:26:07.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.116+0000 7f28a37fe700 1 -- 172.21.15.84:0/2178475868 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f289c003a20 con 0x7f28a40718f0 2023-09-13T08:26:07.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.116+0000 7f28a37fe700 1 -- 172.21.15.84:0/2178475868 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f289c003dd0 con 0x7f28a40718f0 2023-09-13T08:26:07.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.117+0000 7f28aab41700 1 -- 172.21.15.84:0/2178475868 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28a40718f0 msgr2=0x7f28a415afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:07.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.117+0000 7f28aab41700 1 --2- 172.21.15.84:0/2178475868 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28a40718f0 0x7f28a415afd0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f289c009e50 tx=0x7f289c00b330 comp rx=0 tx=0).stop 2023-09-13T08:26:07.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.117+0000 7f28aab41700 1 -- 172.21.15.84:0/2178475868 shutdown_connections 2023-09-13T08:26:07.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.117+0000 7f28aab41700 1 --2- 172.21.15.84:0/2178475868 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28a40718f0 0x7f28a415afd0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:07.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.117+0000 7f28aab41700 1 --2- 172.21.15.84:0/2178475868 >> v2:172.21.15.161:3300/0 conn(0x7f28a40cc340 0x7f28a40713b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:07.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.117+0000 7f28aab41700 1 -- 172.21.15.84:0/2178475868 >> 172.21.15.84:0/2178475868 conn(0x7f28a40d00c0 msgr2=0x7f28a40d04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:26:07.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.117+0000 7f28aab41700 1 -- 172.21.15.84:0/2178475868 shutdown_connections 2023-09-13T08:26:07.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.117+0000 7f28aab41700 1 -- 172.21.15.84:0/2178475868 wait complete. 2023-09-13T08:26:07.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.118+0000 7f28aab41700 1 Processor -- start 2023-09-13T08:26:07.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.118+0000 7f28aab41700 1 -- start start 2023-09-13T08:26:07.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.119+0000 7f28aab41700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f28a40718f0 0x7f28a40b2e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:07.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.119+0000 7f28aab41700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28a40cc340 0x7f28a40b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:07.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.119+0000 7f28aab41700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f28a415eb80 0x7f28a41efd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:07.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.119+0000 7f28aab41700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28a40b3be0 con 0x7f28a40cc340 2023-09-13T08:26:07.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.119+0000 7f28aab41700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28a40b3ec0 con 0x7f28a415eb80 2023-09-13T08:26:07.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.119+0000 7f28aab41700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28a40b41a0 con 0x7f28a40718f0 2023-09-13T08:26:07.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.119+0000 7f28a3fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28a40cc340 0x7f28a40b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:07.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.119+0000 7f28a3fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28a40cc340 0x7f28a40b33b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45920/0 (socket says 172.21.15.84:45920) 2023-09-13T08:26:07.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.119+0000 7f28a3fff700 1 -- 172.21.15.84:0/2087201333 learned_addr learned my addr 172.21.15.84:0/2087201333 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:26:07.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.119+0000 7f28a88dd700 1 --2- 172.21.15.84:0/2087201333 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f28a40718f0 0x7f28a40b2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:07.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.119+0000 7f28a90de700 1 --2- 172.21.15.84:0/2087201333 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f28a415eb80 0x7f28a41efd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:07.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.119+0000 7f28a3fff700 1 -- 172.21.15.84:0/2087201333 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f28a40718f0 msgr2=0x7f28a40b2e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:07.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.119+0000 7f28a3fff700 1 --2- 172.21.15.84:0/2087201333 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f28a40718f0 0x7f28a40b2e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:07.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.119+0000 7f28a3fff700 1 -- 172.21.15.84:0/2087201333 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f28a415eb80 msgr2=0x7f28a41efd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:07.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.119+0000 7f28a3fff700 1 --2- 172.21.15.84:0/2087201333 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f28a415eb80 0x7f28a41efd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:07.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.119+0000 7f28a3fff700 1 -- 172.21.15.84:0/2087201333 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f289c009b30 con 0x7f28a40cc340 2023-09-13T08:26:07.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.119+0000 7f28a90de700 1 --2- 172.21.15.84:0/2087201333 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f28a415eb80 0x7f28a41efd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T08:26:07.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.119+0000 7f28a88dd700 1 --2- 172.21.15.84:0/2087201333 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f28a40718f0 0x7f28a40b2e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T08:26:07.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.120+0000 7f28a3fff700 1 --2- 172.21.15.84:0/2087201333 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28a40cc340 0x7f28a40b33b0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f289000c4d0 tx=0x7f289000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:26:07.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.120+0000 7f28a17fa700 1 -- 172.21.15.84:0/2087201333 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28900108a0 con 0x7f28a40cc340 2023-09-13T08:26:07.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.120+0000 7f28a17fa700 1 -- 172.21.15.84:0/2087201333 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2890010a00 con 0x7f28a40cc340 2023-09-13T08:26:07.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.120+0000 7f28aab41700 1 -- 172.21.15.84:0/2087201333 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28a40b4480 con 0x7f28a40cc340 2023-09-13T08:26:07.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.120+0000 7f28a17fa700 1 -- 172.21.15.84:0/2087201333 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2890010db0 con 0x7f28a40cc340 2023-09-13T08:26:07.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.120+0000 7f28aab41700 1 -- 172.21.15.84:0/2087201333 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28a41f0290 con 0x7f28a40cc340 2023-09-13T08:26:07.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.121+0000 7f28aab41700 1 -- 172.21.15.84:0/2087201333 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28a404e9b0 con 0x7f28a40cc340 2023-09-13T08:26:07.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.121+0000 7f28a17fa700 1 -- 172.21.15.84:0/2087201333 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f2890011470 con 0x7f28a40cc340 2023-09-13T08:26:07.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.121+0000 7f28a17fa700 1 --2- 172.21.15.84:0/2087201333 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f288806a580 0x7f288806ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:07.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.122+0000 7f28a17fa700 1 -- 172.21.15.84:0/2087201333 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f289008a930 con 0x7f28a40cc340 2023-09-13T08:26:07.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.122+0000 7f28a88dd700 1 --2- 172.21.15.84:0/2087201333 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f288806a580 0x7f288806ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:07.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.122+0000 7f28a88dd700 1 --2- 172.21.15.84:0/2087201333 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f288806a580 0x7f288806ca40 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f28980089b0 tx=0x7f2898008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:26:07.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.126+0000 7f28a17fa700 1 -- 172.21.15.84:0/2087201333 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f2890055cd0 con 0x7f28a40cc340 2023-09-13T08:26:07.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.359+0000 7f28aab41700 1 -- 172.21.15.84:0/2087201333 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f28a4154e30 con 0x7f28a40cc340 2023-09-13T08:26:07.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.360+0000 7f28a17fa700 1 -- 172.21.15.84:0/2087201333 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f28a4154e30 con 0x7f28a40cc340 2023-09-13T08:26:07.360 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:26:07.360 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4829,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6834/654446786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":654446786},{"type":"v1","addr":"172.21.15.161:6834","nonce":654446786}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5041,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/359639686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":359639686},{"type":"v1","addr":"172.21.15.84:6837","nonce":359639686}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5358,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/3026578524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3026578524},{"type":"v1","addr":"172.21.15.84:6836","nonce":3026578524}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-13T08:26:01.437659+0000","modified":"2023-09-13T08:26:04.457230+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5373},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5373":{"gid":5373,"name":"d","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.161:6835/3356746418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6833","nonce":3356746418},{"type":"v1","addr":"172.21.15.161:6835","nonce":3356746418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-09-13T08:26:07.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.362+0000 7f28aab41700 1 -- 172.21.15.84:0/2087201333 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f288806a580 msgr2=0x7f288806ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:07.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.362+0000 7f28aab41700 1 --2- 172.21.15.84:0/2087201333 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f288806a580 0x7f288806ca40 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f28980089b0 tx=0x7f2898008040 comp rx=0 tx=0).stop 2023-09-13T08:26:07.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.362+0000 7f28aab41700 1 -- 172.21.15.84:0/2087201333 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28a40cc340 msgr2=0x7f28a40b33b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:07.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.362+0000 7f28aab41700 1 --2- 172.21.15.84:0/2087201333 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28a40cc340 0x7f28a40b33b0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f289000c4d0 tx=0x7f289000c890 comp rx=0 tx=0).stop 2023-09-13T08:26:07.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.362+0000 7f28aab41700 1 -- 172.21.15.84:0/2087201333 shutdown_connections 2023-09-13T08:26:07.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.362+0000 7f28aab41700 1 --2- 172.21.15.84:0/2087201333 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f288806a580 0x7f288806ca40 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:07.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.362+0000 7f28aab41700 1 --2- 172.21.15.84:0/2087201333 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f28a415eb80 0x7f28a41efd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:07.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.362+0000 7f28aab41700 1 --2- 172.21.15.84:0/2087201333 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f28a40718f0 0x7f28a40b2e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:07.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.362+0000 7f28aab41700 1 --2- 172.21.15.84:0/2087201333 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28a40cc340 0x7f28a40b33b0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:07.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.362+0000 7f28aab41700 1 -- 172.21.15.84:0/2087201333 >> 172.21.15.84:0/2087201333 conn(0x7f28a40d00c0 msgr2=0x7f28a4152470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:26:07.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.362+0000 7f28aab41700 1 -- 172.21.15.84:0/2087201333 shutdown_connections 2023-09-13T08:26:07.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.362+0000 7f28aab41700 1 -- 172.21.15.84:0/2087201333 wait complete. 2023-09-13T08:26:07.365 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 18 2023-09-13T08:26:07.777 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 18, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-09-13T08:26:01.437659+0000', 'modified': '2023-09-13T08:26:04.457230+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5373}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5373': {'gid': 5373, 'name': 'd', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.161:6835/3356746418', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.161:6833', 'nonce': 3356746418}, {'type': 'v1', 'addr': '172.21.15.161:6835', 'nonce': 3356746418}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-09-13T08:26:07.777 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-09-13T08:26:07.778 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-09-13T08:26:07.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.900+0000 7fb07de60700 1 Processor -- start 2023-09-13T08:26:07.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.900+0000 7fb07de60700 1 -- start start 2023-09-13T08:26:07.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.901+0000 7fb07de60700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb0780d2ba0 0x7fb078161a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:07.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.901+0000 7fb07de60700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb0780ce230 0x7fb0780cfa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:07.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.901+0000 7fb07de60700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb0780cff60 0x7fb0780b84f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:07.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.901+0000 7fb07de60700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb07815e390 con 0x7fb0780ce230 2023-09-13T08:26:07.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.901+0000 7fb07de60700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb07815daa0 con 0x7fb0780d2ba0 2023-09-13T08:26:07.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.901+0000 7fb07de60700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb07815dd40 con 0x7fb0780cff60 2023-09-13T08:26:07.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.901+0000 7fb076ffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb0780ce230 0x7fb0780cfa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:07.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.901+0000 7fb076ffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb0780ce230 0x7fb0780cfa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45926/0 (socket says 172.21.15.84:45926) 2023-09-13T08:26:07.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.901+0000 7fb076ffd700 1 -- 172.21.15.84:0/1067575230 learned_addr learned my addr 172.21.15.84:0/1067575230 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:26:07.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.901+0000 7fb077fff700 1 --2- 172.21.15.84:0/1067575230 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb0780cff60 0x7fb0780b84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:07.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.901+0000 7fb0777fe700 1 --2- 172.21.15.84:0/1067575230 >> v2:172.21.15.161:3300/0 conn(0x7fb0780d2ba0 0x7fb078161a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:07.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.901+0000 7fb076ffd700 1 -- 172.21.15.84:0/1067575230 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb0780cff60 msgr2=0x7fb0780b84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:26:07.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.901+0000 7fb076ffd700 1 --2- 172.21.15.84:0/1067575230 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb0780cff60 0x7fb0780b84f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:07.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.901+0000 7fb076ffd700 1 -- 172.21.15.84:0/1067575230 >> v2:172.21.15.161:3300/0 conn(0x7fb0780d2ba0 msgr2=0x7fb078161a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:26:07.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.901+0000 7fb076ffd700 1 --2- 172.21.15.84:0/1067575230 >> v2:172.21.15.161:3300/0 conn(0x7fb0780d2ba0 0x7fb078161a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:07.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.901+0000 7fb076ffd700 1 -- 172.21.15.84:0/1067575230 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb07815e020 con 0x7fb0780ce230 2023-09-13T08:26:07.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.902+0000 7fb076ffd700 1 --2- 172.21.15.84:0/1067575230 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0780ce230 0x7fb0780cfa20 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fb07806c170 tx=0x7fb068009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6745a57afdd178bb server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:26:07.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.902+0000 7fb0767fc700 1 -- 172.21.15.84:0/1067575230 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb06800b870 con 0x7fb0780ce230 2023-09-13T08:26:07.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.902+0000 7fb0767fc700 1 -- 172.21.15.84:0/1067575230 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb06800b9d0 con 0x7fb0780ce230 2023-09-13T08:26:07.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.902+0000 7fb0767fc700 1 -- 172.21.15.84:0/1067575230 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb06800bd60 con 0x7fb0780ce230 2023-09-13T08:26:07.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.902+0000 7fb07de60700 1 -- 172.21.15.84:0/1067575230 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0780ce230 msgr2=0x7fb0780cfa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:07.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.902+0000 7fb07de60700 1 --2- 172.21.15.84:0/1067575230 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0780ce230 0x7fb0780cfa20 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fb07806c170 tx=0x7fb068009bd0 comp rx=0 tx=0).stop 2023-09-13T08:26:07.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.902+0000 7fb07de60700 1 -- 172.21.15.84:0/1067575230 shutdown_connections 2023-09-13T08:26:07.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.902+0000 7fb07de60700 1 --2- 172.21.15.84:0/1067575230 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb0780cff60 0x7fb0780b84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:07.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.902+0000 7fb07de60700 1 --2- 172.21.15.84:0/1067575230 >> v2:172.21.15.161:3300/0 conn(0x7fb0780d2ba0 0x7fb078161a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:07.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.902+0000 7fb07de60700 1 --2- 172.21.15.84:0/1067575230 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0780ce230 0x7fb0780cfa20 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:07.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.902+0000 7fb07de60700 1 -- 172.21.15.84:0/1067575230 >> 172.21.15.84:0/1067575230 conn(0x7fb07806b130 msgr2=0x7fb07806b540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:26:07.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.902+0000 7fb07de60700 1 -- 172.21.15.84:0/1067575230 shutdown_connections 2023-09-13T08:26:07.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.902+0000 7fb07de60700 1 -- 172.21.15.84:0/1067575230 wait complete. 2023-09-13T08:26:07.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.903+0000 7fb07de60700 1 Processor -- start 2023-09-13T08:26:07.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.904+0000 7fb07de60700 1 -- start start 2023-09-13T08:26:07.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.904+0000 7fb07de60700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb0780ce230 0x7fb0781497e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:07.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.904+0000 7fb07de60700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb0780cff60 0x7fb0780b35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:07.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.904+0000 7fb07de60700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0780d2ba0 0x7fb0780aa540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:07.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.904+0000 7fb07de60700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb078147980 con 0x7fb0780d2ba0 2023-09-13T08:26:07.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.904+0000 7fb07de60700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb078157b50 con 0x7fb0780cff60 2023-09-13T08:26:07.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.904+0000 7fb07de60700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb07814a710 con 0x7fb0780ce230 2023-09-13T08:26:07.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.904+0000 7fb077fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0780d2ba0 0x7fb0780aa540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:07.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.905+0000 7fb077fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0780d2ba0 0x7fb0780aa540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45932/0 (socket says 172.21.15.84:45932) 2023-09-13T08:26:07.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.905+0000 7fb077fff700 1 -- 172.21.15.84:0/3932340642 learned_addr learned my addr 172.21.15.84:0/3932340642 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:26:07.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.905+0000 7fb0777fe700 1 --2- 172.21.15.84:0/3932340642 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb0780ce230 0x7fb0781497e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:07.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.905+0000 7fb076ffd700 1 --2- 172.21.15.84:0/3932340642 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb0780cff60 0x7fb0780b35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:07.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.905+0000 7fb077fff700 1 -- 172.21.15.84:0/3932340642 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb0780ce230 msgr2=0x7fb0781497e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:07.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.905+0000 7fb077fff700 1 --2- 172.21.15.84:0/3932340642 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb0780ce230 0x7fb0781497e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:07.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.905+0000 7fb077fff700 1 -- 172.21.15.84:0/3932340642 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb0780cff60 msgr2=0x7fb0780b35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:07.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.905+0000 7fb077fff700 1 --2- 172.21.15.84:0/3932340642 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb0780cff60 0x7fb0780b35e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:07.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.905+0000 7fb077fff700 1 -- 172.21.15.84:0/3932340642 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb068009550 con 0x7fb0780d2ba0 2023-09-13T08:26:07.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.905+0000 7fb076ffd700 1 --2- 172.21.15.84:0/3932340642 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb0780cff60 0x7fb0780b35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T08:26:07.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.905+0000 7fb077fff700 1 --2- 172.21.15.84:0/3932340642 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0780d2ba0 0x7fb0780aa540 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fb07000cda0 tx=0x7fb07000a570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:26:07.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.905+0000 7fb05ffff700 1 -- 172.21.15.84:0/3932340642 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb070003a20 con 0x7fb0780d2ba0 2023-09-13T08:26:07.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.905+0000 7fb05ffff700 1 -- 172.21.15.84:0/3932340642 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb070003b80 con 0x7fb0780d2ba0 2023-09-13T08:26:07.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.905+0000 7fb05ffff700 1 -- 172.21.15.84:0/3932340642 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb070004020 con 0x7fb0780d2ba0 2023-09-13T08:26:07.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.905+0000 7fb07de60700 1 -- 172.21.15.84:0/3932340642 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb078149e70 con 0x7fb0780d2ba0 2023-09-13T08:26:07.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.905+0000 7fb07de60700 1 -- 172.21.15.84:0/3932340642 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb07814a430 con 0x7fb0780d2ba0 2023-09-13T08:26:07.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.907+0000 7fb05ffff700 1 -- 172.21.15.84:0/3932340642 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fb070004180 con 0x7fb0780d2ba0 2023-09-13T08:26:07.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.907+0000 7fb05ffff700 1 --2- 172.21.15.84:0/3932340642 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fb06406a580 0x7fb06406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:07.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.907+0000 7fb05ffff700 1 -- 172.21.15.84:0/3932340642 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb070012070 con 0x7fb0780d2ba0 2023-09-13T08:26:07.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.907+0000 7fb0777fe700 1 --2- 172.21.15.84:0/3932340642 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fb06406a580 0x7fb06406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:07.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.907+0000 7fb0777fe700 1 --2- 172.21.15.84:0/3932340642 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fb06406a580 0x7fb06406ca40 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb06c006fd0 tx=0x7fb06c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:26:07.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.909+0000 7fb08a045b80 1 Processor -- start 2023-09-13T08:26:07.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.909+0000 7fb08a045b80 1 -- start start 2023-09-13T08:26:07.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.910+0000 7fb08a045b80 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5600b5d94cf0 0x5600b5d6e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:07.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.910+0000 7fb08a045b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5600b5daaab0 0x5600b5d95490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:07.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.910+0000 7fb08a045b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5600b5d959d0 0x5600b5d98ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:07.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.910+0000 7fb08a045b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600b5cc7730 con 0x5600b5d959d0 2023-09-13T08:26:07.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.910+0000 7fb08a045b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600b5cc5050 con 0x5600b5daaab0 2023-09-13T08:26:07.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.910+0000 7fb08a045b80 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x5600b5cc0940 con 0x5600b5d94cf0 2023-09-13T08:26:07.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.910+0000 7fb077fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5600b5d959d0 0x5600b5d98ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:07.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.910+0000 7fb077fff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5600b5d959d0 0x5600b5d98ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45940/0 (socket says 172.21.15.84:45940) 2023-09-13T08:26:07.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.910+0000 7fb077fff700 1 -- 172.21.15.84:0/2488351090 learned_addr learned my addr 172.21.15.84:0/2488351090 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:26:07.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.910+0000 7fb0777fe700 1 --2- 172.21.15.84:0/2488351090 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5600b5d94cf0 0x5600b5d6e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:07.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.910+0000 7fb076ffd700 1 --2- 172.21.15.84:0/2488351090 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5600b5daaab0 0x5600b5d95490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:07.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.910+0000 7fb077fff700 1 -- 172.21.15.84:0/2488351090 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5600b5d94cf0 msgr2=0x5600b5d6e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:26:07.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.910+0000 7fb077fff700 1 --2- 172.21.15.84:0/2488351090 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5600b5d94cf0 0x5600b5d6e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:07.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.910+0000 7fb077fff700 1 -- 172.21.15.84:0/2488351090 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5600b5daaab0 msgr2=0x5600b5d95490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:26:07.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.910+0000 7fb077fff700 1 --2- 172.21.15.84:0/2488351090 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5600b5daaab0 0x5600b5d95490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:07.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.910+0000 7fb077fff700 1 -- 172.21.15.84:0/2488351090 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5600b5b405e0 con 0x5600b5d959d0 2023-09-13T08:26:07.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.910+0000 7fb076ffd700 1 --2- 172.21.15.84:0/2488351090 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5600b5daaab0 0x5600b5d95490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T08:26:07.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.910+0000 7fb077fff700 1 --2- 172.21.15.84:0/2488351090 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5600b5d959d0 0x5600b5d98ea0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fb070004b80 tx=0x7fb070057d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35cd0003744485ff server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:26:07.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.911+0000 7fb05d7fa700 1 -- 172.21.15.84:0/2488351090 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0700890c0 con 0x5600b5d959d0 2023-09-13T08:26:07.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.911+0000 7fb05d7fa700 1 -- 172.21.15.84:0/2488351090 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb070058420 con 0x5600b5d959d0 2023-09-13T08:26:07.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.911+0000 7fb05d7fa700 1 -- 172.21.15.84:0/2488351090 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07005c250 con 0x5600b5d959d0 2023-09-13T08:26:07.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.911+0000 7fb08a045b80 1 -- 172.21.15.84:0/2488351090 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5600b5d959d0 msgr2=0x5600b5d98ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:07.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.911+0000 7fb08a045b80 1 --2- 172.21.15.84:0/2488351090 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5600b5d959d0 0x5600b5d98ea0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fb070004b80 tx=0x7fb070057d80 comp rx=0 tx=0).stop 2023-09-13T08:26:07.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.911+0000 7fb08a045b80 1 -- 172.21.15.84:0/2488351090 shutdown_connections 2023-09-13T08:26:07.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.911+0000 7fb08a045b80 1 --2- 172.21.15.84:0/2488351090 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5600b5d959d0 0x5600b5d98ea0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:07.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.911+0000 7fb08a045b80 1 --2- 172.21.15.84:0/2488351090 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5600b5d94cf0 0x5600b5d6e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:07.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.911+0000 7fb08a045b80 1 --2- 172.21.15.84:0/2488351090 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5600b5daaab0 0x5600b5d95490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:07.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.911+0000 7fb08a045b80 1 -- 172.21.15.84:0/2488351090 >> 172.21.15.84:0/2488351090 conn(0x5600b5cccc30 msgr2=0x5600b5db3ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:26:07.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.911+0000 7fb08a045b80 1 -- 172.21.15.84:0/2488351090 shutdown_connections 2023-09-13T08:26:07.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.911+0000 7fb08a045b80 1 -- 172.21.15.84:0/2488351090 wait complete. 2023-09-13T08:26:07.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.912+0000 7fb08a045b80 1 -- start start 2023-09-13T08:26:07.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.912+0000 7fb08a045b80 1 Processor -- start 2023-09-13T08:26:07.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.913+0000 7fb08a045b80 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5600b5d94cf0 0x5600b5d9ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:07.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.913+0000 7fb08a045b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5600b5d959d0 0x5600b5d99130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:07.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.913+0000 7fb08a045b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5600b5daaab0 0x5600b5d9c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:07.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.913+0000 7fb08a045b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600b5c5eb60 con 0x5600b5d959d0 2023-09-13T08:26:07.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.913+0000 7fb08a045b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600b5c5e860 con 0x5600b5daaab0 2023-09-13T08:26:07.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.913+0000 7fb08a045b80 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x5600b5b428d0 con 0x5600b5d94cf0 2023-09-13T08:26:07.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.913+0000 7fb08a045b80 10 client.0 _ll_register_callbacks cb 0x5600b5c5c630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T08:26:07.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.913+0000 7fb076ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5600b5d959d0 0x5600b5d99130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:07.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.913+0000 7fb076ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5600b5d959d0 0x5600b5d99130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45944/0 (socket says 172.21.15.84:45944) 2023-09-13T08:26:07.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.913+0000 7fb076ffd700 1 -- 172.21.15.84:0/2298710421 learned_addr learned my addr 172.21.15.84:0/2298710421 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:26:07.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.913+0000 7fb0777fe700 1 --2- 172.21.15.84:0/2298710421 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5600b5d94cf0 0x5600b5d9ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:07.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.913+0000 7fb077fff700 1 --2- 172.21.15.84:0/2298710421 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5600b5daaab0 0x5600b5d9c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:07.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.913+0000 7fb076ffd700 1 -- 172.21.15.84:0/2298710421 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5600b5d94cf0 msgr2=0x5600b5d9ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:26:07.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.913+0000 7fb076ffd700 1 --2- 172.21.15.84:0/2298710421 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5600b5d94cf0 0x5600b5d9ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:07.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.913+0000 7fb076ffd700 1 -- 172.21.15.84:0/2298710421 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5600b5daaab0 msgr2=0x5600b5d9c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:26:07.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.913+0000 7fb076ffd700 1 --2- 172.21.15.84:0/2298710421 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5600b5daaab0 0x5600b5d9c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:07.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.913+0000 7fb076ffd700 1 -- 172.21.15.84:0/2298710421 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb07814a430 con 0x5600b5d959d0 2023-09-13T08:26:07.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.913+0000 7fb077fff700 1 --2- 172.21.15.84:0/2298710421 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5600b5daaab0 0x5600b5d9c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T08:26:07.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.913+0000 7fb076ffd700 1 --2- 172.21.15.84:0/2298710421 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5600b5d959d0 0x5600b5d99130 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fb068009c10 tx=0x7fb0680047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61f5d14c1b2a10b2 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:26:07.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.913+0000 7fb0567fc700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-09-13T08:26:07.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.913+0000 7fb0567fc700 1 -- 172.21.15.84:0/2298710421 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb068021070 con 0x5600b5d959d0 2023-09-13T08:26:07.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.913+0000 7fb0567fc700 1 -- 172.21.15.84:0/2298710421 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb068027c10 con 0x5600b5d959d0 2023-09-13T08:26:07.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.913+0000 7fb08a045b80 1 -- 172.21.15.84:0/2298710421 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5600b5d61810 con 0x5600b5d959d0 2023-09-13T08:26:07.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.914+0000 7fb0567fc700 1 -- 172.21.15.84:0/2298710421 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb068027dd0 con 0x5600b5d959d0 2023-09-13T08:26:07.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.914+0000 7fb08a045b80 10 client.5541 fetch_fsmap learned FSMap version 18 2023-09-13T08:26:07.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.914+0000 7fb08a045b80 1 -- 172.21.15.84:0/2298710421 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x5600b5cd8750 con 0x5600b5d959d0 2023-09-13T08:26:07.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.914+0000 7fb0567fc700 1 -- 172.21.15.84:0/2298710421 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5600b5d61810 con 0x5600b5d959d0 2023-09-13T08:26:07.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.914+0000 7fb0567fc700 1 -- 172.21.15.84:0/2298710421 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 18) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fb068004250 con 0x5600b5d959d0 2023-09-13T08:26:07.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.914+0000 7fb08a045b80 10 client.5541 fetch_fsmap finished waiting for FSMap version 18 2023-09-13T08:26:07.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.914+0000 7fb08a045b80 10 client.5541 resolve_mds: resolved name 'd' to daemon mds.d 2023-09-13T08:26:07.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.914+0000 7fb08a045b80 20 client.5541 populate_metadata read hostname 'smithi084' 2023-09-13T08:26:07.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.914+0000 7fb08a045b80 1 --2- 172.21.15.84:0/2298710421 >> [v2:172.21.15.161:6833/3356746418,v1:172.21.15.161:6835/3356746418] conn(0x5600b5dc39c0 0x5600b5dc3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:07.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.914+0000 7fb08a045b80 4 client.5541 mds_command: new command op to 5373 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T08:26:07.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.914+0000 7fb08a045b80 1 -- 172.21.15.84:0/2298710421 --> [v2:172.21.15.161:6833/3356746418,v1:172.21.15.161:6835/3356746418] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5600b5cb9920 con 0x5600b5dc39c0 2023-09-13T08:26:07.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.914+0000 7fb0777fe700 1 --2- 172.21.15.84:0/2298710421 >> [v2:172.21.15.161:6833/3356746418,v1:172.21.15.161:6835/3356746418] conn(0x5600b5dc39c0 0x5600b5dc3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:07.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.915+0000 7fb0567fc700 10 client.5541 ms_handle_connect on v2:172.21.15.161:6833/3356746418 2023-09-13T08:26:07.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.915+0000 7fb0777fe700 1 --2- 172.21.15.84:0/2298710421 >> [v2:172.21.15.161:6833/3356746418,v1:172.21.15.161:6835/3356746418] conn(0x5600b5dc39c0 0x5600b5dc3da0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe92ebe44531f4d1 server_cookie=95948d6a4150c543 in_seq=0 out_seq=0 2023-09-13T08:26:07.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.915+0000 7fb0567fc700 1 -- 172.21.15.84:0/2298710421 <== mds.0 v2:172.21.15.161:6833/3356746418 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5600b5cb9920 con 0x5600b5dc39c0 2023-09-13T08:26:07.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.915+0000 7fb0567fc700 10 client.5541 handle_command_reply: tid=0 2023-09-13T08:26:07.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.915+0000 7fb08a045b80 1 client.5541 shutdown 2023-09-13T08:26:07.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.916+0000 7fb08a045b80 1 -- 172.21.15.84:0/2298710421 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5600b5d959d0 msgr2=0x5600b5d99130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:07.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.916+0000 7fb08a045b80 1 --2- 172.21.15.84:0/2298710421 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5600b5d959d0 0x5600b5d99130 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fb068009c10 tx=0x7fb0680047c0 comp rx=0 tx=0).stop 2023-09-13T08:26:07.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.916+0000 7fb08a045b80 1 -- 172.21.15.84:0/2298710421 shutdown_connections 2023-09-13T08:26:07.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.916+0000 7fb08a045b80 1 --2- 172.21.15.84:0/2298710421 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5600b5daaab0 0x5600b5d9c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:07.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.916+0000 7fb08a045b80 1 --2- 172.21.15.84:0/2298710421 >> [v2:172.21.15.161:6833/3356746418,v1:172.21.15.161:6835/3356746418] conn(0x5600b5dc39c0 0x5600b5dc3da0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:07.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.916+0000 7fb08a045b80 1 --2- 172.21.15.84:0/2298710421 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5600b5d94cf0 0x5600b5d9ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:07.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.916+0000 7fb08a045b80 1 --2- 172.21.15.84:0/2298710421 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5600b5d959d0 0x5600b5d99130 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:07.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.916+0000 7fb0567fc700 0 client.5541 ms_handle_reset on v2:172.21.15.161:6833/3356746418 2023-09-13T08:26:07.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.916+0000 7fb08a045b80 1 -- 172.21.15.84:0/2298710421 >> 172.21.15.84:0/2298710421 conn(0x5600b5cccc30 msgr2=0x5600b5d69440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:26:07.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.916+0000 7fb08a045b80 1 -- 172.21.15.84:0/2298710421 shutdown_connections 2023-09-13T08:26:07.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.916+0000 7fb08a045b80 1 -- 172.21.15.84:0/2298710421 wait complete. 2023-09-13T08:26:07.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.916+0000 7fb08a045b80 20 client.5541 trim_cache size 0 max 16384 2023-09-13T08:26:07.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.934+0000 7fb08a045b80 1 Processor -- start 2023-09-13T08:26:07.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.934+0000 7fb08a045b80 1 -- start start 2023-09-13T08:26:07.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.935+0000 7fb08a045b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5600b5d94cf0 0x5600b5d62a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:07.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.935+0000 7fb08a045b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5600b5d959d0 0x5600b5d62fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:07.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.935+0000 7fb08a045b80 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5600b5daaab0 0x5600b5d93be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:07.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.935+0000 7fb08a045b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600b5d4b720 con 0x5600b5d94cf0 2023-09-13T08:26:07.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.935+0000 7fb08a045b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600b5d6af30 con 0x5600b5d959d0 2023-09-13T08:26:07.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.935+0000 7fb08a045b80 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x5600b5d61640 con 0x5600b5daaab0 2023-09-13T08:26:07.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.935+0000 7fb0777fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5600b5d94cf0 0x5600b5d62a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:07.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.935+0000 7fb0777fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5600b5d94cf0 0x5600b5d62a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45950/0 (socket says 172.21.15.84:45950) 2023-09-13T08:26:07.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.935+0000 7fb0777fe700 1 -- 172.21.15.84:0/1533971125 learned_addr learned my addr 172.21.15.84:0/1533971125 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:26:07.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.935+0000 7fb077fff700 1 --2- 172.21.15.84:0/1533971125 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5600b5daaab0 0x5600b5d93be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:07.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.935+0000 7fb076ffd700 1 --2- 172.21.15.84:0/1533971125 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5600b5d959d0 0x5600b5d62fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:07.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.935+0000 7fb0777fe700 1 -- 172.21.15.84:0/1533971125 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5600b5daaab0 msgr2=0x5600b5d93be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:26:07.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.935+0000 7fb0777fe700 1 --2- 172.21.15.84:0/1533971125 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5600b5daaab0 0x5600b5d93be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:07.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.935+0000 7fb0777fe700 1 -- 172.21.15.84:0/1533971125 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5600b5d959d0 msgr2=0x5600b5d62fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:26:07.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.935+0000 7fb0777fe700 1 --2- 172.21.15.84:0/1533971125 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5600b5d959d0 0x5600b5d62fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:07.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.935+0000 7fb0777fe700 1 -- 172.21.15.84:0/1533971125 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5600b5aecd90 con 0x5600b5d94cf0 2023-09-13T08:26:07.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.935+0000 7fb077fff700 1 --2- 172.21.15.84:0/1533971125 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5600b5daaab0 0x5600b5d93be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T08:26:07.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.935+0000 7fb076ffd700 1 --2- 172.21.15.84:0/1533971125 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5600b5d959d0 0x5600b5d62fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T08:26:07.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.935+0000 7fb0777fe700 1 --2- 172.21.15.84:0/1533971125 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5600b5d94cf0 0x5600b5d62a80 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fb06c027a70 tx=0x7fb06c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96e7586a012032f9 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:26:07.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.935+0000 7fb05dffb700 1 -- 172.21.15.84:0/1533971125 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb06c026070 con 0x5600b5d94cf0 2023-09-13T08:26:07.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.935+0000 7fb05dffb700 1 -- 172.21.15.84:0/1533971125 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb06c00c040 con 0x5600b5d94cf0 2023-09-13T08:26:07.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.935+0000 7fb05dffb700 1 -- 172.21.15.84:0/1533971125 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb06c027470 con 0x5600b5d94cf0 2023-09-13T08:26:07.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.936+0000 7fb08a045b80 1 -- 172.21.15.84:0/1533971125 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5600b5d94cf0 msgr2=0x5600b5d62a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:07.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.936+0000 7fb08a045b80 1 --2- 172.21.15.84:0/1533971125 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5600b5d94cf0 0x5600b5d62a80 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fb06c027a70 tx=0x7fb06c016000 comp rx=0 tx=0).stop 2023-09-13T08:26:07.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.936+0000 7fb08a045b80 1 -- 172.21.15.84:0/1533971125 shutdown_connections 2023-09-13T08:26:07.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.936+0000 7fb08a045b80 1 --2- 172.21.15.84:0/1533971125 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5600b5daaab0 0x5600b5d93be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:07.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.936+0000 7fb08a045b80 1 --2- 172.21.15.84:0/1533971125 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5600b5d94cf0 0x5600b5d62a80 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:07.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.936+0000 7fb08a045b80 1 --2- 172.21.15.84:0/1533971125 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5600b5d959d0 0x5600b5d62fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:07.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.936+0000 7fb08a045b80 1 -- 172.21.15.84:0/1533971125 >> 172.21.15.84:0/1533971125 conn(0x5600b5cccc30 msgr2=0x5600b5dd5cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:26:07.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.936+0000 7fb08a045b80 1 -- 172.21.15.84:0/1533971125 shutdown_connections 2023-09-13T08:26:07.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.936+0000 7fb08a045b80 1 -- 172.21.15.84:0/1533971125 wait complete. 2023-09-13T08:26:07.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.936+0000 7fb08a045b80 1 -- start start 2023-09-13T08:26:07.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.937+0000 7fb08a045b80 1 Processor -- start 2023-09-13T08:26:07.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.938+0000 7fb08a045b80 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5600b5d94cf0 0x5600b5d62a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:07.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.938+0000 7fb08a045b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5600b5d959d0 0x5600b5d6e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:07.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.938+0000 7fb08a045b80 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5600b5daaab0 0x5600b5d6ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:07.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.938+0000 7fb08a045b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600b5d8f970 con 0x5600b5d959d0 2023-09-13T08:26:07.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.938+0000 7fb08a045b80 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600b5dcd7e0 con 0x5600b5d94cf0 2023-09-13T08:26:07.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.938+0000 7fb08a045b80 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x5600b5dacea0 con 0x5600b5daaab0 2023-09-13T08:26:07.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.938+0000 7fb08a045b80 10 client.0 _ll_register_callbacks cb 0x5600b5c5c630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T08:26:07.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.938+0000 7fb076ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5600b5d959d0 0x5600b5d6e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:07.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.938+0000 7fb076ffd700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5600b5d959d0 0x5600b5d6e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45958/0 (socket says 172.21.15.84:45958) 2023-09-13T08:26:07.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.938+0000 7fb076ffd700 1 -- 172.21.15.84:0/688554985 learned_addr learned my addr 172.21.15.84:0/688554985 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:26:07.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.938+0000 7fb077fff700 1 --2- 172.21.15.84:0/688554985 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5600b5daaab0 0x5600b5d6ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:07.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.938+0000 7fb0777fe700 1 --2- 172.21.15.84:0/688554985 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5600b5d94cf0 0x5600b5d62a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:07.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.938+0000 7fb076ffd700 1 -- 172.21.15.84:0/688554985 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5600b5daaab0 msgr2=0x5600b5d6ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:26:07.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.938+0000 7fb076ffd700 1 --2- 172.21.15.84:0/688554985 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5600b5daaab0 0x5600b5d6ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:07.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.938+0000 7fb076ffd700 1 -- 172.21.15.84:0/688554985 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5600b5d94cf0 msgr2=0x5600b5d62a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:26:07.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.938+0000 7fb076ffd700 1 --2- 172.21.15.84:0/688554985 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5600b5d94cf0 0x5600b5d62a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:07.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.938+0000 7fb076ffd700 1 -- 172.21.15.84:0/688554985 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb06c0277a0 con 0x5600b5d959d0 2023-09-13T08:26:07.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.938+0000 7fb076ffd700 1 --2- 172.21.15.84:0/688554985 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5600b5d959d0 0x5600b5d6e4d0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fb068032050 tx=0x7fb0680092c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f92630fa9034bab server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:26:07.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.938+0000 7fb0567fc700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-09-13T08:26:07.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.938+0000 7fb0567fc700 1 -- 172.21.15.84:0/688554985 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb068004250 con 0x5600b5d959d0 2023-09-13T08:26:07.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.938+0000 7fb0567fc700 1 -- 172.21.15.84:0/688554985 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb068000e40 con 0x5600b5d959d0 2023-09-13T08:26:07.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.938+0000 7fb08a045b80 1 -- 172.21.15.84:0/688554985 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb070058420 con 0x5600b5d959d0 2023-09-13T08:26:07.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.939+0000 7fb0567fc700 1 -- 172.21.15.84:0/688554985 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb0680043b0 con 0x5600b5d959d0 2023-09-13T08:26:07.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.939+0000 7fb08a045b80 10 client.5547 fetch_fsmap learned FSMap version 18 2023-09-13T08:26:07.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.939+0000 7fb08a045b80 1 -- 172.21.15.84:0/688554985 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x5600b5ad5c10 con 0x5600b5d959d0 2023-09-13T08:26:07.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.939+0000 7fb0567fc700 1 -- 172.21.15.84:0/688554985 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb070058420 con 0x5600b5d959d0 2023-09-13T08:26:07.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.939+0000 7fb0567fc700 1 -- 172.21.15.84:0/688554985 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 18) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fb068030680 con 0x5600b5d959d0 2023-09-13T08:26:07.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.939+0000 7fb08a045b80 10 client.5547 fetch_fsmap finished waiting for FSMap version 18 2023-09-13T08:26:07.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.939+0000 7fb08a045b80 10 client.5547 resolve_mds: resolved name 'd' to daemon mds.d 2023-09-13T08:26:07.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.939+0000 7fb08a045b80 20 client.5547 populate_metadata read hostname 'smithi084' 2023-09-13T08:26:07.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.939+0000 7fb08a045b80 1 --2- 172.21.15.84:0/688554985 >> [v2:172.21.15.161:6833/3356746418,v1:172.21.15.161:6835/3356746418] conn(0x5600b5e1ebe0 0x5600b5e1efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:07.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.939+0000 7fb08a045b80 4 client.5547 mds_command: new command op to 5373 tid=0 multi_id=0 [{"prefix": "status"}] 2023-09-13T08:26:07.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.939+0000 7fb08a045b80 1 -- 172.21.15.84:0/688554985 --> [v2:172.21.15.161:6833/3356746418,v1:172.21.15.161:6835/3356746418] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5600b5c7a000 con 0x5600b5e1ebe0 2023-09-13T08:26:07.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.939+0000 7fb0777fe700 1 --2- 172.21.15.84:0/688554985 >> [v2:172.21.15.161:6833/3356746418,v1:172.21.15.161:6835/3356746418] conn(0x5600b5e1ebe0 0x5600b5e1efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:07.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.939+0000 7fb0567fc700 10 client.5547 ms_handle_connect on v2:172.21.15.161:6833/3356746418 2023-09-13T08:26:07.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.939+0000 7fb0777fe700 1 --2- 172.21.15.84:0/688554985 >> [v2:172.21.15.161:6833/3356746418,v1:172.21.15.161:6835/3356746418] conn(0x5600b5e1ebe0 0x5600b5e1efc0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=51d013a92036845e server_cookie=e499d8a9ce5b1a1e in_seq=0 out_seq=0 2023-09-13T08:26:07.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.940+0000 7fb0567fc700 1 -- 172.21.15.84:0/688554985 <== mds.0 v2:172.21.15.161:6833/3356746418 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x5600b5c7a000 con 0x5600b5e1ebe0 2023-09-13T08:26:07.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.940+0000 7fb0567fc700 10 client.5547 handle_command_reply: tid=0 2023-09-13T08:26:07.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.940+0000 7fb08a045b80 1 client.5547 shutdown 2023-09-13T08:26:07.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.940+0000 7fb08a045b80 1 -- 172.21.15.84:0/688554985 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5600b5d959d0 msgr2=0x5600b5d6e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:07.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.940+0000 7fb08a045b80 1 --2- 172.21.15.84:0/688554985 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5600b5d959d0 0x5600b5d6e4d0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fb068032050 tx=0x7fb0680092c0 comp rx=0 tx=0).stop 2023-09-13T08:26:07.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.940+0000 7fb08a045b80 1 -- 172.21.15.84:0/688554985 shutdown_connections 2023-09-13T08:26:07.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.940+0000 7fb08a045b80 1 --2- 172.21.15.84:0/688554985 >> [v2:172.21.15.161:6833/3356746418,v1:172.21.15.161:6835/3356746418] conn(0x5600b5e1ebe0 0x5600b5e1efc0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:07.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.940+0000 7fb08a045b80 1 --2- 172.21.15.84:0/688554985 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5600b5daaab0 0x5600b5d6ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:07.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.940+0000 7fb0567fc700 0 client.5547 ms_handle_reset on v2:172.21.15.161:6833/3356746418 2023-09-13T08:26:07.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.940+0000 7fb08a045b80 1 --2- 172.21.15.84:0/688554985 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5600b5d94cf0 0x5600b5d62a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:07.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.940+0000 7fb08a045b80 1 --2- 172.21.15.84:0/688554985 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5600b5d959d0 0x5600b5d6e4d0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:07.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.940+0000 7fb08a045b80 1 -- 172.21.15.84:0/688554985 >> 172.21.15.84:0/688554985 conn(0x5600b5cccc30 msgr2=0x5600b5dc6770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:26:07.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.940+0000 7fb08a045b80 1 -- 172.21.15.84:0/688554985 shutdown_connections 2023-09-13T08:26:07.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.940+0000 7fb08a045b80 1 -- 172.21.15.84:0/688554985 wait complete. 2023-09-13T08:26:07.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.940+0000 7fb08a045b80 20 client.5547 trim_cache size 0 max 16384 2023-09-13T08:26:07.965 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-09-13T08:26:07.965 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "0107440b-b634-42c5-a643-5d31ea826116", 2023-09-13T08:26:07.965 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 0, 2023-09-13T08:26:07.965 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 5373, 2023-09-13T08:26:07.966 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2023-09-13T08:26:07.966 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2023-09-13T08:26:07.966 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2023-09-13T08:26:07.966 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 5.9049575110000001, 2023-09-13T08:26:07.966 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 18, 2023-09-13T08:26:07.967 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 38, 2023-09-13T08:26:07.967 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 38, 2023-09-13T08:26:07.967 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 13.778695114 2023-09-13T08:26:07.967 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-09-13T08:26:07.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.940+0000 7fb07de60700 1 -- 172.21.15.84:0/3932340642 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fb06406a580 msgr2=0x7fb06406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:07.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.940+0000 7fb07de60700 1 --2- 172.21.15.84:0/3932340642 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fb06406a580 0x7fb06406ca40 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb06c006fd0 tx=0x7fb06c008040 comp rx=0 tx=0).stop 2023-09-13T08:26:07.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.940+0000 7fb07de60700 1 -- 172.21.15.84:0/3932340642 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0780d2ba0 msgr2=0x7fb0780aa540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:07.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.940+0000 7fb07de60700 1 --2- 172.21.15.84:0/3932340642 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0780d2ba0 0x7fb0780aa540 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fb07000cda0 tx=0x7fb07000a570 comp rx=0 tx=0).stop 2023-09-13T08:26:07.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.940+0000 7fb07de60700 1 -- 172.21.15.84:0/3932340642 shutdown_connections 2023-09-13T08:26:07.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.940+0000 7fb07de60700 1 --2- 172.21.15.84:0/3932340642 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0780d2ba0 0x7fb0780aa540 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:07.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.940+0000 7fb07de60700 1 --2- 172.21.15.84:0/3932340642 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb0780ce230 0x7fb0781497e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:07.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.940+0000 7fb07de60700 1 --2- 172.21.15.84:0/3932340642 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fb06406a580 0x7fb06406ca40 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:07.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.940+0000 7fb07de60700 1 --2- 172.21.15.84:0/3932340642 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb0780cff60 0x7fb0780b35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:07.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.940+0000 7fb07de60700 1 -- 172.21.15.84:0/3932340642 >> 172.21.15.84:0/3932340642 conn(0x7fb07806b130 msgr2=0x7fb0780b50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:26:07.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.941+0000 7fb07de60700 1 -- 172.21.15.84:0/3932340642 shutdown_connections 2023-09-13T08:26:07.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:07.941+0000 7fb07de60700 1 -- 172.21.15.84:0/3932340642 wait complete. 2023-09-13T08:26:07.972 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-13T08:26:08.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:08.092+0000 7f759333c700 1 Processor -- start 2023-09-13T08:26:08.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:08.092+0000 7f759333c700 1 -- start start 2023-09-13T08:26:08.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:08.093+0000 7f759333c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f758c0ca920 0x7f758c06d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:08.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:08.093+0000 7f759333c700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f758c0cae50 con 0x7f758c15d530 2023-09-13T08:26:08.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:08.093+0000 7f759333c700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f758c0cb130 con 0x7f758c06a620 2023-09-13T08:26:08.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:08.093+0000 7f759333c700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f758c0cff20 con 0x7f758c0ca920 2023-09-13T08:26:08.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:08.093+0000 7f75908d7700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f758c0ca920 0x7f758c06d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:08.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:08.093+0000 7f75910d8700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f758c15d530 0x7f758c161bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:48610/0 (socket says 172.21.15.84:48610) 2023-09-13T08:26:08.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:08.093+0000 7f75910d8700 1 -- 172.21.15.84:0/2854411839 learned_addr learned my addr 172.21.15.84:0/2854411839 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:26:08.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:08.093+0000 7f75908d7700 1 -- 172.21.15.84:0/2854411839 >> v1:172.21.15.161:6789/0 conn(0x7f758c06a620 legacy=0x7f758c0ce490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:26:08.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:08.093+0000 7f75908d7700 1 -- 172.21.15.84:0/2854411839 >> v1:172.21.15.84:6789/0 conn(0x7f758c15d530 legacy=0x7f758c161bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:08.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:08.093+0000 7f75908d7700 1 -- 172.21.15.84:0/2854411839 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f758c0cb410 con 0x7f758c0ca920 2023-09-13T08:26:08.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:08.093+0000 7f757ffff700 1 -- 172.21.15.84:0/2854411839 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1279386120 0 0) 0x7f758c0cae50 con 0x7f758c15d530 2023-09-13T08:26:08.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:08.093+0000 7f75908d7700 1 --2- 172.21.15.84:0/2854411839 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f758c0ca920 0x7f758c06d700 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f7588009840 tx=0x7f7588009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0a098763c743d11 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:26:08.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:08.094+0000 7f757ffff700 1 -- 172.21.15.84:0/2854411839 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7588004230 con 0x7f758c0ca920 2023-09-13T08:26:08.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:08.094+0000 7f757ffff700 1 -- 172.21.15.84:0/2854411839 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7588004390 con 0x7f758c0ca920 2023-09-13T08:26:08.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:08.094+0000 7f757ffff700 1 -- 172.21.15.84:0/2854411839 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75880036a0 con 0x7f758c0ca920 2023-09-13T08:26:08.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:08.094+0000 7f759333c700 1 -- 172.21.15.84:0/2854411839 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f758c0ca920 msgr2=0x7f758c06d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:08.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:08.094+0000 7f759333c700 1 --2- 172.21.15.84:0/2854411839 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f758c0ca920 0x7f758c06d700 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f7588009840 tx=0x7f7588009b50 comp rx=0 tx=0).stop 2023-09-13T08:26:08.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:08.094+0000 7f759333c700 1 -- 172.21.15.84:0/2854411839 shutdown_connections 2023-09-13T08:26:08.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:08.094+0000 7f759333c700 1 --2- 172.21.15.84:0/2854411839 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f758c0ca920 0x7f758c06d700 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:08.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:08.094+0000 7f759333c700 1 -- 172.21.15.84:0/2854411839 >> 172.21.15.84:0/2854411839 conn(0x7f758c0d00c0 msgr2=0x7f758c0d04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:26:08.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:08.094+0000 7f759333c700 1 -- 172.21.15.84:0/2854411839 shutdown_connections 2023-09-13T08:26:08.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:08.094+0000 7f759333c700 1 -- 172.21.15.84:0/2854411839 wait complete. 2023-09-13T08:26:08.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:08.096+0000 7f759333c700 1 Processor -- start 2023-09-13T08:26:08.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:08.096+0000 7f759333c700 1 -- start start 2023-09-13T08:26:08.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:08.097+0000 7f759333c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f758c06a620 0x7f758c160640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:08.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:08.097+0000 7f759333c700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f758c0ca920 0x7f758c15ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:08.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:08.097+0000 7f759333c700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f758c15d530 0x7f758c0b32c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:08.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:08.097+0000 7f759333c700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f758c159af0 con 0x7f758c15d530 2023-09-13T08:26:08.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:08.097+0000 7f759333c700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f758c159dd0 con 0x7f758c06a620 2023-09-13T08:26:08.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:08.097+0000 7f759333c700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f758c15a0b0 con 0x7f758c0ca920 2023-09-13T08:26:08.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:08.097+0000 7f75918d9700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f758c15d530 0x7f758c0b32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:08.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:08.097+0000 7f75918d9700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f758c15d530 0x7f758c0b32c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45972/0 (socket says 172.21.15.84:45972) 2023-09-13T08:26:08.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:08.097+0000 7f75918d9700 1 -- 172.21.15.84:0/2186345260 learned_addr learned my addr 172.21.15.84:0/2186345260 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:26:08.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:08.097+0000 7f75910d8700 1 --2- 172.21.15.84:0/2186345260 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f758c06a620 0x7f758c160640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:08.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:08.097+0000 7f75908d7700 1 --2- 172.21.15.84:0/2186345260 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f758c0ca920 0x7f758c15ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:08.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:08.097+0000 7f75918d9700 1 -- 172.21.15.84:0/2186345260 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f758c0ca920 msgr2=0x7f758c15ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:08.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:08.097+0000 7f75918d9700 1 --2- 172.21.15.84:0/2186345260 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f758c0ca920 0x7f758c15ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:08.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:08.097+0000 7f75918d9700 1 -- 172.21.15.84:0/2186345260 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f758c06a620 msgr2=0x7f758c160640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:08.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:08.097+0000 7f75918d9700 1 --2- 172.21.15.84:0/2186345260 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f758c06a620 0x7f758c160640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:08.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:08.097+0000 7f75918d9700 1 -- 172.21.15.84:0/2186345260 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75880094a0 con 0x7f758c15d530 2023-09-13T08:26:08.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:08.097+0000 7f75918d9700 1 --2- 172.21.15.84:0/2186345260 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f758c15d530 0x7f758c0b32c0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f758400c780 tx=0x7f758400ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:26:08.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:08.097+0000 7f757dffb700 1 -- 172.21.15.84:0/2186345260 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7584003e10 con 0x7f758c15d530 2023-09-13T08:26:08.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:08.097+0000 7f757dffb700 1 -- 172.21.15.84:0/2186345260 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75840050d0 con 0x7f758c15d530 2023-09-13T08:26:08.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:08.097+0000 7f759333c700 1 -- 172.21.15.84:0/2186345260 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f758c15a390 con 0x7f758c15d530 2023-09-13T08:26:08.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:08.097+0000 7f757dffb700 1 -- 172.21.15.84:0/2186345260 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7584005480 con 0x7f758c15d530 2023-09-13T08:26:08.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:08.098+0000 7f759333c700 1 -- 172.21.15.84:0/2186345260 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f758c159710 con 0x7f758c15d530 2023-09-13T08:26:08.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:08.099+0000 7f759333c700 1 -- 172.21.15.84:0/2186345260 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f758c160f10 con 0x7f758c15d530 2023-09-13T08:26:08.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:08.099+0000 7f757dffb700 1 -- 172.21.15.84:0/2186345260 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f75840055e0 con 0x7f758c15d530 2023-09-13T08:26:08.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:08.099+0000 7f757dffb700 1 --2- 172.21.15.84:0/2186345260 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f757006a580 0x7f757006ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:08.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:08.099+0000 7f757dffb700 1 -- 172.21.15.84:0/2186345260 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f7584087c80 con 0x7f758c15d530 2023-09-13T08:26:08.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:08.099+0000 7f75910d8700 1 --2- 172.21.15.84:0/2186345260 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f757006a580 0x7f757006ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:08.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:08.100+0000 7f75910d8700 1 --2- 172.21.15.84:0/2186345260 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f757006a580 0x7f757006ca40 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7580000f60 tx=0x7f7580007e70 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:26:08.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:08.104+0000 7f757dffb700 1 -- 172.21.15.84:0/2186345260 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f75840530d0 con 0x7f758c15d530 2023-09-13T08:26:08.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:08.338+0000 7f759333c700 1 -- 172.21.15.84:0/2186345260 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f758c15e540 con 0x7f758c15d530 2023-09-13T08:26:08.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:08.339+0000 7f757dffb700 1 -- 172.21.15.84:0/2186345260 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) v1 ==== 53+0+73 (secure 0 0 0) 0x7f7584017060 con 0x7f758c15d530 2023-09-13T08:26:08.339 INFO:teuthology.orchestra.run.smithi084.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-09-13T08:26:08.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:08.341+0000 7f759333c700 1 -- 172.21.15.84:0/2186345260 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f757006a580 msgr2=0x7f757006ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:08.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:08.341+0000 7f759333c700 1 --2- 172.21.15.84:0/2186345260 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f757006a580 0x7f757006ca40 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7580000f60 tx=0x7f7580007e70 comp rx=0 tx=0).stop 2023-09-13T08:26:08.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:08.341+0000 7f759333c700 1 -- 172.21.15.84:0/2186345260 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f758c15d530 msgr2=0x7f758c0b32c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:08.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:08.341+0000 7f759333c700 1 --2- 172.21.15.84:0/2186345260 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f758c15d530 0x7f758c0b32c0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f758400c780 tx=0x7f758400ca90 comp rx=0 tx=0).stop 2023-09-13T08:26:08.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:08.341+0000 7f759333c700 1 -- 172.21.15.84:0/2186345260 shutdown_connections 2023-09-13T08:26:08.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:08.341+0000 7f759333c700 1 --2- 172.21.15.84:0/2186345260 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f758c15d530 0x7f758c0b32c0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:08.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:08.341+0000 7f759333c700 1 --2- 172.21.15.84:0/2186345260 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f757006a580 0x7f757006ca40 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:08.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:08.341+0000 7f759333c700 1 --2- 172.21.15.84:0/2186345260 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f758c06a620 0x7f758c160640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:08.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:08.341+0000 7f759333c700 1 --2- 172.21.15.84:0/2186345260 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f758c0ca920 0x7f758c15ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:08.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:08.341+0000 7f759333c700 1 -- 172.21.15.84:0/2186345260 >> 172.21.15.84:0/2186345260 conn(0x7f758c0d00c0 msgr2=0x7f758c1556d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:26:08.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:08.341+0000 7f759333c700 1 -- 172.21.15.84:0/2186345260 shutdown_connections 2023-09-13T08:26:08.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:08.341+0000 7f759333c700 1 -- 172.21.15.84:0/2186345260 wait complete. 2023-09-13T08:26:08.353 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-09-13T08:26:08.353 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-13T08:26:08.353 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi084.front.sepia.ceph.com 2023-09-13T08:26:08.354 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-09-13T08:26:08.357 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-09-13T08:26:08.357 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-09-13T08:26:08.358 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-09-13T08:26:08.358 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-13T08:26:08.358 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-09-13T08:26:08.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:26:08.359 DEBUG:teuthology.orchestra.run.smithi084:> ip addr 2023-09-13T08:26:08.377 INFO:teuthology.orchestra.run.smithi084.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-13T08:26:08.377 INFO:teuthology.orchestra.run.smithi084.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-13T08:26:08.377 INFO:teuthology.orchestra.run.smithi084.stdout: inet 127.0.0.1/8 scope host lo 2023-09-13T08:26:08.377 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-09-13T08:26:08.378 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 ::1/128 scope host 2023-09-13T08:26:08.378 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-09-13T08:26:08.378 INFO:teuthology.orchestra.run.smithi084.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-13T08:26:08.378 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:68 brd ff:ff:ff:ff:ff:ff 2023-09-13T08:26:08.378 INFO:teuthology.orchestra.run.smithi084.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-13T08:26:08.379 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:69 brd ff:ff:ff:ff:ff:ff 2023-09-13T08:26:08.379 INFO:teuthology.orchestra.run.smithi084.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-13T08:26:08.379 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:50 brd ff:ff:ff:ff:ff:ff 2023-09-13T08:26:08.379 INFO:teuthology.orchestra.run.smithi084.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-13T08:26:08.379 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:51 brd ff:ff:ff:ff:ff:ff 2023-09-13T08:26:08.380 INFO:teuthology.orchestra.run.smithi084.stdout: inet 172.21.15.84/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-09-13T08:26:08.380 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft 42310sec preferred_lft 42310sec 2023-09-13T08:26:08.380 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::9f71:f307:edb2:844f/64 scope link noprefixroute 2023-09-13T08:26:08.380 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-09-13T08:26:08.380 INFO:teuthology.orchestra.run.smithi084.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-13T08:26:08.381 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 9a:83:1f:f8:2d:86 brd ff:ff:ff:ff:ff:ff 2023-09-13T08:26:08.381 INFO:teuthology.orchestra.run.smithi084.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-09-13T08:26:08.381 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-09-13T08:26:08.381 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::3890:2dff:fe73:ffbd/64 scope link 2023-09-13T08:26:08.381 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-09-13T08:26:08.382 INFO:teuthology.orchestra.run.smithi084.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-13T08:26:08.382 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 9a:83:1f:f8:2d:86 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-13T08:26:08.382 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::9883:1fff:fef8:2d86/64 scope link 2023-09-13T08:26:08.382 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-09-13T08:26:08.382 INFO:teuthology.orchestra.run.smithi084.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-13T08:26:08.383 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether fa:7f:11:0b:01:4d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-09-13T08:26:08.383 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::f87f:11ff:fe0b:14d/64 scope link 2023-09-13T08:26:08.383 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-09-13T08:26:08.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:26:08.384 DEBUG:teuthology.orchestra.run.smithi084:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-13T08:26:08.441 INFO:teuthology.orchestra.run.smithi084.stdout:1 2023-09-13T08:26:08.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:26:08.443 DEBUG:teuthology.orchestra.run.smithi084:> route 2023-09-13T08:26:08.501 INFO:teuthology.orchestra.run.smithi084.stdout:Kernel IP routing table 2023-09-13T08:26:08.502 INFO:teuthology.orchestra.run.smithi084.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-13T08:26:08.502 INFO:teuthology.orchestra.run.smithi084.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-09-13T08:26:08.502 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-09-13T08:26:08.502 INFO:teuthology.orchestra.run.smithi084.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-13T08:26:08.503 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:26:08.503 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-09-13T08:26:08.504 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-09-13T08:26:08.504 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-09-13T08:26:08.504 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-09-13T08:26:08.505 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-09-13T08:26:08.505 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-09-13T08:26:08.606 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:26:08.607 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2023-09-13T08:26:08.623 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-09-13T08:26:08.624 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-09-13T08:26:08.624 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-09-13T08:26:08.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:26:08.625 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set brx.0 up 2023-09-13T08:26:08.690 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-13T08:26:08.691 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-09-13T08:26:08.747 INFO:teuthology.orchestra.run.smithi084.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-09-13T08:26:08.748 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-13T08:26:08.748 DEBUG:teuthology.orchestra.run.smithi084:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-09-13T08:26:08.804 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-09-13T08:26:08.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:26:08.805 DEBUG:teuthology.orchestra.run.smithi084:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-13T08:26:08.889 INFO:teuthology.orchestra.run.smithi084.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-13T08:26:08.889 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-09-13T08:26:08.889 INFO:teuthology.orchestra.run.smithi084.stdout:invalid new device string format 2023-09-13T08:26:08.898 INFO:teuthology.orchestra.run.smithi084.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-13T08:26:08.898 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-09-13T08:26:08.898 INFO:teuthology.orchestra.run.smithi084.stdout:invalid new device string format 2023-09-13T08:26:08.898 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: resolved to: "172.21.15.84:3300,172.21.15.161:3300,172.21.15.161:3301" 2023-09-13T08:26:08.899 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-13T08:26:08.923 INFO:teuthology.orchestra.run.smithi084.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-13T08:26:08.924 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-09-13T08:26:08.924 INFO:teuthology.orchestra.run.smithi084.stdout:invalid new device string format 2023-09-13T08:26:08.924 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: resolved to: "172.21.15.84:3300,172.21.15.161:3300,172.21.15.161:3301" 2023-09-13T08:26:08.924 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-13T08:26:08.925 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: resolved to: "172.21.15.84:6789,172.21.15.161:6789,172.21.15.161:6790" 2023-09-13T08:26:08.925 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.84:6789,172.21.15.161:6789,172.21.15.161:6790:/ 2023-09-13T08:26:08.925 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=0107440b-b634-42c5-a643-5d31ea826116" will pass to kernel 2023-09-13T08:26:08.928 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-09-13T08:26:08.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:26:08.928 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-09-13T08:26:08.959 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:26:08.960 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-13T08:26:09.048 INFO:teuthology.orchestra.run.smithi084.stdout:client5559 2023-09-13T08:26:09.049 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-09-13T08:26:09.049 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T08:26:09.067 DEBUG:teuthology.orchestra.run.smithi084:> mktemp -d --suffix=xfstests-dev 2023-09-13T08:26:09.124 INFO:teuthology.orchestra.run.smithi084.stdout:/tmp/tmp.UxTBQ6XIL3xfstests-dev 2023-09-13T08:26:09.125 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:26:09.125 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.UxTBQ6XIL3xfstests-dev) 2023-09-13T08:26:09.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:26:09.193 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.UxTBQ6XIL3xfstests-dev) 2023-09-13T08:26:09.249 INFO:teuthology.orchestra.run.smithi084.stderr:Cloning into '/tmp/tmp.UxTBQ6XIL3xfstests-dev'... 2023-09-13T08:26:09.944 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:26:09.944 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2023-09-13T08:26:10.005 DEBUG:teuthology.orchestra.run.smithi084:> mktemp -d --suffix=test 2023-09-13T08:26:10.061 INFO:teuthology.orchestra.run.smithi084.stdout:/tmp/tmp.ocaSSGQzPctest 2023-09-13T08:26:10.062 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:26:10.062 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2023-09-13T08:26:10.120 DEBUG:teuthology.orchestra.run.smithi084:> mktemp -d --suffix=scratch 2023-09-13T08:26:10.177 INFO:teuthology.orchestra.run.smithi084.stdout:/tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:26:10.178 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "rhel" and "8.6". 2023-09-13T08:26:10.178 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc indent libtool lvm2 make psmisc quota sed xfsdump xfsprogs libacl-devel libattr-devel libaio-devel libuuid-devel xfsprogs-devel python3 sqlite xfsprogs-qa-devel 2023-09-13T08:26:10.573 INFO:teuthology.orchestra.run.smithi084.stdout:Updating Subscription Management repositories. 2023-09-13T08:26:10.935 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:26:10.937 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:26:11.478 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:04:31 ago on Wed 13 Sep 2023 08:21:40 AM UTC. 2023-09-13T08:26:12.761 INFO:teuthology.orchestra.run.smithi084.stdout:Package acl-2.2.53-1.el8.x86_64 is already installed. 2023-09-13T08:26:12.762 INFO:teuthology.orchestra.run.smithi084.stdout:Package attr-2.4.48-3.el8.x86_64 is already installed. 2023-09-13T08:26:12.763 INFO:teuthology.orchestra.run.smithi084.stdout:Package automake-1.16.1-7.el8.noarch is already installed. 2023-09-13T08:26:12.765 INFO:teuthology.orchestra.run.smithi084.stdout:Package bc-1.07.1-5.el8.x86_64 is already installed. 2023-09-13T08:26:12.766 INFO:teuthology.orchestra.run.smithi084.stdout:Package dbench-4.0-20.el8.x86_64 is already installed. 2023-09-13T08:26:12.768 INFO:teuthology.orchestra.run.smithi084.stdout:Package e2fsprogs-1.45.6-4.el8.x86_64 is already installed. 2023-09-13T08:26:12.770 INFO:teuthology.orchestra.run.smithi084.stdout:Package gawk-4.2.1-4.el8.x86_64 is already installed. 2023-09-13T08:26:12.771 INFO:teuthology.orchestra.run.smithi084.stdout:Package gcc-8.5.0-10.1.el8_6.x86_64 is already installed. 2023-09-13T08:26:12.773 INFO:teuthology.orchestra.run.smithi084.stdout:Package libtool-2.4.6-25.el8.x86_64 is already installed. 2023-09-13T08:26:12.774 INFO:teuthology.orchestra.run.smithi084.stdout:Package lvm2-8:2.03.14-3.el8_6.2.x86_64 is already installed. 2023-09-13T08:26:12.775 INFO:teuthology.orchestra.run.smithi084.stdout:Package make-1:4.2.1-11.el8.x86_64 is already installed. 2023-09-13T08:26:12.776 INFO:teuthology.orchestra.run.smithi084.stdout:Package psmisc-23.1-5.el8.x86_64 is already installed. 2023-09-13T08:26:12.778 INFO:teuthology.orchestra.run.smithi084.stdout:Package quota-1:4.04-14.el8.x86_64 is already installed. 2023-09-13T08:26:12.778 INFO:teuthology.orchestra.run.smithi084.stdout:Package sed-4.5-5.el8.x86_64 is already installed. 2023-09-13T08:26:12.779 INFO:teuthology.orchestra.run.smithi084.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-09-13T08:26:12.781 INFO:teuthology.orchestra.run.smithi084.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-09-13T08:26:12.782 INFO:teuthology.orchestra.run.smithi084.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-09-13T08:26:12.783 INFO:teuthology.orchestra.run.smithi084.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-09-13T08:26:12.784 INFO:teuthology.orchestra.run.smithi084.stdout:Package libaio-devel-0.3.112-1.el8.x86_64 is already installed. 2023-09-13T08:26:12.785 INFO:teuthology.orchestra.run.smithi084.stdout:Package libuuid-devel-2.32.1-35.el8.x86_64 is already installed. 2023-09-13T08:26:12.786 INFO:teuthology.orchestra.run.smithi084.stdout:Package xfsprogs-devel-5.0.0-10.el8.x86_64 is already installed. 2023-09-13T08:26:12.790 INFO:teuthology.orchestra.run.smithi084.stdout:Package python36-3.6.8-38.module+el8.5.0+12207+5c5719bc.x86_64 is already installed. 2023-09-13T08:26:12.791 INFO:teuthology.orchestra.run.smithi084.stdout:Package sqlite-3.26.0-15.el8.x86_64 is already installed. 2023-09-13T08:26:12.795 INFO:teuthology.orchestra.run.smithi084.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-09-13T08:26:12.906 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2023-09-13T08:26:12.908 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2023-09-13T08:26:12.908 INFO:teuthology.orchestra.run.smithi084.stdout: Package Arch Version Repository Size 2023-09-13T08:26:12.909 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2023-09-13T08:26:12.909 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2023-09-13T08:26:12.909 INFO:teuthology.orchestra.run.smithi084.stdout: dump x86_64 1:0.4-0.36.b46.el8 rhel-8-for-x86_64-baseos-rpms 164 k 2023-09-13T08:26:12.909 INFO:teuthology.orchestra.run.smithi084.stdout: fio x86_64 3.19-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-09-13T08:26:12.909 INFO:teuthology.orchestra.run.smithi084.stdout: indent x86_64 2.2.13-4.el8 epel 187 k 2023-09-13T08:26:12.910 INFO:teuthology.orchestra.run.smithi084.stdout:Upgrading: 2023-09-13T08:26:12.910 INFO:teuthology.orchestra.run.smithi084.stdout: sqlite x86_64 3.26.0-16.el8_6 rhel-8-for-x86_64-baseos-rpms 668 k 2023-09-13T08:26:12.910 INFO:teuthology.orchestra.run.smithi084.stdout: sqlite-libs x86_64 3.26.0-16.el8_6 rhel-8-for-x86_64-baseos-rpms 581 k 2023-09-13T08:26:12.910 INFO:teuthology.orchestra.run.smithi084.stdout:Installing dependencies: 2023-09-13T08:26:12.910 INFO:teuthology.orchestra.run.smithi084.stdout: daxctl-libs x86_64 71.1-3.el8 rhel-8-for-x86_64-baseos-rpms 42 k 2023-09-13T08:26:12.911 INFO:teuthology.orchestra.run.smithi084.stdout: libpmemblk x86_64 1.6.1-1.el8 rhel-8-for-x86_64-appstream-rpms 92 k 2023-09-13T08:26:12.911 INFO:teuthology.orchestra.run.smithi084.stdout: ndctl-libs x86_64 71.1-3.el8 rhel-8-for-x86_64-baseos-rpms 79 k 2023-09-13T08:26:12.911 INFO:teuthology.orchestra.run.smithi084.stdout: rmt x86_64 2:1.5.3-13.el8 rhel-8-for-x86_64-baseos-rpms 51 k 2023-09-13T08:26:12.911 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:26:12.911 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2023-09-13T08:26:12.912 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2023-09-13T08:26:12.912 INFO:teuthology.orchestra.run.smithi084.stdout:Install 7 Packages 2023-09-13T08:26:12.912 INFO:teuthology.orchestra.run.smithi084.stdout:Upgrade 2 Packages 2023-09-13T08:26:12.912 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:26:12.913 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 2.3 M 2023-09-13T08:26:12.913 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2023-09-13T08:26:13.063 INFO:teuthology.orchestra.run.smithi084.stdout:(1/9): fio-3.19-3.el8.x86_64.rpm 4.7 MB/s | 538 kB 00:00 2023-09-13T08:26:13.093 INFO:teuthology.orchestra.run.smithi084.stdout:(2/9): libpmemblk-1.6.1-1.el8.x86_64.rpm 653 kB/s | 92 kB 00:00 2023-09-13T08:26:13.135 INFO:teuthology.orchestra.run.smithi084.stdout:(3/9): dump-0.4-0.36.b46.el8.x86_64.rpm 2.2 MB/s | 164 kB 00:00 2023-09-13T08:26:13.161 INFO:teuthology.orchestra.run.smithi084.stdout:(4/9): rmt-1.5.3-13.el8.x86_64.rpm 768 kB/s | 51 kB 00:00 2023-09-13T08:26:13.186 INFO:teuthology.orchestra.run.smithi084.stdout:(5/9): indent-2.2.13-4.el8.x86_64.rpm 800 kB/s | 187 kB 00:00 2023-09-13T08:26:13.211 INFO:teuthology.orchestra.run.smithi084.stdout:(6/9): daxctl-libs-71.1-3.el8.x86_64.rpm 551 kB/s | 42 kB 00:00 2023-09-13T08:26:13.237 INFO:teuthology.orchestra.run.smithi084.stdout:(7/9): ndctl-libs-71.1-3.el8.x86_64.rpm 1.0 MB/s | 79 kB 00:00 2023-09-13T08:26:13.270 INFO:teuthology.orchestra.run.smithi084.stdout:(8/9): sqlite-libs-3.26.0-16.el8_6.x86_64.rpm 9.8 MB/s | 581 kB 00:00 2023-09-13T08:26:13.304 INFO:teuthology.orchestra.run.smithi084.stdout:(9/9): sqlite-3.26.0-16.el8_6.x86_64.rpm 5.6 MB/s | 668 kB 00:00 2023-09-13T08:26:13.305 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2023-09-13T08:26:13.305 INFO:teuthology.orchestra.run.smithi084.stdout:Total 5.9 MB/s | 2.3 MB 00:00 2023-09-13T08:26:13.388 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2023-09-13T08:26:13.420 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2023-09-13T08:26:13.420 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2023-09-13T08:26:13.507 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2023-09-13T08:26:13.511 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2023-09-13T08:26:13.916 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2023-09-13T08:26:14.066 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : daxctl-libs-71.1-3.el8.x86_64 1/11 2023-09-13T08:26:14.139 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: daxctl-libs-71.1-3.el8.x86_64 1/11 2023-09-13T08:26:14.366 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ndctl-libs-71.1-3.el8.x86_64 2/11 2023-09-13T08:26:14.434 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ndctl-libs-71.1-3.el8.x86_64 2/11 2023-09-13T08:26:14.608 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libpmemblk-1.6.1-1.el8.x86_64 3/11 2023-09-13T08:26:14.724 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libpmemblk-1.6.1-1.el8.x86_64 3/11 2023-09-13T08:26:14.930 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : sqlite-libs-3.26.0-16.el8_6.x86_64 4/11 2023-09-13T08:26:15.087 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : rmt-2:1.5.3-13.el8.x86_64 5/11 2023-09-13T08:26:15.297 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : dump-1:0.4-0.36.b46.el8.x86_64 6/11 2023-09-13T08:26:15.595 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : sqlite-3.26.0-16.el8_6.x86_64 7/11 2023-09-13T08:26:15.876 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : fio-3.19-3.el8.x86_64 8/11 2023-09-13T08:26:16.092 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : indent-2.2.13-4.el8.x86_64 9/11 2023-09-13T08:26:16.216 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : sqlite-3.26.0-15.el8.x86_64 10/11 2023-09-13T08:26:16.355 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : sqlite-libs-3.26.0-15.el8.x86_64 11/11 2023-09-13T08:26:16.633 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: sqlite-libs-3.26.0-15.el8.x86_64 11/11 2023-09-13T08:26:16.634 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : indent-2.2.13-4.el8.x86_64 1/11 2023-09-13T08:26:16.634 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : fio-3.19-3.el8.x86_64 2/11 2023-09-13T08:26:16.634 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libpmemblk-1.6.1-1.el8.x86_64 3/11 2023-09-13T08:26:16.634 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : dump-1:0.4-0.36.b46.el8.x86_64 4/11 2023-09-13T08:26:16.635 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : rmt-2:1.5.3-13.el8.x86_64 5/11 2023-09-13T08:26:16.635 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : daxctl-libs-71.1-3.el8.x86_64 6/11 2023-09-13T08:26:16.635 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ndctl-libs-71.1-3.el8.x86_64 7/11 2023-09-13T08:26:16.635 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : sqlite-3.26.0-16.el8_6.x86_64 8/11 2023-09-13T08:26:16.636 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : sqlite-3.26.0-15.el8.x86_64 9/11 2023-09-13T08:26:16.636 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : sqlite-libs-3.26.0-16.el8_6.x86_64 10/11 2023-09-13T08:26:17.838 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : sqlite-libs-3.26.0-15.el8.x86_64 11/11 2023-09-13T08:26:17.838 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:04:37 ago on Wed 13 Sep 2023 08:21:40 AM UTC. 2023-09-13T08:26:20.166 INFO:teuthology.orchestra.run.smithi084.stdout:Installed products updated. 2023-09-13T08:26:20.355 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:26:20.355 INFO:teuthology.orchestra.run.smithi084.stdout:Upgraded: 2023-09-13T08:26:20.356 INFO:teuthology.orchestra.run.smithi084.stdout: sqlite-3.26.0-16.el8_6.x86_64 sqlite-libs-3.26.0-16.el8_6.x86_64 2023-09-13T08:26:20.356 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2023-09-13T08:26:20.356 INFO:teuthology.orchestra.run.smithi084.stdout: daxctl-libs-71.1-3.el8.x86_64 dump-1:0.4-0.36.b46.el8.x86_64 2023-09-13T08:26:20.356 INFO:teuthology.orchestra.run.smithi084.stdout: fio-3.19-3.el8.x86_64 indent-2.2.13-4.el8.x86_64 2023-09-13T08:26:20.356 INFO:teuthology.orchestra.run.smithi084.stdout: libpmemblk-1.6.1-1.el8.x86_64 ndctl-libs-71.1-3.el8.x86_64 2023-09-13T08:26:20.357 INFO:teuthology.orchestra.run.smithi084.stdout: rmt-2:1.5.3-13.el8.x86_64 2023-09-13T08:26:20.357 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:26:20.357 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2023-09-13T08:26:20.512 DEBUG:teuthology.orchestra.run.smithi084:> sudo useradd -m fsgqa 2023-09-13T08:26:20.540 INFO:teuthology.orchestra.run.smithi084.stderr:useradd: user 'fsgqa' already exists 2023-09-13T08:26:20.541 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-09-13T08:26:20.542 DEBUG:teuthology.orchestra.run.smithi084:> sudo groupadd fsgqa 2023-09-13T08:26:20.608 INFO:teuthology.orchestra.run.smithi084.stderr:groupadd: group 'fsgqa' already exists 2023-09-13T08:26:20.609 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-09-13T08:26:20.610 DEBUG:teuthology.orchestra.run.smithi084:> sudo useradd fsgqa2 2023-09-13T08:26:21.581 DEBUG:teuthology.orchestra.run.smithi084:> sudo useradd 123456-fsgqa 2023-09-13T08:26:22.397 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2023-09-13T08:26:22.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:22.536+0000 7f59d5afb700 1 Processor -- start 2023-09-13T08:26:22.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:22.536+0000 7f59d5afb700 1 -- start start 2023-09-13T08:26:22.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:22.536+0000 7f59d5afb700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f59d00ca430 0x7f59d00ca890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:22.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:22.536+0000 7f59d5afb700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f59d015b930 0x7f59d015bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:22.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:22.536+0000 7f59d5afb700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59d00cadd0 con 0x7f59d0157c30 2023-09-13T08:26:22.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:22.536+0000 7f59d5afb700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59d00ca100 con 0x7f59d00ca430 2023-09-13T08:26:22.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:22.536+0000 7f59d5afb700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59d015c2a0 con 0x7f59d015b930 2023-09-13T08:26:22.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:22.537+0000 7f59ceffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f59d00ca430 0x7f59d00ca890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:22.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:22.537+0000 7f59ceffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f59d00ca430 0x7f59d00ca890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46000/0 (socket says 172.21.15.84:46000) 2023-09-13T08:26:22.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:22.537+0000 7f59ceffd700 1 -- 172.21.15.84:0/2951010084 learned_addr learned my addr 172.21.15.84:0/2951010084 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:26:22.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:22.537+0000 7f59ceffd700 1 -- 172.21.15.84:0/2951010084 >> v2:172.21.15.161:3300/0 conn(0x7f59d015b930 msgr2=0x7f59d015bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:26:22.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:22.537+0000 7f59cffff700 1 --2- 172.21.15.84:0/2951010084 >> v2:172.21.15.161:3300/0 conn(0x7f59d015b930 0x7f59d015bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:22.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:22.537+0000 7f59ceffd700 1 --2- 172.21.15.84:0/2951010084 >> v2:172.21.15.161:3300/0 conn(0x7f59d015b930 0x7f59d015bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:22.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:22.537+0000 7f59ceffd700 1 -- 172.21.15.84:0/2951010084 >> v1:172.21.15.161:6789/0 conn(0x7f59d0157c30 legacy=0x7f59d0071ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:26:22.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:22.537+0000 7f59ceffd700 1 -- 172.21.15.84:0/2951010084 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59d015b3f0 con 0x7f59d00ca430 2023-09-13T08:26:22.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:22.537+0000 7f59ceffd700 1 --2- 172.21.15.84:0/2951010084 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59d00ca430 0x7f59d00ca890 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f59d00ceec0 tx=0x7f59b8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c705343b313ea6b0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:26:22.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:22.537+0000 7f59ce7fc700 1 -- 172.21.15.84:0/2951010084 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b8004230 con 0x7f59d00ca430 2023-09-13T08:26:22.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:22.537+0000 7f59ce7fc700 1 -- 172.21.15.84:0/2951010084 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59b8004390 con 0x7f59d00ca430 2023-09-13T08:26:22.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:22.537+0000 7f59ce7fc700 1 -- 172.21.15.84:0/2951010084 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b80036a0 con 0x7f59d00ca430 2023-09-13T08:26:22.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:22.538+0000 7f59d5afb700 1 -- 172.21.15.84:0/2951010084 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59d00ca430 msgr2=0x7f59d00ca890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:22.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:22.538+0000 7f59d5afb700 1 --2- 172.21.15.84:0/2951010084 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59d00ca430 0x7f59d00ca890 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f59d00ceec0 tx=0x7f59b8009bd0 comp rx=0 tx=0).stop 2023-09-13T08:26:22.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:22.538+0000 7f59d5afb700 1 -- 172.21.15.84:0/2951010084 shutdown_connections 2023-09-13T08:26:22.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:22.538+0000 7f59d5afb700 1 --2- 172.21.15.84:0/2951010084 >> v2:172.21.15.161:3300/0 conn(0x7f59d015b930 0x7f59d015bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:22.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:22.538+0000 7f59d5afb700 1 --2- 172.21.15.84:0/2951010084 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59d00ca430 0x7f59d00ca890 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:22.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:22.538+0000 7f59d5afb700 1 -- 172.21.15.84:0/2951010084 >> 172.21.15.84:0/2951010084 conn(0x7f59d00b0a20 msgr2=0x7f59d00b0e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:26:22.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:22.538+0000 7f59d5afb700 1 -- 172.21.15.84:0/2951010084 shutdown_connections 2023-09-13T08:26:22.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:22.538+0000 7f59d5afb700 1 -- 172.21.15.84:0/2951010084 wait complete. 2023-09-13T08:26:22.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:22.539+0000 7f59d5afb700 1 Processor -- start 2023-09-13T08:26:22.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:22.539+0000 7f59d5afb700 1 -- start start 2023-09-13T08:26:22.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:22.540+0000 7f59d5afb700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59d00ca430 0x7f59d01f0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:22.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:22.540+0000 7f59d5afb700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f59d0157c30 0x7f59d01f38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:22.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:22.540+0000 7f59d5afb700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f59d015b930 0x7f59d006c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:22.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:22.540+0000 7f59d5afb700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59d014fc60 con 0x7f59d00ca430 2023-09-13T08:26:22.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:22.540+0000 7f59d5afb700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59d00cd770 con 0x7f59d015b930 2023-09-13T08:26:22.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:22.540+0000 7f59d5afb700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59d01f3e30 con 0x7f59d0157c30 2023-09-13T08:26:22.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:22.540+0000 7f59cf7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59d00ca430 0x7f59d01f0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:22.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:22.540+0000 7f59cf7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59d00ca430 0x7f59d01f0430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46004/0 (socket says 172.21.15.84:46004) 2023-09-13T08:26:22.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:22.540+0000 7f59cf7fe700 1 -- 172.21.15.84:0/117673745 learned_addr learned my addr 172.21.15.84:0/117673745 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:26:22.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:22.540+0000 7f59ceffd700 1 --2- 172.21.15.84:0/117673745 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f59d0157c30 0x7f59d01f38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:22.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:22.540+0000 7f59cf7fe700 1 -- 172.21.15.84:0/117673745 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f59d0157c30 msgr2=0x7f59d01f38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:22.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:22.540+0000 7f59cf7fe700 1 --2- 172.21.15.84:0/117673745 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f59d0157c30 0x7f59d01f38f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:22.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:22.540+0000 7f59cf7fe700 1 -- 172.21.15.84:0/117673745 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f59d015b930 msgr2=0x7f59d006c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:22.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:22.540+0000 7f59cf7fe700 1 --2- 172.21.15.84:0/117673745 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f59d015b930 0x7f59d006c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:22.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:22.540+0000 7f59cf7fe700 1 -- 172.21.15.84:0/117673745 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59b8009550 con 0x7f59d00ca430 2023-09-13T08:26:22.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:22.540+0000 7f59cf7fe700 1 --2- 172.21.15.84:0/117673745 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59d00ca430 0x7f59d01f0430 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f59c000c4d0 tx=0x7f59c000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:26:22.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:22.541+0000 7f59c7fff700 1 -- 172.21.15.84:0/117673745 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c00054e0 con 0x7f59d00ca430 2023-09-13T08:26:22.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:22.541+0000 7f59c7fff700 1 -- 172.21.15.84:0/117673745 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59c0003680 con 0x7f59d00ca430 2023-09-13T08:26:22.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:22.541+0000 7f59d5afb700 1 -- 172.21.15.84:0/117673745 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59d00acda0 con 0x7f59d00ca430 2023-09-13T08:26:22.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:22.541+0000 7f59c7fff700 1 -- 172.21.15.84:0/117673745 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c0003a30 con 0x7f59d00ca430 2023-09-13T08:26:22.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:22.541+0000 7f59d5afb700 1 -- 172.21.15.84:0/117673745 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59d00ad360 con 0x7f59d00ca430 2023-09-13T08:26:22.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:22.542+0000 7f59d5afb700 1 -- 172.21.15.84:0/117673745 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59d004e9b0 con 0x7f59d00ca430 2023-09-13T08:26:22.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:22.542+0000 7f59c7fff700 1 -- 172.21.15.84:0/117673745 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f59c0003b90 con 0x7f59d00ca430 2023-09-13T08:26:22.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:22.542+0000 7f59c7fff700 1 --2- 172.21.15.84:0/117673745 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f59b006a580 0x7f59b006ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:22.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:22.543+0000 7f59c7fff700 1 -- 172.21.15.84:0/117673745 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f59c0088110 con 0x7f59d00ca430 2023-09-13T08:26:22.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:22.543+0000 7f59ceffd700 1 --2- 172.21.15.84:0/117673745 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f59b006a580 0x7f59b006ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:22.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:22.543+0000 7f59ceffd700 1 --2- 172.21.15.84:0/117673745 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f59b006a580 0x7f59b006ca40 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f59d006d5d0 tx=0x7f59b8008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:26:22.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:22.547+0000 7f59c7fff700 1 -- 172.21.15.84:0/117673745 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f59c0053540 con 0x7f59d00ca430 2023-09-13T08:26:22.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:22.841+0000 7f59d5afb700 1 -- 172.21.15.84:0/117673745 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f59d00b16c0 con 0x7f59d00ca430 2023-09-13T08:26:22.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:22.842+0000 7f59c7fff700 1 -- 172.21.15.84:0/117673745 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1276 (secure 0 0 0) 0x7f59c0017510 con 0x7f59d00ca430 2023-09-13T08:26:22.842 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:26:22.843 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":1,"fsid":"0107440b-b634-42c5-a643-5d31ea826116","modified":"2023-09-13T08:23:42.480417Z","created":"2023-09-13T08:23:42.480417Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:3300","nonce":0},{"type":"v1","addr":"172.21.15.84:6789","nonce":0}]},"addr":"172.21.15.84:6789/0","public_addr":"172.21.15.84:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:3300","nonce":0},{"type":"v1","addr":"172.21.15.161:6789","nonce":0}]},"addr":"172.21.15.161:6789/0","public_addr":"172.21.15.161:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:3301","nonce":0},{"type":"v1","addr":"172.21.15.161:6790","nonce":0}]},"addr":"172.21.15.161:6790/0","public_addr":"172.21.15.161:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-09-13T08:26:22.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:22.844+0000 7f59d5afb700 1 -- 172.21.15.84:0/117673745 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f59b006a580 msgr2=0x7f59b006ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:22.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:22.844+0000 7f59d5afb700 1 --2- 172.21.15.84:0/117673745 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f59b006a580 0x7f59b006ca40 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f59d006d5d0 tx=0x7f59b8008030 comp rx=0 tx=0).stop 2023-09-13T08:26:22.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:22.844+0000 7f59d5afb700 1 -- 172.21.15.84:0/117673745 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59d00ca430 msgr2=0x7f59d01f0430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:22.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:22.844+0000 7f59d5afb700 1 --2- 172.21.15.84:0/117673745 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59d00ca430 0x7f59d01f0430 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f59c000c4d0 tx=0x7f59c000c890 comp rx=0 tx=0).stop 2023-09-13T08:26:22.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:22.844+0000 7f59d5afb700 1 -- 172.21.15.84:0/117673745 shutdown_connections 2023-09-13T08:26:22.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:22.844+0000 7f59d5afb700 1 --2- 172.21.15.84:0/117673745 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f59b006a580 0x7f59b006ca40 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:22.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:22.844+0000 7f59d5afb700 1 --2- 172.21.15.84:0/117673745 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f59d015b930 0x7f59d006c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:22.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:22.844+0000 7f59d5afb700 1 --2- 172.21.15.84:0/117673745 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59d00ca430 0x7f59d01f0430 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:22.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:22.844+0000 7f59d5afb700 1 --2- 172.21.15.84:0/117673745 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f59d0157c30 0x7f59d01f38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:22.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:22.844+0000 7f59d5afb700 1 -- 172.21.15.84:0/117673745 >> 172.21.15.84:0/117673745 conn(0x7f59d00b0a20 msgr2=0x7f59d00aea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:26:22.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:22.844+0000 7f59d5afb700 1 -- 172.21.15.84:0/117673745 shutdown_connections 2023-09-13T08:26:22.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:22.844+0000 7f59d5afb700 1 -- 172.21.15.84:0/117673745 wait complete. 2023-09-13T08:26:22.847 INFO:teuthology.orchestra.run.smithi084.stderr:dumped monmap epoch 1 2023-09-13T08:26:22.857 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get-or-create client.admin 2023-09-13T08:26:23.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:23.001+0000 7f4269810700 1 Processor -- start 2023-09-13T08:26:23.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:23.001+0000 7f4269810700 1 -- start start 2023-09-13T08:26:23.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:23.002+0000 7f4269810700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f426406ee90 0x7f42641619b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:23.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:23.002+0000 7f4269810700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42640c5fc0 con 0x7f426415e2c0 2023-09-13T08:26:23.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:23.002+0000 7f4269810700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f426415b400 con 0x7f42640cda30 2023-09-13T08:26:23.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:23.002+0000 7f4269810700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4264161ef0 con 0x7f426406ee90 2023-09-13T08:26:23.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:23.002+0000 7f42637fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f426415e2c0 0x7f426406a620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:48662/0 (socket says 172.21.15.84:48662) 2023-09-13T08:26:23.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:23.002+0000 7f42637fe700 1 -- 172.21.15.84:0/2681231236 learned_addr learned my addr 172.21.15.84:0/2681231236 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T08:26:23.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:23.002+0000 7f42627fc700 1 --2- 172.21.15.84:0/2681231236 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f426406ee90 0x7f42641619b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:23.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:23.002+0000 7f4261ffb700 1 -- 172.21.15.84:0/2681231236 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3928406145 0 0) 0x7f42640c5fc0 con 0x7f426415e2c0 2023-09-13T08:26:23.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:23.002+0000 7f4261ffb700 1 -- 172.21.15.84:0/2681231236 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f424c0035b0 con 0x7f426415e2c0 2023-09-13T08:26:23.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:23.002+0000 7f4261ffb700 1 -- 172.21.15.84:0/2681231236 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1207879054 0 0) 0x7f424c0035b0 con 0x7f426415e2c0 2023-09-13T08:26:23.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:23.002+0000 7f4261ffb700 1 -- 172.21.15.84:0/2681231236 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f426406ee90 msgr2=0x7f42641619b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:26:23.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:23.002+0000 7f4261ffb700 1 --2- 172.21.15.84:0/2681231236 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f426406ee90 0x7f42641619b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:23.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:23.002+0000 7f4261ffb700 1 -- 172.21.15.84:0/2681231236 >> v1:172.21.15.161:6789/0 conn(0x7f42640cda30 legacy=0x7f42640cde10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:23.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:23.003+0000 7f4261ffb700 1 -- 172.21.15.84:0/2681231236 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f426406f310 con 0x7f426415e2c0 2023-09-13T08:26:23.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:23.003+0000 7f4261ffb700 1 -- 172.21.15.84:0/2681231236 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2302733408 0 0) 0x7f425c0019f0 con 0x7f426415e2c0 2023-09-13T08:26:23.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:23.003+0000 7f4261ffb700 1 -- 172.21.15.84:0/2681231236 >> v1:172.21.15.84:6789/0 conn(0x7f426415e2c0 legacy=0x7f426406a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:23.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:23.003+0000 7f4261ffb700 1 --2- 172.21.15.84:0/2681231236 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f424c003a30 0x7f424c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:23.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:23.003+0000 7f4261ffb700 1 --2- 172.21.15.84:0/2681231236 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f424c0043e0 0x7f424c0048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:23.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:23.003+0000 7f4261ffb700 1 --2- 172.21.15.84:0/2681231236 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f426406ee90 0x7f424c005110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:23.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:23.003+0000 7f4261ffb700 1 -- 172.21.15.84:0/2681231236 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f424c00ba10 con 0x7f424c0043e0 2023-09-13T08:26:23.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:23.003+0000 7f4261ffb700 1 -- 172.21.15.84:0/2681231236 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f424c00bb50 con 0x7f424c003a30 2023-09-13T08:26:23.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:23.003+0000 7f4261ffb700 1 -- 172.21.15.84:0/2681231236 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f424c00bd10 con 0x7f426406ee90 2023-09-13T08:26:23.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:23.003+0000 7f42627fc700 1 --2- 172.21.15.84:0/2681231236 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f424c0043e0 0x7f424c0048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:23.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:23.003+0000 7f4262ffd700 1 --2- 172.21.15.84:0/2681231236 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f424c003a30 0x7f424c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:23.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:23.003+0000 7f42637fe700 1 --2- 172.21.15.84:0/2681231236 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f426406ee90 0x7f424c005110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:23.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:23.003+0000 7f42627fc700 1 -- 172.21.15.84:0/2681231236 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f426406ee90 msgr2=0x7f424c005110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:26:23.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:23.003+0000 7f42627fc700 1 --2- 172.21.15.84:0/2681231236 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f426406ee90 0x7f424c005110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:23.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:23.003+0000 7f42627fc700 1 -- 172.21.15.84:0/2681231236 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f424c003a30 msgr2=0x7f424c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T08:26:23.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:23.003+0000 7f42627fc700 1 --2- 172.21.15.84:0/2681231236 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f424c003a30 0x7f424c003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:23.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:23.003+0000 7f42627fc700 1 -- 172.21.15.84:0/2681231236 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f424c0035b0 con 0x7f424c0043e0 2023-09-13T08:26:23.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:23.003+0000 7f42627fc700 1 --2- 172.21.15.84:0/2681231236 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f424c0043e0 0x7f424c0048b0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f4258009b60 tx=0x7f424c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61aba5049110ad3b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:26:23.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:23.003+0000 7f4261ffb700 1 -- 172.21.15.84:0/2681231236 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f425800e6c0 con 0x7f424c0043e0 2023-09-13T08:26:23.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:23.003+0000 7f4261ffb700 1 -- 172.21.15.84:0/2681231236 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f425800e820 con 0x7f424c0043e0 2023-09-13T08:26:23.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:23.003+0000 7f4261ffb700 1 -- 172.21.15.84:0/2681231236 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f425800eb90 con 0x7f424c0043e0 2023-09-13T08:26:23.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:23.004+0000 7f4269810700 1 -- 172.21.15.84:0/2681231236 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f424c0043e0 msgr2=0x7f424c0048b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:23.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:23.004+0000 7f4269810700 1 --2- 172.21.15.84:0/2681231236 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f424c0043e0 0x7f424c0048b0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f4258009b60 tx=0x7f424c005880 comp rx=0 tx=0).stop 2023-09-13T08:26:23.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:23.004+0000 7f42637fe700 1 -- 172.21.15.84:0/2681231236 reap_dead start 2023-09-13T08:26:23.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:23.004+0000 7f4269810700 1 -- 172.21.15.84:0/2681231236 shutdown_connections 2023-09-13T08:26:23.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:23.004+0000 7f4269810700 1 -- 172.21.15.84:0/2681231236 >> 172.21.15.84:0/2681231236 conn(0x7f42640cc210 msgr2=0x7f42640cc620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:26:23.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:23.004+0000 7f4269810700 1 -- 172.21.15.84:0/2681231236 shutdown_connections 2023-09-13T08:26:23.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:23.004+0000 7f4269810700 1 -- 172.21.15.84:0/2681231236 wait complete. 2023-09-13T08:26:23.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:23.005+0000 7f4269810700 1 Processor -- start 2023-09-13T08:26:23.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:23.006+0000 7f4269810700 1 -- start start 2023-09-13T08:26:23.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:23.007+0000 7f4269810700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f424c0043e0 0x7f426414b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:23.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:23.007+0000 7f4269810700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f426414b040 0x7f426415f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:23.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:23.007+0000 7f4269810700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f426415f5b0 0x7f42641f2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:23.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:23.007+0000 7f4269810700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f426415fa60 con 0x7f426415f5b0 2023-09-13T08:26:23.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:23.007+0000 7f4269810700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f426414b9e0 con 0x7f424c0043e0 2023-09-13T08:26:23.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:23.007+0000 7f4269810700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f426406e1c0 con 0x7f426414b040 2023-09-13T08:26:23.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:23.007+0000 7f42637fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f426415f5b0 0x7f42641f2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:23.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:23.007+0000 7f42637fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f426415f5b0 0x7f42641f2680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46028/0 (socket says 172.21.15.84:46028) 2023-09-13T08:26:23.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:23.007+0000 7f42637fe700 1 -- 172.21.15.84:0/1386219237 learned_addr learned my addr 172.21.15.84:0/1386219237 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T08:26:23.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:23.007+0000 7f42627fc700 1 --2- 172.21.15.84:0/1386219237 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f426414b040 0x7f426415f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:23.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:23.007+0000 7f4262ffd700 1 --2- 172.21.15.84:0/1386219237 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f424c0043e0 0x7f426414b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:23.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:23.007+0000 7f42637fe700 1 -- 172.21.15.84:0/1386219237 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f426414b040 msgr2=0x7f426415f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:23.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:23.007+0000 7f42637fe700 1 --2- 172.21.15.84:0/1386219237 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f426414b040 0x7f426415f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:23.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:23.007+0000 7f42637fe700 1 -- 172.21.15.84:0/1386219237 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f424c0043e0 msgr2=0x7f426414b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:23.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:23.007+0000 7f42637fe700 1 --2- 172.21.15.84:0/1386219237 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f424c0043e0 0x7f426414b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:23.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:23.007+0000 7f42637fe700 1 -- 172.21.15.84:0/1386219237 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f426406e4a0 con 0x7f426415f5b0 2023-09-13T08:26:23.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:23.007+0000 7f42637fe700 1 --2- 172.21.15.84:0/1386219237 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f426415f5b0 0x7f42641f2680 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f42640af2a0 tx=0x7f425c00a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:26:23.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:23.007+0000 7f424bfff700 1 -- 172.21.15.84:0/1386219237 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f425c00ad60 con 0x7f426415f5b0 2023-09-13T08:26:23.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:23.007+0000 7f424bfff700 1 -- 172.21.15.84:0/1386219237 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f425c0133f0 con 0x7f426415f5b0 2023-09-13T08:26:23.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:23.007+0000 7f4269810700 1 -- 172.21.15.84:0/1386219237 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f426406e780 con 0x7f426415f5b0 2023-09-13T08:26:23.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:23.007+0000 7f424bfff700 1 -- 172.21.15.84:0/1386219237 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f425c0137a0 con 0x7f426415f5b0 2023-09-13T08:26:23.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:23.007+0000 7f4269810700 1 -- 172.21.15.84:0/1386219237 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f426406ce30 con 0x7f426415f5b0 2023-09-13T08:26:23.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:23.008+0000 7f4269810700 1 -- 172.21.15.84:0/1386219237 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f426404e9b0 con 0x7f426415f5b0 2023-09-13T08:26:23.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:23.009+0000 7f424bfff700 1 -- 172.21.15.84:0/1386219237 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f425c013900 con 0x7f426415f5b0 2023-09-13T08:26:23.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:23.009+0000 7f424bfff700 1 --2- 172.21.15.84:0/1386219237 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f425006a580 0x7f425006ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T08:26:23.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:23.010+0000 7f424bfff700 1 -- 172.21.15.84:0/1386219237 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f425c089e00 con 0x7f426415f5b0 2023-09-13T08:26:23.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:23.010+0000 7f4262ffd700 1 --2- 172.21.15.84:0/1386219237 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f425006a580 0x7f425006ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T08:26:23.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:23.010+0000 7f4262ffd700 1 --2- 172.21.15.84:0/1386219237 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f425006a580 0x7f425006ca40 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f4254000c00 tx=0x7f4254009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T08:26:23.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:23.014+0000 7f424bfff700 1 -- 172.21.15.84:0/1386219237 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f425c055460 con 0x7f426415f5b0 2023-09-13T08:26:23.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:23.284+0000 7f4269810700 1 -- 172.21.15.84:0/1386219237 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.admin"} v 0) v1 -- 0x7f426406d1b0 con 0x7f426415f5b0 2023-09-13T08:26:23.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:23.284+0000 7f424bfff700 1 -- 172.21.15.84:0/1386219237 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.admin"}]=0 v11) v1 ==== 92+0+63 (secure 0 0 0) 0x7f425c058a80 con 0x7f426415f5b0 2023-09-13T08:26:23.285 INFO:teuthology.orchestra.run.smithi084.stdout:[client.admin] 2023-09-13T08:26:23.286 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== 2023-09-13T08:26:23.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:23.286+0000 7f4269810700 1 -- 172.21.15.84:0/1386219237 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f425006a580 msgr2=0x7f425006ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:23.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:23.286+0000 7f4269810700 1 --2- 172.21.15.84:0/1386219237 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f425006a580 0x7f425006ca40 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f4254000c00 tx=0x7f4254009040 comp rx=0 tx=0).stop 2023-09-13T08:26:23.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:23.286+0000 7f4269810700 1 -- 172.21.15.84:0/1386219237 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f426415f5b0 msgr2=0x7f42641f2680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T08:26:23.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:23.286+0000 7f4269810700 1 --2- 172.21.15.84:0/1386219237 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f426415f5b0 0x7f42641f2680 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f42640af2a0 tx=0x7f425c00a640 comp rx=0 tx=0).stop 2023-09-13T08:26:23.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:23.286+0000 7f4269810700 1 -- 172.21.15.84:0/1386219237 shutdown_connections 2023-09-13T08:26:23.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:23.286+0000 7f4269810700 1 --2- 172.21.15.84:0/1386219237 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f426415f5b0 0x7f42641f2680 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:23.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:23.286+0000 7f4269810700 1 --2- 172.21.15.84:0/1386219237 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f425006a580 0x7f425006ca40 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:23.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:23.287+0000 7f4269810700 1 --2- 172.21.15.84:0/1386219237 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f424c0043e0 0x7f426414b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:23.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:23.287+0000 7f4269810700 1 --2- 172.21.15.84:0/1386219237 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f426414b040 0x7f426415f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T08:26:23.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:23.287+0000 7f4269810700 1 -- 172.21.15.84:0/1386219237 >> 172.21.15.84:0/1386219237 conn(0x7f42640cc210 msgr2=0x7f4264158d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T08:26:23.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:23.287+0000 7f4269810700 1 -- 172.21.15.84:0/1386219237 shutdown_connections 2023-09-13T08:26:23.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T08:26:23.287+0000 7f4269810700 1 -- 172.21.15.84:0/1386219237 wait complete. 2023-09-13T08:26:23.299 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-09-13T08:26:23.300 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/tmp/tmp.UxTBQ6XIL3xfstests-dev/local.config 2023-09-13T08:26:23.338 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph export TEST_DEV=172.21.15.84:6789:/test export TEST_DIR=/tmp/tmp.ocaSSGQzPctest export SCRATCH_DEV=172.21.15.84:6789:/scratch export SCRATCH_MNT=/tmp/tmp.QSV7Ot1KO9scratch export CEPHFS_MOUNT_OPTIONS="-o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q==" 2023-09-13T08:26:23.339 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-09-13T08:26:23.339 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/tmp/tmp.UxTBQ6XIL3xfstests-dev/ceph.exclude 2023-09-13T08:26:23.404 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo make) 2023-09-13T08:26:23.489 INFO:teuthology.orchestra.run.smithi084.stdout:libtoolize -cfi 2023-09-13T08:26:23.807 INFO:teuthology.orchestra.run.smithi084.stdout:libtoolize: putting auxiliary files in '.'. 2023-09-13T08:26:23.808 INFO:teuthology.orchestra.run.smithi084.stdout:libtoolize: copying file './config.guess' 2023-09-13T08:26:23.811 INFO:teuthology.orchestra.run.smithi084.stdout:libtoolize: copying file './config.sub' 2023-09-13T08:26:23.814 INFO:teuthology.orchestra.run.smithi084.stdout:libtoolize: copying file './install-sh' 2023-09-13T08:26:23.818 INFO:teuthology.orchestra.run.smithi084.stdout:libtoolize: copying file './ltmain.sh' 2023-09-13T08:26:23.838 INFO:teuthology.orchestra.run.smithi084.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-09-13T08:26:23.838 INFO:teuthology.orchestra.run.smithi084.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-09-13T08:26:23.842 INFO:teuthology.orchestra.run.smithi084.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-09-13T08:26:23.846 INFO:teuthology.orchestra.run.smithi084.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-09-13T08:26:23.851 INFO:teuthology.orchestra.run.smithi084.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-09-13T08:26:23.855 INFO:teuthology.orchestra.run.smithi084.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-09-13T08:26:23.860 INFO:teuthology.orchestra.run.smithi084.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-09-13T08:26:23.861 INFO:teuthology.orchestra.run.smithi084.stdout:cp include/install-sh . 2023-09-13T08:26:23.862 INFO:teuthology.orchestra.run.smithi084.stdout:aclocal -I m4 2023-09-13T08:26:25.014 INFO:teuthology.orchestra.run.smithi084.stdout:autoheader 2023-09-13T08:26:25.322 INFO:teuthology.orchestra.run.smithi084.stdout:autoconf 2023-09-13T08:26:25.482 INFO:teuthology.orchestra.run.smithi084.stdout:./configure \ 2023-09-13T08:26:25.483 INFO:teuthology.orchestra.run.smithi084.stdout: --libexecdir=/usr/lib \ 2023-09-13T08:26:25.483 INFO:teuthology.orchestra.run.smithi084.stdout: --exec_prefix=/var/lib 2023-09-13T08:26:25.930 INFO:teuthology.orchestra.run.smithi084.stdout:checking build system type... x86_64-pc-linux-gnu 2023-09-13T08:26:25.930 INFO:teuthology.orchestra.run.smithi084.stdout:checking host system type... x86_64-pc-linux-gnu 2023-09-13T08:26:25.931 INFO:teuthology.orchestra.run.smithi084.stdout:checking how to print strings... printf 2023-09-13T08:26:25.932 INFO:teuthology.orchestra.run.smithi084.stdout:checking for gcc... gcc 2023-09-13T08:26:26.045 INFO:teuthology.orchestra.run.smithi084.stdout:checking whether the C compiler works... yes 2023-09-13T08:26:26.046 INFO:teuthology.orchestra.run.smithi084.stdout:checking for C compiler default output file name... a.out 2023-09-13T08:26:26.072 INFO:teuthology.orchestra.run.smithi084.stdout:checking for suffix of executables... 2023-09-13T08:26:26.135 INFO:teuthology.orchestra.run.smithi084.stdout:checking whether we are cross compiling... no 2023-09-13T08:26:26.152 INFO:teuthology.orchestra.run.smithi084.stdout:checking for suffix of object files... o 2023-09-13T08:26:26.168 INFO:teuthology.orchestra.run.smithi084.stdout:checking whether we are using the GNU C compiler... yes 2023-09-13T08:26:26.184 INFO:teuthology.orchestra.run.smithi084.stdout:checking whether gcc accepts -g... yes 2023-09-13T08:26:26.210 INFO:teuthology.orchestra.run.smithi084.stdout:checking for gcc option to accept ISO C89... none needed 2023-09-13T08:26:26.212 INFO:teuthology.orchestra.run.smithi084.stdout:checking for a sed that does not truncate output... /bin/sed 2023-09-13T08:26:26.214 INFO:teuthology.orchestra.run.smithi084.stdout:checking for grep that handles long lines and -e... /bin/grep 2023-09-13T08:26:26.216 INFO:teuthology.orchestra.run.smithi084.stdout:checking for egrep... /bin/grep -E 2023-09-13T08:26:26.217 INFO:teuthology.orchestra.run.smithi084.stdout:checking for fgrep... /bin/grep -F 2023-09-13T08:26:26.220 INFO:teuthology.orchestra.run.smithi084.stdout:checking for ld used by gcc... /bin/ld 2023-09-13T08:26:26.221 INFO:teuthology.orchestra.run.smithi084.stdout:checking if the linker (/bin/ld) is GNU ld... yes 2023-09-13T08:26:26.225 INFO:teuthology.orchestra.run.smithi084.stdout:checking for BSD- or MS-compatible name lister (nm)... /bin/nm -B 2023-09-13T08:26:26.241 INFO:teuthology.orchestra.run.smithi084.stdout:checking the name lister (/bin/nm -B) interface... BSD nm 2023-09-13T08:26:26.241 INFO:teuthology.orchestra.run.smithi084.stdout:checking whether ln -s works... yes 2023-09-13T08:26:26.251 INFO:teuthology.orchestra.run.smithi084.stdout:checking the maximum length of command line arguments... 1572864 2023-09-13T08:26:26.253 INFO:teuthology.orchestra.run.smithi084.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-09-13T08:26:26.253 INFO:teuthology.orchestra.run.smithi084.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-09-13T08:26:26.253 INFO:teuthology.orchestra.run.smithi084.stdout:checking for /bin/ld option to reload object files... -r 2023-09-13T08:26:26.254 INFO:teuthology.orchestra.run.smithi084.stdout:checking for objdump... objdump 2023-09-13T08:26:26.255 INFO:teuthology.orchestra.run.smithi084.stdout:checking how to recognize dependent libraries... pass_all 2023-09-13T08:26:26.255 INFO:teuthology.orchestra.run.smithi084.stdout:checking for dlltool... no 2023-09-13T08:26:26.255 INFO:teuthology.orchestra.run.smithi084.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-09-13T08:26:26.255 INFO:teuthology.orchestra.run.smithi084.stdout:checking for ar... ar 2023-09-13T08:26:26.279 INFO:teuthology.orchestra.run.smithi084.stdout:checking for archiver @FILE support... @ 2023-09-13T08:26:26.279 INFO:teuthology.orchestra.run.smithi084.stdout:checking for strip... strip 2023-09-13T08:26:26.279 INFO:teuthology.orchestra.run.smithi084.stdout:checking for ranlib... ranlib 2023-09-13T08:26:26.280 INFO:teuthology.orchestra.run.smithi084.stdout:checking for gawk... gawk 2023-09-13T08:26:26.329 INFO:teuthology.orchestra.run.smithi084.stdout:checking command to parse /bin/nm -B output from gcc object... ok 2023-09-13T08:26:26.330 INFO:teuthology.orchestra.run.smithi084.stdout:checking for sysroot... no 2023-09-13T08:26:26.332 INFO:teuthology.orchestra.run.smithi084.stdout:checking for a working dd... /bin/dd 2023-09-13T08:26:26.335 INFO:teuthology.orchestra.run.smithi084.stdout:checking how to truncate binary pipes... /bin/dd bs=4096 count=1 2023-09-13T08:26:26.348 INFO:teuthology.orchestra.run.smithi084.stdout:checking for mt... no 2023-09-13T08:26:26.349 INFO:teuthology.orchestra.run.smithi084.stdout:checking if : is a manifest tool... no 2023-09-13T08:26:26.382 INFO:teuthology.orchestra.run.smithi084.stdout:checking how to run the C preprocessor... gcc -E 2023-09-13T08:26:26.496 INFO:teuthology.orchestra.run.smithi084.stdout:checking for ANSI C header files... yes 2023-09-13T08:26:26.516 INFO:teuthology.orchestra.run.smithi084.stdout:checking for sys/types.h... yes 2023-09-13T08:26:26.538 INFO:teuthology.orchestra.run.smithi084.stdout:checking for sys/stat.h... yes 2023-09-13T08:26:26.561 INFO:teuthology.orchestra.run.smithi084.stdout:checking for stdlib.h... yes 2023-09-13T08:26:26.584 INFO:teuthology.orchestra.run.smithi084.stdout:checking for string.h... yes 2023-09-13T08:26:26.608 INFO:teuthology.orchestra.run.smithi084.stdout:checking for memory.h... yes 2023-09-13T08:26:26.631 INFO:teuthology.orchestra.run.smithi084.stdout:checking for strings.h... yes 2023-09-13T08:26:26.657 INFO:teuthology.orchestra.run.smithi084.stdout:checking for inttypes.h... yes 2023-09-13T08:26:26.681 INFO:teuthology.orchestra.run.smithi084.stdout:checking for stdint.h... yes 2023-09-13T08:26:26.709 INFO:teuthology.orchestra.run.smithi084.stdout:checking for unistd.h... yes 2023-09-13T08:26:26.743 INFO:teuthology.orchestra.run.smithi084.stdout:checking for dlfcn.h... yes 2023-09-13T08:26:26.746 INFO:teuthology.orchestra.run.smithi084.stdout:checking for objdir... .libs 2023-09-13T08:26:26.810 INFO:teuthology.orchestra.run.smithi084.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-09-13T08:26:26.811 INFO:teuthology.orchestra.run.smithi084.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-09-13T08:26:26.825 INFO:teuthology.orchestra.run.smithi084.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-09-13T08:26:26.844 INFO:teuthology.orchestra.run.smithi084.stdout:checking if gcc static flag -static works... no 2023-09-13T08:26:26.864 INFO:teuthology.orchestra.run.smithi084.stdout:checking if gcc supports -c -o file.o... yes 2023-09-13T08:26:26.864 INFO:teuthology.orchestra.run.smithi084.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-09-13T08:26:26.870 INFO:teuthology.orchestra.run.smithi084.stdout:checking whether the gcc linker (/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-09-13T08:26:26.893 INFO:teuthology.orchestra.run.smithi084.stdout:checking whether -lc should be explicitly linked in... no 2023-09-13T08:26:26.935 INFO:teuthology.orchestra.run.smithi084.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-09-13T08:26:26.936 INFO:teuthology.orchestra.run.smithi084.stdout:checking how to hardcode library paths into programs... immediate 2023-09-13T08:26:26.945 INFO:teuthology.orchestra.run.smithi084.stdout:checking whether stripping libraries is possible... yes 2023-09-13T08:26:26.945 INFO:teuthology.orchestra.run.smithi084.stdout:checking if libtool supports shared libraries... yes 2023-09-13T08:26:26.946 INFO:teuthology.orchestra.run.smithi084.stdout:checking whether to build shared libraries... yes 2023-09-13T08:26:26.946 INFO:teuthology.orchestra.run.smithi084.stdout:checking whether to build static libraries... yes 2023-09-13T08:26:26.949 INFO:teuthology.orchestra.run.smithi084.stdout:checking for gcc... (cached) gcc 2023-09-13T08:26:26.965 INFO:teuthology.orchestra.run.smithi084.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-09-13T08:26:26.965 INFO:teuthology.orchestra.run.smithi084.stdout:checking whether gcc accepts -g... (cached) yes 2023-09-13T08:26:26.965 INFO:teuthology.orchestra.run.smithi084.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-09-13T08:26:26.966 INFO:teuthology.orchestra.run.smithi084.stdout:checking for gmake... /usr/bin/gmake 2023-09-13T08:26:26.966 INFO:teuthology.orchestra.run.smithi084.stderr:./configure: line 12070: test: $(SHELL): binary operator expected 2023-09-13T08:26:26.967 INFO:teuthology.orchestra.run.smithi084.stdout:checking for tar... /bin/tar 2023-09-13T08:26:26.967 INFO:teuthology.orchestra.run.smithi084.stdout:checking for gzip... /bin/gzip 2023-09-13T08:26:26.972 INFO:teuthology.orchestra.run.smithi084.stdout:checking whether gcc -MM is supported... yes 2023-09-13T08:26:26.973 INFO:teuthology.orchestra.run.smithi084.stdout:checking for sort... /bin/sort 2023-09-13T08:26:26.973 INFO:teuthology.orchestra.run.smithi084.stdout:checking whether ln -s works... yes 2023-09-13T08:26:26.973 INFO:teuthology.orchestra.run.smithi084.stdout:checking for rpm... /bin/rpm 2023-09-13T08:26:26.977 INFO:teuthology.orchestra.run.smithi084.stdout:checking for rpmbuild... no 2023-09-13T08:26:27.002 INFO:teuthology.orchestra.run.smithi084.stdout:checking assert.h usability... yes 2023-09-13T08:26:27.008 INFO:teuthology.orchestra.run.smithi084.stdout:checking assert.h presence... yes 2023-09-13T08:26:27.008 INFO:teuthology.orchestra.run.smithi084.stdout:checking for assert.h... yes 2023-09-13T08:26:27.033 INFO:teuthology.orchestra.run.smithi084.stdout:checking bstring.h usability... no 2023-09-13T08:26:27.042 INFO:teuthology.orchestra.run.smithi084.stdout:checking bstring.h presence... no 2023-09-13T08:26:27.043 INFO:teuthology.orchestra.run.smithi084.stdout:checking for bstring.h... no 2023-09-13T08:26:27.066 INFO:teuthology.orchestra.run.smithi084.stdout:checking libgen.h usability... yes 2023-09-13T08:26:27.072 INFO:teuthology.orchestra.run.smithi084.stdout:checking libgen.h presence... yes 2023-09-13T08:26:27.073 INFO:teuthology.orchestra.run.smithi084.stdout:checking for libgen.h... yes 2023-09-13T08:26:27.101 INFO:teuthology.orchestra.run.smithi084.stdout:checking dirent.h usability... yes 2023-09-13T08:26:27.107 INFO:teuthology.orchestra.run.smithi084.stdout:checking dirent.h presence... yes 2023-09-13T08:26:27.107 INFO:teuthology.orchestra.run.smithi084.stdout:checking for dirent.h... yes 2023-09-13T08:26:27.159 INFO:teuthology.orchestra.run.smithi084.stdout:checking errno.h usability... yes 2023-09-13T08:26:27.166 INFO:teuthology.orchestra.run.smithi084.stdout:checking errno.h presence... yes 2023-09-13T08:26:27.166 INFO:teuthology.orchestra.run.smithi084.stdout:checking for errno.h... yes 2023-09-13T08:26:27.193 INFO:teuthology.orchestra.run.smithi084.stdout:checking malloc.h usability... yes 2023-09-13T08:26:27.201 INFO:teuthology.orchestra.run.smithi084.stdout:checking malloc.h presence... yes 2023-09-13T08:26:27.201 INFO:teuthology.orchestra.run.smithi084.stdout:checking for malloc.h... yes 2023-09-13T08:26:27.226 INFO:teuthology.orchestra.run.smithi084.stdout:checking uuid.h usability... no 2023-09-13T08:26:27.235 INFO:teuthology.orchestra.run.smithi084.stdout:checking uuid.h presence... no 2023-09-13T08:26:27.235 INFO:teuthology.orchestra.run.smithi084.stdout:checking for uuid.h... no 2023-09-13T08:26:27.261 INFO:teuthology.orchestra.run.smithi084.stdout:checking uuid/uuid.h usability... yes 2023-09-13T08:26:27.269 INFO:teuthology.orchestra.run.smithi084.stdout:checking uuid/uuid.h presence... yes 2023-09-13T08:26:27.269 INFO:teuthology.orchestra.run.smithi084.stdout:checking for uuid/uuid.h... yes 2023-09-13T08:26:27.294 INFO:teuthology.orchestra.run.smithi084.stdout:checking sys/uuid.h usability... no 2023-09-13T08:26:27.303 INFO:teuthology.orchestra.run.smithi084.stdout:checking sys/uuid.h presence... no 2023-09-13T08:26:27.303 INFO:teuthology.orchestra.run.smithi084.stdout:checking for sys/uuid.h... no 2023-09-13T08:26:27.328 INFO:teuthology.orchestra.run.smithi084.stdout:checking sys/file.h usability... yes 2023-09-13T08:26:27.335 INFO:teuthology.orchestra.run.smithi084.stdout:checking sys/file.h presence... yes 2023-09-13T08:26:27.335 INFO:teuthology.orchestra.run.smithi084.stdout:checking for sys/file.h... yes 2023-09-13T08:26:27.361 INFO:teuthology.orchestra.run.smithi084.stdout:checking sys/fcntl.h usability... yes 2023-09-13T08:26:27.369 INFO:teuthology.orchestra.run.smithi084.stdout:checking sys/fcntl.h presence... yes 2023-09-13T08:26:27.369 INFO:teuthology.orchestra.run.smithi084.stdout:checking for sys/fcntl.h... yes 2023-09-13T08:26:27.394 INFO:teuthology.orchestra.run.smithi084.stdout:checking sys/syssgi.h usability... no 2023-09-13T08:26:27.402 INFO:teuthology.orchestra.run.smithi084.stdout:checking sys/syssgi.h presence... no 2023-09-13T08:26:27.403 INFO:teuthology.orchestra.run.smithi084.stdout:checking for sys/syssgi.h... no 2023-09-13T08:26:27.444 INFO:teuthology.orchestra.run.smithi084.stdout:checking sys/param.h usability... yes 2023-09-13T08:26:27.453 INFO:teuthology.orchestra.run.smithi084.stdout:checking sys/param.h presence... yes 2023-09-13T08:26:27.454 INFO:teuthology.orchestra.run.smithi084.stdout:checking for sys/param.h... yes 2023-09-13T08:26:27.458 INFO:teuthology.orchestra.run.smithi084.stdout:checking for sys/stat.h... (cached) yes 2023-09-13T08:26:27.485 INFO:teuthology.orchestra.run.smithi084.stdout:checking sys/statvfs.h usability... yes 2023-09-13T08:26:27.491 INFO:teuthology.orchestra.run.smithi084.stdout:checking sys/statvfs.h presence... yes 2023-09-13T08:26:27.492 INFO:teuthology.orchestra.run.smithi084.stdout:checking for sys/statvfs.h... yes 2023-09-13T08:26:27.517 INFO:teuthology.orchestra.run.smithi084.stdout:checking sys/time.h usability... yes 2023-09-13T08:26:27.524 INFO:teuthology.orchestra.run.smithi084.stdout:checking sys/time.h presence... yes 2023-09-13T08:26:27.524 INFO:teuthology.orchestra.run.smithi084.stdout:checking for sys/time.h... yes 2023-09-13T08:26:27.552 INFO:teuthology.orchestra.run.smithi084.stdout:checking sys/ioctl.h usability... yes 2023-09-13T08:26:27.560 INFO:teuthology.orchestra.run.smithi084.stdout:checking sys/ioctl.h presence... yes 2023-09-13T08:26:27.560 INFO:teuthology.orchestra.run.smithi084.stdout:checking for sys/ioctl.h... yes 2023-09-13T08:26:27.588 INFO:teuthology.orchestra.run.smithi084.stdout:checking sys/wait.h usability... yes 2023-09-13T08:26:27.596 INFO:teuthology.orchestra.run.smithi084.stdout:checking sys/wait.h presence... yes 2023-09-13T08:26:27.596 INFO:teuthology.orchestra.run.smithi084.stdout:checking for sys/wait.h... yes 2023-09-13T08:26:27.601 INFO:teuthology.orchestra.run.smithi084.stdout:checking for sys/types.h... (cached) yes 2023-09-13T08:26:27.606 INFO:teuthology.orchestra.run.smithi084.stdout:checking for strings.h... (cached) yes 2023-09-13T08:26:27.632 INFO:teuthology.orchestra.run.smithi084.stdout:checking err.h usability... yes 2023-09-13T08:26:27.639 INFO:teuthology.orchestra.run.smithi084.stdout:checking err.h presence... yes 2023-09-13T08:26:27.639 INFO:teuthology.orchestra.run.smithi084.stdout:checking for err.h... yes 2023-09-13T08:26:27.665 INFO:teuthology.orchestra.run.smithi084.stdout:checking linux/falloc.h usability... yes 2023-09-13T08:26:27.671 INFO:teuthology.orchestra.run.smithi084.stdout:checking linux/falloc.h presence... yes 2023-09-13T08:26:27.671 INFO:teuthology.orchestra.run.smithi084.stdout:checking for linux/falloc.h... yes 2023-09-13T08:26:27.697 INFO:teuthology.orchestra.run.smithi084.stdout:checking sys/fs/xfs_fsops.h usability... no 2023-09-13T08:26:27.706 INFO:teuthology.orchestra.run.smithi084.stdout:checking sys/fs/xfs_fsops.h presence... no 2023-09-13T08:26:27.706 INFO:teuthology.orchestra.run.smithi084.stdout:checking for sys/fs/xfs_fsops.h... no 2023-09-13T08:26:27.728 INFO:teuthology.orchestra.run.smithi084.stdout:checking sys/fs/xfs_itable.h usability... no 2023-09-13T08:26:27.737 INFO:teuthology.orchestra.run.smithi084.stdout:checking sys/fs/xfs_itable.h presence... no 2023-09-13T08:26:27.738 INFO:teuthology.orchestra.run.smithi084.stdout:checking for sys/fs/xfs_itable.h... no 2023-09-13T08:26:27.760 INFO:teuthology.orchestra.run.smithi084.stdout:checking xfs/platform_defs.h usability... no 2023-09-13T08:26:27.769 INFO:teuthology.orchestra.run.smithi084.stdout:checking xfs/platform_defs.h presence... no 2023-09-13T08:26:27.770 INFO:teuthology.orchestra.run.smithi084.stdout:checking for xfs/platform_defs.h... no 2023-09-13T08:26:27.792 INFO:teuthology.orchestra.run.smithi084.stdout:checking btrfs/ioctl.h usability... no 2023-09-13T08:26:27.801 INFO:teuthology.orchestra.run.smithi084.stdout:checking btrfs/ioctl.h presence... no 2023-09-13T08:26:27.801 INFO:teuthology.orchestra.run.smithi084.stdout:checking for btrfs/ioctl.h... no 2023-09-13T08:26:27.823 INFO:teuthology.orchestra.run.smithi084.stdout:checking cifs/ioctl.h usability... no 2023-09-13T08:26:27.832 INFO:teuthology.orchestra.run.smithi084.stdout:checking cifs/ioctl.h presence... no 2023-09-13T08:26:27.833 INFO:teuthology.orchestra.run.smithi084.stdout:checking for cifs/ioctl.h... no 2023-09-13T08:26:27.871 INFO:teuthology.orchestra.run.smithi084.stdout:checking sys/mman.h usability... yes 2023-09-13T08:26:27.878 INFO:teuthology.orchestra.run.smithi084.stdout:checking sys/mman.h presence... yes 2023-09-13T08:26:27.879 INFO:teuthology.orchestra.run.smithi084.stdout:checking for sys/mman.h... yes 2023-09-13T08:26:27.941 INFO:teuthology.orchestra.run.smithi084.stdout:checking for xfs/xfs_log_format.h... no 2023-09-13T08:26:28.009 INFO:teuthology.orchestra.run.smithi084.stdout:checking for uuid_compare... no 2023-09-13T08:26:28.038 INFO:teuthology.orchestra.run.smithi084.stdout:checking for uuid_compare in -luuid... yes 2023-09-13T08:26:28.096 INFO:teuthology.orchestra.run.smithi084.stdout:checking for xfs/xfs.h... yes 2023-09-13T08:26:28.108 INFO:teuthology.orchestra.run.smithi084.stdout:checking for xfs/libxfs.h... no 2023-09-13T08:26:28.123 INFO:teuthology.orchestra.run.smithi084.stdout:checking whether xlog_assign_lsn is declared... no 2023-09-13T08:26:28.150 INFO:teuthology.orchestra.run.smithi084.stdout:checking for xfs/xqm.h... yes 2023-09-13T08:26:28.193 INFO:teuthology.orchestra.run.smithi084.stdout:checking xfsctl from xfs/xfs.h... ok 2023-09-13T08:26:28.215 INFO:teuthology.orchestra.run.smithi084.stdout:checking xfs/handle.h usability... yes 2023-09-13T08:26:28.221 INFO:teuthology.orchestra.run.smithi084.stdout:checking xfs/handle.h presence... yes 2023-09-13T08:26:28.222 INFO:teuthology.orchestra.run.smithi084.stdout:checking for xfs/handle.h... yes 2023-09-13T08:26:28.267 INFO:teuthology.orchestra.run.smithi084.stdout:checking for attr_list_by_handle in -lhandle... yes 2023-09-13T08:26:28.304 INFO:teuthology.orchestra.run.smithi084.stdout:checking sys/acl.h usability... yes 2023-09-13T08:26:28.311 INFO:teuthology.orchestra.run.smithi084.stdout:checking sys/acl.h presence... yes 2023-09-13T08:26:28.312 INFO:teuthology.orchestra.run.smithi084.stdout:checking for sys/acl.h... yes 2023-09-13T08:26:28.340 INFO:teuthology.orchestra.run.smithi084.stdout:checking acl/libacl.h usability... yes 2023-09-13T08:26:28.347 INFO:teuthology.orchestra.run.smithi084.stdout:checking acl/libacl.h presence... yes 2023-09-13T08:26:28.347 INFO:teuthology.orchestra.run.smithi084.stdout:checking for acl/libacl.h... yes 2023-09-13T08:26:28.378 INFO:teuthology.orchestra.run.smithi084.stdout:checking for acl_init in -lacl... yes 2023-09-13T08:26:28.400 INFO:teuthology.orchestra.run.smithi084.stdout:checking gdbm-ndbm.h usability... no 2023-09-13T08:26:28.409 INFO:teuthology.orchestra.run.smithi084.stdout:checking gdbm-ndbm.h presence... no 2023-09-13T08:26:28.409 INFO:teuthology.orchestra.run.smithi084.stdout:checking for gdbm-ndbm.h... no 2023-09-13T08:26:28.430 INFO:teuthology.orchestra.run.smithi084.stdout:checking gdbm/ndbm.h usability... no 2023-09-13T08:26:28.439 INFO:teuthology.orchestra.run.smithi084.stdout:checking gdbm/ndbm.h presence... no 2023-09-13T08:26:28.439 INFO:teuthology.orchestra.run.smithi084.stdout:checking for gdbm/ndbm.h... no 2023-09-13T08:26:28.460 INFO:teuthology.orchestra.run.smithi084.stdout:checking ndbm.h usability... no 2023-09-13T08:26:28.471 INFO:teuthology.orchestra.run.smithi084.stdout:checking ndbm.h presence... no 2023-09-13T08:26:28.471 INFO:teuthology.orchestra.run.smithi084.stdout:checking for ndbm.h... no 2023-09-13T08:26:28.496 INFO:teuthology.orchestra.run.smithi084.stdout:checking libaio.h usability... yes 2023-09-13T08:26:28.506 INFO:teuthology.orchestra.run.smithi084.stdout:checking libaio.h presence... yes 2023-09-13T08:26:28.506 INFO:teuthology.orchestra.run.smithi084.stdout:checking for libaio.h... yes 2023-09-13T08:26:28.528 INFO:teuthology.orchestra.run.smithi084.stdout:checking liburing.h usability... no 2023-09-13T08:26:28.537 INFO:teuthology.orchestra.run.smithi084.stdout:checking liburing.h presence... no 2023-09-13T08:26:28.538 INFO:teuthology.orchestra.run.smithi084.stdout:checking for liburing.h... no 2023-09-13T08:26:28.558 INFO:teuthology.orchestra.run.smithi084.stdout:checking sys/capability.h usability... no 2023-09-13T08:26:28.567 INFO:teuthology.orchestra.run.smithi084.stdout:checking sys/capability.h presence... no 2023-09-13T08:26:28.567 INFO:teuthology.orchestra.run.smithi084.stdout:checking for sys/capability.h... no 2023-09-13T08:26:28.590 INFO:teuthology.orchestra.run.smithi084.stdout:checking linux/fiemap.h usability... yes 2023-09-13T08:26:28.596 INFO:teuthology.orchestra.run.smithi084.stdout:checking linux/fiemap.h presence... yes 2023-09-13T08:26:28.596 INFO:teuthology.orchestra.run.smithi084.stdout:checking for linux/fiemap.h... yes 2023-09-13T08:26:28.628 INFO:teuthology.orchestra.run.smithi084.stdout:checking for fallocate... yes 2023-09-13T08:26:28.659 INFO:teuthology.orchestra.run.smithi084.stdout:checking for open_by_handle_at... yes 2023-09-13T08:26:28.683 INFO:teuthology.orchestra.run.smithi084.stdout:checking sys/prctl.h usability... yes 2023-09-13T08:26:28.690 INFO:teuthology.orchestra.run.smithi084.stdout:checking sys/prctl.h presence... yes 2023-09-13T08:26:28.690 INFO:teuthology.orchestra.run.smithi084.stdout:checking for sys/prctl.h... yes 2023-09-13T08:26:28.714 INFO:teuthology.orchestra.run.smithi084.stdout:checking linux/fs.h usability... yes 2023-09-13T08:26:28.720 INFO:teuthology.orchestra.run.smithi084.stdout:checking linux/fs.h presence... yes 2023-09-13T08:26:28.720 INFO:teuthology.orchestra.run.smithi084.stdout:checking for linux/fs.h... yes 2023-09-13T08:26:28.741 INFO:teuthology.orchestra.run.smithi084.stdout:checking btrfsutil.h usability... no 2023-09-13T08:26:28.750 INFO:teuthology.orchestra.run.smithi084.stdout:checking btrfsutil.h presence... no 2023-09-13T08:26:28.750 INFO:teuthology.orchestra.run.smithi084.stdout:checking for btrfsutil.h... no 2023-09-13T08:26:28.784 INFO:teuthology.orchestra.run.smithi084.stdout:checking for copy_file_range... yes 2023-09-13T08:26:28.818 INFO:teuthology.orchestra.run.smithi084.stdout:checking for SEEK_DATA... yes 2023-09-13T08:26:28.862 INFO:teuthology.orchestra.run.smithi084.stdout:checking for BMV_OF_SHARED... yes 2023-09-13T08:26:28.905 INFO:teuthology.orchestra.run.smithi084.stdout:checking for nftw... yes 2023-09-13T08:26:28.938 INFO:teuthology.orchestra.run.smithi084.stdout:checking for RLIMIT_NOFILE... yes 2023-09-13T08:26:28.955 INFO:teuthology.orchestra.run.smithi084.stdout:checking for FIEXCHANGE_RANGE... no 2023-09-13T08:26:28.986 INFO:teuthology.orchestra.run.smithi084.stdout:checking for renameat2... yes 2023-09-13T08:26:29.017 INFO:teuthology.orchestra.run.smithi084.stdout:checking for reallocarray... yes 2023-09-13T08:26:29.030 INFO:teuthology.orchestra.run.smithi084.stdout:checking for struct mount_attr... no 2023-09-13T08:26:29.069 INFO:teuthology.orchestra.run.smithi084.stdout:checking for struct btrfs_qgroup_limit... yes 2023-09-13T08:26:29.102 INFO:teuthology.orchestra.run.smithi084.stdout:checking for struct btrfs_qgroup_inherit... yes 2023-09-13T08:26:29.135 INFO:teuthology.orchestra.run.smithi084.stdout:checking for struct btrfs_ioctl_vol_args... yes 2023-09-13T08:26:29.168 INFO:teuthology.orchestra.run.smithi084.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2023-09-13T08:26:29.202 INFO:teuthology.orchestra.run.smithi084.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2023-09-13T08:26:29.234 INFO:teuthology.orchestra.run.smithi084.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2023-09-13T08:26:29.267 INFO:teuthology.orchestra.run.smithi084.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2023-09-13T08:26:29.292 INFO:teuthology.orchestra.run.smithi084.stdout:checking linux/btrfs.h usability... yes 2023-09-13T08:26:29.299 INFO:teuthology.orchestra.run.smithi084.stdout:checking linux/btrfs.h presence... yes 2023-09-13T08:26:29.299 INFO:teuthology.orchestra.run.smithi084.stdout:checking for linux/btrfs.h... yes 2023-09-13T08:26:29.328 INFO:teuthology.orchestra.run.smithi084.stdout:checking linux/btrfs_tree.h usability... yes 2023-09-13T08:26:29.335 INFO:teuthology.orchestra.run.smithi084.stdout:checking linux/btrfs_tree.h presence... yes 2023-09-13T08:26:29.335 INFO:teuthology.orchestra.run.smithi084.stdout:checking for linux/btrfs_tree.h... yes 2023-09-13T08:26:29.364 INFO:teuthology.orchestra.run.smithi084.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... no 2023-09-13T08:26:29.379 INFO:teuthology.orchestra.run.smithi084.stdout:configure: creating ./config.status 2023-09-13T08:26:29.673 INFO:teuthology.orchestra.run.smithi084.stdout:config.status: creating include/builddefs 2023-09-13T08:26:29.683 INFO:teuthology.orchestra.run.smithi084.stdout:config.status: creating include/config.h 2023-09-13T08:26:29.690 INFO:teuthology.orchestra.run.smithi084.stdout:config.status: executing libtool commands 2023-09-13T08:26:29.727 INFO:teuthology.orchestra.run.smithi084.stdout:Building include 2023-09-13T08:26:29.730 INFO:teuthology.orchestra.run.smithi084.stdout:Building lib 2023-09-13T08:26:29.733 INFO:teuthology.orchestra.run.smithi084.stdout: [LTDEP] 2023-09-13T08:26:29.832 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] dataascii.lo 2023-09-13T08:26:29.942 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] databin.lo 2023-09-13T08:26:30.078 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] datapid.lo 2023-09-13T08:26:30.173 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] file_lock.lo 2023-09-13T08:26:30.307 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] forker.lo 2023-09-13T08:26:30.429 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] pattern.lo 2023-09-13T08:26:30.542 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] open_flags.lo 2023-09-13T08:26:30.672 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] random_range.lo 2023-09-13T08:26:30.878 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] string_to_tokens.lo 2023-09-13T08:26:30.975 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] str_to_bytes.lo 2023-09-13T08:26:31.094 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] tlibio.lo 2023-09-13T08:26:31.305 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] write_log.lo 2023-09-13T08:26:31.522 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] random.lo 2023-09-13T08:26:31.631 INFO:teuthology.orchestra.run.smithi084.stdout: [LD] 2023-09-13T08:26:31.700 INFO:teuthology.orchestra.run.smithi084.stdout:Building ltp 2023-09-13T08:26:31.702 INFO:teuthology.orchestra.run.smithi084.stdout: [DEP] 2023-09-13T08:26:31.815 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] doio 2023-09-13T08:26:32.399 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] fsstress 2023-09-13T08:26:33.589 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] fsx 2023-09-13T08:26:34.367 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] growfiles 2023-09-13T08:26:34.822 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] iogen 2023-09-13T08:26:35.139 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] aio-stress 2023-09-13T08:26:35.513 INFO:teuthology.orchestra.run.smithi084.stdout:Building src 2023-09-13T08:26:35.518 INFO:teuthology.orchestra.run.smithi084.stdout: [DEP] 2023-09-13T08:26:36.802 INFO:teuthology.orchestra.run.smithi084.stdout: [DEP] 2023-09-13T08:26:36.827 INFO:teuthology.orchestra.run.smithi084.stdout: [DEP] 2023-09-13T08:26:36.834 INFO:teuthology.orchestra.run.smithi084.stdout: [DEP] 2023-09-13T08:26:37.012 INFO:teuthology.orchestra.run.smithi084.stdout: [DEP] 2023-09-13T08:26:37.032 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] dirstress 2023-09-13T08:26:37.242 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] fill 2023-09-13T08:26:37.383 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] fill2 2023-09-13T08:26:37.585 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] getpagesize 2023-09-13T08:26:37.710 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] holes 2023-09-13T08:26:37.884 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] lstat64 2023-09-13T08:26:38.049 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] nametest 2023-09-13T08:26:38.260 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] permname 2023-09-13T08:26:38.438 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] randholes 2023-09-13T08:26:38.660 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] runas 2023-09-13T08:26:38.817 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] truncfile 2023-09-13T08:26:38.978 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] usemem 2023-09-13T08:26:39.115 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] mmapcat 2023-09-13T08:26:39.251 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] append_reader 2023-09-13T08:26:39.387 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] append_writer 2023-09-13T08:26:39.525 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] dirperf 2023-09-13T08:26:39.720 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] metaperf 2023-09-13T08:26:39.947 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] devzero 2023-09-13T08:26:40.104 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] feature 2023-09-13T08:26:40.296 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] alloc 2023-09-13T08:26:40.484 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] fault 2023-09-13T08:26:40.631 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] fstest 2023-09-13T08:26:40.843 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_access_root 2023-09-13T08:26:40.983 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] godown 2023-09-13T08:26:41.006 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:26:41.008 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:26:41.137 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] resvtest 2023-09-13T08:26:41.304 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] writemod 2023-09-13T08:26:41.438 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] writev_on_pagefault 2023-09-13T08:26:41.581 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] makeextents 2023-09-13T08:26:41.745 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] itrash 2023-09-13T08:26:41.886 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] rename 2023-09-13T08:26:42.013 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] multi_open_unlink 2023-09-13T08:26:42.162 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] unwritten_sync 2023-09-13T08:26:42.323 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] genhashnames 2023-09-13T08:26:42.492 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_holes 2023-09-13T08:26:42.627 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_mmap_writev 2023-09-13T08:26:42.762 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_truncate_cmtime 2023-09-13T08:26:42.905 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] dirhash_collide 2023-09-13T08:26:43.070 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_rename_overwrite 2023-09-13T08:26:43.199 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] holetest 2023-09-13T08:26:43.395 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_truncate_self 2023-09-13T08:26:43.523 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] af_unix 2023-09-13T08:26:43.662 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_mmap_stale_pmd 2023-09-13T08:26:43.825 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_mmap_cow_race 2023-09-13T08:26:43.974 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_mmap_fallocate 2023-09-13T08:26:44.111 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] fsync-err 2023-09-13T08:26:44.277 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_mmap_write_ro 2023-09-13T08:26:44.415 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_ext4_dax_journal_corruption 2023-09-13T08:26:44.558 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_ext4_dax_inline_corruption 2023-09-13T08:26:44.698 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_ofd_locks 2023-09-13T08:26:44.874 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_mmap_collision 2023-09-13T08:26:45.051 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] mmap-write-concurrent 2023-09-13T08:26:45.205 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_get_file_time 2023-09-13T08:26:45.338 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_create_short_dirs 2023-09-13T08:26:45.489 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_create_long_dirs 2023-09-13T08:26:45.639 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_enospc 2023-09-13T08:26:45.807 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_mmap_writev_overlap 2023-09-13T08:26:45.960 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] checkpoint_journal 2023-09-13T08:26:46.100 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] mmap-rw-fault 2023-09-13T08:26:46.267 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] allocstale 2023-09-13T08:26:46.419 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_mmap_cow_memory_failure 2023-09-13T08:26:46.573 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] fake-dump-rootino 2023-09-13T08:26:46.709 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] dio-buf-fault 2023-09-13T08:26:46.850 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] xfsctl 2023-09-13T08:26:47.018 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] bstat 2023-09-13T08:26:47.200 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_mtab 2023-09-13T08:26:47.367 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] getdevicesize 2023-09-13T08:26:47.497 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] preallo_rw_pattern_reader 2023-09-13T08:26:47.641 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] preallo_rw_pattern_writer 2023-09-13T08:26:47.783 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] ftrunc 2023-09-13T08:26:47.919 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] trunc 2023-09-13T08:26:48.065 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] fs_perms 2023-09-13T08:26:48.214 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] testx 2023-09-13T08:26:48.335 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] looptest 2023-09-13T08:26:48.509 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] locktest 2023-09-13T08:26:48.784 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] unwritten_mmap 2023-09-13T08:26:48.931 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] bulkstat_unlink_test 2023-09-13T08:26:49.112 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] deduperace 2023-09-13T08:26:49.287 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] bulkstat_unlink_test_modified 2023-09-13T08:26:49.464 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_dir_offset 2023-09-13T08:26:49.599 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_futimens 2023-09-13T08:26:49.728 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_immutable 2023-09-13T08:26:50.269 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] stale_handle 2023-09-13T08:26:50.423 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] pwrite_mmap_blocked 2023-09-13T08:26:50.562 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_dir_offset2 2023-09-13T08:26:50.734 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] seek_sanity_test 2023-09-13T08:26:51.107 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] seek_copy_test 2023-09-13T08:26:51.266 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_readdir_1 2023-09-13T08:26:51.401 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_readdir_2 2023-09-13T08:26:51.539 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] fsync-tester 2023-09-13T08:26:51.761 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] nsexec 2023-09-13T08:26:51.920 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] cloner 2023-09-13T08:26:52.080 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] renameat2 2023-09-13T08:26:52.230 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_getcwd 2023-09-13T08:26:52.374 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] e4compact 2023-09-13T08:26:52.555 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] test-nextquota 2023-09-13T08:26:52.708 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] punch-alternating 2023-09-13T08:26:52.863 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] attr-list-by-handle-cursor-test 2023-09-13T08:26:53.014 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] listxattr 2023-09-13T08:26:53.149 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] dio-interleaved 2023-09-13T08:26:53.294 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_dir_type 2023-09-13T08:26:53.436 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] dio-invalidate-cache 2023-09-13T08:26:53.620 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] stat_test 2023-09-13T08:26:53.886 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_encrypted_d_revalidate 2023-09-13T08:26:54.083 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] attr_replace_test 2023-09-13T08:26:54.332 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] swapon 2023-09-13T08:26:54.482 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] mkswap 2023-09-13T08:26:54.620 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_attr_corruption 2023-09-13T08:26:54.756 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_open_tmpfiles 2023-09-13T08:26:54.918 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] fscrypt-crypt-util 2023-09-13T08:26:55.484 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] bulkstat_null_ocount 2023-09-13T08:26:55.628 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] splice-test 2023-09-13T08:26:55.792 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] chprojid_fail 2023-09-13T08:26:55.938 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] detached_mounts_propagation 2023-09-13T08:26:56.104 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] ext4_resize 2023-09-13T08:26:56.239 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_readdir_3 2023-09-13T08:26:56.416 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] splice2pipe 2023-09-13T08:26:56.565 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] uuid_ioctl 2023-09-13T08:26:56.706 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] fiemap-tester 2023-09-13T08:26:56.945 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_stripealign 2023-09-13T08:26:57.087 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] open_by_handle 2023-09-13T08:26:57.316 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_mmap_dio 2023-09-13T08:26:57.463 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] xfsfind 2023-09-13T08:26:57.636 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] fssum 2023-09-13T08:26:58.026 INFO:teuthology.orchestra.run.smithi084.stdout:Building log-writes 2023-09-13T08:26:58.031 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] replay-log 2023-09-13T08:26:58.308 INFO:teuthology.orchestra.run.smithi084.stdout:Building perf 2023-09-13T08:26:58.312 INFO:teuthology.orchestra.run.smithi084.stdout:Building aio-dio-regress 2023-09-13T08:26:58.317 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] aio-dio-append-write-fallocate-race 2023-09-13T08:26:58.474 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] aio-dio-fcntl-race 2023-09-13T08:26:58.626 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] aio-dio-subblock-eof-read 2023-09-13T08:26:58.760 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] aio-dio-append-write-read-race 2023-09-13T08:26:58.923 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] aio-dio-invalidate-readahead 2023-09-13T08:26:59.074 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] aio-dio-write-verify 2023-09-13T08:26:59.250 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2023-09-13T08:26:59.376 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] aio-last-ref-held-by-io 2023-09-13T08:26:59.536 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] aio-dio-cycle-write 2023-09-13T08:26:59.706 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] aio-dio-extend-stat 2023-09-13T08:26:59.860 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2023-09-13T08:26:59.984 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] aio-dio-hole-filling-race 2023-09-13T08:27:00.123 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] aio-dio-invalidate-failure 2023-09-13T08:27:00.271 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] aiodio_sparse2 2023-09-13T08:27:00.467 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] aiocp 2023-09-13T08:27:00.671 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] aio-dio-cow-race 2023-09-13T08:27:00.815 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] aio-dio-eof-race 2023-09-13T08:27:00.984 INFO:teuthology.orchestra.run.smithi084.stdout:Building vfs 2023-09-13T08:27:00.989 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] vfstest 2023-09-13T08:27:02.664 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] mount-idmapped 2023-09-13T08:27:02.994 INFO:teuthology.orchestra.run.smithi084.stdout:Building m4 2023-09-13T08:27:02.997 INFO:teuthology.orchestra.run.smithi084.stdout:Building common 2023-09-13T08:27:03.000 INFO:teuthology.orchestra.run.smithi084.stdout:Building tests 2023-09-13T08:27:03.005 INFO:teuthology.orchestra.run.smithi084.stdout:Building perf 2023-09-13T08:27:03.010 INFO:teuthology.orchestra.run.smithi084.stdout: [GROUP] /tmp/tmp.UxTBQ6XIL3xfstests-dev/tests/perf/group.list 2023-09-13T08:27:03.020 INFO:teuthology.orchestra.run.smithi084.stdout:Building ext4 2023-09-13T08:27:03.025 INFO:teuthology.orchestra.run.smithi084.stdout: [GROUP] /tmp/tmp.UxTBQ6XIL3xfstests-dev/tests/ext4/group.list 2023-09-13T08:27:03.058 INFO:teuthology.orchestra.run.smithi084.stdout:Building ocfs2 2023-09-13T08:27:03.063 INFO:teuthology.orchestra.run.smithi084.stdout: [GROUP] /tmp/tmp.UxTBQ6XIL3xfstests-dev/tests/ocfs2/group.list 2023-09-13T08:27:03.075 INFO:teuthology.orchestra.run.smithi084.stdout:Building overlay 2023-09-13T08:27:03.079 INFO:teuthology.orchestra.run.smithi084.stdout: [GROUP] /tmp/tmp.UxTBQ6XIL3xfstests-dev/tests/overlay/group.list 2023-09-13T08:27:03.114 INFO:teuthology.orchestra.run.smithi084.stdout:Building cifs 2023-09-13T08:27:03.119 INFO:teuthology.orchestra.run.smithi084.stdout: [GROUP] /tmp/tmp.UxTBQ6XIL3xfstests-dev/tests/cifs/group.list 2023-09-13T08:27:03.130 INFO:teuthology.orchestra.run.smithi084.stdout:Building generic 2023-09-13T08:27:03.136 INFO:teuthology.orchestra.run.smithi084.stdout: [GROUP] /tmp/tmp.UxTBQ6XIL3xfstests-dev/tests/generic/group.list 2023-09-13T08:27:03.224 INFO:teuthology.orchestra.run.smithi084.stdout:Building shared 2023-09-13T08:27:03.229 INFO:teuthology.orchestra.run.smithi084.stdout: [GROUP] /tmp/tmp.UxTBQ6XIL3xfstests-dev/tests/shared/group.list 2023-09-13T08:27:03.245 INFO:teuthology.orchestra.run.smithi084.stdout:Building nfs 2023-09-13T08:27:03.249 INFO:teuthology.orchestra.run.smithi084.stdout: [GROUP] /tmp/tmp.UxTBQ6XIL3xfstests-dev/tests/nfs/group.list 2023-09-13T08:27:03.261 INFO:teuthology.orchestra.run.smithi084.stdout:Building f2fs 2023-09-13T08:27:03.266 INFO:teuthology.orchestra.run.smithi084.stdout: [GROUP] /tmp/tmp.UxTBQ6XIL3xfstests-dev/tests/f2fs/group.list 2023-09-13T08:27:03.282 INFO:teuthology.orchestra.run.smithi084.stdout:Building udf 2023-09-13T08:27:03.286 INFO:teuthology.orchestra.run.smithi084.stdout: [GROUP] /tmp/tmp.UxTBQ6XIL3xfstests-dev/tests/udf/group.list 2023-09-13T08:27:03.296 INFO:teuthology.orchestra.run.smithi084.stdout:Building ceph 2023-09-13T08:27:03.301 INFO:teuthology.orchestra.run.smithi084.stdout: [GROUP] /tmp/tmp.UxTBQ6XIL3xfstests-dev/tests/ceph/group.list 2023-09-13T08:27:03.314 INFO:teuthology.orchestra.run.smithi084.stdout:Building xfs 2023-09-13T08:27:03.320 INFO:teuthology.orchestra.run.smithi084.stdout: [GROUP] /tmp/tmp.UxTBQ6XIL3xfstests-dev/tests/xfs/group.list 2023-09-13T08:27:03.409 INFO:teuthology.orchestra.run.smithi084.stdout:Building btrfs 2023-09-13T08:27:03.414 INFO:teuthology.orchestra.run.smithi084.stdout: [GROUP] /tmp/tmp.UxTBQ6XIL3xfstests-dev/tests/btrfs/group.list 2023-09-13T08:27:03.466 INFO:teuthology.orchestra.run.smithi084.stdout:Building tmpfs 2023-09-13T08:27:03.471 INFO:teuthology.orchestra.run.smithi084.stdout: [GROUP] /tmp/tmp.UxTBQ6XIL3xfstests-dev/tests/tmpfs/group.list 2023-09-13T08:27:03.483 INFO:teuthology.orchestra.run.smithi084.stdout:Building selftest 2023-09-13T08:27:03.488 INFO:teuthology.orchestra.run.smithi084.stdout: [GROUP] /tmp/tmp.UxTBQ6XIL3xfstests-dev/tests/selftest/group.list 2023-09-13T08:27:03.501 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo make install) 2023-09-13T08:27:03.540 INFO:teuthology.orchestra.run.smithi084.stdout:Building include 2023-09-13T08:27:03.543 INFO:teuthology.orchestra.run.smithi084.stdout:Building lib 2023-09-13T08:27:03.547 INFO:teuthology.orchestra.run.smithi084.stdout:Building ltp 2023-09-13T08:27:03.552 INFO:teuthology.orchestra.run.smithi084.stdout:Building src 2023-09-13T08:27:03.584 INFO:teuthology.orchestra.run.smithi084.stdout:Building log-writes 2023-09-13T08:27:03.587 INFO:teuthology.orchestra.run.smithi084.stdout:Building perf 2023-09-13T08:27:03.590 INFO:teuthology.orchestra.run.smithi084.stdout:Building aio-dio-regress 2023-09-13T08:27:03.594 INFO:teuthology.orchestra.run.smithi084.stdout:Building vfs 2023-09-13T08:27:03.598 INFO:teuthology.orchestra.run.smithi084.stdout:Building m4 2023-09-13T08:27:03.601 INFO:teuthology.orchestra.run.smithi084.stdout:Building common 2023-09-13T08:27:03.604 INFO:teuthology.orchestra.run.smithi084.stdout:Building tests 2023-09-13T08:27:03.609 INFO:teuthology.orchestra.run.smithi084.stdout:Building perf 2023-09-13T08:27:03.614 INFO:teuthology.orchestra.run.smithi084.stdout: [GROUP] /tmp/tmp.UxTBQ6XIL3xfstests-dev/tests/perf/group.list 2023-09-13T08:27:03.624 INFO:teuthology.orchestra.run.smithi084.stdout:Building ext4 2023-09-13T08:27:03.629 INFO:teuthology.orchestra.run.smithi084.stdout: [GROUP] /tmp/tmp.UxTBQ6XIL3xfstests-dev/tests/ext4/group.list 2023-09-13T08:27:03.662 INFO:teuthology.orchestra.run.smithi084.stdout:Building ocfs2 2023-09-13T08:27:03.667 INFO:teuthology.orchestra.run.smithi084.stdout: [GROUP] /tmp/tmp.UxTBQ6XIL3xfstests-dev/tests/ocfs2/group.list 2023-09-13T08:27:03.679 INFO:teuthology.orchestra.run.smithi084.stdout:Building overlay 2023-09-13T08:27:03.683 INFO:teuthology.orchestra.run.smithi084.stdout: [GROUP] /tmp/tmp.UxTBQ6XIL3xfstests-dev/tests/overlay/group.list 2023-09-13T08:27:03.718 INFO:teuthology.orchestra.run.smithi084.stdout:Building cifs 2023-09-13T08:27:03.723 INFO:teuthology.orchestra.run.smithi084.stdout: [GROUP] /tmp/tmp.UxTBQ6XIL3xfstests-dev/tests/cifs/group.list 2023-09-13T08:27:03.734 INFO:teuthology.orchestra.run.smithi084.stdout:Building generic 2023-09-13T08:27:03.741 INFO:teuthology.orchestra.run.smithi084.stdout: [GROUP] /tmp/tmp.UxTBQ6XIL3xfstests-dev/tests/generic/group.list 2023-09-13T08:27:03.827 INFO:teuthology.orchestra.run.smithi084.stdout:Building shared 2023-09-13T08:27:03.832 INFO:teuthology.orchestra.run.smithi084.stdout: [GROUP] /tmp/tmp.UxTBQ6XIL3xfstests-dev/tests/shared/group.list 2023-09-13T08:27:03.847 INFO:teuthology.orchestra.run.smithi084.stdout:Building nfs 2023-09-13T08:27:03.854 INFO:teuthology.orchestra.run.smithi084.stdout: [GROUP] /tmp/tmp.UxTBQ6XIL3xfstests-dev/tests/nfs/group.list 2023-09-13T08:27:03.865 INFO:teuthology.orchestra.run.smithi084.stdout:Building f2fs 2023-09-13T08:27:03.869 INFO:teuthology.orchestra.run.smithi084.stdout: [GROUP] /tmp/tmp.UxTBQ6XIL3xfstests-dev/tests/f2fs/group.list 2023-09-13T08:27:03.884 INFO:teuthology.orchestra.run.smithi084.stdout:Building udf 2023-09-13T08:27:03.889 INFO:teuthology.orchestra.run.smithi084.stdout: [GROUP] /tmp/tmp.UxTBQ6XIL3xfstests-dev/tests/udf/group.list 2023-09-13T08:27:03.899 INFO:teuthology.orchestra.run.smithi084.stdout:Building ceph 2023-09-13T08:27:03.904 INFO:teuthology.orchestra.run.smithi084.stdout: [GROUP] /tmp/tmp.UxTBQ6XIL3xfstests-dev/tests/ceph/group.list 2023-09-13T08:27:03.916 INFO:teuthology.orchestra.run.smithi084.stdout:Building xfs 2023-09-13T08:27:03.923 INFO:teuthology.orchestra.run.smithi084.stdout: [GROUP] /tmp/tmp.UxTBQ6XIL3xfstests-dev/tests/xfs/group.list 2023-09-13T08:27:04.009 INFO:teuthology.orchestra.run.smithi084.stdout:Building btrfs 2023-09-13T08:27:04.014 INFO:teuthology.orchestra.run.smithi084.stdout: [GROUP] /tmp/tmp.UxTBQ6XIL3xfstests-dev/tests/btrfs/group.list 2023-09-13T08:27:04.067 INFO:teuthology.orchestra.run.smithi084.stdout:Building tmpfs 2023-09-13T08:27:04.072 INFO:teuthology.orchestra.run.smithi084.stdout: [GROUP] /tmp/tmp.UxTBQ6XIL3xfstests-dev/tests/tmpfs/group.list 2023-09-13T08:27:04.084 INFO:teuthology.orchestra.run.smithi084.stdout:Building selftest 2023-09-13T08:27:04.088 INFO:teuthology.orchestra.run.smithi084.stdout: [GROUP] /tmp/tmp.UxTBQ6XIL3xfstests-dev/tests/selftest/group.list 2023-09-13T08:27:04.099 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2023-09-13T08:27:04.100 INFO:teuthology.orchestra.run.smithi084.stdout:gmake[1]: Nothing to be done for 'install'. 2023-09-13T08:27:04.100 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2023-09-13T08:27:04.102 INFO:teuthology.orchestra.run.smithi084.stdout:gmake[1]: Nothing to be done for 'install'. 2023-09-13T08:27:04.103 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2023-09-13T08:27:04.104 INFO:teuthology.orchestra.run.smithi084.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2023-09-13T08:27:04.113 INFO:teuthology.orchestra.run.smithi084.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2023-09-13T08:27:04.189 INFO:teuthology.orchestra.run.smithi084.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2023-09-13T08:27:04.197 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2023-09-13T08:27:04.213 INFO:teuthology.orchestra.run.smithi084.stdout:Building log-writes 2023-09-13T08:27:04.216 INFO:teuthology.orchestra.run.smithi084.stdout:Building perf 2023-09-13T08:27:04.220 INFO:teuthology.orchestra.run.smithi084.stdout:Building aio-dio-regress 2023-09-13T08:27:04.223 INFO:teuthology.orchestra.run.smithi084.stdout:Building vfs 2023-09-13T08:27:04.226 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/gmake -C log-writes install 2023-09-13T08:27:04.228 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2023-09-13T08:27:04.236 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2023-09-13T08:27:04.245 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/gmake -C perf install 2023-09-13T08:27:04.247 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2023-09-13T08:27:04.255 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 ResultData.py fio-insert-and-compare.py FioResultDecoder.py FioCompare.py generate-schema.py fio-results.sql /var/lib/xfstests/src/perf 2023-09-13T08:27:04.277 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/gmake -C aio-dio-regress install 2023-09-13T08:27:04.279 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2023-09-13T08:27:04.288 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 aio-dio-append-write-fallocate-race aio-dio-fcntl-race aio-dio-subblock-eof-read aio-dio-append-write-read-race aio-dio-invalidate-readahead aio-dio-write-verify aio-free-ring-with-bogus-nr-pages aio-last-ref-held-by-io aio-dio-cycle-write aio-dio-extend-stat aio-io-setup-with-nonwritable-context-pointer aio-dio-hole-filling-race aio-dio-invalidate-failure aiodio_sparse2 aiocp aio-dio-cow-race aio-dio-eof-race /var/lib/xfstests/src/aio-dio-regress 2023-09-13T08:27:04.340 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/gmake -C vfs install 2023-09-13T08:27:04.341 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2023-09-13T08:27:04.350 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2023-09-13T08:27:04.361 INFO:teuthology.orchestra.run.smithi084.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2023-09-13T08:27:04.370 INFO:teuthology.orchestra.run.smithi084.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl fiemap-tester t_stripealign open_by_handle t_mmap_dio xfsfind fssum /var/lib/xfstests/src 2023-09-13T08:27:05.545 INFO:teuthology.orchestra.run.smithi084.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py soak_duration.awk /var/lib/xfstests/src 2023-09-13T08:27:05.647 INFO:teuthology.orchestra.run.smithi084.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2023-09-13T08:27:05.677 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2023-09-13T08:27:05.679 INFO:teuthology.orchestra.run.smithi084.stdout:gmake[1]: Nothing to be done for 'install'. 2023-09-13T08:27:05.679 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2023-09-13T08:27:05.680 INFO:teuthology.orchestra.run.smithi084.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2023-09-13T08:27:05.689 INFO:teuthology.orchestra.run.smithi084.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2023-09-13T08:27:05.822 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2023-09-13T08:27:05.824 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.UxTBQ6XIL3xfstests-dev/tests/btrfs/ install 2023-09-13T08:27:05.826 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2023-09-13T08:27:05.835 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 299 300 /var/lib/xfstests/tests/btrfs 2023-09-13T08:27:06.643 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2023-09-13T08:27:06.652 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 644 175.out 186.out 240.out 092.out 077.out 140.out 265.out 236.out 108.out 204.out 233.out 194.out 234.out 295.out 109.out 033.out 082.out 252.out 270.out 040.out 176.out 202.out 137.out 034.out 125.out 014.out 165.out 181.out 152.out 024.out 192.out 148.out 282.out 267.out 052.out 256.out 228.out 183.out 273.out 251.out 110.out 043.out 069.out 151.out 206.out 195.out 274.out 215.out 115.out 015.out 275.out 250.out 191.out 281.out 046.out 051.out 131.out 244.out 219.out 119.out 019.out 128.out 177.out 232.out 189.out 220.out 120.out 020.out 102.out 263.out 171.out 261.out 045.out 217.out 117.out 017.out 072.out 068.out 048.out 062.out 038.out 084.out 129.out 066.out 029.out 229.out 103.out 111.out 011.out 243.out 134.out 170.out 260.out 157.out 143.out 133.out 286.out 161.out 246.out 216.out 116.out 016.out 155.out 296.out 118.out 287.out 067.out 010.out 238.out 141.out 114.out 138.out 095.out 297.out 160.out 091.out 081.out 071.out 061.out 085.out 037.out 300.out 200.out 100.out 025.out 258.out 185.out 269.out 208.out 039.out 173.out 222.out 035.out 169.out 098.out 290.out 080.out 070.out 060.out 207.out 106.out 009.out 167.out 211.out 158.out 182.out 146.out 188.out 293.out 104.out 089.out 086.out 254.out 279.out 225.out 174.out 156.out 268.out 135.out 257.out 124.out 172.out 063.out 058.out 113.out 262.out 036.out 042.out 047.out 193.out 097.out 271.out 283.out 083.out 199.out 099.out 278.out 007.out 209.out 053.out 164.out 154.out 239.out 241.out 002.out 178.out 190.out 214.out 074.out 056.out 041.out 057.out 005.out 223.out 150.out 123.out 179.out 144.out 032.out 277.out 205.out 136.out 096.out 198.out 008.out 280.out 050.out 105.out 027.out 187.out 153.out 088.out 285.out 044.out 201.out 101.out 001.out 266.out 237.out 065.out 231.out 227.out 075.out 028.out 213.out 142.out 013.out 031.out 272.out 078.out 184.out 259.out 210.out 132.out 093.out 235.out 127.out 230.out 166.out 292.out 130.out 023.out 073.out 030.out 203.out 003.out 055.out 291.out 245.out 145.out 159.out 249.out 122.out 076.out 022.out 289.out 006.out 284.out 299.out 224.out 276.out 149.out 064.out 264.out 218.out 018.out 168.out 021.out 079.out 054.out 059.out 049.out 226.out 163.out 126.out 121.out 026.out 180.out 253.out 255.out 139.out 090.out 221.out 087.out 294.out 212.out 112.out 094.out 012.out 247.out 107.out 248.out 162.out 147.out 288.out 197.out 196.out 242.out 004.out /var/lib/xfstests/tests/btrfs 2023-09-13T08:27:07.456 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.UxTBQ6XIL3xfstests-dev/tests/ceph/ install 2023-09-13T08:27:07.458 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2023-09-13T08:27:07.466 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2023-09-13T08:27:07.485 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2023-09-13T08:27:07.493 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 644 003.out 005.out 001.out 004.out 002.out /var/lib/xfstests/tests/ceph 2023-09-13T08:27:07.513 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.UxTBQ6XIL3xfstests-dev/tests/cifs/ install 2023-09-13T08:27:07.514 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2023-09-13T08:27:07.522 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2023-09-13T08:27:07.531 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2023-09-13T08:27:07.540 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2023-09-13T08:27:07.548 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.UxTBQ6XIL3xfstests-dev/tests/ext4/ install 2023-09-13T08:27:07.550 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2023-09-13T08:27:07.558 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2023-09-13T08:27:07.746 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2023-09-13T08:27:07.754 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 644 001.out.nodelalloc 001.out.default 001.out.nozero 001.cfg 032.out 039.out 305.out 005.out 008.out 035.out 036.out 308.out 050.out 040.out 306.out 007.out 021.out 046.out 012.out 009.out 033.out 045.out 034.out 056.out 047.out 018.out 023.out 302.out 020.out 002.out 014.out 024.out 013.out 031.out 015.out 304.out 004.out 048.out 038.out 052.out 303.out 029.out 011.out 027.out 042.out 044.out 055.out 030.out 058.out 003.out 017.out 043.out 053.out 016.out 059.out 037.out 301.out 010.out 022.out 006.out 057.out 025.out 026.out 271.out 051.out 041.out 307.out 019.out 028.out 054.out 049.out /var/lib/xfstests/tests/ext4 2023-09-13T08:27:07.949 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.UxTBQ6XIL3xfstests-dev/tests/f2fs/ install 2023-09-13T08:27:07.950 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2023-09-13T08:27:07.959 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2023-09-13T08:27:07.970 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2023-09-13T08:27:07.978 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2023-09-13T08:27:07.990 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.UxTBQ6XIL3xfstests-dev/tests/generic/ install 2023-09-13T08:27:07.994 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2023-09-13T08:27:08.003 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 /var/lib/xfstests/tests/generic 2023-09-13T08:27:09.967 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2023-09-13T08:27:09.977 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 644 050.out.xfsquota 035.out.nfs 035.out.default 050.out.nojournal 050.out.default 050.cfg 035.cfg 208.out 433.out 670.out 040.out 104.out 377.out 537.out 683.out 497.out 337.out 702.out 602.out 149.out 088.out 366.out 202.out 137.out 034.out 110.out 389.out 403.out 593.out 571.out 243.out 592.out 282.out 472.out 468.out 628.out 284.out 528.out 607.out 428.out 659.out 407.out 228.out 128.out 171.out 028.out 620.out 273.out 474.out 492.out 609.out 707.out 595.out 506.out 268.out 460.out 632.out 532.out 591.out 281.out 719.out 619.out 519.out 419.out 319.out 177.out 523.out 119.out 019.out 727.out 372.out 673.out 190.out 686.out 312.out 718.out 143.out 716.out 161.out 516.out 518.out 538.out 655.out 216.out 116.out 016.out 155.out 118.out 338.out 238.out 500.out 138.out 189.out 263.out 277.out 181.out 160.out 483.out 274.out 722.out 061.out 239.out 457.out 333.out 258.out 362.out 379.out 691.out 039.out 173.out 498.out 665.out 098.out 426.out 290.out 480.out 706.out 060.out 406.out 306.out 106.out 642.out 217.out 693.out 191.out 411.out 357.out 481.out 211.out 158.out 014.out 182.out 370.out 188.out 030.out 099.out 585.out 724.out 721.out 624.out 524.out 174.out 156.out 324.out 224.out 313.out 355.out 124.out 382.out 672.out 278.out 063.out 058.out 384.out 296.out 042.out 641.out 271.out 465.out 473.out 335.out 247.out 509.out 568.out 441.out 440.out 475.out 548.out 356.out 341.out 094.out 241.out 600.out 089.out 614.out 514.out 414.out 314.out 416.out 214.out 381.out 056.out 041.out 634.out 340.out 358.out 572.out 586.out 521.out 240.out 549.out 633.out 434.out 140.out 708.out 533.out 508.out 408.out 308.out 476.out 087.out 199.out 458.out 233.out 639.out 443.out 540.out 397.out 053.out 279.out 276.out 711.out 164.out 376.out 589.out 587.out 339.out 294.out 352.out 484.out 456.out 489.out 139.out 317.out 399.out 220.out 552.out 695.out 017.out 677.out 097.out 175.out 315.out 295.out 580.out 193.out 186.out 452.out 679.out 292.out 252.out 077.out 167.out 688.out 206.out 348.out 394.out 651.out 184.out 466.out 697.out 495.out 725.out 109.out 482.out 625.out 283.out 525.out 488.out 496.out 325.out 551.out 225.out 322.out 636.out 125.out 715.out 192.out 544.out 515.out 650.out 152.out 658.out 563.out 578.out 451.out 015.out 392.out 682.out 684.out 550.out 052.out 652.out 534.out 351.out 583.out 450.out 463.out 251.out 267.out 176.out 069.out 644.out 065.out 487.out 615.out 395.out 676.out 415.out 344.out 215.out 115.out 444.out 027.out 250.out 391.out 674.out 464.out 705.out 536.out 577.out 439.out 244.out 336.out 144.out 505.out 405.out 057.out 205.out 136.out 598.out 363.out 036.out 198.out 723.out 008.out 390.out 680.out 605.out 305.out 105.out 005.out 367.out 291.out 709.out 323.out 685.out 562.out 570.out 388.out 527.out 237.out 151.out 227.out 163.out 332.out 661.out 582.out 232.out 478.out 584.out 462.out 597.out 412.out 132.out 179.out 037.out 293.out 499.out 638.out 448.out 353.out 020.out 660.out 561.out 141.out 076.out 668.out 044.out 648.out 387.out 594.out 438.out 265.out 289.out 574.out 006.out 690.out 477.out 567.out 299.out 461.out 307.out 647.out 493.out 107.out 007.out 380.out 526.out 479.out 547.out 150.out 326.out 082.out 226.out 413.out 126.out 025.out 121.out 026.out 021.out 013.out 485.out 694.out 347.out 275.out 090.out 361.out 564.out 066.out 302.out 432.out 002.out 558.out 162.out 147.out 288.out 197.out 033.out 396.out 051.out 350.out 145.out 047.out 024.out 360.out 543.out 261.out 447.out 692.out 255.out 726.out 729.out 378.out 346.out 048.out 062.out 626.out 529.out 231.out 343.out 662.out 425.out 329.out 165.out 334.out 103.out 003.out 129.out 423.out 371.out 234.out 183.out 671.out 645.out 486.out 223.out 123.out 262.out 669.out 023.out 459.out 616.out 032.out 266.out 146.out 398.out 728.out 696.out 427.out 590.out 280.out 470.out 455.out 187.out 091.out 046.out 153.out 731.out 374.out 631.out 256.out 328.out 260.out 654.out 359.out 531.out 649.out 301.out 101.out 635.out 623.out 385.out 331.out 556.out 713.out 613.out 513.out 622.out 131.out 213.out 730.out 095.out 031.out 565.out 630.out 675.out 272.out 530.out 510.out 627.out 573.out 576.out 430.out 310.out 569.out 454.out 259.out 210.out 449.out 327.out 330.out 067.out 093.out 604.out 287.out 127.out 699.out 071.out 166.out 130.out 219.out 073.out 603.out 503.out 303.out 203.out 354.out 157.out 386.out 349.out 055.out 245.out 522.out 422.out 222.out 159.out 539.out 249.out 122.out 689.out 022.out 681.out 424.out 321.out 045.out 490.out 435.out 375.out 134.out 154.out 566.out 618.out 501.out 418.out 318.out 542.out 218.out 575.out 172.out 168.out 079.out 469.out 054.out 059.out 049.out 442.out 657.out 621.out 180.out 270.out 253.out 421.out 712.out 612.out 667.out 512.out 494.out 221.out 212.out 112.out 342.out 012.out 029.out 195.out 554.out 148.out 185.out 596.out 720.out 248.out 196.out 520.out 242.out 420.out 285.out 320.out 629.out 230.out 120.out 502.out 402.out 102.out 717.out 617.out 517.out 429.out 417.out 365.out 092.out 117.out 664.out 072.out 068.out 229.out 038.out 084.out 369.out 611.out 511.out 311.out 368.out 637.out 111.out 011.out 257.out 194.out 170.out 606.out 133.out 286.out 043.out 437.out 545.out 714.out 559.out 710.out 610.out 687.out 410.out 701.out 601.out 401.out 201.out 010.out 001.out 096.out 114.out 113.out 074.out 581.out 491.out 081.out 083.out 653.out 700.out 064.out 400.out 300.out 200.out 100.out 646.out 541.out 445.out 269.out 546.out 656.out 698.out 553.out 178.out 298.out 446.out 080.out 070.out 608.out 507.out 409.out 309.out 209.out 108.out 009.out 643.out 004.out 557.out 453.out 666.out 236.out 078.out 364.out 555.out 075.out 383.out 085.out 704.out 588.out 504.out 404.out 304.out 204.out 535.out 345.out 246.out 467.out 086.out 254.out 207.out 142.out 235.out 436.out 703.out 135.out 264.out 431.out 678.out 373.out 316.out 169.out 640.out 579.out 018.out 297.out 393.out 560.out 663.out 599.out /var/lib/xfstests/tests/generic 2023-09-13T08:27:11.071 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:27:11.073 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:27:11.967 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.UxTBQ6XIL3xfstests-dev/tests/nfs/ install 2023-09-13T08:27:11.969 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2023-09-13T08:27:11.978 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2023-09-13T08:27:11.986 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2023-09-13T08:27:11.995 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2023-09-13T08:27:12.003 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.UxTBQ6XIL3xfstests-dev/tests/ocfs2/ install 2023-09-13T08:27:12.005 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2023-09-13T08:27:12.014 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2023-09-13T08:27:12.022 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2023-09-13T08:27:12.031 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2023-09-13T08:27:12.040 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.UxTBQ6XIL3xfstests-dev/tests/overlay/ install 2023-09-13T08:27:12.042 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2023-09-13T08:27:12.050 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2023-09-13T08:27:12.316 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2023-09-13T08:27:12.324 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 644 035.out 019.out 034.out 018.out 024.out 077.out 069.out 020.out 102.out 014.out 013.out 031.out 015.out 117.out 017.out 072.out 068.out 063.out 048.out 062.out 038.out 026.out 042.out 052.out 110.out 067.out 029.out 111.out 055.out 112.out 073.out 078.out 030.out 058.out 003.out 045.out 023.out 043.out 053.out 109.out 036.out 116.out 016.out 010.out 001.out 022.out 106.out 007.out 006.out 115.out 057.out 113.out 114.out 074.out 046.out 071.out 061.out 025.out 051.out 011.out 041.out 047.out 100.out 064.out 107.out 104.out 028.out 076.out 079.out 054.out 059.out 008.out 049.out 032.out 039.out 021.out 005.out 002.out 065.out 108.out 080.out 070.out 060.out 050.out 027.out 105.out 009.out 004.out 037.out 044.out 012.out 101.out 075.out 103.out 033.out 066.out 040.out 056.out /var/lib/xfstests/tests/overlay 2023-09-13T08:27:12.590 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.UxTBQ6XIL3xfstests-dev/tests/perf/ install 2023-09-13T08:27:12.591 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2023-09-13T08:27:12.600 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2023-09-13T08:27:12.609 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2023-09-13T08:27:12.617 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2023-09-13T08:27:12.626 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.UxTBQ6XIL3xfstests-dev/tests/selftest/ install 2023-09-13T08:27:12.627 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2023-09-13T08:27:12.637 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2023-09-13T08:27:12.658 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2023-09-13T08:27:12.666 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 644 006.out 003.out 005.out 001.out 004.out 002.out /var/lib/xfstests/tests/selftest 2023-09-13T08:27:12.688 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.UxTBQ6XIL3xfstests-dev/tests/shared/ install 2023-09-13T08:27:12.689 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2023-09-13T08:27:12.698 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2023-09-13T08:27:12.712 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2023-09-13T08:27:12.721 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 644 032.out 298.out 002.out /var/lib/xfstests/tests/shared 2023-09-13T08:27:12.735 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.UxTBQ6XIL3xfstests-dev/tests/tmpfs/ install 2023-09-13T08:27:12.736 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2023-09-13T08:27:12.746 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2023-09-13T08:27:12.753 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2023-09-13T08:27:12.762 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2023-09-13T08:27:12.770 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.UxTBQ6XIL3xfstests-dev/tests/udf/ install 2023-09-13T08:27:12.772 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2023-09-13T08:27:12.780 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2023-09-13T08:27:12.789 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2023-09-13T08:27:12.798 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2023-09-13T08:27:12.807 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.UxTBQ6XIL3xfstests-dev/tests/xfs/ install 2023-09-13T08:27:12.811 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2023-09-13T08:27:12.819 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2023-09-13T08:27:14.676 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2023-09-13T08:27:14.685 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 644 096.out.internal 033.out.crc 096.out.external 033.out.default 071.out.64 216.out.classic 216.out.64mblog 071.out.32 216.cfg 033.cfg 537.out 295.out 497.out 337.out 385.out 082.out 270.out 460.out 149.out 759.out 502.out 088.out 366.out 202.out 137.out 034.out 110.out 389.out 018.out 593.out 571.out 243.out 592.out 282.out 267.out 728.out 468.out 799.out 284.out 528.out 769.out 428.out 507.out 407.out 228.out 128.out 171.out 183.out 273.out 017.out 492.out 109.out 559.out 506.out 195.out 732.out 268.out 275.out 113.out 532.out 591.out 281.out 471.out 723.out 255.out 013.out 371.out 319.out 467.out 523.out 119.out 775.out 727.out 372.out 329.out 165.out 229.out 103.out 003.out 129.out 131.out 383.out 738.out 260.out 718.out 143.out 716.out 161.out 516.out 518.out 416.out 026.out 116.out 043.out 155.out 338.out 238.out 500.out 138.out 189.out 263.out 184.out 181.out 160.out 483.out 274.out 722.out 061.out 239.out 047.out 772.out 258.out 379.out 322.out 039.out 430.out 173.out 222.out 742.out 098.out 426.out 290.out 480.out 060.out 406.out 306.out 141.out 106.out 006.out 167.out 191.out 542.out 211.out 442.out 188.out 099.out 177.out 721.out 174.out 156.out 771.out 324.out 224.out 313.out 124.out 278.out 058.out 741.out 384.out 042.out 193.out 392.out 768.out 399.out 473.out 770.out 709.out 247.out 568.out 364.out 209.out 441.out 440.out 009.out 740.out 356.out 197.out 341.out 094.out 241.out 501.out 089.out 540.out 514.out 414.out 314.out 214.out 381.out 147.out 041.out 340.out 793.out 358.out 572.out 586.out 240.out 549.out 092.out 439.out 434.out 140.out 708.out 766.out 508.out 408.out 308.out 208.out 737.out 040.out 304.out 349.out 254.out 544.out 059.out 086.out 249.out 335.out 142.out 235.out 436.out 575.out 253.out 715.out 533.out 264.out 431.out 784.out 433.out 036.out 316.out 169.out 035.out 579.out 457.out 297.out 393.out 333.out 599.out 476.out 087.out 199.out 739.out 233.out 752.out 736.out 443.out 773.out 053.out 749.out 279.out 133.out 711.out 458.out 164.out 589.out 587.out 339.out 577.out 294.out 352.out 484.out 498.out 489.out 139.out 774.out 790.out 552.out 781.out 357.out 065.out 097.out 175.out 186.out 452.out 069.out 252.out 751.out 376.out 724.out 206.out 778.out 190.out 794.out 348.out 466.out 248.out 725.out 785.out 750.out 525.out 496.out 325.out 257.out 225.out 125.out 789.out 192.out 296.out 152.out 563.out 246.out 551.out 015.out 792.out 075.out 472.out 578.out 463.out 550.out 052.out 534.out 351.out 276.out 451.out 425.out 450.out 744.out 251.out 444.out 487.out 762.out 395.out 515.out 415.out 315.out 215.out 115.out 597.out 027.out 250.out 344.out 051.out 536.out 030.out 244.out 336.out 028.out 150.out 144.out 505.out 342.out 136.out 598.out 005.out 176.out 198.out 008.out 390.out 178.out 405.out 305.out 205.out 105.out 367.out 291.out 437.out 044.out 719.out 323.out 519.out 363.out 562.out 382.out 570.out 388.out 527.out 158.out 019.out 237.out 151.out 760.out 227.out 163.out 332.out 796.out 582.out 232.out 584.out 462.out 220.out 412.out 132.out 179.out 037.out 293.out 499.out 112.out 748.out 020.out 786.out 063.out 561.out 076.out 465.out 014.out 758.out 387.out 594.out 438.out 265.out 289.out 574.out 755.out 548.out 299.out 419.out 521.out 581.out 595.out 461.out 477.out 307.out 726.out 107.out 007.out 448.out 262.out 380.out 093.out 479.out 547.out 326.out 226.out 747.out 126.out 025.out 121.out 447.out 761.out 580.out 021.out 485.out 347.out 077.out 090.out 361.out 564.out 788.out 066.out 455.out 432.out 002.out 585.out 162.out 288.out 050.out 396.out 446.out 350.out 354.out 429.out 187.out 360.out 543.out 261.out 734.out 045.out 292.out 482.out 729.out 104.out 048.out 062.out 529.out 231.out 343.out 503.out 526.out 486.out 223.out 123.out 023.out 459.out 032.out 798.out 277.out 373.out 146.out 398.out 168.out 427.out 590.out 280.out 470.out 491.out 767.out 016.out 046.out 488.out 731.out 782.out 374.out 583.out 285.out 127.out 328.out 359.out 531.out 301.out 101.out 266.out 331.out 791.out 743.out 556.out 713.out 081.out 024.out 513.out 213.out 730.out 095.out 031.out 565.out 182.out 272.out 530.out 754.out 573.out 576.out 569.out 454.out 259.out 449.out 327.out 330.out 067.out 493.out 010.out 287.out 230.out 166.out 130.out 219.out 073.out 370.out 135.out 303.out 203.out 345.out 355.out 386.out 560.out 055.out 334.out 245.out 522.out 787.out 745.out 422.out 394.out 539.out 524.out 122.out 234.out 022.out 424.out 779.out 490.out 435.out 353.out 423.out 134.out 154.out 271.out 064.out 418.out 318.out 218.out 118.out 757.out 377.out 172.out 079.out 469.out 054.out 049.out 765.out 776.out 456.out 180.out 378.out 421.out 712.out 403.out 321.out 057.out 512.out 494.out 221.out 312.out 212.out 538.out 256.out 012.out 764.out 283.out 554.out 397.out 185.out 596.out 720.out 481.out 196.out 520.out 242.out 420.out 478.out 320.out 555.out 120.out 153.out 402.out 302.out 102.out 717.out 517.out 417.out 317.out 365.out 217.out 117.out 475.out 072.out 068.out 474.out 038.out 084.out 056.out 369.out 511.out 148.out 411.out 029.out 311.out 368.out 111.out 011.out 783.out 194.out 170.out 286.out 756.out 545.out 714.out 157.out 710.out 510.out 413.out 410.out 310.out 210.out 401.out 201.out 001.out 495.out 362.out 114.out 753.out 074.out 145.out 797.out 464.out 091.out 746.out 083.out 800.out 777.out 400.out 300.out 200.out 100.out 375.out 541.out 445.out 269.out 546.out 780.out 553.out 763.out 298.out 567.out 080.out 070.out 509.out 409.out 309.out 207.out 108.out 346.out 391.out 004.out 557.out 453.out 236.out 078.out 159.out 566.out 735.out 085.out 588.out 504.out 404.out 558.out 204.out 535.out 795.out 733.out /var/lib/xfstests/tests/xfs 2023-09-13T08:27:16.572 INFO:teuthology.orchestra.run.smithi084.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2023-09-13T08:27:16.581 INFO:teuthology.orchestra.run.smithi084.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2023-09-13T08:27:16.589 INFO:teuthology.orchestra.run.smithi084.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2023-09-13T08:27:16.598 INFO:teuthology.orchestra.run.smithi084.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2023-09-13T08:27:16.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T08:27:16.609 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec ls tests/generic) 2023-09-13T08:27:16.627 INFO:teuthology.orchestra.run.smithi084.stdout:001 2023-09-13T08:27:16.627 INFO:teuthology.orchestra.run.smithi084.stdout:001.out 2023-09-13T08:27:16.627 INFO:teuthology.orchestra.run.smithi084.stdout:002 2023-09-13T08:27:16.628 INFO:teuthology.orchestra.run.smithi084.stdout:002.out 2023-09-13T08:27:16.628 INFO:teuthology.orchestra.run.smithi084.stdout:003 2023-09-13T08:27:16.628 INFO:teuthology.orchestra.run.smithi084.stdout:003.out 2023-09-13T08:27:16.628 INFO:teuthology.orchestra.run.smithi084.stdout:004 2023-09-13T08:27:16.629 INFO:teuthology.orchestra.run.smithi084.stdout:004.out 2023-09-13T08:27:16.629 INFO:teuthology.orchestra.run.smithi084.stdout:005 2023-09-13T08:27:16.629 INFO:teuthology.orchestra.run.smithi084.stdout:005.out 2023-09-13T08:27:16.629 INFO:teuthology.orchestra.run.smithi084.stdout:006 2023-09-13T08:27:16.629 INFO:teuthology.orchestra.run.smithi084.stdout:006.out 2023-09-13T08:27:16.629 INFO:teuthology.orchestra.run.smithi084.stdout:007 2023-09-13T08:27:16.630 INFO:teuthology.orchestra.run.smithi084.stdout:007.out 2023-09-13T08:27:16.630 INFO:teuthology.orchestra.run.smithi084.stdout:008 2023-09-13T08:27:16.630 INFO:teuthology.orchestra.run.smithi084.stdout:008.out 2023-09-13T08:27:16.630 INFO:teuthology.orchestra.run.smithi084.stdout:009 2023-09-13T08:27:16.631 INFO:teuthology.orchestra.run.smithi084.stdout:009.out 2023-09-13T08:27:16.631 INFO:teuthology.orchestra.run.smithi084.stdout:010 2023-09-13T08:27:16.631 INFO:teuthology.orchestra.run.smithi084.stdout:010.out 2023-09-13T08:27:16.631 INFO:teuthology.orchestra.run.smithi084.stdout:011 2023-09-13T08:27:16.631 INFO:teuthology.orchestra.run.smithi084.stdout:011.out 2023-09-13T08:27:16.632 INFO:teuthology.orchestra.run.smithi084.stdout:012 2023-09-13T08:27:16.632 INFO:teuthology.orchestra.run.smithi084.stdout:012.out 2023-09-13T08:27:16.632 INFO:teuthology.orchestra.run.smithi084.stdout:013 2023-09-13T08:27:16.632 INFO:teuthology.orchestra.run.smithi084.stdout:013.out 2023-09-13T08:27:16.632 INFO:teuthology.orchestra.run.smithi084.stdout:014 2023-09-13T08:27:16.633 INFO:teuthology.orchestra.run.smithi084.stdout:014.out 2023-09-13T08:27:16.633 INFO:teuthology.orchestra.run.smithi084.stdout:015 2023-09-13T08:27:16.634 INFO:teuthology.orchestra.run.smithi084.stdout:015.out 2023-09-13T08:27:16.634 INFO:teuthology.orchestra.run.smithi084.stdout:016 2023-09-13T08:27:16.634 INFO:teuthology.orchestra.run.smithi084.stdout:016.out 2023-09-13T08:27:16.634 INFO:teuthology.orchestra.run.smithi084.stdout:017 2023-09-13T08:27:16.635 INFO:teuthology.orchestra.run.smithi084.stdout:017.out 2023-09-13T08:27:16.635 INFO:teuthology.orchestra.run.smithi084.stdout:018 2023-09-13T08:27:16.635 INFO:teuthology.orchestra.run.smithi084.stdout:018.out 2023-09-13T08:27:16.635 INFO:teuthology.orchestra.run.smithi084.stdout:019 2023-09-13T08:27:16.635 INFO:teuthology.orchestra.run.smithi084.stdout:019.out 2023-09-13T08:27:16.636 INFO:teuthology.orchestra.run.smithi084.stdout:020 2023-09-13T08:27:16.636 INFO:teuthology.orchestra.run.smithi084.stdout:020.out 2023-09-13T08:27:16.636 INFO:teuthology.orchestra.run.smithi084.stdout:021 2023-09-13T08:27:16.636 INFO:teuthology.orchestra.run.smithi084.stdout:021.out 2023-09-13T08:27:16.636 INFO:teuthology.orchestra.run.smithi084.stdout:022 2023-09-13T08:27:16.637 INFO:teuthology.orchestra.run.smithi084.stdout:022.out 2023-09-13T08:27:16.637 INFO:teuthology.orchestra.run.smithi084.stdout:023 2023-09-13T08:27:16.637 INFO:teuthology.orchestra.run.smithi084.stdout:023.out 2023-09-13T08:27:16.637 INFO:teuthology.orchestra.run.smithi084.stdout:024 2023-09-13T08:27:16.637 INFO:teuthology.orchestra.run.smithi084.stdout:024.out 2023-09-13T08:27:16.637 INFO:teuthology.orchestra.run.smithi084.stdout:025 2023-09-13T08:27:16.638 INFO:teuthology.orchestra.run.smithi084.stdout:025.out 2023-09-13T08:27:16.638 INFO:teuthology.orchestra.run.smithi084.stdout:026 2023-09-13T08:27:16.638 INFO:teuthology.orchestra.run.smithi084.stdout:026.out 2023-09-13T08:27:16.638 INFO:teuthology.orchestra.run.smithi084.stdout:027 2023-09-13T08:27:16.638 INFO:teuthology.orchestra.run.smithi084.stdout:027.out 2023-09-13T08:27:16.639 INFO:teuthology.orchestra.run.smithi084.stdout:028 2023-09-13T08:27:16.639 INFO:teuthology.orchestra.run.smithi084.stdout:028.out 2023-09-13T08:27:16.639 INFO:teuthology.orchestra.run.smithi084.stdout:029 2023-09-13T08:27:16.639 INFO:teuthology.orchestra.run.smithi084.stdout:029.out 2023-09-13T08:27:16.639 INFO:teuthology.orchestra.run.smithi084.stdout:030 2023-09-13T08:27:16.640 INFO:teuthology.orchestra.run.smithi084.stdout:030.out 2023-09-13T08:27:16.640 INFO:teuthology.orchestra.run.smithi084.stdout:031 2023-09-13T08:27:16.640 INFO:teuthology.orchestra.run.smithi084.stdout:031.out 2023-09-13T08:27:16.640 INFO:teuthology.orchestra.run.smithi084.stdout:032 2023-09-13T08:27:16.640 INFO:teuthology.orchestra.run.smithi084.stdout:032.out 2023-09-13T08:27:16.641 INFO:teuthology.orchestra.run.smithi084.stdout:033 2023-09-13T08:27:16.641 INFO:teuthology.orchestra.run.smithi084.stdout:033.out 2023-09-13T08:27:16.641 INFO:teuthology.orchestra.run.smithi084.stdout:034 2023-09-13T08:27:16.641 INFO:teuthology.orchestra.run.smithi084.stdout:034.out 2023-09-13T08:27:16.641 INFO:teuthology.orchestra.run.smithi084.stdout:035 2023-09-13T08:27:16.641 INFO:teuthology.orchestra.run.smithi084.stdout:035.cfg 2023-09-13T08:27:16.642 INFO:teuthology.orchestra.run.smithi084.stdout:035.out.default 2023-09-13T08:27:16.642 INFO:teuthology.orchestra.run.smithi084.stdout:035.out.nfs 2023-09-13T08:27:16.642 INFO:teuthology.orchestra.run.smithi084.stdout:036 2023-09-13T08:27:16.642 INFO:teuthology.orchestra.run.smithi084.stdout:036.out 2023-09-13T08:27:16.642 INFO:teuthology.orchestra.run.smithi084.stdout:037 2023-09-13T08:27:16.643 INFO:teuthology.orchestra.run.smithi084.stdout:037.out 2023-09-13T08:27:16.643 INFO:teuthology.orchestra.run.smithi084.stdout:038 2023-09-13T08:27:16.643 INFO:teuthology.orchestra.run.smithi084.stdout:038.out 2023-09-13T08:27:16.643 INFO:teuthology.orchestra.run.smithi084.stdout:039 2023-09-13T08:27:16.643 INFO:teuthology.orchestra.run.smithi084.stdout:039.out 2023-09-13T08:27:16.644 INFO:teuthology.orchestra.run.smithi084.stdout:040 2023-09-13T08:27:16.644 INFO:teuthology.orchestra.run.smithi084.stdout:040.out 2023-09-13T08:27:16.644 INFO:teuthology.orchestra.run.smithi084.stdout:041 2023-09-13T08:27:16.644 INFO:teuthology.orchestra.run.smithi084.stdout:041.out 2023-09-13T08:27:16.644 INFO:teuthology.orchestra.run.smithi084.stdout:042 2023-09-13T08:27:16.645 INFO:teuthology.orchestra.run.smithi084.stdout:042.out 2023-09-13T08:27:16.645 INFO:teuthology.orchestra.run.smithi084.stdout:043 2023-09-13T08:27:16.645 INFO:teuthology.orchestra.run.smithi084.stdout:043.out 2023-09-13T08:27:16.645 INFO:teuthology.orchestra.run.smithi084.stdout:044 2023-09-13T08:27:16.645 INFO:teuthology.orchestra.run.smithi084.stdout:044.out 2023-09-13T08:27:16.646 INFO:teuthology.orchestra.run.smithi084.stdout:045 2023-09-13T08:27:16.646 INFO:teuthology.orchestra.run.smithi084.stdout:045.out 2023-09-13T08:27:16.646 INFO:teuthology.orchestra.run.smithi084.stdout:046 2023-09-13T08:27:16.646 INFO:teuthology.orchestra.run.smithi084.stdout:046.out 2023-09-13T08:27:16.646 INFO:teuthology.orchestra.run.smithi084.stdout:047 2023-09-13T08:27:16.647 INFO:teuthology.orchestra.run.smithi084.stdout:047.out 2023-09-13T08:27:16.647 INFO:teuthology.orchestra.run.smithi084.stdout:048 2023-09-13T08:27:16.647 INFO:teuthology.orchestra.run.smithi084.stdout:048.out 2023-09-13T08:27:16.647 INFO:teuthology.orchestra.run.smithi084.stdout:049 2023-09-13T08:27:16.647 INFO:teuthology.orchestra.run.smithi084.stdout:049.out 2023-09-13T08:27:16.647 INFO:teuthology.orchestra.run.smithi084.stdout:050 2023-09-13T08:27:16.648 INFO:teuthology.orchestra.run.smithi084.stdout:050.cfg 2023-09-13T08:27:16.648 INFO:teuthology.orchestra.run.smithi084.stdout:050.out.default 2023-09-13T08:27:16.648 INFO:teuthology.orchestra.run.smithi084.stdout:050.out.nojournal 2023-09-13T08:27:16.648 INFO:teuthology.orchestra.run.smithi084.stdout:050.out.xfsquota 2023-09-13T08:27:16.648 INFO:teuthology.orchestra.run.smithi084.stdout:051 2023-09-13T08:27:16.649 INFO:teuthology.orchestra.run.smithi084.stdout:051.out 2023-09-13T08:27:16.649 INFO:teuthology.orchestra.run.smithi084.stdout:052 2023-09-13T08:27:16.649 INFO:teuthology.orchestra.run.smithi084.stdout:052.out 2023-09-13T08:27:16.649 INFO:teuthology.orchestra.run.smithi084.stdout:053 2023-09-13T08:27:16.649 INFO:teuthology.orchestra.run.smithi084.stdout:053.out 2023-09-13T08:27:16.650 INFO:teuthology.orchestra.run.smithi084.stdout:054 2023-09-13T08:27:16.650 INFO:teuthology.orchestra.run.smithi084.stdout:054.out 2023-09-13T08:27:16.650 INFO:teuthology.orchestra.run.smithi084.stdout:055 2023-09-13T08:27:16.650 INFO:teuthology.orchestra.run.smithi084.stdout:055.out 2023-09-13T08:27:16.650 INFO:teuthology.orchestra.run.smithi084.stdout:056 2023-09-13T08:27:16.651 INFO:teuthology.orchestra.run.smithi084.stdout:056.out 2023-09-13T08:27:16.651 INFO:teuthology.orchestra.run.smithi084.stdout:057 2023-09-13T08:27:16.651 INFO:teuthology.orchestra.run.smithi084.stdout:057.out 2023-09-13T08:27:16.651 INFO:teuthology.orchestra.run.smithi084.stdout:058 2023-09-13T08:27:16.651 INFO:teuthology.orchestra.run.smithi084.stdout:058.out 2023-09-13T08:27:16.652 INFO:teuthology.orchestra.run.smithi084.stdout:059 2023-09-13T08:27:16.652 INFO:teuthology.orchestra.run.smithi084.stdout:059.out 2023-09-13T08:27:16.652 INFO:teuthology.orchestra.run.smithi084.stdout:060 2023-09-13T08:27:16.652 INFO:teuthology.orchestra.run.smithi084.stdout:060.out 2023-09-13T08:27:16.652 INFO:teuthology.orchestra.run.smithi084.stdout:061 2023-09-13T08:27:16.653 INFO:teuthology.orchestra.run.smithi084.stdout:061.out 2023-09-13T08:27:16.653 INFO:teuthology.orchestra.run.smithi084.stdout:062 2023-09-13T08:27:16.653 INFO:teuthology.orchestra.run.smithi084.stdout:062.out 2023-09-13T08:27:16.653 INFO:teuthology.orchestra.run.smithi084.stdout:063 2023-09-13T08:27:16.653 INFO:teuthology.orchestra.run.smithi084.stdout:063.out 2023-09-13T08:27:16.653 INFO:teuthology.orchestra.run.smithi084.stdout:064 2023-09-13T08:27:16.654 INFO:teuthology.orchestra.run.smithi084.stdout:064.out 2023-09-13T08:27:16.654 INFO:teuthology.orchestra.run.smithi084.stdout:065 2023-09-13T08:27:16.654 INFO:teuthology.orchestra.run.smithi084.stdout:065.out 2023-09-13T08:27:16.654 INFO:teuthology.orchestra.run.smithi084.stdout:066 2023-09-13T08:27:16.654 INFO:teuthology.orchestra.run.smithi084.stdout:066.out 2023-09-13T08:27:16.655 INFO:teuthology.orchestra.run.smithi084.stdout:067 2023-09-13T08:27:16.655 INFO:teuthology.orchestra.run.smithi084.stdout:067.out 2023-09-13T08:27:16.655 INFO:teuthology.orchestra.run.smithi084.stdout:068 2023-09-13T08:27:16.655 INFO:teuthology.orchestra.run.smithi084.stdout:068.out 2023-09-13T08:27:16.655 INFO:teuthology.orchestra.run.smithi084.stdout:069 2023-09-13T08:27:16.656 INFO:teuthology.orchestra.run.smithi084.stdout:069.out 2023-09-13T08:27:16.656 INFO:teuthology.orchestra.run.smithi084.stdout:070 2023-09-13T08:27:16.656 INFO:teuthology.orchestra.run.smithi084.stdout:070.out 2023-09-13T08:27:16.656 INFO:teuthology.orchestra.run.smithi084.stdout:071 2023-09-13T08:27:16.656 INFO:teuthology.orchestra.run.smithi084.stdout:071.out 2023-09-13T08:27:16.656 INFO:teuthology.orchestra.run.smithi084.stdout:072 2023-09-13T08:27:16.657 INFO:teuthology.orchestra.run.smithi084.stdout:072.out 2023-09-13T08:27:16.657 INFO:teuthology.orchestra.run.smithi084.stdout:073 2023-09-13T08:27:16.657 INFO:teuthology.orchestra.run.smithi084.stdout:073.out 2023-09-13T08:27:16.657 INFO:teuthology.orchestra.run.smithi084.stdout:074 2023-09-13T08:27:16.657 INFO:teuthology.orchestra.run.smithi084.stdout:074.out 2023-09-13T08:27:16.658 INFO:teuthology.orchestra.run.smithi084.stdout:075 2023-09-13T08:27:16.658 INFO:teuthology.orchestra.run.smithi084.stdout:075.out 2023-09-13T08:27:16.658 INFO:teuthology.orchestra.run.smithi084.stdout:076 2023-09-13T08:27:16.658 INFO:teuthology.orchestra.run.smithi084.stdout:076.out 2023-09-13T08:27:16.658 INFO:teuthology.orchestra.run.smithi084.stdout:077 2023-09-13T08:27:16.659 INFO:teuthology.orchestra.run.smithi084.stdout:077.out 2023-09-13T08:27:16.659 INFO:teuthology.orchestra.run.smithi084.stdout:078 2023-09-13T08:27:16.659 INFO:teuthology.orchestra.run.smithi084.stdout:078.out 2023-09-13T08:27:16.659 INFO:teuthology.orchestra.run.smithi084.stdout:079 2023-09-13T08:27:16.659 INFO:teuthology.orchestra.run.smithi084.stdout:079.out 2023-09-13T08:27:16.659 INFO:teuthology.orchestra.run.smithi084.stdout:080 2023-09-13T08:27:16.660 INFO:teuthology.orchestra.run.smithi084.stdout:080.out 2023-09-13T08:27:16.660 INFO:teuthology.orchestra.run.smithi084.stdout:081 2023-09-13T08:27:16.660 INFO:teuthology.orchestra.run.smithi084.stdout:081.out 2023-09-13T08:27:16.660 INFO:teuthology.orchestra.run.smithi084.stdout:082 2023-09-13T08:27:16.660 INFO:teuthology.orchestra.run.smithi084.stdout:082.out 2023-09-13T08:27:16.661 INFO:teuthology.orchestra.run.smithi084.stdout:083 2023-09-13T08:27:16.661 INFO:teuthology.orchestra.run.smithi084.stdout:083.out 2023-09-13T08:27:16.661 INFO:teuthology.orchestra.run.smithi084.stdout:084 2023-09-13T08:27:16.661 INFO:teuthology.orchestra.run.smithi084.stdout:084.out 2023-09-13T08:27:16.661 INFO:teuthology.orchestra.run.smithi084.stdout:085 2023-09-13T08:27:16.662 INFO:teuthology.orchestra.run.smithi084.stdout:085.out 2023-09-13T08:27:16.662 INFO:teuthology.orchestra.run.smithi084.stdout:086 2023-09-13T08:27:16.662 INFO:teuthology.orchestra.run.smithi084.stdout:086.out 2023-09-13T08:27:16.662 INFO:teuthology.orchestra.run.smithi084.stdout:087 2023-09-13T08:27:16.662 INFO:teuthology.orchestra.run.smithi084.stdout:087.out 2023-09-13T08:27:16.663 INFO:teuthology.orchestra.run.smithi084.stdout:088 2023-09-13T08:27:16.663 INFO:teuthology.orchestra.run.smithi084.stdout:088.out 2023-09-13T08:27:16.663 INFO:teuthology.orchestra.run.smithi084.stdout:089 2023-09-13T08:27:16.663 INFO:teuthology.orchestra.run.smithi084.stdout:089.out 2023-09-13T08:27:16.663 INFO:teuthology.orchestra.run.smithi084.stdout:090 2023-09-13T08:27:16.663 INFO:teuthology.orchestra.run.smithi084.stdout:090.out 2023-09-13T08:27:16.664 INFO:teuthology.orchestra.run.smithi084.stdout:091 2023-09-13T08:27:16.664 INFO:teuthology.orchestra.run.smithi084.stdout:091.out 2023-09-13T08:27:16.664 INFO:teuthology.orchestra.run.smithi084.stdout:092 2023-09-13T08:27:16.664 INFO:teuthology.orchestra.run.smithi084.stdout:092.out 2023-09-13T08:27:16.664 INFO:teuthology.orchestra.run.smithi084.stdout:093 2023-09-13T08:27:16.665 INFO:teuthology.orchestra.run.smithi084.stdout:093.out 2023-09-13T08:27:16.665 INFO:teuthology.orchestra.run.smithi084.stdout:094 2023-09-13T08:27:16.665 INFO:teuthology.orchestra.run.smithi084.stdout:094.out 2023-09-13T08:27:16.665 INFO:teuthology.orchestra.run.smithi084.stdout:095 2023-09-13T08:27:16.665 INFO:teuthology.orchestra.run.smithi084.stdout:095.out 2023-09-13T08:27:16.666 INFO:teuthology.orchestra.run.smithi084.stdout:096 2023-09-13T08:27:16.666 INFO:teuthology.orchestra.run.smithi084.stdout:096.out 2023-09-13T08:27:16.666 INFO:teuthology.orchestra.run.smithi084.stdout:097 2023-09-13T08:27:16.666 INFO:teuthology.orchestra.run.smithi084.stdout:097.out 2023-09-13T08:27:16.666 INFO:teuthology.orchestra.run.smithi084.stdout:098 2023-09-13T08:27:16.666 INFO:teuthology.orchestra.run.smithi084.stdout:098.out 2023-09-13T08:27:16.667 INFO:teuthology.orchestra.run.smithi084.stdout:099 2023-09-13T08:27:16.667 INFO:teuthology.orchestra.run.smithi084.stdout:099.out 2023-09-13T08:27:16.667 INFO:teuthology.orchestra.run.smithi084.stdout:100 2023-09-13T08:27:16.667 INFO:teuthology.orchestra.run.smithi084.stdout:100.out 2023-09-13T08:27:16.667 INFO:teuthology.orchestra.run.smithi084.stdout:101 2023-09-13T08:27:16.668 INFO:teuthology.orchestra.run.smithi084.stdout:101.out 2023-09-13T08:27:16.668 INFO:teuthology.orchestra.run.smithi084.stdout:102 2023-09-13T08:27:16.668 INFO:teuthology.orchestra.run.smithi084.stdout:102.out 2023-09-13T08:27:16.668 INFO:teuthology.orchestra.run.smithi084.stdout:103 2023-09-13T08:27:16.668 INFO:teuthology.orchestra.run.smithi084.stdout:103.out 2023-09-13T08:27:16.669 INFO:teuthology.orchestra.run.smithi084.stdout:104 2023-09-13T08:27:16.669 INFO:teuthology.orchestra.run.smithi084.stdout:104.out 2023-09-13T08:27:16.669 INFO:teuthology.orchestra.run.smithi084.stdout:105 2023-09-13T08:27:16.669 INFO:teuthology.orchestra.run.smithi084.stdout:105.out 2023-09-13T08:27:16.669 INFO:teuthology.orchestra.run.smithi084.stdout:106 2023-09-13T08:27:16.670 INFO:teuthology.orchestra.run.smithi084.stdout:106.out 2023-09-13T08:27:16.670 INFO:teuthology.orchestra.run.smithi084.stdout:107 2023-09-13T08:27:16.670 INFO:teuthology.orchestra.run.smithi084.stdout:107.out 2023-09-13T08:27:16.670 INFO:teuthology.orchestra.run.smithi084.stdout:108 2023-09-13T08:27:16.670 INFO:teuthology.orchestra.run.smithi084.stdout:108.out 2023-09-13T08:27:16.671 INFO:teuthology.orchestra.run.smithi084.stdout:109 2023-09-13T08:27:16.671 INFO:teuthology.orchestra.run.smithi084.stdout:109.out 2023-09-13T08:27:16.671 INFO:teuthology.orchestra.run.smithi084.stdout:110 2023-09-13T08:27:16.671 INFO:teuthology.orchestra.run.smithi084.stdout:110.out 2023-09-13T08:27:16.671 INFO:teuthology.orchestra.run.smithi084.stdout:111 2023-09-13T08:27:16.672 INFO:teuthology.orchestra.run.smithi084.stdout:111.out 2023-09-13T08:27:16.672 INFO:teuthology.orchestra.run.smithi084.stdout:112 2023-09-13T08:27:16.672 INFO:teuthology.orchestra.run.smithi084.stdout:112.out 2023-09-13T08:27:16.672 INFO:teuthology.orchestra.run.smithi084.stdout:113 2023-09-13T08:27:16.672 INFO:teuthology.orchestra.run.smithi084.stdout:113.out 2023-09-13T08:27:16.673 INFO:teuthology.orchestra.run.smithi084.stdout:114 2023-09-13T08:27:16.673 INFO:teuthology.orchestra.run.smithi084.stdout:114.out 2023-09-13T08:27:16.673 INFO:teuthology.orchestra.run.smithi084.stdout:115 2023-09-13T08:27:16.673 INFO:teuthology.orchestra.run.smithi084.stdout:115.out 2023-09-13T08:27:16.673 INFO:teuthology.orchestra.run.smithi084.stdout:116 2023-09-13T08:27:16.673 INFO:teuthology.orchestra.run.smithi084.stdout:116.out 2023-09-13T08:27:16.674 INFO:teuthology.orchestra.run.smithi084.stdout:117 2023-09-13T08:27:16.674 INFO:teuthology.orchestra.run.smithi084.stdout:117.out 2023-09-13T08:27:16.674 INFO:teuthology.orchestra.run.smithi084.stdout:118 2023-09-13T08:27:16.674 INFO:teuthology.orchestra.run.smithi084.stdout:118.out 2023-09-13T08:27:16.674 INFO:teuthology.orchestra.run.smithi084.stdout:119 2023-09-13T08:27:16.675 INFO:teuthology.orchestra.run.smithi084.stdout:119.out 2023-09-13T08:27:16.675 INFO:teuthology.orchestra.run.smithi084.stdout:120 2023-09-13T08:27:16.675 INFO:teuthology.orchestra.run.smithi084.stdout:120.out 2023-09-13T08:27:16.675 INFO:teuthology.orchestra.run.smithi084.stdout:121 2023-09-13T08:27:16.675 INFO:teuthology.orchestra.run.smithi084.stdout:121.out 2023-09-13T08:27:16.676 INFO:teuthology.orchestra.run.smithi084.stdout:122 2023-09-13T08:27:16.676 INFO:teuthology.orchestra.run.smithi084.stdout:122.out 2023-09-13T08:27:16.676 INFO:teuthology.orchestra.run.smithi084.stdout:123 2023-09-13T08:27:16.676 INFO:teuthology.orchestra.run.smithi084.stdout:123.out 2023-09-13T08:27:16.676 INFO:teuthology.orchestra.run.smithi084.stdout:124 2023-09-13T08:27:16.676 INFO:teuthology.orchestra.run.smithi084.stdout:124.out 2023-09-13T08:27:16.677 INFO:teuthology.orchestra.run.smithi084.stdout:125 2023-09-13T08:27:16.677 INFO:teuthology.orchestra.run.smithi084.stdout:125.out 2023-09-13T08:27:16.677 INFO:teuthology.orchestra.run.smithi084.stdout:126 2023-09-13T08:27:16.677 INFO:teuthology.orchestra.run.smithi084.stdout:126.out 2023-09-13T08:27:16.677 INFO:teuthology.orchestra.run.smithi084.stdout:127 2023-09-13T08:27:16.678 INFO:teuthology.orchestra.run.smithi084.stdout:127.out 2023-09-13T08:27:16.678 INFO:teuthology.orchestra.run.smithi084.stdout:128 2023-09-13T08:27:16.678 INFO:teuthology.orchestra.run.smithi084.stdout:128.out 2023-09-13T08:27:16.678 INFO:teuthology.orchestra.run.smithi084.stdout:129 2023-09-13T08:27:16.678 INFO:teuthology.orchestra.run.smithi084.stdout:129.out 2023-09-13T08:27:16.679 INFO:teuthology.orchestra.run.smithi084.stdout:130 2023-09-13T08:27:16.679 INFO:teuthology.orchestra.run.smithi084.stdout:130.out 2023-09-13T08:27:16.679 INFO:teuthology.orchestra.run.smithi084.stdout:131 2023-09-13T08:27:16.679 INFO:teuthology.orchestra.run.smithi084.stdout:131.out 2023-09-13T08:27:16.679 INFO:teuthology.orchestra.run.smithi084.stdout:132 2023-09-13T08:27:16.680 INFO:teuthology.orchestra.run.smithi084.stdout:132.out 2023-09-13T08:27:16.680 INFO:teuthology.orchestra.run.smithi084.stdout:133 2023-09-13T08:27:16.680 INFO:teuthology.orchestra.run.smithi084.stdout:133.out 2023-09-13T08:27:16.680 INFO:teuthology.orchestra.run.smithi084.stdout:134 2023-09-13T08:27:16.680 INFO:teuthology.orchestra.run.smithi084.stdout:134.out 2023-09-13T08:27:16.680 INFO:teuthology.orchestra.run.smithi084.stdout:135 2023-09-13T08:27:16.681 INFO:teuthology.orchestra.run.smithi084.stdout:135.out 2023-09-13T08:27:16.681 INFO:teuthology.orchestra.run.smithi084.stdout:136 2023-09-13T08:27:16.681 INFO:teuthology.orchestra.run.smithi084.stdout:136.out 2023-09-13T08:27:16.681 INFO:teuthology.orchestra.run.smithi084.stdout:137 2023-09-13T08:27:16.681 INFO:teuthology.orchestra.run.smithi084.stdout:137.out 2023-09-13T08:27:16.682 INFO:teuthology.orchestra.run.smithi084.stdout:138 2023-09-13T08:27:16.682 INFO:teuthology.orchestra.run.smithi084.stdout:138.out 2023-09-13T08:27:16.682 INFO:teuthology.orchestra.run.smithi084.stdout:139 2023-09-13T08:27:16.682 INFO:teuthology.orchestra.run.smithi084.stdout:139.out 2023-09-13T08:27:16.683 INFO:teuthology.orchestra.run.smithi084.stdout:140 2023-09-13T08:27:16.683 INFO:teuthology.orchestra.run.smithi084.stdout:140.out 2023-09-13T08:27:16.683 INFO:teuthology.orchestra.run.smithi084.stdout:141 2023-09-13T08:27:16.683 INFO:teuthology.orchestra.run.smithi084.stdout:141.out 2023-09-13T08:27:16.684 INFO:teuthology.orchestra.run.smithi084.stdout:142 2023-09-13T08:27:16.684 INFO:teuthology.orchestra.run.smithi084.stdout:142.out 2023-09-13T08:27:16.684 INFO:teuthology.orchestra.run.smithi084.stdout:143 2023-09-13T08:27:16.684 INFO:teuthology.orchestra.run.smithi084.stdout:143.out 2023-09-13T08:27:16.684 INFO:teuthology.orchestra.run.smithi084.stdout:144 2023-09-13T08:27:16.684 INFO:teuthology.orchestra.run.smithi084.stdout:144.out 2023-09-13T08:27:16.685 INFO:teuthology.orchestra.run.smithi084.stdout:145 2023-09-13T08:27:16.685 INFO:teuthology.orchestra.run.smithi084.stdout:145.out 2023-09-13T08:27:16.685 INFO:teuthology.orchestra.run.smithi084.stdout:146 2023-09-13T08:27:16.685 INFO:teuthology.orchestra.run.smithi084.stdout:146.out 2023-09-13T08:27:16.686 INFO:teuthology.orchestra.run.smithi084.stdout:147 2023-09-13T08:27:16.686 INFO:teuthology.orchestra.run.smithi084.stdout:147.out 2023-09-13T08:27:16.686 INFO:teuthology.orchestra.run.smithi084.stdout:148 2023-09-13T08:27:16.686 INFO:teuthology.orchestra.run.smithi084.stdout:148.out 2023-09-13T08:27:16.686 INFO:teuthology.orchestra.run.smithi084.stdout:149 2023-09-13T08:27:16.687 INFO:teuthology.orchestra.run.smithi084.stdout:149.out 2023-09-13T08:27:16.687 INFO:teuthology.orchestra.run.smithi084.stdout:150 2023-09-13T08:27:16.687 INFO:teuthology.orchestra.run.smithi084.stdout:150.out 2023-09-13T08:27:16.687 INFO:teuthology.orchestra.run.smithi084.stdout:151 2023-09-13T08:27:16.687 INFO:teuthology.orchestra.run.smithi084.stdout:151.out 2023-09-13T08:27:16.687 INFO:teuthology.orchestra.run.smithi084.stdout:152 2023-09-13T08:27:16.688 INFO:teuthology.orchestra.run.smithi084.stdout:152.out 2023-09-13T08:27:16.688 INFO:teuthology.orchestra.run.smithi084.stdout:153 2023-09-13T08:27:16.688 INFO:teuthology.orchestra.run.smithi084.stdout:153.out 2023-09-13T08:27:16.688 INFO:teuthology.orchestra.run.smithi084.stdout:154 2023-09-13T08:27:16.688 INFO:teuthology.orchestra.run.smithi084.stdout:154.out 2023-09-13T08:27:16.689 INFO:teuthology.orchestra.run.smithi084.stdout:155 2023-09-13T08:27:16.689 INFO:teuthology.orchestra.run.smithi084.stdout:155.out 2023-09-13T08:27:16.689 INFO:teuthology.orchestra.run.smithi084.stdout:156 2023-09-13T08:27:16.689 INFO:teuthology.orchestra.run.smithi084.stdout:156.out 2023-09-13T08:27:16.689 INFO:teuthology.orchestra.run.smithi084.stdout:157 2023-09-13T08:27:16.690 INFO:teuthology.orchestra.run.smithi084.stdout:157.out 2023-09-13T08:27:16.690 INFO:teuthology.orchestra.run.smithi084.stdout:158 2023-09-13T08:27:16.690 INFO:teuthology.orchestra.run.smithi084.stdout:158.out 2023-09-13T08:27:16.690 INFO:teuthology.orchestra.run.smithi084.stdout:159 2023-09-13T08:27:16.690 INFO:teuthology.orchestra.run.smithi084.stdout:159.out 2023-09-13T08:27:16.690 INFO:teuthology.orchestra.run.smithi084.stdout:160 2023-09-13T08:27:16.691 INFO:teuthology.orchestra.run.smithi084.stdout:160.out 2023-09-13T08:27:16.691 INFO:teuthology.orchestra.run.smithi084.stdout:161 2023-09-13T08:27:16.691 INFO:teuthology.orchestra.run.smithi084.stdout:161.out 2023-09-13T08:27:16.691 INFO:teuthology.orchestra.run.smithi084.stdout:162 2023-09-13T08:27:16.691 INFO:teuthology.orchestra.run.smithi084.stdout:162.out 2023-09-13T08:27:16.692 INFO:teuthology.orchestra.run.smithi084.stdout:163 2023-09-13T08:27:16.692 INFO:teuthology.orchestra.run.smithi084.stdout:163.out 2023-09-13T08:27:16.692 INFO:teuthology.orchestra.run.smithi084.stdout:164 2023-09-13T08:27:16.692 INFO:teuthology.orchestra.run.smithi084.stdout:164.out 2023-09-13T08:27:16.692 INFO:teuthology.orchestra.run.smithi084.stdout:165 2023-09-13T08:27:16.693 INFO:teuthology.orchestra.run.smithi084.stdout:165.out 2023-09-13T08:27:16.693 INFO:teuthology.orchestra.run.smithi084.stdout:166 2023-09-13T08:27:16.693 INFO:teuthology.orchestra.run.smithi084.stdout:166.out 2023-09-13T08:27:16.693 INFO:teuthology.orchestra.run.smithi084.stdout:167 2023-09-13T08:27:16.693 INFO:teuthology.orchestra.run.smithi084.stdout:167.out 2023-09-13T08:27:16.693 INFO:teuthology.orchestra.run.smithi084.stdout:168 2023-09-13T08:27:16.694 INFO:teuthology.orchestra.run.smithi084.stdout:168.out 2023-09-13T08:27:16.694 INFO:teuthology.orchestra.run.smithi084.stdout:169 2023-09-13T08:27:16.694 INFO:teuthology.orchestra.run.smithi084.stdout:169.out 2023-09-13T08:27:16.694 INFO:teuthology.orchestra.run.smithi084.stdout:170 2023-09-13T08:27:16.694 INFO:teuthology.orchestra.run.smithi084.stdout:170.out 2023-09-13T08:27:16.695 INFO:teuthology.orchestra.run.smithi084.stdout:171 2023-09-13T08:27:16.695 INFO:teuthology.orchestra.run.smithi084.stdout:171.out 2023-09-13T08:27:16.695 INFO:teuthology.orchestra.run.smithi084.stdout:172 2023-09-13T08:27:16.695 INFO:teuthology.orchestra.run.smithi084.stdout:172.out 2023-09-13T08:27:16.695 INFO:teuthology.orchestra.run.smithi084.stdout:173 2023-09-13T08:27:16.696 INFO:teuthology.orchestra.run.smithi084.stdout:173.out 2023-09-13T08:27:16.696 INFO:teuthology.orchestra.run.smithi084.stdout:174 2023-09-13T08:27:16.696 INFO:teuthology.orchestra.run.smithi084.stdout:174.out 2023-09-13T08:27:16.696 INFO:teuthology.orchestra.run.smithi084.stdout:175 2023-09-13T08:27:16.696 INFO:teuthology.orchestra.run.smithi084.stdout:175.out 2023-09-13T08:27:16.696 INFO:teuthology.orchestra.run.smithi084.stdout:176 2023-09-13T08:27:16.697 INFO:teuthology.orchestra.run.smithi084.stdout:176.out 2023-09-13T08:27:16.697 INFO:teuthology.orchestra.run.smithi084.stdout:177 2023-09-13T08:27:16.697 INFO:teuthology.orchestra.run.smithi084.stdout:177.out 2023-09-13T08:27:16.697 INFO:teuthology.orchestra.run.smithi084.stdout:178 2023-09-13T08:27:16.697 INFO:teuthology.orchestra.run.smithi084.stdout:178.out 2023-09-13T08:27:16.698 INFO:teuthology.orchestra.run.smithi084.stdout:179 2023-09-13T08:27:16.698 INFO:teuthology.orchestra.run.smithi084.stdout:179.out 2023-09-13T08:27:16.698 INFO:teuthology.orchestra.run.smithi084.stdout:180 2023-09-13T08:27:16.698 INFO:teuthology.orchestra.run.smithi084.stdout:180.out 2023-09-13T08:27:16.698 INFO:teuthology.orchestra.run.smithi084.stdout:181 2023-09-13T08:27:16.699 INFO:teuthology.orchestra.run.smithi084.stdout:181.out 2023-09-13T08:27:16.699 INFO:teuthology.orchestra.run.smithi084.stdout:182 2023-09-13T08:27:16.699 INFO:teuthology.orchestra.run.smithi084.stdout:182.out 2023-09-13T08:27:16.699 INFO:teuthology.orchestra.run.smithi084.stdout:183 2023-09-13T08:27:16.699 INFO:teuthology.orchestra.run.smithi084.stdout:183.out 2023-09-13T08:27:16.700 INFO:teuthology.orchestra.run.smithi084.stdout:184 2023-09-13T08:27:16.700 INFO:teuthology.orchestra.run.smithi084.stdout:184.out 2023-09-13T08:27:16.700 INFO:teuthology.orchestra.run.smithi084.stdout:185 2023-09-13T08:27:16.700 INFO:teuthology.orchestra.run.smithi084.stdout:185.out 2023-09-13T08:27:16.700 INFO:teuthology.orchestra.run.smithi084.stdout:186 2023-09-13T08:27:16.700 INFO:teuthology.orchestra.run.smithi084.stdout:186.out 2023-09-13T08:27:16.701 INFO:teuthology.orchestra.run.smithi084.stdout:187 2023-09-13T08:27:16.701 INFO:teuthology.orchestra.run.smithi084.stdout:187.out 2023-09-13T08:27:16.701 INFO:teuthology.orchestra.run.smithi084.stdout:188 2023-09-13T08:27:16.701 INFO:teuthology.orchestra.run.smithi084.stdout:188.out 2023-09-13T08:27:16.701 INFO:teuthology.orchestra.run.smithi084.stdout:189 2023-09-13T08:27:16.702 INFO:teuthology.orchestra.run.smithi084.stdout:189.out 2023-09-13T08:27:16.702 INFO:teuthology.orchestra.run.smithi084.stdout:190 2023-09-13T08:27:16.702 INFO:teuthology.orchestra.run.smithi084.stdout:190.out 2023-09-13T08:27:16.702 INFO:teuthology.orchestra.run.smithi084.stdout:191 2023-09-13T08:27:16.702 INFO:teuthology.orchestra.run.smithi084.stdout:191.out 2023-09-13T08:27:16.703 INFO:teuthology.orchestra.run.smithi084.stdout:192 2023-09-13T08:27:16.703 INFO:teuthology.orchestra.run.smithi084.stdout:192.out 2023-09-13T08:27:16.703 INFO:teuthology.orchestra.run.smithi084.stdout:193 2023-09-13T08:27:16.703 INFO:teuthology.orchestra.run.smithi084.stdout:193.out 2023-09-13T08:27:16.703 INFO:teuthology.orchestra.run.smithi084.stdout:194 2023-09-13T08:27:16.704 INFO:teuthology.orchestra.run.smithi084.stdout:194.out 2023-09-13T08:27:16.704 INFO:teuthology.orchestra.run.smithi084.stdout:195 2023-09-13T08:27:16.704 INFO:teuthology.orchestra.run.smithi084.stdout:195.out 2023-09-13T08:27:16.704 INFO:teuthology.orchestra.run.smithi084.stdout:196 2023-09-13T08:27:16.704 INFO:teuthology.orchestra.run.smithi084.stdout:196.out 2023-09-13T08:27:16.704 INFO:teuthology.orchestra.run.smithi084.stdout:197 2023-09-13T08:27:16.705 INFO:teuthology.orchestra.run.smithi084.stdout:197.out 2023-09-13T08:27:16.705 INFO:teuthology.orchestra.run.smithi084.stdout:198 2023-09-13T08:27:16.705 INFO:teuthology.orchestra.run.smithi084.stdout:198.out 2023-09-13T08:27:16.705 INFO:teuthology.orchestra.run.smithi084.stdout:199 2023-09-13T08:27:16.705 INFO:teuthology.orchestra.run.smithi084.stdout:199.out 2023-09-13T08:27:16.706 INFO:teuthology.orchestra.run.smithi084.stdout:200 2023-09-13T08:27:16.706 INFO:teuthology.orchestra.run.smithi084.stdout:200.out 2023-09-13T08:27:16.706 INFO:teuthology.orchestra.run.smithi084.stdout:201 2023-09-13T08:27:16.706 INFO:teuthology.orchestra.run.smithi084.stdout:201.out 2023-09-13T08:27:16.706 INFO:teuthology.orchestra.run.smithi084.stdout:202 2023-09-13T08:27:16.707 INFO:teuthology.orchestra.run.smithi084.stdout:202.out 2023-09-13T08:27:16.707 INFO:teuthology.orchestra.run.smithi084.stdout:203 2023-09-13T08:27:16.707 INFO:teuthology.orchestra.run.smithi084.stdout:203.out 2023-09-13T08:27:16.707 INFO:teuthology.orchestra.run.smithi084.stdout:204 2023-09-13T08:27:16.707 INFO:teuthology.orchestra.run.smithi084.stdout:204.out 2023-09-13T08:27:16.708 INFO:teuthology.orchestra.run.smithi084.stdout:205 2023-09-13T08:27:16.708 INFO:teuthology.orchestra.run.smithi084.stdout:205.out 2023-09-13T08:27:16.708 INFO:teuthology.orchestra.run.smithi084.stdout:206 2023-09-13T08:27:16.708 INFO:teuthology.orchestra.run.smithi084.stdout:206.out 2023-09-13T08:27:16.708 INFO:teuthology.orchestra.run.smithi084.stdout:207 2023-09-13T08:27:16.708 INFO:teuthology.orchestra.run.smithi084.stdout:207.out 2023-09-13T08:27:16.709 INFO:teuthology.orchestra.run.smithi084.stdout:208 2023-09-13T08:27:16.709 INFO:teuthology.orchestra.run.smithi084.stdout:208.out 2023-09-13T08:27:16.709 INFO:teuthology.orchestra.run.smithi084.stdout:209 2023-09-13T08:27:16.709 INFO:teuthology.orchestra.run.smithi084.stdout:209.out 2023-09-13T08:27:16.709 INFO:teuthology.orchestra.run.smithi084.stdout:210 2023-09-13T08:27:16.710 INFO:teuthology.orchestra.run.smithi084.stdout:210.out 2023-09-13T08:27:16.710 INFO:teuthology.orchestra.run.smithi084.stdout:211 2023-09-13T08:27:16.710 INFO:teuthology.orchestra.run.smithi084.stdout:211.out 2023-09-13T08:27:16.710 INFO:teuthology.orchestra.run.smithi084.stdout:212 2023-09-13T08:27:16.710 INFO:teuthology.orchestra.run.smithi084.stdout:212.out 2023-09-13T08:27:16.711 INFO:teuthology.orchestra.run.smithi084.stdout:213 2023-09-13T08:27:16.711 INFO:teuthology.orchestra.run.smithi084.stdout:213.out 2023-09-13T08:27:16.711 INFO:teuthology.orchestra.run.smithi084.stdout:214 2023-09-13T08:27:16.711 INFO:teuthology.orchestra.run.smithi084.stdout:214.out 2023-09-13T08:27:16.711 INFO:teuthology.orchestra.run.smithi084.stdout:215 2023-09-13T08:27:16.712 INFO:teuthology.orchestra.run.smithi084.stdout:215.out 2023-09-13T08:27:16.712 INFO:teuthology.orchestra.run.smithi084.stdout:216 2023-09-13T08:27:16.712 INFO:teuthology.orchestra.run.smithi084.stdout:216.out 2023-09-13T08:27:16.712 INFO:teuthology.orchestra.run.smithi084.stdout:217 2023-09-13T08:27:16.712 INFO:teuthology.orchestra.run.smithi084.stdout:217.out 2023-09-13T08:27:16.713 INFO:teuthology.orchestra.run.smithi084.stdout:218 2023-09-13T08:27:16.713 INFO:teuthology.orchestra.run.smithi084.stdout:218.out 2023-09-13T08:27:16.713 INFO:teuthology.orchestra.run.smithi084.stdout:219 2023-09-13T08:27:16.713 INFO:teuthology.orchestra.run.smithi084.stdout:219.out 2023-09-13T08:27:16.713 INFO:teuthology.orchestra.run.smithi084.stdout:220 2023-09-13T08:27:16.713 INFO:teuthology.orchestra.run.smithi084.stdout:220.out 2023-09-13T08:27:16.714 INFO:teuthology.orchestra.run.smithi084.stdout:221 2023-09-13T08:27:16.714 INFO:teuthology.orchestra.run.smithi084.stdout:221.out 2023-09-13T08:27:16.714 INFO:teuthology.orchestra.run.smithi084.stdout:222 2023-09-13T08:27:16.714 INFO:teuthology.orchestra.run.smithi084.stdout:222.out 2023-09-13T08:27:16.714 INFO:teuthology.orchestra.run.smithi084.stdout:223 2023-09-13T08:27:16.715 INFO:teuthology.orchestra.run.smithi084.stdout:223.out 2023-09-13T08:27:16.715 INFO:teuthology.orchestra.run.smithi084.stdout:224 2023-09-13T08:27:16.715 INFO:teuthology.orchestra.run.smithi084.stdout:224.out 2023-09-13T08:27:16.715 INFO:teuthology.orchestra.run.smithi084.stdout:225 2023-09-13T08:27:16.715 INFO:teuthology.orchestra.run.smithi084.stdout:225.out 2023-09-13T08:27:16.716 INFO:teuthology.orchestra.run.smithi084.stdout:226 2023-09-13T08:27:16.716 INFO:teuthology.orchestra.run.smithi084.stdout:226.out 2023-09-13T08:27:16.716 INFO:teuthology.orchestra.run.smithi084.stdout:227 2023-09-13T08:27:16.716 INFO:teuthology.orchestra.run.smithi084.stdout:227.out 2023-09-13T08:27:16.716 INFO:teuthology.orchestra.run.smithi084.stdout:228 2023-09-13T08:27:16.717 INFO:teuthology.orchestra.run.smithi084.stdout:228.out 2023-09-13T08:27:16.717 INFO:teuthology.orchestra.run.smithi084.stdout:229 2023-09-13T08:27:16.717 INFO:teuthology.orchestra.run.smithi084.stdout:229.out 2023-09-13T08:27:16.717 INFO:teuthology.orchestra.run.smithi084.stdout:230 2023-09-13T08:27:16.717 INFO:teuthology.orchestra.run.smithi084.stdout:230.out 2023-09-13T08:27:16.718 INFO:teuthology.orchestra.run.smithi084.stdout:231 2023-09-13T08:27:16.718 INFO:teuthology.orchestra.run.smithi084.stdout:231.out 2023-09-13T08:27:16.718 INFO:teuthology.orchestra.run.smithi084.stdout:232 2023-09-13T08:27:16.718 INFO:teuthology.orchestra.run.smithi084.stdout:232.out 2023-09-13T08:27:16.718 INFO:teuthology.orchestra.run.smithi084.stdout:233 2023-09-13T08:27:16.719 INFO:teuthology.orchestra.run.smithi084.stdout:233.out 2023-09-13T08:27:16.719 INFO:teuthology.orchestra.run.smithi084.stdout:234 2023-09-13T08:27:16.719 INFO:teuthology.orchestra.run.smithi084.stdout:234.out 2023-09-13T08:27:16.719 INFO:teuthology.orchestra.run.smithi084.stdout:235 2023-09-13T08:27:16.719 INFO:teuthology.orchestra.run.smithi084.stdout:235.out 2023-09-13T08:27:16.719 INFO:teuthology.orchestra.run.smithi084.stdout:236 2023-09-13T08:27:16.720 INFO:teuthology.orchestra.run.smithi084.stdout:236.out 2023-09-13T08:27:16.720 INFO:teuthology.orchestra.run.smithi084.stdout:237 2023-09-13T08:27:16.720 INFO:teuthology.orchestra.run.smithi084.stdout:237.out 2023-09-13T08:27:16.720 INFO:teuthology.orchestra.run.smithi084.stdout:238 2023-09-13T08:27:16.720 INFO:teuthology.orchestra.run.smithi084.stdout:238.out 2023-09-13T08:27:16.721 INFO:teuthology.orchestra.run.smithi084.stdout:239 2023-09-13T08:27:16.721 INFO:teuthology.orchestra.run.smithi084.stdout:239.out 2023-09-13T08:27:16.721 INFO:teuthology.orchestra.run.smithi084.stdout:240 2023-09-13T08:27:16.721 INFO:teuthology.orchestra.run.smithi084.stdout:240.out 2023-09-13T08:27:16.721 INFO:teuthology.orchestra.run.smithi084.stdout:241 2023-09-13T08:27:16.722 INFO:teuthology.orchestra.run.smithi084.stdout:241.out 2023-09-13T08:27:16.722 INFO:teuthology.orchestra.run.smithi084.stdout:242 2023-09-13T08:27:16.722 INFO:teuthology.orchestra.run.smithi084.stdout:242.out 2023-09-13T08:27:16.722 INFO:teuthology.orchestra.run.smithi084.stdout:243 2023-09-13T08:27:16.722 INFO:teuthology.orchestra.run.smithi084.stdout:243.out 2023-09-13T08:27:16.722 INFO:teuthology.orchestra.run.smithi084.stdout:244 2023-09-13T08:27:16.723 INFO:teuthology.orchestra.run.smithi084.stdout:244.out 2023-09-13T08:27:16.723 INFO:teuthology.orchestra.run.smithi084.stdout:245 2023-09-13T08:27:16.723 INFO:teuthology.orchestra.run.smithi084.stdout:245.out 2023-09-13T08:27:16.723 INFO:teuthology.orchestra.run.smithi084.stdout:246 2023-09-13T08:27:16.723 INFO:teuthology.orchestra.run.smithi084.stdout:246.out 2023-09-13T08:27:16.724 INFO:teuthology.orchestra.run.smithi084.stdout:247 2023-09-13T08:27:16.724 INFO:teuthology.orchestra.run.smithi084.stdout:247.out 2023-09-13T08:27:16.724 INFO:teuthology.orchestra.run.smithi084.stdout:248 2023-09-13T08:27:16.724 INFO:teuthology.orchestra.run.smithi084.stdout:248.out 2023-09-13T08:27:16.724 INFO:teuthology.orchestra.run.smithi084.stdout:249 2023-09-13T08:27:16.725 INFO:teuthology.orchestra.run.smithi084.stdout:249.out 2023-09-13T08:27:16.725 INFO:teuthology.orchestra.run.smithi084.stdout:250 2023-09-13T08:27:16.725 INFO:teuthology.orchestra.run.smithi084.stdout:250.out 2023-09-13T08:27:16.725 INFO:teuthology.orchestra.run.smithi084.stdout:251 2023-09-13T08:27:16.725 INFO:teuthology.orchestra.run.smithi084.stdout:251.out 2023-09-13T08:27:16.725 INFO:teuthology.orchestra.run.smithi084.stdout:252 2023-09-13T08:27:16.726 INFO:teuthology.orchestra.run.smithi084.stdout:252.out 2023-09-13T08:27:16.726 INFO:teuthology.orchestra.run.smithi084.stdout:253 2023-09-13T08:27:16.726 INFO:teuthology.orchestra.run.smithi084.stdout:253.out 2023-09-13T08:27:16.726 INFO:teuthology.orchestra.run.smithi084.stdout:254 2023-09-13T08:27:16.726 INFO:teuthology.orchestra.run.smithi084.stdout:254.out 2023-09-13T08:27:16.727 INFO:teuthology.orchestra.run.smithi084.stdout:255 2023-09-13T08:27:16.727 INFO:teuthology.orchestra.run.smithi084.stdout:255.out 2023-09-13T08:27:16.727 INFO:teuthology.orchestra.run.smithi084.stdout:256 2023-09-13T08:27:16.727 INFO:teuthology.orchestra.run.smithi084.stdout:256.out 2023-09-13T08:27:16.727 INFO:teuthology.orchestra.run.smithi084.stdout:257 2023-09-13T08:27:16.728 INFO:teuthology.orchestra.run.smithi084.stdout:257.out 2023-09-13T08:27:16.728 INFO:teuthology.orchestra.run.smithi084.stdout:258 2023-09-13T08:27:16.728 INFO:teuthology.orchestra.run.smithi084.stdout:258.out 2023-09-13T08:27:16.728 INFO:teuthology.orchestra.run.smithi084.stdout:259 2023-09-13T08:27:16.728 INFO:teuthology.orchestra.run.smithi084.stdout:259.out 2023-09-13T08:27:16.728 INFO:teuthology.orchestra.run.smithi084.stdout:260 2023-09-13T08:27:16.729 INFO:teuthology.orchestra.run.smithi084.stdout:260.out 2023-09-13T08:27:16.729 INFO:teuthology.orchestra.run.smithi084.stdout:261 2023-09-13T08:27:16.729 INFO:teuthology.orchestra.run.smithi084.stdout:261.out 2023-09-13T08:27:16.729 INFO:teuthology.orchestra.run.smithi084.stdout:262 2023-09-13T08:27:16.729 INFO:teuthology.orchestra.run.smithi084.stdout:262.out 2023-09-13T08:27:16.730 INFO:teuthology.orchestra.run.smithi084.stdout:263 2023-09-13T08:27:16.730 INFO:teuthology.orchestra.run.smithi084.stdout:263.out 2023-09-13T08:27:16.730 INFO:teuthology.orchestra.run.smithi084.stdout:264 2023-09-13T08:27:16.730 INFO:teuthology.orchestra.run.smithi084.stdout:264.out 2023-09-13T08:27:16.730 INFO:teuthology.orchestra.run.smithi084.stdout:265 2023-09-13T08:27:16.731 INFO:teuthology.orchestra.run.smithi084.stdout:265.out 2023-09-13T08:27:16.731 INFO:teuthology.orchestra.run.smithi084.stdout:266 2023-09-13T08:27:16.731 INFO:teuthology.orchestra.run.smithi084.stdout:266.out 2023-09-13T08:27:16.731 INFO:teuthology.orchestra.run.smithi084.stdout:267 2023-09-13T08:27:16.731 INFO:teuthology.orchestra.run.smithi084.stdout:267.out 2023-09-13T08:27:16.731 INFO:teuthology.orchestra.run.smithi084.stdout:268 2023-09-13T08:27:16.732 INFO:teuthology.orchestra.run.smithi084.stdout:268.out 2023-09-13T08:27:16.732 INFO:teuthology.orchestra.run.smithi084.stdout:269 2023-09-13T08:27:16.732 INFO:teuthology.orchestra.run.smithi084.stdout:269.out 2023-09-13T08:27:16.732 INFO:teuthology.orchestra.run.smithi084.stdout:270 2023-09-13T08:27:16.732 INFO:teuthology.orchestra.run.smithi084.stdout:270.out 2023-09-13T08:27:16.733 INFO:teuthology.orchestra.run.smithi084.stdout:271 2023-09-13T08:27:16.733 INFO:teuthology.orchestra.run.smithi084.stdout:271.out 2023-09-13T08:27:16.733 INFO:teuthology.orchestra.run.smithi084.stdout:272 2023-09-13T08:27:16.733 INFO:teuthology.orchestra.run.smithi084.stdout:272.out 2023-09-13T08:27:16.733 INFO:teuthology.orchestra.run.smithi084.stdout:273 2023-09-13T08:27:16.734 INFO:teuthology.orchestra.run.smithi084.stdout:273.out 2023-09-13T08:27:16.734 INFO:teuthology.orchestra.run.smithi084.stdout:274 2023-09-13T08:27:16.734 INFO:teuthology.orchestra.run.smithi084.stdout:274.out 2023-09-13T08:27:16.734 INFO:teuthology.orchestra.run.smithi084.stdout:275 2023-09-13T08:27:16.734 INFO:teuthology.orchestra.run.smithi084.stdout:275.out 2023-09-13T08:27:16.735 INFO:teuthology.orchestra.run.smithi084.stdout:276 2023-09-13T08:27:16.735 INFO:teuthology.orchestra.run.smithi084.stdout:276.out 2023-09-13T08:27:16.735 INFO:teuthology.orchestra.run.smithi084.stdout:277 2023-09-13T08:27:16.735 INFO:teuthology.orchestra.run.smithi084.stdout:277.out 2023-09-13T08:27:16.735 INFO:teuthology.orchestra.run.smithi084.stdout:278 2023-09-13T08:27:16.736 INFO:teuthology.orchestra.run.smithi084.stdout:278.out 2023-09-13T08:27:16.736 INFO:teuthology.orchestra.run.smithi084.stdout:279 2023-09-13T08:27:16.736 INFO:teuthology.orchestra.run.smithi084.stdout:279.out 2023-09-13T08:27:16.736 INFO:teuthology.orchestra.run.smithi084.stdout:280 2023-09-13T08:27:16.736 INFO:teuthology.orchestra.run.smithi084.stdout:280.out 2023-09-13T08:27:16.736 INFO:teuthology.orchestra.run.smithi084.stdout:281 2023-09-13T08:27:16.737 INFO:teuthology.orchestra.run.smithi084.stdout:281.out 2023-09-13T08:27:16.737 INFO:teuthology.orchestra.run.smithi084.stdout:282 2023-09-13T08:27:16.737 INFO:teuthology.orchestra.run.smithi084.stdout:282.out 2023-09-13T08:27:16.737 INFO:teuthology.orchestra.run.smithi084.stdout:283 2023-09-13T08:27:16.737 INFO:teuthology.orchestra.run.smithi084.stdout:283.out 2023-09-13T08:27:16.738 INFO:teuthology.orchestra.run.smithi084.stdout:284 2023-09-13T08:27:16.738 INFO:teuthology.orchestra.run.smithi084.stdout:284.out 2023-09-13T08:27:16.738 INFO:teuthology.orchestra.run.smithi084.stdout:285 2023-09-13T08:27:16.738 INFO:teuthology.orchestra.run.smithi084.stdout:285.out 2023-09-13T08:27:16.738 INFO:teuthology.orchestra.run.smithi084.stdout:286 2023-09-13T08:27:16.739 INFO:teuthology.orchestra.run.smithi084.stdout:286.out 2023-09-13T08:27:16.739 INFO:teuthology.orchestra.run.smithi084.stdout:287 2023-09-13T08:27:16.739 INFO:teuthology.orchestra.run.smithi084.stdout:287.out 2023-09-13T08:27:16.739 INFO:teuthology.orchestra.run.smithi084.stdout:288 2023-09-13T08:27:16.739 INFO:teuthology.orchestra.run.smithi084.stdout:288.out 2023-09-13T08:27:16.739 INFO:teuthology.orchestra.run.smithi084.stdout:289 2023-09-13T08:27:16.740 INFO:teuthology.orchestra.run.smithi084.stdout:289.out 2023-09-13T08:27:16.740 INFO:teuthology.orchestra.run.smithi084.stdout:290 2023-09-13T08:27:16.740 INFO:teuthology.orchestra.run.smithi084.stdout:290.out 2023-09-13T08:27:16.740 INFO:teuthology.orchestra.run.smithi084.stdout:291 2023-09-13T08:27:16.740 INFO:teuthology.orchestra.run.smithi084.stdout:291.out 2023-09-13T08:27:16.741 INFO:teuthology.orchestra.run.smithi084.stdout:292 2023-09-13T08:27:16.741 INFO:teuthology.orchestra.run.smithi084.stdout:292.out 2023-09-13T08:27:16.741 INFO:teuthology.orchestra.run.smithi084.stdout:293 2023-09-13T08:27:16.741 INFO:teuthology.orchestra.run.smithi084.stdout:293.out 2023-09-13T08:27:16.741 INFO:teuthology.orchestra.run.smithi084.stdout:294 2023-09-13T08:27:16.741 INFO:teuthology.orchestra.run.smithi084.stdout:294.out 2023-09-13T08:27:16.742 INFO:teuthology.orchestra.run.smithi084.stdout:295 2023-09-13T08:27:16.742 INFO:teuthology.orchestra.run.smithi084.stdout:295.out 2023-09-13T08:27:16.742 INFO:teuthology.orchestra.run.smithi084.stdout:296 2023-09-13T08:27:16.742 INFO:teuthology.orchestra.run.smithi084.stdout:296.out 2023-09-13T08:27:16.742 INFO:teuthology.orchestra.run.smithi084.stdout:297 2023-09-13T08:27:16.743 INFO:teuthology.orchestra.run.smithi084.stdout:297.out 2023-09-13T08:27:16.743 INFO:teuthology.orchestra.run.smithi084.stdout:298 2023-09-13T08:27:16.743 INFO:teuthology.orchestra.run.smithi084.stdout:298.out 2023-09-13T08:27:16.743 INFO:teuthology.orchestra.run.smithi084.stdout:299 2023-09-13T08:27:16.743 INFO:teuthology.orchestra.run.smithi084.stdout:299.out 2023-09-13T08:27:16.744 INFO:teuthology.orchestra.run.smithi084.stdout:300 2023-09-13T08:27:16.744 INFO:teuthology.orchestra.run.smithi084.stdout:300.out 2023-09-13T08:27:16.744 INFO:teuthology.orchestra.run.smithi084.stdout:301 2023-09-13T08:27:16.744 INFO:teuthology.orchestra.run.smithi084.stdout:301.out 2023-09-13T08:27:16.744 INFO:teuthology.orchestra.run.smithi084.stdout:302 2023-09-13T08:27:16.745 INFO:teuthology.orchestra.run.smithi084.stdout:302.out 2023-09-13T08:27:16.745 INFO:teuthology.orchestra.run.smithi084.stdout:303 2023-09-13T08:27:16.745 INFO:teuthology.orchestra.run.smithi084.stdout:303.out 2023-09-13T08:27:16.745 INFO:teuthology.orchestra.run.smithi084.stdout:304 2023-09-13T08:27:16.745 INFO:teuthology.orchestra.run.smithi084.stdout:304.out 2023-09-13T08:27:16.745 INFO:teuthology.orchestra.run.smithi084.stdout:305 2023-09-13T08:27:16.746 INFO:teuthology.orchestra.run.smithi084.stdout:305.out 2023-09-13T08:27:16.746 INFO:teuthology.orchestra.run.smithi084.stdout:306 2023-09-13T08:27:16.746 INFO:teuthology.orchestra.run.smithi084.stdout:306.out 2023-09-13T08:27:16.746 INFO:teuthology.orchestra.run.smithi084.stdout:307 2023-09-13T08:27:16.746 INFO:teuthology.orchestra.run.smithi084.stdout:307.out 2023-09-13T08:27:16.747 INFO:teuthology.orchestra.run.smithi084.stdout:308 2023-09-13T08:27:16.747 INFO:teuthology.orchestra.run.smithi084.stdout:308.out 2023-09-13T08:27:16.747 INFO:teuthology.orchestra.run.smithi084.stdout:309 2023-09-13T08:27:16.747 INFO:teuthology.orchestra.run.smithi084.stdout:309.out 2023-09-13T08:27:16.747 INFO:teuthology.orchestra.run.smithi084.stdout:310 2023-09-13T08:27:16.748 INFO:teuthology.orchestra.run.smithi084.stdout:310.out 2023-09-13T08:27:16.748 INFO:teuthology.orchestra.run.smithi084.stdout:311 2023-09-13T08:27:16.748 INFO:teuthology.orchestra.run.smithi084.stdout:311.out 2023-09-13T08:27:16.748 INFO:teuthology.orchestra.run.smithi084.stdout:312 2023-09-13T08:27:16.748 INFO:teuthology.orchestra.run.smithi084.stdout:312.out 2023-09-13T08:27:16.748 INFO:teuthology.orchestra.run.smithi084.stdout:313 2023-09-13T08:27:16.749 INFO:teuthology.orchestra.run.smithi084.stdout:313.out 2023-09-13T08:27:16.749 INFO:teuthology.orchestra.run.smithi084.stdout:314 2023-09-13T08:27:16.749 INFO:teuthology.orchestra.run.smithi084.stdout:314.out 2023-09-13T08:27:16.749 INFO:teuthology.orchestra.run.smithi084.stdout:315 2023-09-13T08:27:16.749 INFO:teuthology.orchestra.run.smithi084.stdout:315.out 2023-09-13T08:27:16.750 INFO:teuthology.orchestra.run.smithi084.stdout:316 2023-09-13T08:27:16.750 INFO:teuthology.orchestra.run.smithi084.stdout:316.out 2023-09-13T08:27:16.750 INFO:teuthology.orchestra.run.smithi084.stdout:317 2023-09-13T08:27:16.750 INFO:teuthology.orchestra.run.smithi084.stdout:317.out 2023-09-13T08:27:16.750 INFO:teuthology.orchestra.run.smithi084.stdout:318 2023-09-13T08:27:16.751 INFO:teuthology.orchestra.run.smithi084.stdout:318.out 2023-09-13T08:27:16.751 INFO:teuthology.orchestra.run.smithi084.stdout:319 2023-09-13T08:27:16.751 INFO:teuthology.orchestra.run.smithi084.stdout:319.out 2023-09-13T08:27:16.751 INFO:teuthology.orchestra.run.smithi084.stdout:320 2023-09-13T08:27:16.751 INFO:teuthology.orchestra.run.smithi084.stdout:320.out 2023-09-13T08:27:16.751 INFO:teuthology.orchestra.run.smithi084.stdout:321 2023-09-13T08:27:16.752 INFO:teuthology.orchestra.run.smithi084.stdout:321.out 2023-09-13T08:27:16.752 INFO:teuthology.orchestra.run.smithi084.stdout:322 2023-09-13T08:27:16.752 INFO:teuthology.orchestra.run.smithi084.stdout:322.out 2023-09-13T08:27:16.752 INFO:teuthology.orchestra.run.smithi084.stdout:323 2023-09-13T08:27:16.752 INFO:teuthology.orchestra.run.smithi084.stdout:323.out 2023-09-13T08:27:16.753 INFO:teuthology.orchestra.run.smithi084.stdout:324 2023-09-13T08:27:16.753 INFO:teuthology.orchestra.run.smithi084.stdout:324.out 2023-09-13T08:27:16.753 INFO:teuthology.orchestra.run.smithi084.stdout:325 2023-09-13T08:27:16.753 INFO:teuthology.orchestra.run.smithi084.stdout:325.out 2023-09-13T08:27:16.753 INFO:teuthology.orchestra.run.smithi084.stdout:326 2023-09-13T08:27:16.754 INFO:teuthology.orchestra.run.smithi084.stdout:326.out 2023-09-13T08:27:16.754 INFO:teuthology.orchestra.run.smithi084.stdout:327 2023-09-13T08:27:16.754 INFO:teuthology.orchestra.run.smithi084.stdout:327.out 2023-09-13T08:27:16.754 INFO:teuthology.orchestra.run.smithi084.stdout:328 2023-09-13T08:27:16.754 INFO:teuthology.orchestra.run.smithi084.stdout:328.out 2023-09-13T08:27:16.755 INFO:teuthology.orchestra.run.smithi084.stdout:329 2023-09-13T08:27:16.755 INFO:teuthology.orchestra.run.smithi084.stdout:329.out 2023-09-13T08:27:16.755 INFO:teuthology.orchestra.run.smithi084.stdout:330 2023-09-13T08:27:16.755 INFO:teuthology.orchestra.run.smithi084.stdout:330.out 2023-09-13T08:27:16.755 INFO:teuthology.orchestra.run.smithi084.stdout:331 2023-09-13T08:27:16.756 INFO:teuthology.orchestra.run.smithi084.stdout:331.out 2023-09-13T08:27:16.756 INFO:teuthology.orchestra.run.smithi084.stdout:332 2023-09-13T08:27:16.756 INFO:teuthology.orchestra.run.smithi084.stdout:332.out 2023-09-13T08:27:16.756 INFO:teuthology.orchestra.run.smithi084.stdout:333 2023-09-13T08:27:16.756 INFO:teuthology.orchestra.run.smithi084.stdout:333.out 2023-09-13T08:27:16.757 INFO:teuthology.orchestra.run.smithi084.stdout:334 2023-09-13T08:27:16.757 INFO:teuthology.orchestra.run.smithi084.stdout:334.out 2023-09-13T08:27:16.757 INFO:teuthology.orchestra.run.smithi084.stdout:335 2023-09-13T08:27:16.757 INFO:teuthology.orchestra.run.smithi084.stdout:335.out 2023-09-13T08:27:16.757 INFO:teuthology.orchestra.run.smithi084.stdout:336 2023-09-13T08:27:16.757 INFO:teuthology.orchestra.run.smithi084.stdout:336.out 2023-09-13T08:27:16.758 INFO:teuthology.orchestra.run.smithi084.stdout:337 2023-09-13T08:27:16.758 INFO:teuthology.orchestra.run.smithi084.stdout:337.out 2023-09-13T08:27:16.758 INFO:teuthology.orchestra.run.smithi084.stdout:338 2023-09-13T08:27:16.758 INFO:teuthology.orchestra.run.smithi084.stdout:338.out 2023-09-13T08:27:16.759 INFO:teuthology.orchestra.run.smithi084.stdout:339 2023-09-13T08:27:16.759 INFO:teuthology.orchestra.run.smithi084.stdout:339.out 2023-09-13T08:27:16.759 INFO:teuthology.orchestra.run.smithi084.stdout:340 2023-09-13T08:27:16.759 INFO:teuthology.orchestra.run.smithi084.stdout:340.out 2023-09-13T08:27:16.759 INFO:teuthology.orchestra.run.smithi084.stdout:341 2023-09-13T08:27:16.760 INFO:teuthology.orchestra.run.smithi084.stdout:341.out 2023-09-13T08:27:16.760 INFO:teuthology.orchestra.run.smithi084.stdout:342 2023-09-13T08:27:16.760 INFO:teuthology.orchestra.run.smithi084.stdout:342.out 2023-09-13T08:27:16.760 INFO:teuthology.orchestra.run.smithi084.stdout:343 2023-09-13T08:27:16.760 INFO:teuthology.orchestra.run.smithi084.stdout:343.out 2023-09-13T08:27:16.760 INFO:teuthology.orchestra.run.smithi084.stdout:344 2023-09-13T08:27:16.761 INFO:teuthology.orchestra.run.smithi084.stdout:344.out 2023-09-13T08:27:16.761 INFO:teuthology.orchestra.run.smithi084.stdout:345 2023-09-13T08:27:16.761 INFO:teuthology.orchestra.run.smithi084.stdout:345.out 2023-09-13T08:27:16.761 INFO:teuthology.orchestra.run.smithi084.stdout:346 2023-09-13T08:27:16.761 INFO:teuthology.orchestra.run.smithi084.stdout:346.out 2023-09-13T08:27:16.762 INFO:teuthology.orchestra.run.smithi084.stdout:347 2023-09-13T08:27:16.762 INFO:teuthology.orchestra.run.smithi084.stdout:347.out 2023-09-13T08:27:16.762 INFO:teuthology.orchestra.run.smithi084.stdout:348 2023-09-13T08:27:16.762 INFO:teuthology.orchestra.run.smithi084.stdout:348.out 2023-09-13T08:27:16.762 INFO:teuthology.orchestra.run.smithi084.stdout:349 2023-09-13T08:27:16.763 INFO:teuthology.orchestra.run.smithi084.stdout:349.out 2023-09-13T08:27:16.763 INFO:teuthology.orchestra.run.smithi084.stdout:350 2023-09-13T08:27:16.763 INFO:teuthology.orchestra.run.smithi084.stdout:350.out 2023-09-13T08:27:16.763 INFO:teuthology.orchestra.run.smithi084.stdout:351 2023-09-13T08:27:16.763 INFO:teuthology.orchestra.run.smithi084.stdout:351.out 2023-09-13T08:27:16.763 INFO:teuthology.orchestra.run.smithi084.stdout:352 2023-09-13T08:27:16.764 INFO:teuthology.orchestra.run.smithi084.stdout:352.out 2023-09-13T08:27:16.764 INFO:teuthology.orchestra.run.smithi084.stdout:353 2023-09-13T08:27:16.764 INFO:teuthology.orchestra.run.smithi084.stdout:353.out 2023-09-13T08:27:16.764 INFO:teuthology.orchestra.run.smithi084.stdout:354 2023-09-13T08:27:16.764 INFO:teuthology.orchestra.run.smithi084.stdout:354.out 2023-09-13T08:27:16.765 INFO:teuthology.orchestra.run.smithi084.stdout:355 2023-09-13T08:27:16.765 INFO:teuthology.orchestra.run.smithi084.stdout:355.out 2023-09-13T08:27:16.765 INFO:teuthology.orchestra.run.smithi084.stdout:356 2023-09-13T08:27:16.765 INFO:teuthology.orchestra.run.smithi084.stdout:356.out 2023-09-13T08:27:16.765 INFO:teuthology.orchestra.run.smithi084.stdout:357 2023-09-13T08:27:16.766 INFO:teuthology.orchestra.run.smithi084.stdout:357.out 2023-09-13T08:27:16.766 INFO:teuthology.orchestra.run.smithi084.stdout:358 2023-09-13T08:27:16.766 INFO:teuthology.orchestra.run.smithi084.stdout:358.out 2023-09-13T08:27:16.766 INFO:teuthology.orchestra.run.smithi084.stdout:359 2023-09-13T08:27:16.766 INFO:teuthology.orchestra.run.smithi084.stdout:359.out 2023-09-13T08:27:16.767 INFO:teuthology.orchestra.run.smithi084.stdout:360 2023-09-13T08:27:16.767 INFO:teuthology.orchestra.run.smithi084.stdout:360.out 2023-09-13T08:27:16.767 INFO:teuthology.orchestra.run.smithi084.stdout:361 2023-09-13T08:27:16.767 INFO:teuthology.orchestra.run.smithi084.stdout:361.out 2023-09-13T08:27:16.767 INFO:teuthology.orchestra.run.smithi084.stdout:362 2023-09-13T08:27:16.768 INFO:teuthology.orchestra.run.smithi084.stdout:362.out 2023-09-13T08:27:16.768 INFO:teuthology.orchestra.run.smithi084.stdout:363 2023-09-13T08:27:16.768 INFO:teuthology.orchestra.run.smithi084.stdout:363.out 2023-09-13T08:27:16.768 INFO:teuthology.orchestra.run.smithi084.stdout:364 2023-09-13T08:27:16.768 INFO:teuthology.orchestra.run.smithi084.stdout:364.out 2023-09-13T08:27:16.768 INFO:teuthology.orchestra.run.smithi084.stdout:365 2023-09-13T08:27:16.769 INFO:teuthology.orchestra.run.smithi084.stdout:365.out 2023-09-13T08:27:16.769 INFO:teuthology.orchestra.run.smithi084.stdout:366 2023-09-13T08:27:16.769 INFO:teuthology.orchestra.run.smithi084.stdout:366.out 2023-09-13T08:27:16.769 INFO:teuthology.orchestra.run.smithi084.stdout:367 2023-09-13T08:27:16.769 INFO:teuthology.orchestra.run.smithi084.stdout:367.out 2023-09-13T08:27:16.770 INFO:teuthology.orchestra.run.smithi084.stdout:368 2023-09-13T08:27:16.770 INFO:teuthology.orchestra.run.smithi084.stdout:368.out 2023-09-13T08:27:16.770 INFO:teuthology.orchestra.run.smithi084.stdout:369 2023-09-13T08:27:16.770 INFO:teuthology.orchestra.run.smithi084.stdout:369.out 2023-09-13T08:27:16.770 INFO:teuthology.orchestra.run.smithi084.stdout:370 2023-09-13T08:27:16.771 INFO:teuthology.orchestra.run.smithi084.stdout:370.out 2023-09-13T08:27:16.771 INFO:teuthology.orchestra.run.smithi084.stdout:371 2023-09-13T08:27:16.771 INFO:teuthology.orchestra.run.smithi084.stdout:371.out 2023-09-13T08:27:16.771 INFO:teuthology.orchestra.run.smithi084.stdout:372 2023-09-13T08:27:16.771 INFO:teuthology.orchestra.run.smithi084.stdout:372.out 2023-09-13T08:27:16.771 INFO:teuthology.orchestra.run.smithi084.stdout:373 2023-09-13T08:27:16.772 INFO:teuthology.orchestra.run.smithi084.stdout:373.out 2023-09-13T08:27:16.772 INFO:teuthology.orchestra.run.smithi084.stdout:374 2023-09-13T08:27:16.772 INFO:teuthology.orchestra.run.smithi084.stdout:374.out 2023-09-13T08:27:16.772 INFO:teuthology.orchestra.run.smithi084.stdout:375 2023-09-13T08:27:16.772 INFO:teuthology.orchestra.run.smithi084.stdout:375.out 2023-09-13T08:27:16.773 INFO:teuthology.orchestra.run.smithi084.stdout:376 2023-09-13T08:27:16.773 INFO:teuthology.orchestra.run.smithi084.stdout:376.out 2023-09-13T08:27:16.773 INFO:teuthology.orchestra.run.smithi084.stdout:377 2023-09-13T08:27:16.773 INFO:teuthology.orchestra.run.smithi084.stdout:377.out 2023-09-13T08:27:16.773 INFO:teuthology.orchestra.run.smithi084.stdout:378 2023-09-13T08:27:16.774 INFO:teuthology.orchestra.run.smithi084.stdout:378.out 2023-09-13T08:27:16.774 INFO:teuthology.orchestra.run.smithi084.stdout:379 2023-09-13T08:27:16.774 INFO:teuthology.orchestra.run.smithi084.stdout:379.out 2023-09-13T08:27:16.774 INFO:teuthology.orchestra.run.smithi084.stdout:380 2023-09-13T08:27:16.774 INFO:teuthology.orchestra.run.smithi084.stdout:380.out 2023-09-13T08:27:16.775 INFO:teuthology.orchestra.run.smithi084.stdout:381 2023-09-13T08:27:16.775 INFO:teuthology.orchestra.run.smithi084.stdout:381.out 2023-09-13T08:27:16.775 INFO:teuthology.orchestra.run.smithi084.stdout:382 2023-09-13T08:27:16.775 INFO:teuthology.orchestra.run.smithi084.stdout:382.out 2023-09-13T08:27:16.775 INFO:teuthology.orchestra.run.smithi084.stdout:383 2023-09-13T08:27:16.775 INFO:teuthology.orchestra.run.smithi084.stdout:383.out 2023-09-13T08:27:16.776 INFO:teuthology.orchestra.run.smithi084.stdout:384 2023-09-13T08:27:16.776 INFO:teuthology.orchestra.run.smithi084.stdout:384.out 2023-09-13T08:27:16.776 INFO:teuthology.orchestra.run.smithi084.stdout:385 2023-09-13T08:27:16.776 INFO:teuthology.orchestra.run.smithi084.stdout:385.out 2023-09-13T08:27:16.776 INFO:teuthology.orchestra.run.smithi084.stdout:386 2023-09-13T08:27:16.777 INFO:teuthology.orchestra.run.smithi084.stdout:386.out 2023-09-13T08:27:16.777 INFO:teuthology.orchestra.run.smithi084.stdout:387 2023-09-13T08:27:16.777 INFO:teuthology.orchestra.run.smithi084.stdout:387.out 2023-09-13T08:27:16.777 INFO:teuthology.orchestra.run.smithi084.stdout:388 2023-09-13T08:27:16.777 INFO:teuthology.orchestra.run.smithi084.stdout:388.out 2023-09-13T08:27:16.778 INFO:teuthology.orchestra.run.smithi084.stdout:389 2023-09-13T08:27:16.778 INFO:teuthology.orchestra.run.smithi084.stdout:389.out 2023-09-13T08:27:16.778 INFO:teuthology.orchestra.run.smithi084.stdout:390 2023-09-13T08:27:16.778 INFO:teuthology.orchestra.run.smithi084.stdout:390.out 2023-09-13T08:27:16.778 INFO:teuthology.orchestra.run.smithi084.stdout:391 2023-09-13T08:27:16.779 INFO:teuthology.orchestra.run.smithi084.stdout:391.out 2023-09-13T08:27:16.779 INFO:teuthology.orchestra.run.smithi084.stdout:392 2023-09-13T08:27:16.779 INFO:teuthology.orchestra.run.smithi084.stdout:392.out 2023-09-13T08:27:16.779 INFO:teuthology.orchestra.run.smithi084.stdout:393 2023-09-13T08:27:16.779 INFO:teuthology.orchestra.run.smithi084.stdout:393.out 2023-09-13T08:27:16.779 INFO:teuthology.orchestra.run.smithi084.stdout:394 2023-09-13T08:27:16.780 INFO:teuthology.orchestra.run.smithi084.stdout:394.out 2023-09-13T08:27:16.780 INFO:teuthology.orchestra.run.smithi084.stdout:395 2023-09-13T08:27:16.780 INFO:teuthology.orchestra.run.smithi084.stdout:395.out 2023-09-13T08:27:16.780 INFO:teuthology.orchestra.run.smithi084.stdout:396 2023-09-13T08:27:16.780 INFO:teuthology.orchestra.run.smithi084.stdout:396.out 2023-09-13T08:27:16.781 INFO:teuthology.orchestra.run.smithi084.stdout:397 2023-09-13T08:27:16.781 INFO:teuthology.orchestra.run.smithi084.stdout:397.out 2023-09-13T08:27:16.781 INFO:teuthology.orchestra.run.smithi084.stdout:398 2023-09-13T08:27:16.781 INFO:teuthology.orchestra.run.smithi084.stdout:398.out 2023-09-13T08:27:16.781 INFO:teuthology.orchestra.run.smithi084.stdout:399 2023-09-13T08:27:16.781 INFO:teuthology.orchestra.run.smithi084.stdout:399.out 2023-09-13T08:27:16.782 INFO:teuthology.orchestra.run.smithi084.stdout:400 2023-09-13T08:27:16.782 INFO:teuthology.orchestra.run.smithi084.stdout:400.out 2023-09-13T08:27:16.782 INFO:teuthology.orchestra.run.smithi084.stdout:401 2023-09-13T08:27:16.782 INFO:teuthology.orchestra.run.smithi084.stdout:401.out 2023-09-13T08:27:16.782 INFO:teuthology.orchestra.run.smithi084.stdout:402 2023-09-13T08:27:16.783 INFO:teuthology.orchestra.run.smithi084.stdout:402.out 2023-09-13T08:27:16.783 INFO:teuthology.orchestra.run.smithi084.stdout:403 2023-09-13T08:27:16.783 INFO:teuthology.orchestra.run.smithi084.stdout:403.out 2023-09-13T08:27:16.783 INFO:teuthology.orchestra.run.smithi084.stdout:404 2023-09-13T08:27:16.783 INFO:teuthology.orchestra.run.smithi084.stdout:404.out 2023-09-13T08:27:16.784 INFO:teuthology.orchestra.run.smithi084.stdout:405 2023-09-13T08:27:16.784 INFO:teuthology.orchestra.run.smithi084.stdout:405.out 2023-09-13T08:27:16.784 INFO:teuthology.orchestra.run.smithi084.stdout:406 2023-09-13T08:27:16.784 INFO:teuthology.orchestra.run.smithi084.stdout:406.out 2023-09-13T08:27:16.784 INFO:teuthology.orchestra.run.smithi084.stdout:407 2023-09-13T08:27:16.784 INFO:teuthology.orchestra.run.smithi084.stdout:407.out 2023-09-13T08:27:16.785 INFO:teuthology.orchestra.run.smithi084.stdout:408 2023-09-13T08:27:16.785 INFO:teuthology.orchestra.run.smithi084.stdout:408.out 2023-09-13T08:27:16.785 INFO:teuthology.orchestra.run.smithi084.stdout:409 2023-09-13T08:27:16.785 INFO:teuthology.orchestra.run.smithi084.stdout:409.out 2023-09-13T08:27:16.785 INFO:teuthology.orchestra.run.smithi084.stdout:410 2023-09-13T08:27:16.786 INFO:teuthology.orchestra.run.smithi084.stdout:410.out 2023-09-13T08:27:16.786 INFO:teuthology.orchestra.run.smithi084.stdout:411 2023-09-13T08:27:16.786 INFO:teuthology.orchestra.run.smithi084.stdout:411.out 2023-09-13T08:27:16.786 INFO:teuthology.orchestra.run.smithi084.stdout:412 2023-09-13T08:27:16.786 INFO:teuthology.orchestra.run.smithi084.stdout:412.out 2023-09-13T08:27:16.787 INFO:teuthology.orchestra.run.smithi084.stdout:413 2023-09-13T08:27:16.787 INFO:teuthology.orchestra.run.smithi084.stdout:413.out 2023-09-13T08:27:16.787 INFO:teuthology.orchestra.run.smithi084.stdout:414 2023-09-13T08:27:16.787 INFO:teuthology.orchestra.run.smithi084.stdout:414.out 2023-09-13T08:27:16.788 INFO:teuthology.orchestra.run.smithi084.stdout:415 2023-09-13T08:27:16.788 INFO:teuthology.orchestra.run.smithi084.stdout:415.out 2023-09-13T08:27:16.788 INFO:teuthology.orchestra.run.smithi084.stdout:416 2023-09-13T08:27:16.788 INFO:teuthology.orchestra.run.smithi084.stdout:416.out 2023-09-13T08:27:16.788 INFO:teuthology.orchestra.run.smithi084.stdout:417 2023-09-13T08:27:16.789 INFO:teuthology.orchestra.run.smithi084.stdout:417.out 2023-09-13T08:27:16.789 INFO:teuthology.orchestra.run.smithi084.stdout:418 2023-09-13T08:27:16.789 INFO:teuthology.orchestra.run.smithi084.stdout:418.out 2023-09-13T08:27:16.789 INFO:teuthology.orchestra.run.smithi084.stdout:419 2023-09-13T08:27:16.789 INFO:teuthology.orchestra.run.smithi084.stdout:419.out 2023-09-13T08:27:16.789 INFO:teuthology.orchestra.run.smithi084.stdout:420 2023-09-13T08:27:16.790 INFO:teuthology.orchestra.run.smithi084.stdout:420.out 2023-09-13T08:27:16.790 INFO:teuthology.orchestra.run.smithi084.stdout:421 2023-09-13T08:27:16.790 INFO:teuthology.orchestra.run.smithi084.stdout:421.out 2023-09-13T08:27:16.790 INFO:teuthology.orchestra.run.smithi084.stdout:422 2023-09-13T08:27:16.790 INFO:teuthology.orchestra.run.smithi084.stdout:422.out 2023-09-13T08:27:16.791 INFO:teuthology.orchestra.run.smithi084.stdout:423 2023-09-13T08:27:16.791 INFO:teuthology.orchestra.run.smithi084.stdout:423.out 2023-09-13T08:27:16.791 INFO:teuthology.orchestra.run.smithi084.stdout:424 2023-09-13T08:27:16.791 INFO:teuthology.orchestra.run.smithi084.stdout:424.out 2023-09-13T08:27:16.791 INFO:teuthology.orchestra.run.smithi084.stdout:425 2023-09-13T08:27:16.792 INFO:teuthology.orchestra.run.smithi084.stdout:425.out 2023-09-13T08:27:16.792 INFO:teuthology.orchestra.run.smithi084.stdout:426 2023-09-13T08:27:16.792 INFO:teuthology.orchestra.run.smithi084.stdout:426.out 2023-09-13T08:27:16.792 INFO:teuthology.orchestra.run.smithi084.stdout:427 2023-09-13T08:27:16.792 INFO:teuthology.orchestra.run.smithi084.stdout:427.out 2023-09-13T08:27:16.793 INFO:teuthology.orchestra.run.smithi084.stdout:428 2023-09-13T08:27:16.793 INFO:teuthology.orchestra.run.smithi084.stdout:428.out 2023-09-13T08:27:16.793 INFO:teuthology.orchestra.run.smithi084.stdout:429 2023-09-13T08:27:16.793 INFO:teuthology.orchestra.run.smithi084.stdout:429.out 2023-09-13T08:27:16.793 INFO:teuthology.orchestra.run.smithi084.stdout:430 2023-09-13T08:27:16.793 INFO:teuthology.orchestra.run.smithi084.stdout:430.out 2023-09-13T08:27:16.794 INFO:teuthology.orchestra.run.smithi084.stdout:431 2023-09-13T08:27:16.794 INFO:teuthology.orchestra.run.smithi084.stdout:431.out 2023-09-13T08:27:16.794 INFO:teuthology.orchestra.run.smithi084.stdout:432 2023-09-13T08:27:16.794 INFO:teuthology.orchestra.run.smithi084.stdout:432.out 2023-09-13T08:27:16.794 INFO:teuthology.orchestra.run.smithi084.stdout:433 2023-09-13T08:27:16.795 INFO:teuthology.orchestra.run.smithi084.stdout:433.out 2023-09-13T08:27:16.795 INFO:teuthology.orchestra.run.smithi084.stdout:434 2023-09-13T08:27:16.795 INFO:teuthology.orchestra.run.smithi084.stdout:434.out 2023-09-13T08:27:16.795 INFO:teuthology.orchestra.run.smithi084.stdout:435 2023-09-13T08:27:16.795 INFO:teuthology.orchestra.run.smithi084.stdout:435.out 2023-09-13T08:27:16.796 INFO:teuthology.orchestra.run.smithi084.stdout:436 2023-09-13T08:27:16.796 INFO:teuthology.orchestra.run.smithi084.stdout:436.out 2023-09-13T08:27:16.796 INFO:teuthology.orchestra.run.smithi084.stdout:437 2023-09-13T08:27:16.796 INFO:teuthology.orchestra.run.smithi084.stdout:437.out 2023-09-13T08:27:16.796 INFO:teuthology.orchestra.run.smithi084.stdout:438 2023-09-13T08:27:16.797 INFO:teuthology.orchestra.run.smithi084.stdout:438.out 2023-09-13T08:27:16.797 INFO:teuthology.orchestra.run.smithi084.stdout:439 2023-09-13T08:27:16.797 INFO:teuthology.orchestra.run.smithi084.stdout:439.out 2023-09-13T08:27:16.797 INFO:teuthology.orchestra.run.smithi084.stdout:440 2023-09-13T08:27:16.797 INFO:teuthology.orchestra.run.smithi084.stdout:440.out 2023-09-13T08:27:16.797 INFO:teuthology.orchestra.run.smithi084.stdout:441 2023-09-13T08:27:16.798 INFO:teuthology.orchestra.run.smithi084.stdout:441.out 2023-09-13T08:27:16.798 INFO:teuthology.orchestra.run.smithi084.stdout:442 2023-09-13T08:27:16.798 INFO:teuthology.orchestra.run.smithi084.stdout:442.out 2023-09-13T08:27:16.798 INFO:teuthology.orchestra.run.smithi084.stdout:443 2023-09-13T08:27:16.798 INFO:teuthology.orchestra.run.smithi084.stdout:443.out 2023-09-13T08:27:16.799 INFO:teuthology.orchestra.run.smithi084.stdout:444 2023-09-13T08:27:16.799 INFO:teuthology.orchestra.run.smithi084.stdout:444.out 2023-09-13T08:27:16.799 INFO:teuthology.orchestra.run.smithi084.stdout:445 2023-09-13T08:27:16.799 INFO:teuthology.orchestra.run.smithi084.stdout:445.out 2023-09-13T08:27:16.799 INFO:teuthology.orchestra.run.smithi084.stdout:446 2023-09-13T08:27:16.800 INFO:teuthology.orchestra.run.smithi084.stdout:446.out 2023-09-13T08:27:16.800 INFO:teuthology.orchestra.run.smithi084.stdout:447 2023-09-13T08:27:16.800 INFO:teuthology.orchestra.run.smithi084.stdout:447.out 2023-09-13T08:27:16.800 INFO:teuthology.orchestra.run.smithi084.stdout:448 2023-09-13T08:27:16.800 INFO:teuthology.orchestra.run.smithi084.stdout:448.out 2023-09-13T08:27:16.800 INFO:teuthology.orchestra.run.smithi084.stdout:449 2023-09-13T08:27:16.801 INFO:teuthology.orchestra.run.smithi084.stdout:449.out 2023-09-13T08:27:16.801 INFO:teuthology.orchestra.run.smithi084.stdout:450 2023-09-13T08:27:16.801 INFO:teuthology.orchestra.run.smithi084.stdout:450.out 2023-09-13T08:27:16.801 INFO:teuthology.orchestra.run.smithi084.stdout:451 2023-09-13T08:27:16.801 INFO:teuthology.orchestra.run.smithi084.stdout:451.out 2023-09-13T08:27:16.802 INFO:teuthology.orchestra.run.smithi084.stdout:452 2023-09-13T08:27:16.802 INFO:teuthology.orchestra.run.smithi084.stdout:452.out 2023-09-13T08:27:16.802 INFO:teuthology.orchestra.run.smithi084.stdout:453 2023-09-13T08:27:16.802 INFO:teuthology.orchestra.run.smithi084.stdout:453.out 2023-09-13T08:27:16.802 INFO:teuthology.orchestra.run.smithi084.stdout:454 2023-09-13T08:27:16.803 INFO:teuthology.orchestra.run.smithi084.stdout:454.out 2023-09-13T08:27:16.803 INFO:teuthology.orchestra.run.smithi084.stdout:455 2023-09-13T08:27:16.803 INFO:teuthology.orchestra.run.smithi084.stdout:455.out 2023-09-13T08:27:16.803 INFO:teuthology.orchestra.run.smithi084.stdout:456 2023-09-13T08:27:16.803 INFO:teuthology.orchestra.run.smithi084.stdout:456.out 2023-09-13T08:27:16.803 INFO:teuthology.orchestra.run.smithi084.stdout:457 2023-09-13T08:27:16.804 INFO:teuthology.orchestra.run.smithi084.stdout:457.out 2023-09-13T08:27:16.804 INFO:teuthology.orchestra.run.smithi084.stdout:458 2023-09-13T08:27:16.804 INFO:teuthology.orchestra.run.smithi084.stdout:458.out 2023-09-13T08:27:16.804 INFO:teuthology.orchestra.run.smithi084.stdout:459 2023-09-13T08:27:16.804 INFO:teuthology.orchestra.run.smithi084.stdout:459.out 2023-09-13T08:27:16.805 INFO:teuthology.orchestra.run.smithi084.stdout:460 2023-09-13T08:27:16.805 INFO:teuthology.orchestra.run.smithi084.stdout:460.out 2023-09-13T08:27:16.805 INFO:teuthology.orchestra.run.smithi084.stdout:461 2023-09-13T08:27:16.805 INFO:teuthology.orchestra.run.smithi084.stdout:461.out 2023-09-13T08:27:16.805 INFO:teuthology.orchestra.run.smithi084.stdout:462 2023-09-13T08:27:16.806 INFO:teuthology.orchestra.run.smithi084.stdout:462.out 2023-09-13T08:27:16.806 INFO:teuthology.orchestra.run.smithi084.stdout:463 2023-09-13T08:27:16.806 INFO:teuthology.orchestra.run.smithi084.stdout:463.out 2023-09-13T08:27:16.806 INFO:teuthology.orchestra.run.smithi084.stdout:464 2023-09-13T08:27:16.806 INFO:teuthology.orchestra.run.smithi084.stdout:464.out 2023-09-13T08:27:16.807 INFO:teuthology.orchestra.run.smithi084.stdout:465 2023-09-13T08:27:16.807 INFO:teuthology.orchestra.run.smithi084.stdout:465.out 2023-09-13T08:27:16.807 INFO:teuthology.orchestra.run.smithi084.stdout:466 2023-09-13T08:27:16.807 INFO:teuthology.orchestra.run.smithi084.stdout:466.out 2023-09-13T08:27:16.807 INFO:teuthology.orchestra.run.smithi084.stdout:467 2023-09-13T08:27:16.807 INFO:teuthology.orchestra.run.smithi084.stdout:467.out 2023-09-13T08:27:16.808 INFO:teuthology.orchestra.run.smithi084.stdout:468 2023-09-13T08:27:16.808 INFO:teuthology.orchestra.run.smithi084.stdout:468.out 2023-09-13T08:27:16.808 INFO:teuthology.orchestra.run.smithi084.stdout:469 2023-09-13T08:27:16.808 INFO:teuthology.orchestra.run.smithi084.stdout:469.out 2023-09-13T08:27:16.808 INFO:teuthology.orchestra.run.smithi084.stdout:470 2023-09-13T08:27:16.809 INFO:teuthology.orchestra.run.smithi084.stdout:470.out 2023-09-13T08:27:16.809 INFO:teuthology.orchestra.run.smithi084.stdout:472 2023-09-13T08:27:16.809 INFO:teuthology.orchestra.run.smithi084.stdout:472.out 2023-09-13T08:27:16.809 INFO:teuthology.orchestra.run.smithi084.stdout:473 2023-09-13T08:27:16.809 INFO:teuthology.orchestra.run.smithi084.stdout:473.out 2023-09-13T08:27:16.810 INFO:teuthology.orchestra.run.smithi084.stdout:474 2023-09-13T08:27:16.810 INFO:teuthology.orchestra.run.smithi084.stdout:474.out 2023-09-13T08:27:16.810 INFO:teuthology.orchestra.run.smithi084.stdout:475 2023-09-13T08:27:16.810 INFO:teuthology.orchestra.run.smithi084.stdout:475.out 2023-09-13T08:27:16.810 INFO:teuthology.orchestra.run.smithi084.stdout:476 2023-09-13T08:27:16.810 INFO:teuthology.orchestra.run.smithi084.stdout:476.out 2023-09-13T08:27:16.811 INFO:teuthology.orchestra.run.smithi084.stdout:477 2023-09-13T08:27:16.811 INFO:teuthology.orchestra.run.smithi084.stdout:477.out 2023-09-13T08:27:16.811 INFO:teuthology.orchestra.run.smithi084.stdout:478 2023-09-13T08:27:16.811 INFO:teuthology.orchestra.run.smithi084.stdout:478.out 2023-09-13T08:27:16.811 INFO:teuthology.orchestra.run.smithi084.stdout:479 2023-09-13T08:27:16.812 INFO:teuthology.orchestra.run.smithi084.stdout:479.out 2023-09-13T08:27:16.812 INFO:teuthology.orchestra.run.smithi084.stdout:480 2023-09-13T08:27:16.812 INFO:teuthology.orchestra.run.smithi084.stdout:480.out 2023-09-13T08:27:16.812 INFO:teuthology.orchestra.run.smithi084.stdout:481 2023-09-13T08:27:16.812 INFO:teuthology.orchestra.run.smithi084.stdout:481.out 2023-09-13T08:27:16.813 INFO:teuthology.orchestra.run.smithi084.stdout:482 2023-09-13T08:27:16.813 INFO:teuthology.orchestra.run.smithi084.stdout:482.out 2023-09-13T08:27:16.813 INFO:teuthology.orchestra.run.smithi084.stdout:483 2023-09-13T08:27:16.813 INFO:teuthology.orchestra.run.smithi084.stdout:483.out 2023-09-13T08:27:16.813 INFO:teuthology.orchestra.run.smithi084.stdout:484 2023-09-13T08:27:16.814 INFO:teuthology.orchestra.run.smithi084.stdout:484.out 2023-09-13T08:27:16.814 INFO:teuthology.orchestra.run.smithi084.stdout:485 2023-09-13T08:27:16.814 INFO:teuthology.orchestra.run.smithi084.stdout:485.out 2023-09-13T08:27:16.814 INFO:teuthology.orchestra.run.smithi084.stdout:486 2023-09-13T08:27:16.814 INFO:teuthology.orchestra.run.smithi084.stdout:486.out 2023-09-13T08:27:16.815 INFO:teuthology.orchestra.run.smithi084.stdout:487 2023-09-13T08:27:16.815 INFO:teuthology.orchestra.run.smithi084.stdout:487.out 2023-09-13T08:27:16.815 INFO:teuthology.orchestra.run.smithi084.stdout:488 2023-09-13T08:27:16.815 INFO:teuthology.orchestra.run.smithi084.stdout:488.out 2023-09-13T08:27:16.815 INFO:teuthology.orchestra.run.smithi084.stdout:489 2023-09-13T08:27:16.816 INFO:teuthology.orchestra.run.smithi084.stdout:489.out 2023-09-13T08:27:16.816 INFO:teuthology.orchestra.run.smithi084.stdout:490 2023-09-13T08:27:16.816 INFO:teuthology.orchestra.run.smithi084.stdout:490.out 2023-09-13T08:27:16.816 INFO:teuthology.orchestra.run.smithi084.stdout:491 2023-09-13T08:27:16.816 INFO:teuthology.orchestra.run.smithi084.stdout:491.out 2023-09-13T08:27:16.816 INFO:teuthology.orchestra.run.smithi084.stdout:492 2023-09-13T08:27:16.817 INFO:teuthology.orchestra.run.smithi084.stdout:492.out 2023-09-13T08:27:16.817 INFO:teuthology.orchestra.run.smithi084.stdout:493 2023-09-13T08:27:16.817 INFO:teuthology.orchestra.run.smithi084.stdout:493.out 2023-09-13T08:27:16.817 INFO:teuthology.orchestra.run.smithi084.stdout:494 2023-09-13T08:27:16.817 INFO:teuthology.orchestra.run.smithi084.stdout:494.out 2023-09-13T08:27:16.818 INFO:teuthology.orchestra.run.smithi084.stdout:495 2023-09-13T08:27:16.818 INFO:teuthology.orchestra.run.smithi084.stdout:495.out 2023-09-13T08:27:16.818 INFO:teuthology.orchestra.run.smithi084.stdout:496 2023-09-13T08:27:16.818 INFO:teuthology.orchestra.run.smithi084.stdout:496.out 2023-09-13T08:27:16.818 INFO:teuthology.orchestra.run.smithi084.stdout:497 2023-09-13T08:27:16.819 INFO:teuthology.orchestra.run.smithi084.stdout:497.out 2023-09-13T08:27:16.819 INFO:teuthology.orchestra.run.smithi084.stdout:498 2023-09-13T08:27:16.819 INFO:teuthology.orchestra.run.smithi084.stdout:498.out 2023-09-13T08:27:16.819 INFO:teuthology.orchestra.run.smithi084.stdout:499 2023-09-13T08:27:16.819 INFO:teuthology.orchestra.run.smithi084.stdout:499.out 2023-09-13T08:27:16.820 INFO:teuthology.orchestra.run.smithi084.stdout:500 2023-09-13T08:27:16.820 INFO:teuthology.orchestra.run.smithi084.stdout:500.out 2023-09-13T08:27:16.820 INFO:teuthology.orchestra.run.smithi084.stdout:501 2023-09-13T08:27:16.820 INFO:teuthology.orchestra.run.smithi084.stdout:501.out 2023-09-13T08:27:16.820 INFO:teuthology.orchestra.run.smithi084.stdout:502 2023-09-13T08:27:16.820 INFO:teuthology.orchestra.run.smithi084.stdout:502.out 2023-09-13T08:27:16.821 INFO:teuthology.orchestra.run.smithi084.stdout:503 2023-09-13T08:27:16.821 INFO:teuthology.orchestra.run.smithi084.stdout:503.out 2023-09-13T08:27:16.821 INFO:teuthology.orchestra.run.smithi084.stdout:504 2023-09-13T08:27:16.821 INFO:teuthology.orchestra.run.smithi084.stdout:504.out 2023-09-13T08:27:16.821 INFO:teuthology.orchestra.run.smithi084.stdout:505 2023-09-13T08:27:16.822 INFO:teuthology.orchestra.run.smithi084.stdout:505.out 2023-09-13T08:27:16.822 INFO:teuthology.orchestra.run.smithi084.stdout:506 2023-09-13T08:27:16.822 INFO:teuthology.orchestra.run.smithi084.stdout:506.out 2023-09-13T08:27:16.822 INFO:teuthology.orchestra.run.smithi084.stdout:507 2023-09-13T08:27:16.822 INFO:teuthology.orchestra.run.smithi084.stdout:507.out 2023-09-13T08:27:16.823 INFO:teuthology.orchestra.run.smithi084.stdout:508 2023-09-13T08:27:16.823 INFO:teuthology.orchestra.run.smithi084.stdout:508.out 2023-09-13T08:27:16.823 INFO:teuthology.orchestra.run.smithi084.stdout:509 2023-09-13T08:27:16.823 INFO:teuthology.orchestra.run.smithi084.stdout:509.out 2023-09-13T08:27:16.823 INFO:teuthology.orchestra.run.smithi084.stdout:510 2023-09-13T08:27:16.824 INFO:teuthology.orchestra.run.smithi084.stdout:510.out 2023-09-13T08:27:16.824 INFO:teuthology.orchestra.run.smithi084.stdout:511 2023-09-13T08:27:16.824 INFO:teuthology.orchestra.run.smithi084.stdout:511.out 2023-09-13T08:27:16.824 INFO:teuthology.orchestra.run.smithi084.stdout:512 2023-09-13T08:27:16.824 INFO:teuthology.orchestra.run.smithi084.stdout:512.out 2023-09-13T08:27:16.824 INFO:teuthology.orchestra.run.smithi084.stdout:513 2023-09-13T08:27:16.825 INFO:teuthology.orchestra.run.smithi084.stdout:513.out 2023-09-13T08:27:16.825 INFO:teuthology.orchestra.run.smithi084.stdout:514 2023-09-13T08:27:16.825 INFO:teuthology.orchestra.run.smithi084.stdout:514.out 2023-09-13T08:27:16.825 INFO:teuthology.orchestra.run.smithi084.stdout:515 2023-09-13T08:27:16.825 INFO:teuthology.orchestra.run.smithi084.stdout:515.out 2023-09-13T08:27:16.826 INFO:teuthology.orchestra.run.smithi084.stdout:516 2023-09-13T08:27:16.826 INFO:teuthology.orchestra.run.smithi084.stdout:516.out 2023-09-13T08:27:16.826 INFO:teuthology.orchestra.run.smithi084.stdout:517 2023-09-13T08:27:16.826 INFO:teuthology.orchestra.run.smithi084.stdout:517.out 2023-09-13T08:27:16.826 INFO:teuthology.orchestra.run.smithi084.stdout:518 2023-09-13T08:27:16.827 INFO:teuthology.orchestra.run.smithi084.stdout:518.out 2023-09-13T08:27:16.827 INFO:teuthology.orchestra.run.smithi084.stdout:519 2023-09-13T08:27:16.827 INFO:teuthology.orchestra.run.smithi084.stdout:519.out 2023-09-13T08:27:16.827 INFO:teuthology.orchestra.run.smithi084.stdout:520 2023-09-13T08:27:16.827 INFO:teuthology.orchestra.run.smithi084.stdout:520.out 2023-09-13T08:27:16.828 INFO:teuthology.orchestra.run.smithi084.stdout:521 2023-09-13T08:27:16.828 INFO:teuthology.orchestra.run.smithi084.stdout:521.out 2023-09-13T08:27:16.828 INFO:teuthology.orchestra.run.smithi084.stdout:522 2023-09-13T08:27:16.828 INFO:teuthology.orchestra.run.smithi084.stdout:522.out 2023-09-13T08:27:16.828 INFO:teuthology.orchestra.run.smithi084.stdout:523 2023-09-13T08:27:16.829 INFO:teuthology.orchestra.run.smithi084.stdout:523.out 2023-09-13T08:27:16.829 INFO:teuthology.orchestra.run.smithi084.stdout:524 2023-09-13T08:27:16.829 INFO:teuthology.orchestra.run.smithi084.stdout:524.out 2023-09-13T08:27:16.829 INFO:teuthology.orchestra.run.smithi084.stdout:525 2023-09-13T08:27:16.829 INFO:teuthology.orchestra.run.smithi084.stdout:525.out 2023-09-13T08:27:16.830 INFO:teuthology.orchestra.run.smithi084.stdout:526 2023-09-13T08:27:16.830 INFO:teuthology.orchestra.run.smithi084.stdout:526.out 2023-09-13T08:27:16.830 INFO:teuthology.orchestra.run.smithi084.stdout:527 2023-09-13T08:27:16.830 INFO:teuthology.orchestra.run.smithi084.stdout:527.out 2023-09-13T08:27:16.830 INFO:teuthology.orchestra.run.smithi084.stdout:528 2023-09-13T08:27:16.831 INFO:teuthology.orchestra.run.smithi084.stdout:528.out 2023-09-13T08:27:16.831 INFO:teuthology.orchestra.run.smithi084.stdout:529 2023-09-13T08:27:16.831 INFO:teuthology.orchestra.run.smithi084.stdout:529.out 2023-09-13T08:27:16.831 INFO:teuthology.orchestra.run.smithi084.stdout:530 2023-09-13T08:27:16.831 INFO:teuthology.orchestra.run.smithi084.stdout:530.out 2023-09-13T08:27:16.831 INFO:teuthology.orchestra.run.smithi084.stdout:531 2023-09-13T08:27:16.832 INFO:teuthology.orchestra.run.smithi084.stdout:531.out 2023-09-13T08:27:16.832 INFO:teuthology.orchestra.run.smithi084.stdout:532 2023-09-13T08:27:16.832 INFO:teuthology.orchestra.run.smithi084.stdout:532.out 2023-09-13T08:27:16.832 INFO:teuthology.orchestra.run.smithi084.stdout:533 2023-09-13T08:27:16.832 INFO:teuthology.orchestra.run.smithi084.stdout:533.out 2023-09-13T08:27:16.833 INFO:teuthology.orchestra.run.smithi084.stdout:534 2023-09-13T08:27:16.833 INFO:teuthology.orchestra.run.smithi084.stdout:534.out 2023-09-13T08:27:16.833 INFO:teuthology.orchestra.run.smithi084.stdout:535 2023-09-13T08:27:16.833 INFO:teuthology.orchestra.run.smithi084.stdout:535.out 2023-09-13T08:27:16.833 INFO:teuthology.orchestra.run.smithi084.stdout:536 2023-09-13T08:27:16.834 INFO:teuthology.orchestra.run.smithi084.stdout:536.out 2023-09-13T08:27:16.834 INFO:teuthology.orchestra.run.smithi084.stdout:537 2023-09-13T08:27:16.834 INFO:teuthology.orchestra.run.smithi084.stdout:537.out 2023-09-13T08:27:16.834 INFO:teuthology.orchestra.run.smithi084.stdout:538 2023-09-13T08:27:16.834 INFO:teuthology.orchestra.run.smithi084.stdout:538.out 2023-09-13T08:27:16.835 INFO:teuthology.orchestra.run.smithi084.stdout:539 2023-09-13T08:27:16.835 INFO:teuthology.orchestra.run.smithi084.stdout:539.out 2023-09-13T08:27:16.835 INFO:teuthology.orchestra.run.smithi084.stdout:540 2023-09-13T08:27:16.835 INFO:teuthology.orchestra.run.smithi084.stdout:540.out 2023-09-13T08:27:16.835 INFO:teuthology.orchestra.run.smithi084.stdout:541 2023-09-13T08:27:16.835 INFO:teuthology.orchestra.run.smithi084.stdout:541.out 2023-09-13T08:27:16.836 INFO:teuthology.orchestra.run.smithi084.stdout:542 2023-09-13T08:27:16.836 INFO:teuthology.orchestra.run.smithi084.stdout:542.out 2023-09-13T08:27:16.836 INFO:teuthology.orchestra.run.smithi084.stdout:543 2023-09-13T08:27:16.836 INFO:teuthology.orchestra.run.smithi084.stdout:543.out 2023-09-13T08:27:16.836 INFO:teuthology.orchestra.run.smithi084.stdout:544 2023-09-13T08:27:16.837 INFO:teuthology.orchestra.run.smithi084.stdout:544.out 2023-09-13T08:27:16.837 INFO:teuthology.orchestra.run.smithi084.stdout:545 2023-09-13T08:27:16.837 INFO:teuthology.orchestra.run.smithi084.stdout:545.out 2023-09-13T08:27:16.837 INFO:teuthology.orchestra.run.smithi084.stdout:546 2023-09-13T08:27:16.837 INFO:teuthology.orchestra.run.smithi084.stdout:546.out 2023-09-13T08:27:16.838 INFO:teuthology.orchestra.run.smithi084.stdout:547 2023-09-13T08:27:16.838 INFO:teuthology.orchestra.run.smithi084.stdout:547.out 2023-09-13T08:27:16.838 INFO:teuthology.orchestra.run.smithi084.stdout:548 2023-09-13T08:27:16.838 INFO:teuthology.orchestra.run.smithi084.stdout:548.out 2023-09-13T08:27:16.838 INFO:teuthology.orchestra.run.smithi084.stdout:549 2023-09-13T08:27:16.838 INFO:teuthology.orchestra.run.smithi084.stdout:549.out 2023-09-13T08:27:16.839 INFO:teuthology.orchestra.run.smithi084.stdout:550 2023-09-13T08:27:16.839 INFO:teuthology.orchestra.run.smithi084.stdout:550.out 2023-09-13T08:27:16.839 INFO:teuthology.orchestra.run.smithi084.stdout:551 2023-09-13T08:27:16.839 INFO:teuthology.orchestra.run.smithi084.stdout:551.out 2023-09-13T08:27:16.839 INFO:teuthology.orchestra.run.smithi084.stdout:552 2023-09-13T08:27:16.840 INFO:teuthology.orchestra.run.smithi084.stdout:552.out 2023-09-13T08:27:16.840 INFO:teuthology.orchestra.run.smithi084.stdout:553 2023-09-13T08:27:16.840 INFO:teuthology.orchestra.run.smithi084.stdout:553.out 2023-09-13T08:27:16.840 INFO:teuthology.orchestra.run.smithi084.stdout:554 2023-09-13T08:27:16.840 INFO:teuthology.orchestra.run.smithi084.stdout:554.out 2023-09-13T08:27:16.841 INFO:teuthology.orchestra.run.smithi084.stdout:555 2023-09-13T08:27:16.841 INFO:teuthology.orchestra.run.smithi084.stdout:555.out 2023-09-13T08:27:16.841 INFO:teuthology.orchestra.run.smithi084.stdout:556 2023-09-13T08:27:16.841 INFO:teuthology.orchestra.run.smithi084.stdout:556.out 2023-09-13T08:27:16.841 INFO:teuthology.orchestra.run.smithi084.stdout:557 2023-09-13T08:27:16.841 INFO:teuthology.orchestra.run.smithi084.stdout:557.out 2023-09-13T08:27:16.842 INFO:teuthology.orchestra.run.smithi084.stdout:558 2023-09-13T08:27:16.842 INFO:teuthology.orchestra.run.smithi084.stdout:558.out 2023-09-13T08:27:16.842 INFO:teuthology.orchestra.run.smithi084.stdout:559 2023-09-13T08:27:16.842 INFO:teuthology.orchestra.run.smithi084.stdout:559.out 2023-09-13T08:27:16.842 INFO:teuthology.orchestra.run.smithi084.stdout:560 2023-09-13T08:27:16.843 INFO:teuthology.orchestra.run.smithi084.stdout:560.out 2023-09-13T08:27:16.843 INFO:teuthology.orchestra.run.smithi084.stdout:561 2023-09-13T08:27:16.843 INFO:teuthology.orchestra.run.smithi084.stdout:561.out 2023-09-13T08:27:16.843 INFO:teuthology.orchestra.run.smithi084.stdout:562 2023-09-13T08:27:16.843 INFO:teuthology.orchestra.run.smithi084.stdout:562.out 2023-09-13T08:27:16.843 INFO:teuthology.orchestra.run.smithi084.stdout:563 2023-09-13T08:27:16.844 INFO:teuthology.orchestra.run.smithi084.stdout:563.out 2023-09-13T08:27:16.844 INFO:teuthology.orchestra.run.smithi084.stdout:564 2023-09-13T08:27:16.844 INFO:teuthology.orchestra.run.smithi084.stdout:564.out 2023-09-13T08:27:16.844 INFO:teuthology.orchestra.run.smithi084.stdout:565 2023-09-13T08:27:16.844 INFO:teuthology.orchestra.run.smithi084.stdout:565.out 2023-09-13T08:27:16.845 INFO:teuthology.orchestra.run.smithi084.stdout:566 2023-09-13T08:27:16.845 INFO:teuthology.orchestra.run.smithi084.stdout:566.out 2023-09-13T08:27:16.845 INFO:teuthology.orchestra.run.smithi084.stdout:567 2023-09-13T08:27:16.845 INFO:teuthology.orchestra.run.smithi084.stdout:567.out 2023-09-13T08:27:16.845 INFO:teuthology.orchestra.run.smithi084.stdout:568 2023-09-13T08:27:16.846 INFO:teuthology.orchestra.run.smithi084.stdout:568.out 2023-09-13T08:27:16.846 INFO:teuthology.orchestra.run.smithi084.stdout:569 2023-09-13T08:27:16.846 INFO:teuthology.orchestra.run.smithi084.stdout:569.out 2023-09-13T08:27:16.846 INFO:teuthology.orchestra.run.smithi084.stdout:570 2023-09-13T08:27:16.846 INFO:teuthology.orchestra.run.smithi084.stdout:570.out 2023-09-13T08:27:16.846 INFO:teuthology.orchestra.run.smithi084.stdout:571 2023-09-13T08:27:16.847 INFO:teuthology.orchestra.run.smithi084.stdout:571.out 2023-09-13T08:27:16.847 INFO:teuthology.orchestra.run.smithi084.stdout:572 2023-09-13T08:27:16.847 INFO:teuthology.orchestra.run.smithi084.stdout:572.out 2023-09-13T08:27:16.847 INFO:teuthology.orchestra.run.smithi084.stdout:573 2023-09-13T08:27:16.847 INFO:teuthology.orchestra.run.smithi084.stdout:573.out 2023-09-13T08:27:16.848 INFO:teuthology.orchestra.run.smithi084.stdout:574 2023-09-13T08:27:16.848 INFO:teuthology.orchestra.run.smithi084.stdout:574.out 2023-09-13T08:27:16.848 INFO:teuthology.orchestra.run.smithi084.stdout:575 2023-09-13T08:27:16.848 INFO:teuthology.orchestra.run.smithi084.stdout:575.out 2023-09-13T08:27:16.848 INFO:teuthology.orchestra.run.smithi084.stdout:576 2023-09-13T08:27:16.849 INFO:teuthology.orchestra.run.smithi084.stdout:576.out 2023-09-13T08:27:16.849 INFO:teuthology.orchestra.run.smithi084.stdout:577 2023-09-13T08:27:16.849 INFO:teuthology.orchestra.run.smithi084.stdout:577.out 2023-09-13T08:27:16.849 INFO:teuthology.orchestra.run.smithi084.stdout:578 2023-09-13T08:27:16.849 INFO:teuthology.orchestra.run.smithi084.stdout:578.out 2023-09-13T08:27:16.850 INFO:teuthology.orchestra.run.smithi084.stdout:579 2023-09-13T08:27:16.850 INFO:teuthology.orchestra.run.smithi084.stdout:579.out 2023-09-13T08:27:16.850 INFO:teuthology.orchestra.run.smithi084.stdout:580 2023-09-13T08:27:16.850 INFO:teuthology.orchestra.run.smithi084.stdout:580.out 2023-09-13T08:27:16.850 INFO:teuthology.orchestra.run.smithi084.stdout:581 2023-09-13T08:27:16.851 INFO:teuthology.orchestra.run.smithi084.stdout:581.out 2023-09-13T08:27:16.851 INFO:teuthology.orchestra.run.smithi084.stdout:582 2023-09-13T08:27:16.851 INFO:teuthology.orchestra.run.smithi084.stdout:582.out 2023-09-13T08:27:16.851 INFO:teuthology.orchestra.run.smithi084.stdout:583 2023-09-13T08:27:16.851 INFO:teuthology.orchestra.run.smithi084.stdout:583.out 2023-09-13T08:27:16.852 INFO:teuthology.orchestra.run.smithi084.stdout:584 2023-09-13T08:27:16.852 INFO:teuthology.orchestra.run.smithi084.stdout:584.out 2023-09-13T08:27:16.852 INFO:teuthology.orchestra.run.smithi084.stdout:585 2023-09-13T08:27:16.852 INFO:teuthology.orchestra.run.smithi084.stdout:585.out 2023-09-13T08:27:16.852 INFO:teuthology.orchestra.run.smithi084.stdout:586 2023-09-13T08:27:16.852 INFO:teuthology.orchestra.run.smithi084.stdout:586.out 2023-09-13T08:27:16.853 INFO:teuthology.orchestra.run.smithi084.stdout:587 2023-09-13T08:27:16.853 INFO:teuthology.orchestra.run.smithi084.stdout:587.out 2023-09-13T08:27:16.853 INFO:teuthology.orchestra.run.smithi084.stdout:588 2023-09-13T08:27:16.853 INFO:teuthology.orchestra.run.smithi084.stdout:588.out 2023-09-13T08:27:16.853 INFO:teuthology.orchestra.run.smithi084.stdout:589 2023-09-13T08:27:16.854 INFO:teuthology.orchestra.run.smithi084.stdout:589.out 2023-09-13T08:27:16.854 INFO:teuthology.orchestra.run.smithi084.stdout:590 2023-09-13T08:27:16.854 INFO:teuthology.orchestra.run.smithi084.stdout:590.out 2023-09-13T08:27:16.854 INFO:teuthology.orchestra.run.smithi084.stdout:591 2023-09-13T08:27:16.854 INFO:teuthology.orchestra.run.smithi084.stdout:591.out 2023-09-13T08:27:16.855 INFO:teuthology.orchestra.run.smithi084.stdout:592 2023-09-13T08:27:16.855 INFO:teuthology.orchestra.run.smithi084.stdout:592.out 2023-09-13T08:27:16.855 INFO:teuthology.orchestra.run.smithi084.stdout:593 2023-09-13T08:27:16.855 INFO:teuthology.orchestra.run.smithi084.stdout:593.out 2023-09-13T08:27:16.855 INFO:teuthology.orchestra.run.smithi084.stdout:594 2023-09-13T08:27:16.856 INFO:teuthology.orchestra.run.smithi084.stdout:594.out 2023-09-13T08:27:16.856 INFO:teuthology.orchestra.run.smithi084.stdout:595 2023-09-13T08:27:16.856 INFO:teuthology.orchestra.run.smithi084.stdout:595.out 2023-09-13T08:27:16.856 INFO:teuthology.orchestra.run.smithi084.stdout:596 2023-09-13T08:27:16.856 INFO:teuthology.orchestra.run.smithi084.stdout:596.out 2023-09-13T08:27:16.856 INFO:teuthology.orchestra.run.smithi084.stdout:597 2023-09-13T08:27:16.857 INFO:teuthology.orchestra.run.smithi084.stdout:597.out 2023-09-13T08:27:16.857 INFO:teuthology.orchestra.run.smithi084.stdout:598 2023-09-13T08:27:16.857 INFO:teuthology.orchestra.run.smithi084.stdout:598.out 2023-09-13T08:27:16.857 INFO:teuthology.orchestra.run.smithi084.stdout:599 2023-09-13T08:27:16.857 INFO:teuthology.orchestra.run.smithi084.stdout:599.out 2023-09-13T08:27:16.858 INFO:teuthology.orchestra.run.smithi084.stdout:600 2023-09-13T08:27:16.858 INFO:teuthology.orchestra.run.smithi084.stdout:600.out 2023-09-13T08:27:16.858 INFO:teuthology.orchestra.run.smithi084.stdout:601 2023-09-13T08:27:16.858 INFO:teuthology.orchestra.run.smithi084.stdout:601.out 2023-09-13T08:27:16.858 INFO:teuthology.orchestra.run.smithi084.stdout:602 2023-09-13T08:27:16.859 INFO:teuthology.orchestra.run.smithi084.stdout:602.out 2023-09-13T08:27:16.859 INFO:teuthology.orchestra.run.smithi084.stdout:603 2023-09-13T08:27:16.859 INFO:teuthology.orchestra.run.smithi084.stdout:603.out 2023-09-13T08:27:16.859 INFO:teuthology.orchestra.run.smithi084.stdout:604 2023-09-13T08:27:16.859 INFO:teuthology.orchestra.run.smithi084.stdout:604.out 2023-09-13T08:27:16.860 INFO:teuthology.orchestra.run.smithi084.stdout:605 2023-09-13T08:27:16.860 INFO:teuthology.orchestra.run.smithi084.stdout:605.out 2023-09-13T08:27:16.860 INFO:teuthology.orchestra.run.smithi084.stdout:606 2023-09-13T08:27:16.860 INFO:teuthology.orchestra.run.smithi084.stdout:606.out 2023-09-13T08:27:16.860 INFO:teuthology.orchestra.run.smithi084.stdout:607 2023-09-13T08:27:16.860 INFO:teuthology.orchestra.run.smithi084.stdout:607.out 2023-09-13T08:27:16.861 INFO:teuthology.orchestra.run.smithi084.stdout:608 2023-09-13T08:27:16.861 INFO:teuthology.orchestra.run.smithi084.stdout:608.out 2023-09-13T08:27:16.861 INFO:teuthology.orchestra.run.smithi084.stdout:609 2023-09-13T08:27:16.861 INFO:teuthology.orchestra.run.smithi084.stdout:609.out 2023-09-13T08:27:16.861 INFO:teuthology.orchestra.run.smithi084.stdout:610 2023-09-13T08:27:16.862 INFO:teuthology.orchestra.run.smithi084.stdout:610.out 2023-09-13T08:27:16.862 INFO:teuthology.orchestra.run.smithi084.stdout:611 2023-09-13T08:27:16.862 INFO:teuthology.orchestra.run.smithi084.stdout:611.out 2023-09-13T08:27:16.862 INFO:teuthology.orchestra.run.smithi084.stdout:612 2023-09-13T08:27:16.862 INFO:teuthology.orchestra.run.smithi084.stdout:612.out 2023-09-13T08:27:16.863 INFO:teuthology.orchestra.run.smithi084.stdout:613 2023-09-13T08:27:16.863 INFO:teuthology.orchestra.run.smithi084.stdout:613.out 2023-09-13T08:27:16.863 INFO:teuthology.orchestra.run.smithi084.stdout:614 2023-09-13T08:27:16.863 INFO:teuthology.orchestra.run.smithi084.stdout:614.out 2023-09-13T08:27:16.863 INFO:teuthology.orchestra.run.smithi084.stdout:615 2023-09-13T08:27:16.863 INFO:teuthology.orchestra.run.smithi084.stdout:615.out 2023-09-13T08:27:16.864 INFO:teuthology.orchestra.run.smithi084.stdout:616 2023-09-13T08:27:16.864 INFO:teuthology.orchestra.run.smithi084.stdout:616.out 2023-09-13T08:27:16.864 INFO:teuthology.orchestra.run.smithi084.stdout:617 2023-09-13T08:27:16.864 INFO:teuthology.orchestra.run.smithi084.stdout:617.out 2023-09-13T08:27:16.864 INFO:teuthology.orchestra.run.smithi084.stdout:618 2023-09-13T08:27:16.865 INFO:teuthology.orchestra.run.smithi084.stdout:618.out 2023-09-13T08:27:16.865 INFO:teuthology.orchestra.run.smithi084.stdout:619 2023-09-13T08:27:16.865 INFO:teuthology.orchestra.run.smithi084.stdout:619.out 2023-09-13T08:27:16.865 INFO:teuthology.orchestra.run.smithi084.stdout:620 2023-09-13T08:27:16.865 INFO:teuthology.orchestra.run.smithi084.stdout:620.out 2023-09-13T08:27:16.866 INFO:teuthology.orchestra.run.smithi084.stdout:621 2023-09-13T08:27:16.866 INFO:teuthology.orchestra.run.smithi084.stdout:621.out 2023-09-13T08:27:16.866 INFO:teuthology.orchestra.run.smithi084.stdout:622 2023-09-13T08:27:16.866 INFO:teuthology.orchestra.run.smithi084.stdout:622.out 2023-09-13T08:27:16.866 INFO:teuthology.orchestra.run.smithi084.stdout:623 2023-09-13T08:27:16.866 INFO:teuthology.orchestra.run.smithi084.stdout:623.out 2023-09-13T08:27:16.867 INFO:teuthology.orchestra.run.smithi084.stdout:624 2023-09-13T08:27:16.867 INFO:teuthology.orchestra.run.smithi084.stdout:624.out 2023-09-13T08:27:16.867 INFO:teuthology.orchestra.run.smithi084.stdout:625 2023-09-13T08:27:16.867 INFO:teuthology.orchestra.run.smithi084.stdout:625.out 2023-09-13T08:27:16.867 INFO:teuthology.orchestra.run.smithi084.stdout:626 2023-09-13T08:27:16.868 INFO:teuthology.orchestra.run.smithi084.stdout:626.out 2023-09-13T08:27:16.868 INFO:teuthology.orchestra.run.smithi084.stdout:627 2023-09-13T08:27:16.868 INFO:teuthology.orchestra.run.smithi084.stdout:627.out 2023-09-13T08:27:16.868 INFO:teuthology.orchestra.run.smithi084.stdout:628 2023-09-13T08:27:16.868 INFO:teuthology.orchestra.run.smithi084.stdout:628.out 2023-09-13T08:27:16.869 INFO:teuthology.orchestra.run.smithi084.stdout:629 2023-09-13T08:27:16.869 INFO:teuthology.orchestra.run.smithi084.stdout:629.out 2023-09-13T08:27:16.869 INFO:teuthology.orchestra.run.smithi084.stdout:630 2023-09-13T08:27:16.869 INFO:teuthology.orchestra.run.smithi084.stdout:630.out 2023-09-13T08:27:16.869 INFO:teuthology.orchestra.run.smithi084.stdout:631 2023-09-13T08:27:16.870 INFO:teuthology.orchestra.run.smithi084.stdout:631.out 2023-09-13T08:27:16.870 INFO:teuthology.orchestra.run.smithi084.stdout:632 2023-09-13T08:27:16.870 INFO:teuthology.orchestra.run.smithi084.stdout:632.out 2023-09-13T08:27:16.870 INFO:teuthology.orchestra.run.smithi084.stdout:633 2023-09-13T08:27:16.870 INFO:teuthology.orchestra.run.smithi084.stdout:633.out 2023-09-13T08:27:16.871 INFO:teuthology.orchestra.run.smithi084.stdout:634 2023-09-13T08:27:16.871 INFO:teuthology.orchestra.run.smithi084.stdout:634.out 2023-09-13T08:27:16.871 INFO:teuthology.orchestra.run.smithi084.stdout:635 2023-09-13T08:27:16.871 INFO:teuthology.orchestra.run.smithi084.stdout:635.out 2023-09-13T08:27:16.871 INFO:teuthology.orchestra.run.smithi084.stdout:636 2023-09-13T08:27:16.872 INFO:teuthology.orchestra.run.smithi084.stdout:636.out 2023-09-13T08:27:16.872 INFO:teuthology.orchestra.run.smithi084.stdout:637 2023-09-13T08:27:16.872 INFO:teuthology.orchestra.run.smithi084.stdout:637.out 2023-09-13T08:27:16.872 INFO:teuthology.orchestra.run.smithi084.stdout:638 2023-09-13T08:27:16.872 INFO:teuthology.orchestra.run.smithi084.stdout:638.out 2023-09-13T08:27:16.873 INFO:teuthology.orchestra.run.smithi084.stdout:639 2023-09-13T08:27:16.873 INFO:teuthology.orchestra.run.smithi084.stdout:639.out 2023-09-13T08:27:16.873 INFO:teuthology.orchestra.run.smithi084.stdout:640 2023-09-13T08:27:16.873 INFO:teuthology.orchestra.run.smithi084.stdout:640.out 2023-09-13T08:27:16.873 INFO:teuthology.orchestra.run.smithi084.stdout:641 2023-09-13T08:27:16.874 INFO:teuthology.orchestra.run.smithi084.stdout:641.out 2023-09-13T08:27:16.874 INFO:teuthology.orchestra.run.smithi084.stdout:642 2023-09-13T08:27:16.874 INFO:teuthology.orchestra.run.smithi084.stdout:642.out 2023-09-13T08:27:16.874 INFO:teuthology.orchestra.run.smithi084.stdout:643 2023-09-13T08:27:16.874 INFO:teuthology.orchestra.run.smithi084.stdout:643.out 2023-09-13T08:27:16.875 INFO:teuthology.orchestra.run.smithi084.stdout:644 2023-09-13T08:27:16.875 INFO:teuthology.orchestra.run.smithi084.stdout:644.out 2023-09-13T08:27:16.875 INFO:teuthology.orchestra.run.smithi084.stdout:645 2023-09-13T08:27:16.875 INFO:teuthology.orchestra.run.smithi084.stdout:645.out 2023-09-13T08:27:16.875 INFO:teuthology.orchestra.run.smithi084.stdout:646 2023-09-13T08:27:16.875 INFO:teuthology.orchestra.run.smithi084.stdout:646.out 2023-09-13T08:27:16.876 INFO:teuthology.orchestra.run.smithi084.stdout:647 2023-09-13T08:27:16.876 INFO:teuthology.orchestra.run.smithi084.stdout:647.out 2023-09-13T08:27:16.876 INFO:teuthology.orchestra.run.smithi084.stdout:648 2023-09-13T08:27:16.876 INFO:teuthology.orchestra.run.smithi084.stdout:648.out 2023-09-13T08:27:16.877 INFO:teuthology.orchestra.run.smithi084.stdout:649 2023-09-13T08:27:16.877 INFO:teuthology.orchestra.run.smithi084.stdout:649.out 2023-09-13T08:27:16.877 INFO:teuthology.orchestra.run.smithi084.stdout:650 2023-09-13T08:27:16.877 INFO:teuthology.orchestra.run.smithi084.stdout:650.out 2023-09-13T08:27:16.877 INFO:teuthology.orchestra.run.smithi084.stdout:651 2023-09-13T08:27:16.877 INFO:teuthology.orchestra.run.smithi084.stdout:651.out 2023-09-13T08:27:16.878 INFO:teuthology.orchestra.run.smithi084.stdout:652 2023-09-13T08:27:16.878 INFO:teuthology.orchestra.run.smithi084.stdout:652.out 2023-09-13T08:27:16.878 INFO:teuthology.orchestra.run.smithi084.stdout:653 2023-09-13T08:27:16.878 INFO:teuthology.orchestra.run.smithi084.stdout:653.out 2023-09-13T08:27:16.878 INFO:teuthology.orchestra.run.smithi084.stdout:654 2023-09-13T08:27:16.879 INFO:teuthology.orchestra.run.smithi084.stdout:654.out 2023-09-13T08:27:16.879 INFO:teuthology.orchestra.run.smithi084.stdout:655 2023-09-13T08:27:16.879 INFO:teuthology.orchestra.run.smithi084.stdout:655.out 2023-09-13T08:27:16.879 INFO:teuthology.orchestra.run.smithi084.stdout:656 2023-09-13T08:27:16.879 INFO:teuthology.orchestra.run.smithi084.stdout:656.out 2023-09-13T08:27:16.880 INFO:teuthology.orchestra.run.smithi084.stdout:657 2023-09-13T08:27:16.880 INFO:teuthology.orchestra.run.smithi084.stdout:657.out 2023-09-13T08:27:16.880 INFO:teuthology.orchestra.run.smithi084.stdout:658 2023-09-13T08:27:16.880 INFO:teuthology.orchestra.run.smithi084.stdout:658.out 2023-09-13T08:27:16.880 INFO:teuthology.orchestra.run.smithi084.stdout:659 2023-09-13T08:27:16.880 INFO:teuthology.orchestra.run.smithi084.stdout:659.out 2023-09-13T08:27:16.881 INFO:teuthology.orchestra.run.smithi084.stdout:660 2023-09-13T08:27:16.881 INFO:teuthology.orchestra.run.smithi084.stdout:660.out 2023-09-13T08:27:16.881 INFO:teuthology.orchestra.run.smithi084.stdout:661 2023-09-13T08:27:16.881 INFO:teuthology.orchestra.run.smithi084.stdout:661.out 2023-09-13T08:27:16.881 INFO:teuthology.orchestra.run.smithi084.stdout:662 2023-09-13T08:27:16.882 INFO:teuthology.orchestra.run.smithi084.stdout:662.out 2023-09-13T08:27:16.882 INFO:teuthology.orchestra.run.smithi084.stdout:663 2023-09-13T08:27:16.882 INFO:teuthology.orchestra.run.smithi084.stdout:663.out 2023-09-13T08:27:16.882 INFO:teuthology.orchestra.run.smithi084.stdout:664 2023-09-13T08:27:16.882 INFO:teuthology.orchestra.run.smithi084.stdout:664.out 2023-09-13T08:27:16.883 INFO:teuthology.orchestra.run.smithi084.stdout:665 2023-09-13T08:27:16.883 INFO:teuthology.orchestra.run.smithi084.stdout:665.out 2023-09-13T08:27:16.883 INFO:teuthology.orchestra.run.smithi084.stdout:666 2023-09-13T08:27:16.883 INFO:teuthology.orchestra.run.smithi084.stdout:666.out 2023-09-13T08:27:16.883 INFO:teuthology.orchestra.run.smithi084.stdout:667 2023-09-13T08:27:16.883 INFO:teuthology.orchestra.run.smithi084.stdout:667.out 2023-09-13T08:27:16.884 INFO:teuthology.orchestra.run.smithi084.stdout:668 2023-09-13T08:27:16.884 INFO:teuthology.orchestra.run.smithi084.stdout:668.out 2023-09-13T08:27:16.884 INFO:teuthology.orchestra.run.smithi084.stdout:669 2023-09-13T08:27:16.884 INFO:teuthology.orchestra.run.smithi084.stdout:669.out 2023-09-13T08:27:16.884 INFO:teuthology.orchestra.run.smithi084.stdout:670 2023-09-13T08:27:16.885 INFO:teuthology.orchestra.run.smithi084.stdout:670.out 2023-09-13T08:27:16.885 INFO:teuthology.orchestra.run.smithi084.stdout:671 2023-09-13T08:27:16.885 INFO:teuthology.orchestra.run.smithi084.stdout:671.out 2023-09-13T08:27:16.885 INFO:teuthology.orchestra.run.smithi084.stdout:672 2023-09-13T08:27:16.885 INFO:teuthology.orchestra.run.smithi084.stdout:672.out 2023-09-13T08:27:16.886 INFO:teuthology.orchestra.run.smithi084.stdout:673 2023-09-13T08:27:16.886 INFO:teuthology.orchestra.run.smithi084.stdout:673.out 2023-09-13T08:27:16.886 INFO:teuthology.orchestra.run.smithi084.stdout:674 2023-09-13T08:27:16.886 INFO:teuthology.orchestra.run.smithi084.stdout:674.out 2023-09-13T08:27:16.886 INFO:teuthology.orchestra.run.smithi084.stdout:675 2023-09-13T08:27:16.887 INFO:teuthology.orchestra.run.smithi084.stdout:675.out 2023-09-13T08:27:16.887 INFO:teuthology.orchestra.run.smithi084.stdout:676 2023-09-13T08:27:16.887 INFO:teuthology.orchestra.run.smithi084.stdout:676.out 2023-09-13T08:27:16.887 INFO:teuthology.orchestra.run.smithi084.stdout:677 2023-09-13T08:27:16.887 INFO:teuthology.orchestra.run.smithi084.stdout:677.out 2023-09-13T08:27:16.888 INFO:teuthology.orchestra.run.smithi084.stdout:678 2023-09-13T08:27:16.888 INFO:teuthology.orchestra.run.smithi084.stdout:678.out 2023-09-13T08:27:16.888 INFO:teuthology.orchestra.run.smithi084.stdout:679 2023-09-13T08:27:16.888 INFO:teuthology.orchestra.run.smithi084.stdout:679.out 2023-09-13T08:27:16.888 INFO:teuthology.orchestra.run.smithi084.stdout:680 2023-09-13T08:27:16.888 INFO:teuthology.orchestra.run.smithi084.stdout:680.out 2023-09-13T08:27:16.889 INFO:teuthology.orchestra.run.smithi084.stdout:681 2023-09-13T08:27:16.889 INFO:teuthology.orchestra.run.smithi084.stdout:681.out 2023-09-13T08:27:16.889 INFO:teuthology.orchestra.run.smithi084.stdout:682 2023-09-13T08:27:16.889 INFO:teuthology.orchestra.run.smithi084.stdout:682.out 2023-09-13T08:27:16.889 INFO:teuthology.orchestra.run.smithi084.stdout:683 2023-09-13T08:27:16.890 INFO:teuthology.orchestra.run.smithi084.stdout:683.out 2023-09-13T08:27:16.890 INFO:teuthology.orchestra.run.smithi084.stdout:684 2023-09-13T08:27:16.890 INFO:teuthology.orchestra.run.smithi084.stdout:684.out 2023-09-13T08:27:16.890 INFO:teuthology.orchestra.run.smithi084.stdout:685 2023-09-13T08:27:16.890 INFO:teuthology.orchestra.run.smithi084.stdout:685.out 2023-09-13T08:27:16.891 INFO:teuthology.orchestra.run.smithi084.stdout:686 2023-09-13T08:27:16.891 INFO:teuthology.orchestra.run.smithi084.stdout:686.out 2023-09-13T08:27:16.891 INFO:teuthology.orchestra.run.smithi084.stdout:687 2023-09-13T08:27:16.891 INFO:teuthology.orchestra.run.smithi084.stdout:687.out 2023-09-13T08:27:16.891 INFO:teuthology.orchestra.run.smithi084.stdout:688 2023-09-13T08:27:16.892 INFO:teuthology.orchestra.run.smithi084.stdout:688.out 2023-09-13T08:27:16.892 INFO:teuthology.orchestra.run.smithi084.stdout:689 2023-09-13T08:27:16.892 INFO:teuthology.orchestra.run.smithi084.stdout:689.out 2023-09-13T08:27:16.892 INFO:teuthology.orchestra.run.smithi084.stdout:690 2023-09-13T08:27:16.892 INFO:teuthology.orchestra.run.smithi084.stdout:690.out 2023-09-13T08:27:16.892 INFO:teuthology.orchestra.run.smithi084.stdout:691 2023-09-13T08:27:16.893 INFO:teuthology.orchestra.run.smithi084.stdout:691.out 2023-09-13T08:27:16.893 INFO:teuthology.orchestra.run.smithi084.stdout:692 2023-09-13T08:27:16.893 INFO:teuthology.orchestra.run.smithi084.stdout:692.out 2023-09-13T08:27:16.893 INFO:teuthology.orchestra.run.smithi084.stdout:693 2023-09-13T08:27:16.893 INFO:teuthology.orchestra.run.smithi084.stdout:693.out 2023-09-13T08:27:16.894 INFO:teuthology.orchestra.run.smithi084.stdout:694 2023-09-13T08:27:16.894 INFO:teuthology.orchestra.run.smithi084.stdout:694.out 2023-09-13T08:27:16.894 INFO:teuthology.orchestra.run.smithi084.stdout:695 2023-09-13T08:27:16.894 INFO:teuthology.orchestra.run.smithi084.stdout:695.out 2023-09-13T08:27:16.894 INFO:teuthology.orchestra.run.smithi084.stdout:696 2023-09-13T08:27:16.895 INFO:teuthology.orchestra.run.smithi084.stdout:696.out 2023-09-13T08:27:16.895 INFO:teuthology.orchestra.run.smithi084.stdout:697 2023-09-13T08:27:16.895 INFO:teuthology.orchestra.run.smithi084.stdout:697.out 2023-09-13T08:27:16.895 INFO:teuthology.orchestra.run.smithi084.stdout:698 2023-09-13T08:27:16.895 INFO:teuthology.orchestra.run.smithi084.stdout:698.out 2023-09-13T08:27:16.896 INFO:teuthology.orchestra.run.smithi084.stdout:699 2023-09-13T08:27:16.896 INFO:teuthology.orchestra.run.smithi084.stdout:699.out 2023-09-13T08:27:16.896 INFO:teuthology.orchestra.run.smithi084.stdout:700 2023-09-13T08:27:16.896 INFO:teuthology.orchestra.run.smithi084.stdout:700.out 2023-09-13T08:27:16.896 INFO:teuthology.orchestra.run.smithi084.stdout:701 2023-09-13T08:27:16.897 INFO:teuthology.orchestra.run.smithi084.stdout:701.out 2023-09-13T08:27:16.897 INFO:teuthology.orchestra.run.smithi084.stdout:702 2023-09-13T08:27:16.897 INFO:teuthology.orchestra.run.smithi084.stdout:702.out 2023-09-13T08:27:16.897 INFO:teuthology.orchestra.run.smithi084.stdout:703 2023-09-13T08:27:16.897 INFO:teuthology.orchestra.run.smithi084.stdout:703.out 2023-09-13T08:27:16.898 INFO:teuthology.orchestra.run.smithi084.stdout:704 2023-09-13T08:27:16.898 INFO:teuthology.orchestra.run.smithi084.stdout:704.out 2023-09-13T08:27:16.898 INFO:teuthology.orchestra.run.smithi084.stdout:705 2023-09-13T08:27:16.898 INFO:teuthology.orchestra.run.smithi084.stdout:705.out 2023-09-13T08:27:16.898 INFO:teuthology.orchestra.run.smithi084.stdout:706 2023-09-13T08:27:16.898 INFO:teuthology.orchestra.run.smithi084.stdout:706.out 2023-09-13T08:27:16.899 INFO:teuthology.orchestra.run.smithi084.stdout:707 2023-09-13T08:27:16.899 INFO:teuthology.orchestra.run.smithi084.stdout:707.out 2023-09-13T08:27:16.899 INFO:teuthology.orchestra.run.smithi084.stdout:708 2023-09-13T08:27:16.899 INFO:teuthology.orchestra.run.smithi084.stdout:708.out 2023-09-13T08:27:16.900 INFO:teuthology.orchestra.run.smithi084.stdout:709 2023-09-13T08:27:16.900 INFO:teuthology.orchestra.run.smithi084.stdout:709.out 2023-09-13T08:27:16.900 INFO:teuthology.orchestra.run.smithi084.stdout:710 2023-09-13T08:27:16.900 INFO:teuthology.orchestra.run.smithi084.stdout:710.out 2023-09-13T08:27:16.900 INFO:teuthology.orchestra.run.smithi084.stdout:711 2023-09-13T08:27:16.901 INFO:teuthology.orchestra.run.smithi084.stdout:711.out 2023-09-13T08:27:16.901 INFO:teuthology.orchestra.run.smithi084.stdout:712 2023-09-13T08:27:16.901 INFO:teuthology.orchestra.run.smithi084.stdout:712.out 2023-09-13T08:27:16.901 INFO:teuthology.orchestra.run.smithi084.stdout:713 2023-09-13T08:27:16.901 INFO:teuthology.orchestra.run.smithi084.stdout:713.out 2023-09-13T08:27:16.902 INFO:teuthology.orchestra.run.smithi084.stdout:714 2023-09-13T08:27:16.902 INFO:teuthology.orchestra.run.smithi084.stdout:714.out 2023-09-13T08:27:16.902 INFO:teuthology.orchestra.run.smithi084.stdout:715 2023-09-13T08:27:16.902 INFO:teuthology.orchestra.run.smithi084.stdout:715.out 2023-09-13T08:27:16.902 INFO:teuthology.orchestra.run.smithi084.stdout:716 2023-09-13T08:27:16.903 INFO:teuthology.orchestra.run.smithi084.stdout:716.out 2023-09-13T08:27:16.903 INFO:teuthology.orchestra.run.smithi084.stdout:717 2023-09-13T08:27:16.903 INFO:teuthology.orchestra.run.smithi084.stdout:717.out 2023-09-13T08:27:16.903 INFO:teuthology.orchestra.run.smithi084.stdout:718 2023-09-13T08:27:16.903 INFO:teuthology.orchestra.run.smithi084.stdout:718.out 2023-09-13T08:27:16.904 INFO:teuthology.orchestra.run.smithi084.stdout:719 2023-09-13T08:27:16.904 INFO:teuthology.orchestra.run.smithi084.stdout:719.out 2023-09-13T08:27:16.904 INFO:teuthology.orchestra.run.smithi084.stdout:720 2023-09-13T08:27:16.904 INFO:teuthology.orchestra.run.smithi084.stdout:720.out 2023-09-13T08:27:16.904 INFO:teuthology.orchestra.run.smithi084.stdout:721 2023-09-13T08:27:16.904 INFO:teuthology.orchestra.run.smithi084.stdout:721.out 2023-09-13T08:27:16.905 INFO:teuthology.orchestra.run.smithi084.stdout:722 2023-09-13T08:27:16.905 INFO:teuthology.orchestra.run.smithi084.stdout:722.out 2023-09-13T08:27:16.905 INFO:teuthology.orchestra.run.smithi084.stdout:723 2023-09-13T08:27:16.905 INFO:teuthology.orchestra.run.smithi084.stdout:723.out 2023-09-13T08:27:16.905 INFO:teuthology.orchestra.run.smithi084.stdout:724 2023-09-13T08:27:16.906 INFO:teuthology.orchestra.run.smithi084.stdout:724.out 2023-09-13T08:27:16.906 INFO:teuthology.orchestra.run.smithi084.stdout:725 2023-09-13T08:27:16.906 INFO:teuthology.orchestra.run.smithi084.stdout:725.out 2023-09-13T08:27:16.906 INFO:teuthology.orchestra.run.smithi084.stdout:726 2023-09-13T08:27:16.906 INFO:teuthology.orchestra.run.smithi084.stdout:726.out 2023-09-13T08:27:16.907 INFO:teuthology.orchestra.run.smithi084.stdout:727 2023-09-13T08:27:16.907 INFO:teuthology.orchestra.run.smithi084.stdout:727.out 2023-09-13T08:27:16.907 INFO:teuthology.orchestra.run.smithi084.stdout:728 2023-09-13T08:27:16.907 INFO:teuthology.orchestra.run.smithi084.stdout:728.out 2023-09-13T08:27:16.908 INFO:teuthology.orchestra.run.smithi084.stdout:729 2023-09-13T08:27:16.908 INFO:teuthology.orchestra.run.smithi084.stdout:729.out 2023-09-13T08:27:16.908 INFO:teuthology.orchestra.run.smithi084.stdout:730 2023-09-13T08:27:16.908 INFO:teuthology.orchestra.run.smithi084.stdout:730.out 2023-09-13T08:27:16.908 INFO:teuthology.orchestra.run.smithi084.stdout:731 2023-09-13T08:27:16.909 INFO:teuthology.orchestra.run.smithi084.stdout:731.out 2023-09-13T08:27:16.909 INFO:teuthology.orchestra.run.smithi084.stdout:group.list 2023-09-13T08:27:16.909 INFO:teuthology.orchestra.run.smithi084.stdout:Makefile 2023-09-13T08:27:16.910 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/001) 2023-09-13T08:27:17.157 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:27:17.161 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:27:17.162 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:27:17.163 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:27:17.163 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:27:22.197 INFO:teuthology.orchestra.run.smithi084.stdout:generic/001 5s 2023-09-13T08:27:22.202 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/001 2023-09-13T08:27:22.202 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:27:22.204 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:27:22.905 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:27:22.905 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/002) 2023-09-13T08:27:23.107 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:27:23.111 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:27:23.112 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:27:23.113 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:27:23.113 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:27:23.722 INFO:teuthology.orchestra.run.smithi084.stdout:generic/002 0s 2023-09-13T08:27:23.726 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/002 2023-09-13T08:27:23.727 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:27:23.728 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:27:23.799 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:27:23.800 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/003) 2023-09-13T08:27:24.006 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:27:24.010 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:27:24.011 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:27:24.011 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:27:24.012 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:27:24.302 INFO:teuthology.orchestra.run.smithi084.stdout:generic/003 [not run] atime not maintained by ceph 2023-09-13T08:27:24.307 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/003 2023-09-13T08:27:24.307 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/003 2023-09-13T08:27:24.307 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:27:24.308 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:27:24.332 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:27:24.333 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/004) 2023-09-13T08:27:24.564 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:27:24.568 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:27:24.568 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:27:24.569 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:27:24.569 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:27:24.859 INFO:teuthology.orchestra.run.smithi084.stdout:generic/004 [not run] O_TMPFILE is not supported 2023-09-13T08:27:24.862 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/004 2023-09-13T08:27:24.863 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/004 2023-09-13T08:27:24.863 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:27:24.864 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:27:24.887 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:27:24.887 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/005) 2023-09-13T08:27:25.090 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:27:25.094 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:27:25.095 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:27:25.096 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:27:25.096 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:27:25.603 INFO:teuthology.orchestra.run.smithi084.stdout:generic/005 0s 2023-09-13T08:27:25.607 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/005 2023-09-13T08:27:25.608 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:27:25.610 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:27:25.736 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:27:25.737 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/006) 2023-09-13T08:27:25.936 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:27:25.939 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:27:25.940 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:27:25.941 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:27:25.941 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:27:41.145 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:27:41.161 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:27:50.812 INFO:teuthology.orchestra.run.smithi084.stdout:generic/006 24s 2023-09-13T08:27:50.823 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/006 2023-09-13T08:27:50.823 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:27:50.826 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:27:50.936 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:27:50.937 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/007) 2023-09-13T08:27:51.133 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:27:51.137 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:27:51.137 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:27:51.138 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:27:51.138 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:28:11.223 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:28:11.226 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:28:41.289 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:28:41.293 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:28:41.971 INFO:teuthology.orchestra.run.smithi084.stdout:generic/007 50s 2023-09-13T08:28:41.976 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/007 2023-09-13T08:28:41.976 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:28:41.978 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:28:42.110 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:28:42.112 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/008) 2023-09-13T08:28:42.359 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:28:42.363 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:28:42.363 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:28:42.364 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:28:42.364 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:28:42.727 INFO:teuthology.orchestra.run.smithi084.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-09-13T08:28:42.733 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/008 2023-09-13T08:28:42.733 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/008 2023-09-13T08:28:42.735 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:28:42.735 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:28:42.763 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:28:42.764 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/009) 2023-09-13T08:28:43.043 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:28:43.047 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:28:43.048 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:28:43.048 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:28:43.049 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:28:43.430 INFO:teuthology.orchestra.run.smithi084.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-09-13T08:28:43.434 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/009 2023-09-13T08:28:43.435 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/009 2023-09-13T08:28:43.435 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:28:43.436 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:28:43.466 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:28:43.466 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/010) 2023-09-13T08:28:43.667 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:28:43.671 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:28:43.671 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:28:43.672 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:28:43.672 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:28:43.997 INFO:teuthology.orchestra.run.smithi084.stdout:generic/010 [not run] /tmp/tmp.UxTBQ6XIL3xfstests-dev/src/dbtest not built 2023-09-13T08:28:44.001 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/010 2023-09-13T08:28:44.001 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/010 2023-09-13T08:28:44.001 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:28:44.003 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:28:44.024 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:28:44.024 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/011) 2023-09-13T08:28:44.251 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:28:44.255 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:28:44.255 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:28:44.256 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:28:44.257 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:29:11.493 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:29:11.496 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:29:20.762 INFO:teuthology.orchestra.run.smithi084.stdout:generic/011 36s 2023-09-13T08:29:20.766 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/011 2023-09-13T08:29:20.766 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:29:20.768 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:29:20.987 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:29:20.988 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/012) 2023-09-13T08:29:21.188 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:29:21.192 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:29:21.192 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:29:21.193 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:29:21.193 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:29:21.657 INFO:teuthology.orchestra.run.smithi084.stdout:generic/012 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-13T08:29:21.661 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/012 2023-09-13T08:29:21.661 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/012 2023-09-13T08:29:21.661 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:29:21.663 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:29:21.724 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:29:21.725 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/013) 2023-09-13T08:29:21.920 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:29:21.924 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:29:21.925 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:29:21.926 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:29:21.926 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:29:41.707 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:29:41.710 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:30:12.121 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:30:12.124 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:30:14.658 INFO:teuthology.orchestra.run.smithi084.stdout:generic/013 52s 2023-09-13T08:30:14.695 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/013 2023-09-13T08:30:14.695 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:30:14.697 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:30:14.736 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:30:14.737 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/014) 2023-09-13T08:30:15.050 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:30:15.057 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:30:15.057 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:30:15.058 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:30:15.059 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:30:42.202 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:30:42.206 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:31:12.293 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:31:12.296 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:31:42.395 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:31:42.398 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:32:12.661 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:32:12.664 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:32:42.783 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:32:42.788 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:33:12.887 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:33:12.890 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:33:43.303 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:33:43.306 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:34:13.695 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:34:13.706 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:34:44.022 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:34:44.036 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:34:45.111 INFO:teuthology.orchestra.run.smithi084.stdout:generic/014 270s 2023-09-13T08:34:45.118 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/014 2023-09-13T08:34:45.119 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:34:45.121 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:34:45.167 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:34:45.198 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/015) 2023-09-13T08:34:45.525 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:34:45.530 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:34:45.530 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:34:45.531 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:34:45.531 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:34:46.010 INFO:teuthology.orchestra.run.smithi084.stdout:generic/015 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-09-13T08:34:46.017 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/015 2023-09-13T08:34:46.018 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/015 2023-09-13T08:34:46.018 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:34:46.019 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:34:46.043 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:34:46.044 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/016) 2023-09-13T08:34:46.366 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:34:46.372 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:34:46.373 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:34:46.373 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:34:46.373 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:34:47.001 INFO:teuthology.orchestra.run.smithi084.stdout:generic/016 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-13T08:34:47.005 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/016 2023-09-13T08:34:47.005 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/016 2023-09-13T08:34:47.006 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:34:47.007 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:34:47.218 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:34:47.218 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/017) 2023-09-13T08:34:47.605 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:34:47.609 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:34:47.609 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:34:47.610 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:34:47.611 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:34:48.089 INFO:teuthology.orchestra.run.smithi084.stdout:generic/017 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-09-13T08:34:48.094 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/017 2023-09-13T08:34:48.094 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/017 2023-09-13T08:34:48.095 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:34:48.101 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:34:48.138 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:34:48.139 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/018) 2023-09-13T08:34:48.452 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:34:48.461 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:34:48.461 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:34:48.464 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:34:48.465 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:34:49.047 INFO:teuthology.orchestra.run.smithi084.stdout:generic/018 [not run] defragmentation not supported for fstype "ceph" 2023-09-13T08:34:49.062 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/018 2023-09-13T08:34:49.063 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/018 2023-09-13T08:34:49.063 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:34:49.064 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:34:49.123 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:34:49.124 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/019) 2023-09-13T08:34:49.505 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:34:49.509 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:34:49.510 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:34:49.511 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:34:49.511 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:34:49.993 INFO:teuthology.orchestra.run.smithi084.stdout:generic/019 [not run] require 172.21.15.84:6789:/scratch to be valid block disk 2023-09-13T08:34:49.998 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/019 2023-09-13T08:34:49.998 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/019 2023-09-13T08:34:49.999 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:34:50.004 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:34:50.030 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:34:50.031 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/020) 2023-09-13T08:34:50.318 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:34:50.325 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:34:50.327 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:34:50.328 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:34:50.328 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:34:53.826 INFO:teuthology.orchestra.run.smithi084.stdout:generic/020 3s 2023-09-13T08:34:53.834 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/020 2023-09-13T08:34:53.834 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:34:53.836 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:34:54.135 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:34:54.136 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/021) 2023-09-13T08:34:54.439 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:34:54.448 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:34:54.448 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:34:54.449 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:34:54.449 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:34:55.065 INFO:teuthology.orchestra.run.smithi084.stdout:generic/021 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-13T08:34:55.069 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/021 2023-09-13T08:34:55.070 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/021 2023-09-13T08:34:55.070 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:34:55.072 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:34:55.336 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:34:55.337 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/022) 2023-09-13T08:34:55.650 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:34:55.655 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:34:55.655 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:34:55.656 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:34:55.656 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:34:56.237 INFO:teuthology.orchestra.run.smithi084.stdout:generic/022 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-13T08:34:56.241 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/022 2023-09-13T08:34:56.242 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/022 2023-09-13T08:34:56.242 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:34:56.243 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:34:56.467 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:34:56.467 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/023) 2023-09-13T08:34:56.859 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:34:56.865 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:34:56.866 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:34:56.867 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:34:56.867 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:35:14.131 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:35:14.134 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:35:44.226 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:35:44.229 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:35:49.355 INFO:teuthology.orchestra.run.smithi084.stdout:generic/023 52s 2023-09-13T08:35:49.361 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/023 2023-09-13T08:35:49.361 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:35:49.363 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:35:49.580 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:35:49.581 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/024) 2023-09-13T08:35:50.019 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:35:50.023 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:35:50.023 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:35:50.025 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:35:50.026 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:35:50.491 INFO:teuthology.orchestra.run.smithi084.stdout:generic/024 [not run] kernel doesn't support renameat2 syscall 2023-09-13T08:35:50.495 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/024 2023-09-13T08:35:50.495 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/024 2023-09-13T08:35:50.495 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:35:50.497 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:35:50.743 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:35:50.744 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/025) 2023-09-13T08:35:51.161 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:35:51.166 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:35:51.167 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:35:51.170 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:35:51.170 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:35:51.640 INFO:teuthology.orchestra.run.smithi084.stdout:generic/025 [not run] kernel doesn't support renameat2 syscall 2023-09-13T08:35:51.644 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/025 2023-09-13T08:35:51.644 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/025 2023-09-13T08:35:51.645 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:35:51.647 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:35:51.947 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:35:51.947 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/026) 2023-09-13T08:35:52.254 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:35:52.259 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:35:52.259 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:35:52.260 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:35:52.260 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:35:52.757 INFO:teuthology.orchestra.run.smithi084.stdout:generic/026 [not run] ceph does not define maximum ACL count 2023-09-13T08:35:52.765 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/026 2023-09-13T08:35:52.766 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/026 2023-09-13T08:35:52.766 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:35:52.768 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:35:52.806 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:35:52.807 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/027) 2023-09-13T08:35:53.136 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:35:53.142 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:35:53.143 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:35:53.143 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:35:53.144 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:35:53.603 INFO:teuthology.orchestra.run.smithi084.stdout:generic/027 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-09-13T08:35:53.608 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/027 2023-09-13T08:35:53.608 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/027 2023-09-13T08:35:53.609 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:35:53.610 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:35:53.636 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:35:53.636 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/028) 2023-09-13T08:35:53.996 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:35:54.000 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:35:54.001 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:35:54.001 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:35:54.002 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:35:59.482 INFO:teuthology.orchestra.run.smithi084.stdout:generic/028 5s 2023-09-13T08:35:59.487 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/028 2023-09-13T08:35:59.488 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:35:59.490 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:35:59.516 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:35:59.517 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/029) 2023-09-13T08:35:59.836 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:35:59.846 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:35:59.847 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:35:59.847 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:35:59.848 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:36:04.791 INFO:teuthology.orchestra.run.smithi084.stdout:generic/029 4s 2023-09-13T08:36:04.797 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/029 2023-09-13T08:36:04.798 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:36:04.800 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:36:04.815 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:36:04.816 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/030) 2023-09-13T08:36:05.112 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:36:05.116 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:36:05.116 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:36:05.123 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:36:05.123 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:36:09.845 INFO:teuthology.orchestra.run.smithi084.stdout:generic/030 4s 2023-09-13T08:36:09.849 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/030 2023-09-13T08:36:09.849 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:36:09.851 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:36:09.860 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:36:09.861 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/031) 2023-09-13T08:36:10.170 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:36:10.177 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:36:10.178 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:36:10.178 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:36:10.179 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:36:10.721 INFO:teuthology.orchestra.run.smithi084.stdout:generic/031 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-09-13T08:36:10.724 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/031 2023-09-13T08:36:10.725 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/031 2023-09-13T08:36:10.725 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:36:10.727 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:36:10.757 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:36:10.758 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/032) 2023-09-13T08:36:11.060 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:36:11.063 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:36:11.063 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:36:11.064 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:36:11.064 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:36:11.536 INFO:teuthology.orchestra.run.smithi084.stdout:generic/032 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-13T08:36:11.541 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/032 2023-09-13T08:36:11.542 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/032 2023-09-13T08:36:11.542 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:36:11.546 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:36:11.575 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:36:11.575 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/033) 2023-09-13T08:36:11.902 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:36:11.911 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:36:11.912 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:36:11.913 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:36:11.913 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:36:12.448 INFO:teuthology.orchestra.run.smithi084.stdout:generic/033 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-09-13T08:36:12.454 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/033 2023-09-13T08:36:12.454 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/033 2023-09-13T08:36:12.455 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:36:12.460 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:36:12.506 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:36:12.507 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/034) 2023-09-13T08:36:12.797 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:36:12.802 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:36:12.803 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:36:12.804 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:36:12.804 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:36:13.258 INFO:teuthology.orchestra.run.smithi084.stdout:generic/034 [not run] require 172.21.15.84:6789:/scratch to be valid block disk 2023-09-13T08:36:13.262 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/034 2023-09-13T08:36:13.263 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/034 2023-09-13T08:36:13.263 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:36:13.269 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:36:13.305 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:36:13.306 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/035) 2023-09-13T08:36:13.652 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:36:13.664 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:36:13.664 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:36:13.664 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:36:13.665 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:36:14.226 INFO:teuthology.orchestra.run.smithi084.stdout:generic/035 1s 2023-09-13T08:36:14.231 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/035 2023-09-13T08:36:14.232 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:36:14.234 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:36:14.324 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:36:14.333 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:36:14.353 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:36:14.354 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/036) 2023-09-13T08:36:14.888 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:36:14.893 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:36:14.893 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:36:14.894 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:36:14.894 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:36:25.459 INFO:teuthology.orchestra.run.smithi084.stdout:generic/036 10s 2023-09-13T08:36:25.465 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/036 2023-09-13T08:36:25.466 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:36:25.468 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:36:25.775 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:36:25.776 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/037) 2023-09-13T08:36:26.092 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:36:26.097 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:36:26.097 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:36:26.098 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:36:26.099 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:36:29.085 INFO:teuthology.orchestra.run.smithi084.stdout:generic/037 3s 2023-09-13T08:36:29.090 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/037 2023-09-13T08:36:29.090 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:36:29.092 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:36:29.100 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:36:29.101 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/038) 2023-09-13T08:36:29.303 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:36:29.307 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:36:29.308 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:36:29.308 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:36:29.309 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:36:29.660 INFO:teuthology.orchestra.run.smithi084.stdout:generic/038 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-13T08:36:29.664 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/038 2023-09-13T08:36:29.665 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/038 2023-09-13T08:36:29.665 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:36:29.666 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:36:29.698 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:36:29.699 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/039) 2023-09-13T08:36:29.900 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:36:30.163 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:36:30.163 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:36:30.163 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:36:30.163 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:36:30.254 INFO:teuthology.orchestra.run.smithi084.stdout:generic/039 [not run] require 172.21.15.84:6789:/scratch to be valid block disk 2023-09-13T08:36:30.258 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/039 2023-09-13T08:36:30.258 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/039 2023-09-13T08:36:30.259 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:36:30.259 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:36:30.284 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:36:30.285 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/040) 2023-09-13T08:36:30.477 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:36:30.481 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:36:30.481 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:36:30.482 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:36:30.482 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:36:30.787 INFO:teuthology.orchestra.run.smithi084.stdout:generic/040 [not run] require 172.21.15.84:6789:/scratch to be valid block disk 2023-09-13T08:36:30.790 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/040 2023-09-13T08:36:30.791 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/040 2023-09-13T08:36:30.791 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:36:30.793 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:36:30.816 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:36:30.817 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/041) 2023-09-13T08:36:31.011 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:36:31.015 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:36:31.016 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:36:31.017 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:36:31.017 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:36:31.356 INFO:teuthology.orchestra.run.smithi084.stdout:generic/041 [not run] require 172.21.15.84:6789:/scratch to be valid block disk 2023-09-13T08:36:31.360 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/041 2023-09-13T08:36:31.361 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/041 2023-09-13T08:36:31.361 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:36:31.363 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:36:31.390 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:36:31.390 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/042) 2023-09-13T08:36:31.592 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:36:31.596 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:36:31.596 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:36:31.597 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:36:31.597 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:36:32.053 INFO:teuthology.orchestra.run.smithi084.stdout:generic/042 [not run] ceph does not support shutdown 2023-09-13T08:36:32.072 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/042 2023-09-13T08:36:32.073 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/042 2023-09-13T08:36:32.073 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:36:32.074 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:36:32.095 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:36:32.096 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/043) 2023-09-13T08:36:32.291 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:36:32.296 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:36:32.296 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:36:32.297 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:36:32.297 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:36:32.740 INFO:teuthology.orchestra.run.smithi084.stdout:generic/043 [not run] ceph does not support shutdown 2023-09-13T08:36:32.763 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/043 2023-09-13T08:36:32.763 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/043 2023-09-13T08:36:32.764 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:36:32.765 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:36:32.785 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:36:32.786 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/044) 2023-09-13T08:36:32.997 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:36:33.001 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:36:33.002 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:36:33.002 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:36:33.002 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:36:33.453 INFO:teuthology.orchestra.run.smithi084.stdout:generic/044 [not run] ceph does not support shutdown 2023-09-13T08:36:33.467 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/044 2023-09-13T08:36:33.468 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/044 2023-09-13T08:36:33.468 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:36:33.470 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:36:33.496 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:36:33.496 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/045) 2023-09-13T08:36:33.692 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:36:33.697 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:36:33.698 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:36:33.699 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:36:33.699 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:36:34.152 INFO:teuthology.orchestra.run.smithi084.stdout:generic/045 [not run] ceph does not support shutdown 2023-09-13T08:36:34.167 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/045 2023-09-13T08:36:34.167 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/045 2023-09-13T08:36:34.168 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:36:34.168 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:36:34.202 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:36:34.205 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/046) 2023-09-13T08:36:34.407 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:36:34.411 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:36:34.411 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:36:34.412 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:36:34.412 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:36:34.896 INFO:teuthology.orchestra.run.smithi084.stdout:generic/046 [not run] ceph does not support shutdown 2023-09-13T08:36:34.919 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/046 2023-09-13T08:36:34.919 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/046 2023-09-13T08:36:34.920 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:36:34.921 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:36:34.942 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:36:34.943 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/047) 2023-09-13T08:36:35.150 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:36:35.154 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:36:35.155 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:36:35.156 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:36:35.156 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:36:35.618 INFO:teuthology.orchestra.run.smithi084.stdout:generic/047 [not run] ceph does not support shutdown 2023-09-13T08:36:35.636 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/047 2023-09-13T08:36:35.636 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/047 2023-09-13T08:36:35.637 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:36:35.638 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:36:35.659 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:36:35.659 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/048) 2023-09-13T08:36:35.859 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:36:35.863 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:36:35.864 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:36:35.865 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:36:35.865 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:36:36.342 INFO:teuthology.orchestra.run.smithi084.stdout:generic/048 [not run] ceph does not support shutdown 2023-09-13T08:36:36.370 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/048 2023-09-13T08:36:36.370 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/048 2023-09-13T08:36:36.370 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:36:36.372 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:36:36.409 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:36:36.410 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/049) 2023-09-13T08:36:36.613 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:36:36.617 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:36:36.618 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:36:36.619 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:36:36.619 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:36:37.090 INFO:teuthology.orchestra.run.smithi084.stdout:generic/049 [not run] ceph does not support shutdown 2023-09-13T08:36:37.119 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/049 2023-09-13T08:36:37.119 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/049 2023-09-13T08:36:37.120 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:36:37.121 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:36:37.140 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:36:37.141 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/050) 2023-09-13T08:36:37.344 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:36:37.348 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:36:37.348 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:36:37.349 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:36:37.349 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:36:37.881 INFO:teuthology.orchestra.run.smithi084.stdout:generic/050 [not run] ceph does not support shutdown 2023-09-13T08:36:37.901 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/050 2023-09-13T08:36:37.901 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/050 2023-09-13T08:36:37.901 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:36:37.903 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:36:37.923 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:36:37.924 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/051) 2023-09-13T08:36:38.125 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:36:38.129 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:36:38.129 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:36:38.130 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:36:38.130 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:36:38.613 INFO:teuthology.orchestra.run.smithi084.stdout:generic/051 [not run] ceph does not support shutdown 2023-09-13T08:36:38.617 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/051 2023-09-13T08:36:38.618 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/051 2023-09-13T08:36:38.618 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:36:38.620 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:36:38.641 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:36:38.642 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/052) 2023-09-13T08:36:38.839 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:36:38.842 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:36:38.843 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:36:38.843 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:36:38.843 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:36:39.293 INFO:teuthology.orchestra.run.smithi084.stdout:generic/052 [not run] ceph does not support shutdown 2023-09-13T08:36:39.311 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/052 2023-09-13T08:36:39.311 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/052 2023-09-13T08:36:39.311 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:36:39.313 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:36:39.334 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:36:39.335 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/053) 2023-09-13T08:36:39.552 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:36:39.556 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:36:39.556 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:36:39.557 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:36:39.557 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:36:40.518 INFO:teuthology.orchestra.run.smithi084.stdout:generic/053 1s 2023-09-13T08:36:40.593 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/053 2023-09-13T08:36:40.593 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:36:40.597 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:36:40.634 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:36:40.634 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/054) 2023-09-13T08:36:40.838 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:36:40.842 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:36:40.842 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:36:40.843 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:36:40.844 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:36:41.328 INFO:teuthology.orchestra.run.smithi084.stdout:generic/054 [not run] ceph does not support shutdown 2023-09-13T08:36:41.343 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/054 2023-09-13T08:36:41.343 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/054 2023-09-13T08:36:41.344 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:36:41.345 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:36:41.369 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:36:41.369 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/055) 2023-09-13T08:36:41.565 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:36:41.569 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:36:41.570 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:36:41.571 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:36:41.571 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:36:42.035 INFO:teuthology.orchestra.run.smithi084.stdout:generic/055 [not run] ceph does not support shutdown 2023-09-13T08:36:42.062 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/055 2023-09-13T08:36:42.063 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/055 2023-09-13T08:36:42.063 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:36:42.064 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:36:42.090 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:36:42.091 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/056) 2023-09-13T08:36:42.302 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:36:42.306 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:36:42.306 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:36:42.307 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:36:42.308 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:36:42.636 INFO:teuthology.orchestra.run.smithi084.stdout:generic/056 [not run] require 172.21.15.84:6789:/scratch to be valid block disk 2023-09-13T08:36:42.653 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/056 2023-09-13T08:36:42.653 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/056 2023-09-13T08:36:42.654 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:36:42.654 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:36:42.676 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:36:42.677 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/057) 2023-09-13T08:36:42.876 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:36:42.880 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:36:42.880 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:36:42.881 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:36:42.881 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:36:43.213 INFO:teuthology.orchestra.run.smithi084.stdout:generic/057 [not run] require 172.21.15.84:6789:/scratch to be valid block disk 2023-09-13T08:36:43.217 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/057 2023-09-13T08:36:43.217 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/057 2023-09-13T08:36:43.217 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:36:43.219 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:36:43.248 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:36:43.248 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/058) 2023-09-13T08:36:43.454 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:36:43.458 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:36:43.458 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:36:43.459 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:36:43.459 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:36:43.853 INFO:teuthology.orchestra.run.smithi084.stdout:generic/058 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-13T08:36:43.857 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/058 2023-09-13T08:36:43.858 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/058 2023-09-13T08:36:43.858 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:36:43.859 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:36:44.129 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:36:44.130 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/059) 2023-09-13T08:36:44.362 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:36:44.366 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:36:44.366 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:36:44.367 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:36:44.368 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:36:44.680 INFO:teuthology.orchestra.run.smithi084.stdout:generic/059 [not run] require 172.21.15.84:6789:/scratch to be valid block disk 2023-09-13T08:36:44.684 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/059 2023-09-13T08:36:44.684 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/059 2023-09-13T08:36:44.684 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:36:44.685 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:36:44.687 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:36:44.691 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:36:44.705 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:36:44.709 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/060) 2023-09-13T08:36:44.987 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:36:44.991 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:36:44.991 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:36:44.992 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:36:44.993 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:36:45.386 INFO:teuthology.orchestra.run.smithi084.stdout:generic/060 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-13T08:36:45.390 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/060 2023-09-13T08:36:45.390 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/060 2023-09-13T08:36:45.390 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:36:45.392 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:36:45.519 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:36:45.519 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/061) 2023-09-13T08:36:45.884 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:36:45.888 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:36:45.889 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:36:45.890 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:36:45.890 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:36:46.258 INFO:teuthology.orchestra.run.smithi084.stdout:generic/061 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-13T08:36:46.262 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/061 2023-09-13T08:36:46.262 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/061 2023-09-13T08:36:46.262 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:36:46.264 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:36:46.522 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:36:46.522 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/062) 2023-09-13T08:36:46.786 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:36:46.790 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:36:46.791 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:36:46.791 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:36:46.792 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:36:48.583 INFO:teuthology.orchestra.run.smithi084.stdout:generic/062 1s 2023-09-13T08:36:48.598 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/062 2023-09-13T08:36:48.599 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:36:48.601 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:36:48.611 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:36:48.612 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/063) 2023-09-13T08:36:48.842 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:36:48.845 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:36:48.845 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:36:48.846 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:36:48.846 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:36:49.301 INFO:teuthology.orchestra.run.smithi084.stdout:generic/063 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-13T08:36:49.305 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/063 2023-09-13T08:36:49.305 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/063 2023-09-13T08:36:49.305 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:36:49.307 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:36:49.490 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:36:49.491 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/064) 2023-09-13T08:36:49.817 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:36:49.823 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:36:49.823 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:36:49.823 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:36:49.824 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:36:50.147 INFO:teuthology.orchestra.run.smithi084.stdout:generic/064 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-09-13T08:36:50.151 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/064 2023-09-13T08:36:50.151 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/064 2023-09-13T08:36:50.152 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:36:50.153 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:36:50.174 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:36:50.175 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/065) 2023-09-13T08:36:50.394 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:36:50.398 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:36:50.398 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:36:50.399 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:36:50.399 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:36:50.723 INFO:teuthology.orchestra.run.smithi084.stdout:generic/065 [not run] require 172.21.15.84:6789:/scratch to be valid block disk 2023-09-13T08:36:50.727 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/065 2023-09-13T08:36:50.727 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/065 2023-09-13T08:36:50.728 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:36:50.729 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:36:50.754 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:36:50.754 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/066) 2023-09-13T08:36:50.948 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:36:50.952 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:36:50.953 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:36:50.953 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:36:50.954 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:36:51.268 INFO:teuthology.orchestra.run.smithi084.stdout:generic/066 [not run] require 172.21.15.84:6789:/scratch to be valid block disk 2023-09-13T08:36:51.272 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/066 2023-09-13T08:36:51.273 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/066 2023-09-13T08:36:51.273 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:36:51.274 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:36:51.294 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:36:51.294 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/067) 2023-09-13T08:36:51.492 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:36:51.496 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:36:51.496 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:36:51.497 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:36:51.497 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:36:51.859 INFO:teuthology.orchestra.run.smithi084.stdout:generic/067 [not run] require 172.21.15.84:6789:/scratch to be valid block disk 2023-09-13T08:36:51.863 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/067 2023-09-13T08:36:51.864 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/067 2023-09-13T08:36:51.864 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:36:51.865 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:36:51.897 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:36:51.899 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/068) 2023-09-13T08:36:52.122 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:36:52.126 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:36:52.127 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:36:52.128 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:36:52.128 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:36:52.455 INFO:teuthology.orchestra.run.smithi084.stdout:generic/068 [not run] ceph does not support freezing 2023-09-13T08:36:52.459 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/068 2023-09-13T08:36:52.459 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/068 2023-09-13T08:36:52.459 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:36:52.460 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:36:52.486 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:36:52.487 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/069) 2023-09-13T08:36:52.682 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:36:52.684 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:36:52.684 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:36:52.685 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:36:52.686 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:36:58.295 INFO:teuthology.orchestra.run.smithi084.stdout:generic/069 6s 2023-09-13T08:36:58.303 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/069 2023-09-13T08:36:58.303 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:36:58.306 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:36:58.319 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:36:58.320 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/070) 2023-09-13T08:36:58.529 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:36:58.533 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:36:58.534 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:36:58.535 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:36:58.535 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:37:15.575 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:37:15.635 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:37:26.838 INFO:teuthology.orchestra.run.smithi084.stdout:generic/070 28s 2023-09-13T08:37:26.843 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/070 2023-09-13T08:37:26.843 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:37:26.845 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:37:27.159 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:37:27.160 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/071) 2023-09-13T08:37:27.478 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:37:27.488 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:37:27.490 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:37:27.494 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:37:27.494 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:37:27.969 INFO:teuthology.orchestra.run.smithi084.stdout:generic/071 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-09-13T08:37:27.975 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/071 2023-09-13T08:37:27.975 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/071 2023-09-13T08:37:27.975 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:37:27.978 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:37:28.015 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:37:28.015 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/072) 2023-09-13T08:37:28.369 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:37:28.373 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:37:28.374 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:37:28.375 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:37:28.375 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:37:28.945 INFO:teuthology.orchestra.run.smithi084.stdout:generic/072 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-09-13T08:37:28.950 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/072 2023-09-13T08:37:28.951 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/072 2023-09-13T08:37:28.951 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:37:28.953 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:37:28.992 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:37:28.992 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/073) 2023-09-13T08:37:29.314 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:37:29.325 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:37:29.326 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:37:29.326 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:37:29.326 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:37:29.797 INFO:teuthology.orchestra.run.smithi084.stdout:generic/073 [not run] require 172.21.15.84:6789:/scratch to be valid block disk 2023-09-13T08:37:29.807 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/073 2023-09-13T08:37:29.807 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/073 2023-09-13T08:37:29.808 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:37:29.811 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:37:29.847 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:37:29.848 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/074) 2023-09-13T08:37:30.203 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:37:30.213 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:37:30.213 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:37:30.214 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:37:30.214 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:37:46.111 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:37:46.114 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:37:46.222 INFO:tasks.ceph.mds.d.smithi161.stderr:2023-09-13T08:37:46.222+0000 7f3b9b143700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 112791) UID: 0 2023-09-13T08:37:46.223 INFO:tasks.ceph.mds.b.smithi161.stderr:2023-09-13T08:37:46.222+0000 7f40246c1700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 112791) UID: 0 2023-09-13T08:37:47.982 INFO:teuthology.orchestra.run.smithi084.stdout:generic/074 17s 2023-09-13T08:37:48.030 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/074 2023-09-13T08:37:48.030 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:37:48.032 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:37:49.396 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:37:49.397 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/075) 2023-09-13T08:37:49.796 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:37:49.894 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:37:49.895 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:37:49.895 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:37:49.896 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:38:24.156 INFO:teuthology.orchestra.run.smithi084.stdout:generic/075 34s 2023-09-13T08:38:24.165 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/075 2023-09-13T08:38:24.165 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:38:24.166 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:38:24.473 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:38:24.474 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/076) 2023-09-13T08:38:24.799 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:38:24.808 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:38:24.809 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:38:24.810 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:38:24.810 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:38:25.292 INFO:teuthology.orchestra.run.smithi084.stdout:generic/076 [not run] require 172.21.15.84:6789:/scratch to be local device 2023-09-13T08:38:25.300 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/076 2023-09-13T08:38:25.300 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/076 2023-09-13T08:38:25.300 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:38:25.307 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:38:25.344 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:38:25.344 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/077) 2023-09-13T08:38:25.652 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:38:25.658 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:38:25.659 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:38:25.660 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:38:25.660 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:38:28.546 INFO:teuthology.orchestra.run.smithi084.stdout:generic/077 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-09-13T08:38:28.550 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/077 2023-09-13T08:38:28.551 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/077 2023-09-13T08:38:28.551 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:38:28.553 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:38:28.776 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:38:28.777 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/078) 2023-09-13T08:38:29.161 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:38:29.165 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:38:29.166 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:38:29.167 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:38:29.167 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:38:29.617 INFO:teuthology.orchestra.run.smithi084.stdout:generic/078 [not run] kernel doesn't support renameat2 syscall 2023-09-13T08:38:29.622 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/078 2023-09-13T08:38:29.622 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/078 2023-09-13T08:38:29.622 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:38:29.624 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:38:29.786 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:38:29.787 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/079) 2023-09-13T08:38:30.200 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:38:30.212 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:38:30.213 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:38:30.213 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:38:30.214 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:38:30.710 INFO:teuthology.orchestra.run.smithi084.stdout:generic/079 [not run] file system doesn't support chattr +ia 2023-09-13T08:38:30.714 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/079 2023-09-13T08:38:30.715 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/079 2023-09-13T08:38:30.715 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:38:30.716 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:38:30.768 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:38:30.769 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/080) 2023-09-13T08:38:31.111 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:38:31.122 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:38:31.122 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:38:31.123 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:38:31.124 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:38:33.664 INFO:teuthology.orchestra.run.smithi084.stdout:generic/080 2s 2023-09-13T08:38:33.672 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/080 2023-09-13T08:38:33.672 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:38:33.674 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:38:33.717 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:38:33.718 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/081) 2023-09-13T08:38:34.020 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:38:34.025 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:38:34.025 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:38:34.030 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:38:34.030 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:38:34.488 INFO:teuthology.orchestra.run.smithi084.stdout:generic/081 [not run] require 172.21.15.84:6789:/scratch to be valid block disk 2023-09-13T08:38:34.494 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/081 2023-09-13T08:38:34.494 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/081 2023-09-13T08:38:34.495 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:38:34.496 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:38:34.524 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:38:34.525 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/082) 2023-09-13T08:38:34.834 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:38:34.838 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:38:34.838 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:38:34.839 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:38:34.839 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:38:35.260 INFO:teuthology.orchestra.run.smithi084.stdout:generic/082 [not run] disk quotas not supported by this filesystem type: ceph 2023-09-13T08:38:35.264 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/082 2023-09-13T08:38:35.265 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/082 2023-09-13T08:38:35.265 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:38:35.267 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:38:35.305 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:38:35.306 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/083) 2023-09-13T08:38:35.615 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:38:35.620 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:38:35.621 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:38:35.621 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:38:35.622 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:38:36.066 INFO:teuthology.orchestra.run.smithi084.stdout:generic/083 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-09-13T08:38:36.071 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/083 2023-09-13T08:38:36.071 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/083 2023-09-13T08:38:36.071 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:38:36.073 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:38:36.103 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:38:36.104 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/084) 2023-09-13T08:38:36.387 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:38:36.393 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:38:36.394 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:38:36.395 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:38:36.395 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:38:42.421 INFO:teuthology.orchestra.run.smithi084.stdout:generic/084 6s 2023-09-13T08:38:42.428 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/084 2023-09-13T08:38:42.428 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:38:42.432 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:38:42.442 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:38:42.442 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/085) 2023-09-13T08:38:42.714 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:38:42.718 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:38:42.719 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:38:42.720 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:38:42.720 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:38:43.128 INFO:teuthology.orchestra.run.smithi084.stdout:generic/085 [not run] require 172.21.15.84:6789:/scratch to be valid block disk 2023-09-13T08:38:43.133 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/085 2023-09-13T08:38:43.133 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/085 2023-09-13T08:38:43.134 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:38:43.140 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:38:43.173 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:38:43.174 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/086) 2023-09-13T08:38:43.465 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:38:43.471 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:38:43.471 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:38:43.472 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:38:43.472 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:38:43.923 INFO:teuthology.orchestra.run.smithi084.stdout:generic/086 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-13T08:38:43.928 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/086 2023-09-13T08:38:43.928 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/086 2023-09-13T08:38:43.928 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:38:43.930 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:38:43.964 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:38:43.965 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/087) 2023-09-13T08:38:44.280 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:38:44.287 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:38:44.287 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:38:44.288 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:38:44.288 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:38:44.872 INFO:teuthology.orchestra.run.smithi084.stdout:generic/087 0s 2023-09-13T08:38:44.878 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/087 2023-09-13T08:38:44.879 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:38:44.880 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:38:45.061 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:38:45.062 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/088) 2023-09-13T08:38:45.522 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:38:45.532 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:38:45.533 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:38:45.534 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:38:45.534 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:38:46.009 INFO:teuthology.orchestra.run.smithi084.stdout:generic/088 1s 2023-09-13T08:38:46.014 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/088 2023-09-13T08:38:46.014 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:38:46.016 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:38:46.325 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:38:46.326 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/089) 2023-09-13T08:38:46.623 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:38:46.627 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:38:46.627 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:38:46.632 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:38:46.632 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:41:08.136 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:41:08.173 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:41:39.004 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:41:39.007 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:42:09.084 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:42:09.087 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:42:39.546 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:42:39.549 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:42:39.612 INFO:tasks.ceph.mds.d.smithi161.stderr:2023-09-13T08:42:39.612+0000 7f3b9b143700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 113103) UID: 0 2023-09-13T08:42:39.612 INFO:tasks.ceph.mds.b.smithi161.stderr:2023-09-13T08:42:39.612+0000 7f40246c1700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 113103) UID: 0 2023-09-13T08:45:29.050 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:45:29.086 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:45:59.139 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:45:59.143 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:46:29.619 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:46:29.622 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:46:29.669 INFO:tasks.ceph.mds.d.smithi161.stderr:2023-09-13T08:46:29.669+0000 7f3b9b143700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 113209) UID: 0 2023-09-13T08:46:29.669 INFO:tasks.ceph.mds.b.smithi161.stderr:2023-09-13T08:46:29.669+0000 7f40246c1700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 113209) UID: 0 2023-09-13T08:47:03.679 INFO:teuthology.orchestra.run.smithi084.stdout:generic/089 497s 2023-09-13T08:47:05.169 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/089 2023-09-13T08:47:05.169 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:47:05.170 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:47:05.170 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:47:05.183 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/090) 2023-09-13T08:47:05.729 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:47:05.735 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:47:05.737 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:47:05.741 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:47:05.741 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:47:06.269 INFO:teuthology.orchestra.run.smithi084.stdout:generic/090 [not run] require 172.21.15.84:6789:/scratch to be valid block disk 2023-09-13T08:47:06.273 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/090 2023-09-13T08:47:06.273 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/090 2023-09-13T08:47:06.273 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:47:06.275 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:47:06.299 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:47:06.300 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/091) 2023-09-13T08:47:06.529 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:47:06.533 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:47:06.533 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:47:06.534 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:47:06.535 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:48:52.774 INFO:teuthology.orchestra.run.smithi084.stdout:generic/091 106s 2023-09-13T08:48:52.798 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/091 2023-09-13T08:48:52.798 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:48:52.798 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:48:53.109 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:48:53.110 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/092) 2023-09-13T08:48:53.326 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:48:53.329 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:48:53.330 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:48:53.331 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:48:53.331 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:48:53.629 INFO:teuthology.orchestra.run.smithi084.stdout:generic/092 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-13T08:48:53.630 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/092 2023-09-13T08:48:53.631 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/092 2023-09-13T08:48:53.631 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:48:53.632 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:48:53.659 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:48:53.660 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/093) 2023-09-13T08:48:53.888 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:48:53.892 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:48:53.893 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:48:53.893 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:48:53.894 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:48:54.358 INFO:teuthology.orchestra.run.smithi084.stdout:generic/093 0s 2023-09-13T08:48:54.362 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/093 2023-09-13T08:48:54.362 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:48:54.364 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:48:54.651 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:48:54.651 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/094) 2023-09-13T08:48:54.899 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:48:54.903 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:48:54.903 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:48:54.904 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:48:54.905 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:48:55.276 INFO:teuthology.orchestra.run.smithi084.stdout:generic/094 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-09-13T08:48:55.281 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/094 2023-09-13T08:48:55.282 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/094 2023-09-13T08:48:55.282 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:48:55.282 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:48:55.477 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:48:55.477 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/095) 2023-09-13T08:48:55.813 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:48:55.816 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:48:55.817 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:48:55.818 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:48:55.818 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:49:08.086 INFO:teuthology.orchestra.run.smithi084.stdout:generic/095 13s 2023-09-13T08:49:08.090 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/095 2023-09-13T08:49:08.091 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:49:08.092 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:49:08.101 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:49:08.102 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/096) 2023-09-13T08:49:08.305 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:49:08.310 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:49:08.310 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:49:08.311 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:49:08.311 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:49:08.693 INFO:teuthology.orchestra.run.smithi084.stdout:generic/096 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-09-13T08:49:08.697 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/096 2023-09-13T08:49:08.697 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/096 2023-09-13T08:49:08.697 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:49:08.699 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:49:08.725 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:49:08.726 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/097) 2023-09-13T08:49:08.916 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:49:08.920 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:49:08.921 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:49:08.922 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:49:08.922 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:49:09.789 INFO:teuthology.orchestra.run.smithi084.stdout:generic/097 0s 2023-09-13T08:49:09.791 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/097 2023-09-13T08:49:09.791 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:49:09.793 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:49:09.825 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:49:09.826 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/098) 2023-09-13T08:49:10.028 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:49:10.031 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:49:10.032 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:49:10.033 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:49:10.033 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:49:10.531 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:49:10.533 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:49:11.940 INFO:teuthology.orchestra.run.smithi084.stdout:generic/098 1s 2023-09-13T08:49:11.945 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/098 2023-09-13T08:49:11.945 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:49:11.947 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:49:11.955 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:49:11.956 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/099) 2023-09-13T08:49:12.148 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:49:12.152 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:49:12.152 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:49:12.153 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:49:12.155 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:49:13.077 INFO:teuthology.orchestra.run.smithi084.stdout:generic/099 1s 2023-09-13T08:49:13.091 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/099 2023-09-13T08:49:13.092 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:49:13.092 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:49:13.384 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:49:13.385 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/100) 2023-09-13T08:49:13.661 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:49:13.665 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:49:13.666 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:49:13.667 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:49:13.667 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:49:24.953 INFO:teuthology.orchestra.run.smithi084.stdout:generic/100 11s 2023-09-13T08:49:24.957 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/100 2023-09-13T08:49:24.957 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:49:24.959 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:49:29.019 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:49:29.020 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/101) 2023-09-13T08:49:29.307 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:49:29.311 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:49:29.312 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:49:29.312 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:49:29.313 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:49:29.670 INFO:teuthology.orchestra.run.smithi084.stdout:generic/101 [not run] require 172.21.15.84:6789:/scratch to be valid block disk 2023-09-13T08:49:29.675 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/101 2023-09-13T08:49:29.675 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/101 2023-09-13T08:49:29.676 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:49:29.678 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:49:29.740 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:49:29.741 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/102) 2023-09-13T08:49:29.953 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:49:29.957 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:49:29.957 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:49:29.958 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:49:29.958 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:49:30.250 INFO:teuthology.orchestra.run.smithi084.stdout:generic/102 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-09-13T08:49:30.254 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/102 2023-09-13T08:49:30.254 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/102 2023-09-13T08:49:30.254 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:49:30.256 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:49:30.278 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:49:30.282 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/103) 2023-09-13T08:49:30.510 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:49:30.514 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:49:30.514 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:49:30.515 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:49:30.516 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:49:30.834 INFO:teuthology.orchestra.run.smithi084.stdout:generic/103 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-13T08:49:30.838 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/103 2023-09-13T08:49:30.838 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/103 2023-09-13T08:49:30.838 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:49:30.840 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:49:31.137 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:49:31.138 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/104) 2023-09-13T08:49:31.387 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:49:31.391 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:49:31.391 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:49:31.392 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:49:31.392 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:49:31.769 INFO:teuthology.orchestra.run.smithi084.stdout:generic/104 [not run] require 172.21.15.84:6789:/scratch to be valid block disk 2023-09-13T08:49:31.854 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/104 2023-09-13T08:49:31.855 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/104 2023-09-13T08:49:31.855 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:49:31.855 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:49:31.856 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:49:31.856 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/105) 2023-09-13T08:49:32.066 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:49:32.070 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:49:32.070 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:49:32.071 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:49:32.072 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:49:32.996 INFO:teuthology.orchestra.run.smithi084.stdout:generic/105 0s 2023-09-13T08:49:33.002 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/105 2023-09-13T08:49:33.002 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:49:33.004 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:49:33.015 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:49:33.016 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/106) 2023-09-13T08:49:33.249 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:49:33.292 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:49:33.293 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:49:33.293 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:49:33.293 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:49:33.623 INFO:teuthology.orchestra.run.smithi084.stdout:generic/106 [not run] require 172.21.15.84:6789:/scratch to be valid block disk 2023-09-13T08:49:33.627 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/106 2023-09-13T08:49:33.627 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/106 2023-09-13T08:49:33.628 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:49:33.629 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:49:33.658 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:49:33.658 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/107) 2023-09-13T08:49:33.859 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:49:33.863 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:49:33.864 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:49:33.864 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:49:33.865 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:49:34.191 INFO:teuthology.orchestra.run.smithi084.stdout:generic/107 [not run] require 172.21.15.84:6789:/scratch to be valid block disk 2023-09-13T08:49:34.194 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/107 2023-09-13T08:49:34.195 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/107 2023-09-13T08:49:34.195 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:49:34.197 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:49:34.217 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:49:34.218 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/108) 2023-09-13T08:49:34.446 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:49:34.450 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:49:34.450 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:49:34.451 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:49:34.451 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:49:34.900 INFO:teuthology.orchestra.run.smithi084.stdout:generic/108 [not run] require 172.21.15.84:6789:/scratch to be valid block disk 2023-09-13T08:49:34.901 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/108 2023-09-13T08:49:34.901 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/108 2023-09-13T08:49:34.901 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:49:34.903 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:49:34.927 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:49:34.928 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/109) 2023-09-13T08:49:35.124 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:49:35.127 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:49:35.128 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:49:35.129 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:49:35.129 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:49:40.977 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:49:40.980 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:49:46.118 INFO:teuthology.orchestra.run.smithi084.stdout:generic/109 11s 2023-09-13T08:49:46.134 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/109 2023-09-13T08:49:46.134 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:49:46.142 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:49:46.159 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:49:46.159 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/110) 2023-09-13T08:49:47.066 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:49:47.070 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:49:47.093 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:49:47.094 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:49:47.094 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:50:08.213 INFO:teuthology.orchestra.run.smithi084.stdout:generic/110 [not run] Reflink not supported by test filesystem type: ceph 2023-09-13T08:50:08.217 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/110 2023-09-13T08:50:08.218 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/110 2023-09-13T08:50:08.218 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:50:08.219 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:50:08.576 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:50:08.577 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/111) 2023-09-13T08:50:08.989 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:50:09.017 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:50:09.018 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:50:09.018 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:50:09.019 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:50:09.545 INFO:teuthology.orchestra.run.smithi084.stdout:generic/111 [not run] Reflink not supported by test filesystem type: ceph 2023-09-13T08:50:09.549 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/111 2023-09-13T08:50:09.549 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/111 2023-09-13T08:50:09.550 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:50:09.551 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:50:09.850 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:50:09.851 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/112) 2023-09-13T08:50:10.121 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:50:10.125 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:50:10.126 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:50:10.126 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:50:10.127 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:50:11.034 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:50:11.036 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:50:26.833 INFO:teuthology.orchestra.run.smithi084.stdout:generic/112 16s 2023-09-13T08:50:26.837 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/112 2023-09-13T08:50:26.837 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:50:26.839 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:50:27.125 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:50:27.126 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/113) 2023-09-13T08:50:27.376 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:50:27.380 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:50:27.381 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:50:27.381 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:50:27.382 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:50:41.473 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:50:41.476 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:50:42.271 INFO:teuthology.orchestra.run.smithi084.stdout:generic/113 15s 2023-09-13T08:50:42.276 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/113 2023-09-13T08:50:42.276 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:50:42.278 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:50:42.608 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:50:42.609 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/114) 2023-09-13T08:50:42.951 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:50:42.954 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:50:42.955 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:50:42.955 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:50:42.956 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:50:43.324 INFO:teuthology.orchestra.run.smithi084.stdout:generic/114 [not run] device block size: 4096 greater than 512 2023-09-13T08:50:43.328 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/114 2023-09-13T08:50:43.328 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/114 2023-09-13T08:50:43.328 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:50:43.330 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:50:43.360 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:50:43.360 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/115) 2023-09-13T08:50:43.562 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:50:43.566 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:50:43.567 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:50:43.568 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:50:43.568 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:50:43.926 INFO:teuthology.orchestra.run.smithi084.stdout:generic/115 [not run] Reflink not supported by test filesystem type: ceph 2023-09-13T08:50:43.930 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/115 2023-09-13T08:50:43.931 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/115 2023-09-13T08:50:43.931 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:50:43.933 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:50:44.256 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:50:44.257 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/116) 2023-09-13T08:50:44.464 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:50:44.468 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:50:44.469 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:50:44.469 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:50:44.470 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:50:44.829 INFO:teuthology.orchestra.run.smithi084.stdout:generic/116 [not run] Reflink not supported by test filesystem type: ceph 2023-09-13T08:50:44.833 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/116 2023-09-13T08:50:44.834 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/116 2023-09-13T08:50:44.834 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:50:44.835 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:50:45.173 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:50:45.173 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/117) 2023-09-13T08:50:45.381 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:50:45.385 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:50:45.386 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:50:45.387 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:50:45.387 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:50:56.699 INFO:teuthology.orchestra.run.smithi084.stdout:generic/117 11s 2023-09-13T08:50:56.712 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/117 2023-09-13T08:50:56.713 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:50:56.717 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:50:56.733 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:50:56.734 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/118) 2023-09-13T08:50:56.944 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:50:56.948 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:50:56.949 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:50:56.949 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:50:56.950 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:50:57.648 INFO:teuthology.orchestra.run.smithi084.stdout:generic/118 [not run] Reflink not supported by test filesystem type: ceph 2023-09-13T08:50:57.651 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/118 2023-09-13T08:50:57.652 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/118 2023-09-13T08:50:57.652 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:50:57.653 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:50:57.920 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:50:57.921 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/119) 2023-09-13T08:50:58.284 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:50:58.287 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:50:58.295 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:50:58.296 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:50:58.297 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:50:58.637 INFO:teuthology.orchestra.run.smithi084.stdout:generic/119 [not run] Reflink not supported by test filesystem type: ceph 2023-09-13T08:50:58.641 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/119 2023-09-13T08:50:58.641 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/119 2023-09-13T08:50:58.641 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:50:58.643 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:50:58.971 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:50:58.971 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/120) 2023-09-13T08:50:59.188 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:50:59.193 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:50:59.193 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:50:59.194 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:50:59.194 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:50:59.497 INFO:teuthology.orchestra.run.smithi084.stdout:generic/120 [not run] atime not maintained by ceph 2023-09-13T08:50:59.500 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/120 2023-09-13T08:50:59.501 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/120 2023-09-13T08:50:59.501 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:50:59.502 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:50:59.530 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:50:59.531 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/121) 2023-09-13T08:50:59.725 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:50:59.729 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:50:59.730 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:50:59.731 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:50:59.731 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:51:00.072 INFO:teuthology.orchestra.run.smithi084.stdout:generic/121 [not run] Dedupe not supported by test filesystem type: ceph 2023-09-13T08:51:00.076 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/121 2023-09-13T08:51:00.077 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/121 2023-09-13T08:51:00.077 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:51:00.078 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:51:00.362 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:51:00.363 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/122) 2023-09-13T08:51:00.614 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:51:00.618 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:51:00.619 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:51:00.620 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:51:00.620 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:51:00.951 INFO:teuthology.orchestra.run.smithi084.stdout:generic/122 [not run] Dedupe not supported by test filesystem type: ceph 2023-09-13T08:51:00.955 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/122 2023-09-13T08:51:00.956 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/122 2023-09-13T08:51:00.956 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:51:00.957 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:51:01.228 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:51:01.229 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/123) 2023-09-13T08:51:01.482 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:51:01.486 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:51:01.486 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:51:01.487 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:51:01.487 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:51:01.965 INFO:teuthology.orchestra.run.smithi084.stdout:generic/123 0s 2023-09-13T08:51:01.969 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/123 2023-09-13T08:51:01.969 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:51:01.971 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:51:02.055 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:51:02.056 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/124) 2023-09-13T08:51:02.517 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:51:02.521 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:51:02.521 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:51:02.522 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:51:02.522 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:51:04.806 INFO:teuthology.orchestra.run.smithi084.stdout:generic/124 2s 2023-09-13T08:51:04.813 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/124 2023-09-13T08:51:04.813 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:51:04.815 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:51:05.360 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:51:05.360 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/125) 2023-09-13T08:51:05.710 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:51:05.714 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:51:05.715 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:51:05.716 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:51:05.716 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:51:11.581 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:51:11.586 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:51:41.722 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:51:41.726 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:52:07.258 INFO:teuthology.orchestra.run.smithi084.stdout:generic/125 62s 2023-09-13T08:52:07.263 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/125 2023-09-13T08:52:07.264 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:52:07.265 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:52:07.518 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:52:07.519 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/126) 2023-09-13T08:52:07.809 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:52:07.813 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:52:07.814 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:52:07.815 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:52:07.815 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:52:08.316 INFO:teuthology.orchestra.run.smithi084.stdout:generic/126 0s 2023-09-13T08:52:08.320 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/126 2023-09-13T08:52:08.321 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T08:52:08.322 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:52:08.550 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T08:52:08.550 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/127) 2023-09-13T08:52:08.883 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T08:52:08.887 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T08:52:08.888 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T08:52:08.888 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T08:52:08.889 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T08:52:11.832 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:52:11.834 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:52:41.897 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:52:41.900 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:53:11.953 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:53:11.956 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:53:42.040 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:53:42.058 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:54:12.141 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:54:12.144 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:54:42.261 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:54:42.263 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:55:12.316 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:55:12.319 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:55:42.846 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:55:42.850 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:56:13.162 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:56:13.192 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:56:43.266 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:56:43.269 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:57:13.333 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:57:13.336 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:57:43.422 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:57:43.425 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:58:13.485 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:58:13.488 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:58:43.554 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:58:43.557 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:59:13.636 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:59:13.641 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:59:43.703 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T08:59:43.706 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:00:13.764 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:00:13.767 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:00:44.087 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:00:44.091 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:01:14.501 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:01:14.506 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:01:33.281 INFO:teuthology.orchestra.run.smithi084.stdout:generic/127 564s 2023-09-13T09:01:33.288 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/127 2023-09-13T09:01:33.288 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:01:33.290 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:01:33.607 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:01:33.622 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/128) 2023-09-13T09:01:33.925 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:01:33.929 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:01:33.929 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:01:33.930 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:01:33.930 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:01:35.012 INFO:teuthology.orchestra.run.smithi084.stdout:generic/128 1s 2023-09-13T09:01:35.017 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/128 2023-09-13T09:01:35.017 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:01:35.019 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:01:35.027 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:01:35.028 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/129) 2023-09-13T09:01:35.245 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:01:35.249 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:01:35.249 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:01:35.250 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:01:35.251 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:01:44.574 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:01:44.589 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:02:14.703 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:02:14.708 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:02:44.783 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:02:44.789 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:03:14.950 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:03:14.960 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:03:45.062 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:03:45.069 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:04:15.162 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:04:15.194 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:04:45.322 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:04:45.336 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:05:15.992 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:05:15.995 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:05:46.138 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:05:46.154 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:05:46.271 INFO:tasks.ceph.osd.4.smithi161.stderr:2023-09-13T09:05:46.270+0000 7f74b53b3700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 115304) UID: 0 2023-09-13T09:05:46.276 INFO:tasks.ceph.osd.7.smithi161.stderr:2023-09-13T09:05:46.273+0000 7f01a431f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 115304) UID: 0 2023-09-13T09:05:46.300 INFO:tasks.ceph.osd.5.smithi161.stderr:2023-09-13T09:05:46.276+0000 7ffb9d22b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 115304) UID: 0 2023-09-13T09:05:46.300 INFO:tasks.ceph.osd.6.smithi161.stderr:2023-09-13T09:05:46.271+0000 7f1a51b0f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 115304) UID: 0 2023-09-13T09:10:13.849 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:10:13.895 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:10:13.994 INFO:tasks.ceph.osd.0.smithi084.stderr:2023-09-13T09:10:13.982+0000 7f41ea673700 -1 received signal: Hangup from (PID: 260874) UID: 0 2023-09-13T09:10:13.995 INFO:tasks.ceph.osd.1.smithi084.stderr:2023-09-13T09:10:13.977+0000 7f7780105700 -1 received signal: Hangup from (PID: 260874) UID: 0 2023-09-13T09:10:14.012 INFO:tasks.ceph.osd.2.smithi084.stderr:2023-09-13T09:10:13.985+0000 7f459a7f9700 -1 received signal: Hangup from (PID: 260874) UID: 0 2023-09-13T09:10:14.012 INFO:tasks.ceph.osd.3.smithi084.stderr:2023-09-13T09:10:13.977+0000 7f2433cf8700 -1 received signal: Hangup from (PID: 260874) UID: 0 2023-09-13T09:10:14.079 INFO:tasks.ceph.osd.4.smithi161.stderr:2023-09-13T09:10:14.078+0000 7f74b53b3700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 115369) UID: 0 2023-09-13T09:10:14.079 INFO:tasks.ceph.osd.6.smithi161.stderr:2023-09-13T09:10:14.078+0000 7f1a51b0f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 115369) UID: 0 2023-09-13T09:10:14.080 INFO:tasks.ceph.osd.5.smithi161.stderr:2023-09-13T09:10:14.079+0000 7ffb9d22b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 115369) UID: 0 2023-09-13T09:10:14.080 INFO:tasks.ceph.osd.7.smithi161.stderr:2023-09-13T09:10:14.079+0000 7f01a431f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 115369) UID: 0 2023-09-13T09:14:57.307 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:14:57.402 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:14:57.779 INFO:tasks.ceph.osd.1.smithi084.stderr:2023-09-13T09:14:57.779+0000 7f7780105700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 260936) UID: 0 2023-09-13T09:14:57.781 INFO:tasks.ceph.osd.3.smithi084.stderr:2023-09-13T09:14:57.781+0000 7f2433cf8700 -1 received signal: Hangup from (PID: 260936) UID: 0 2023-09-13T09:14:57.788 INFO:tasks.ceph.osd.2.smithi084.stderr:2023-09-13T09:14:57.781+0000 7f459a7f9700 -1 received signal: Hangup from (PID: 260936) UID: 0 2023-09-13T09:14:57.819 INFO:tasks.ceph.osd.0.smithi084.stderr:2023-09-13T09:14:57.779+0000 7f41ea673700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 260936) UID: 0 2023-09-13T09:14:57.907 INFO:tasks.ceph.osd.7.smithi161.stderr:2023-09-13T09:14:57.907+0000 7f01a431f700 -1 Fail to open '/proc/115435/cmdline' error = (2) No such file or directory 2023-09-13T09:14:57.908 INFO:tasks.ceph.osd.7.smithi161.stderr:2023-09-13T09:14:57.907+0000 7f01a431f700 -1 received signal: Hangup from (PID: 115435) UID: 0 2023-09-13T09:14:57.913 INFO:tasks.ceph.osd.4.smithi161.stderr:2023-09-13T09:14:57.911+0000 7f74b53b3700 -1 Fail to open '/proc/115435/cmdline' error = (2) No such file or directory 2023-09-13T09:14:57.914 INFO:tasks.ceph.osd.4.smithi161.stderr:2023-09-13T09:14:57.911+0000 7f74b53b3700 -1 received signal: Hangup from (PID: 115435) UID: 0 2023-09-13T09:14:57.914 INFO:tasks.ceph.osd.6.smithi161.stderr:2023-09-13T09:14:57.909+0000 7f1a51b0f700 -1 Fail to open '/proc/115435/cmdline' error = (2) No such file or directory 2023-09-13T09:14:57.914 INFO:tasks.ceph.osd.6.smithi161.stderr:2023-09-13T09:14:57.909+0000 7f1a51b0f700 -1 received signal: Hangup from (PID: 115435) UID: 0 2023-09-13T09:14:57.915 INFO:tasks.ceph.osd.5.smithi161.stderr:2023-09-13T09:14:57.909+0000 7ffb9d22b700 -1 Fail to open '/proc/115435/cmdline' error = (2) No such file or directory 2023-09-13T09:14:57.915 INFO:tasks.ceph.osd.5.smithi161.stderr:2023-09-13T09:14:57.909+0000 7ffb9d22b700 -1 received signal: Hangup from (PID: 115435) UID: 0 2023-09-13T09:19:24.001 INFO:teuthology.orchestra.run.smithi161.stderr:error: Compressing program wrote following message to stderr when compressing log /var/log/ceph/ceph-osd.4.log.1: 2023-09-13T09:19:24.029 INFO:teuthology.orchestra.run.smithi161.stderr:gzip: stdin: file size changed while zipping 2023-09-13T09:22:17.487 INFO:teuthology.orchestra.run.smithi084.stdout:generic/129 1242s 2023-09-13T09:22:17.551 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/129 2023-09-13T09:22:17.551 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:22:17.600 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:22:17.610 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:22:17.628 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/130) 2023-09-13T09:22:18.672 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:22:18.676 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:22:18.676 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:22:18.677 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:22:18.677 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:22:31.282 INFO:teuthology.orchestra.run.smithi084.stdout:generic/130 13s 2023-09-13T09:22:31.283 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/130 2023-09-13T09:22:31.283 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:22:31.283 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:22:31.291 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:22:31.291 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/131) 2023-09-13T09:22:31.501 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:22:31.505 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:22:31.505 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:22:31.506 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:22:31.507 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:22:33.178 INFO:teuthology.orchestra.run.smithi084.stdout:generic/131 2s 2023-09-13T09:22:33.191 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/131 2023-09-13T09:22:33.191 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:22:33.199 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:22:33.554 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:22:33.555 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/132) 2023-09-13T09:22:33.970 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:22:33.976 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:22:33.976 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:22:33.978 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:22:33.979 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:22:48.129 INFO:teuthology.orchestra.run.smithi084.stdout:generic/132 14s 2023-09-13T09:22:48.134 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/132 2023-09-13T09:22:48.134 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:22:48.136 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:22:48.144 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:22:48.145 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/133) 2023-09-13T09:22:48.356 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:22:48.360 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:22:48.360 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:22:48.361 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:22:48.362 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:23:09.536 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:23:09.539 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:23:09.612 INFO:tasks.ceph.mds.d.smithi161.stderr:2023-09-13T09:23:09.611+0000 7f3b9b143700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 115737) UID: 0 2023-09-13T09:23:09.612 INFO:tasks.ceph.mds.b.smithi161.stderr:2023-09-13T09:23:09.611+0000 7f40246c1700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 115737) UID: 0 2023-09-13T09:23:09.778 INFO:tasks.ceph.osd.0.smithi084.stderr:2023-09-13T09:23:09.778+0000 7f41ea673700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 263314) UID: 0 2023-09-13T09:23:09.779 INFO:tasks.ceph.osd.1.smithi084.stderr:2023-09-13T09:23:09.778+0000 7f7780105700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 263314) UID: 0 2023-09-13T09:23:09.779 INFO:tasks.ceph.osd.2.smithi084.stderr:2023-09-13T09:23:09.778+0000 7f459a7f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 263314) UID: 0 2023-09-13T09:23:09.779 INFO:tasks.ceph.osd.3.smithi084.stderr:2023-09-13T09:23:09.778+0000 7f2433cf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 263314) UID: 0 2023-09-13T09:25:19.247 INFO:tasks.ceph.osd.4.smithi161.stderr:2023-09-13T09:25:19.246+0000 7f74b53b3700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 116060) UID: 0 2023-09-13T09:25:19.248 INFO:tasks.ceph.osd.5.smithi161.stderr:2023-09-13T09:25:19.246+0000 7ffb9d22b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 116060) UID: 0 2023-09-13T09:25:19.248 INFO:tasks.ceph.osd.6.smithi161.stderr:2023-09-13T09:25:19.246+0000 7f1a51b0f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 116060) UID: 0 2023-09-13T09:25:19.249 INFO:tasks.ceph.osd.7.smithi161.stderr:2023-09-13T09:25:19.246+0000 7f01a431f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 116060) UID: 0 2023-09-13T09:27:16.757 INFO:teuthology.orchestra.run.smithi084.stdout:generic/133 268s 2023-09-13T09:27:16.762 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/133 2023-09-13T09:27:16.762 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:27:16.764 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:27:17.066 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:27:17.067 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/134) 2023-09-13T09:27:17.318 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:27:17.322 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:27:17.322 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:27:17.323 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:27:17.324 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:27:17.812 INFO:teuthology.orchestra.run.smithi084.stdout:generic/134 [not run] Reflink not supported by test filesystem type: ceph 2023-09-13T09:27:17.817 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/134 2023-09-13T09:27:17.817 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/134 2023-09-13T09:27:17.817 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:27:17.819 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:27:18.190 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:27:18.191 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/135) 2023-09-13T09:27:18.439 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:27:18.443 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:27:18.444 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:27:18.445 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:27:18.445 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:27:19.658 INFO:teuthology.orchestra.run.smithi084.stdout:generic/135 1s 2023-09-13T09:27:19.663 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/135 2023-09-13T09:27:19.663 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:27:19.665 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:27:19.674 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:27:19.674 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/136) 2023-09-13T09:27:19.907 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:27:19.911 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:27:19.911 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:27:19.912 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:27:19.913 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:27:20.273 INFO:teuthology.orchestra.run.smithi084.stdout:generic/136 [not run] Dedupe not supported by test filesystem type: ceph 2023-09-13T09:27:20.277 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/136 2023-09-13T09:27:20.278 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/136 2023-09-13T09:27:20.278 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:27:20.279 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:27:20.530 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:27:20.531 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/137) 2023-09-13T09:27:20.862 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:27:20.866 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:27:20.867 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:27:20.867 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:27:20.868 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:27:21.246 INFO:teuthology.orchestra.run.smithi084.stdout:generic/137 [not run] Reflink not supported by test filesystem type: ceph 2023-09-13T09:27:21.250 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/137 2023-09-13T09:27:21.250 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/137 2023-09-13T09:27:21.250 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:27:21.252 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:27:21.520 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:27:21.521 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/138) 2023-09-13T09:27:21.850 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:27:21.854 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:27:21.855 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:27:21.856 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:27:21.856 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:27:22.234 INFO:teuthology.orchestra.run.smithi084.stdout:generic/138 [not run] Reflink not supported by test filesystem type: ceph 2023-09-13T09:27:22.238 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/138 2023-09-13T09:27:22.239 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/138 2023-09-13T09:27:22.239 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:27:22.241 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:27:22.551 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:27:22.552 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/139) 2023-09-13T09:27:22.815 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:27:22.819 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:27:22.820 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:27:22.820 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:27:22.821 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:27:23.175 INFO:teuthology.orchestra.run.smithi084.stdout:generic/139 [not run] Reflink not supported by test filesystem type: ceph 2023-09-13T09:27:23.179 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/139 2023-09-13T09:27:23.180 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/139 2023-09-13T09:27:23.180 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:27:23.182 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:27:23.364 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:27:23.365 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/140) 2023-09-13T09:27:23.750 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:27:23.754 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:27:23.755 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:27:23.756 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:27:23.756 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:27:24.125 INFO:teuthology.orchestra.run.smithi084.stdout:generic/140 [not run] Reflink not supported by test filesystem type: ceph 2023-09-13T09:27:24.129 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/140 2023-09-13T09:27:24.130 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/140 2023-09-13T09:27:24.130 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:27:24.131 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:27:24.278 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:27:24.278 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/141) 2023-09-13T09:27:24.704 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:27:24.708 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:27:24.709 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:27:24.710 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:27:24.710 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:27:25.288 INFO:teuthology.orchestra.run.smithi084.stdout:generic/141 1s 2023-09-13T09:27:25.293 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/141 2023-09-13T09:27:25.293 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:27:25.295 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:27:25.303 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:27:25.303 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/142) 2023-09-13T09:27:25.535 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:27:25.539 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:27:25.539 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:27:25.540 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:27:25.540 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:27:25.915 INFO:teuthology.orchestra.run.smithi084.stdout:generic/142 [not run] Reflink not supported by test filesystem type: ceph 2023-09-13T09:27:25.919 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/142 2023-09-13T09:27:25.920 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/142 2023-09-13T09:27:25.920 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:27:25.921 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:27:26.239 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:27:26.240 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/143) 2023-09-13T09:27:26.481 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:27:26.485 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:27:26.486 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:27:26.487 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:27:26.487 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:27:26.849 INFO:teuthology.orchestra.run.smithi084.stdout:generic/143 [not run] Reflink not supported by test filesystem type: ceph 2023-09-13T09:27:26.852 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/143 2023-09-13T09:27:26.853 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/143 2023-09-13T09:27:26.853 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:27:26.855 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:27:27.205 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:27:27.206 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/144) 2023-09-13T09:27:27.422 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:27:27.426 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:27:27.427 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:27:27.429 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:27:27.429 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:27:27.799 INFO:teuthology.orchestra.run.smithi084.stdout:generic/144 [not run] Reflink not supported by test filesystem type: ceph 2023-09-13T09:27:27.803 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/144 2023-09-13T09:27:27.803 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/144 2023-09-13T09:27:27.804 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:27:27.805 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:27:28.165 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:27:28.166 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/145) 2023-09-13T09:27:28.388 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:27:28.392 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:27:28.392 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:27:28.393 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:27:28.393 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:27:28.776 INFO:teuthology.orchestra.run.smithi084.stdout:generic/145 [not run] Reflink not supported by test filesystem type: ceph 2023-09-13T09:27:28.780 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/145 2023-09-13T09:27:28.781 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/145 2023-09-13T09:27:28.781 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:27:28.782 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:27:29.140 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:27:29.141 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/146) 2023-09-13T09:27:29.354 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:27:29.358 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:27:29.358 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:27:29.359 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:27:29.359 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:27:29.719 INFO:teuthology.orchestra.run.smithi084.stdout:generic/146 [not run] Reflink not supported by test filesystem type: ceph 2023-09-13T09:27:29.723 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/146 2023-09-13T09:27:29.723 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/146 2023-09-13T09:27:29.724 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:27:29.725 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:27:29.950 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:27:29.950 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/147) 2023-09-13T09:27:30.298 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:27:30.302 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:27:30.303 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:27:30.304 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:27:30.304 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:27:30.690 INFO:teuthology.orchestra.run.smithi084.stdout:generic/147 [not run] Reflink not supported by test filesystem type: ceph 2023-09-13T09:27:30.694 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/147 2023-09-13T09:27:30.694 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/147 2023-09-13T09:27:30.695 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:27:30.696 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:27:31.044 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:27:31.044 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/148) 2023-09-13T09:27:31.271 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:27:31.275 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:27:31.275 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:27:31.276 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:27:31.276 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:27:31.630 INFO:teuthology.orchestra.run.smithi084.stdout:generic/148 [not run] Reflink not supported by test filesystem type: ceph 2023-09-13T09:27:31.633 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/148 2023-09-13T09:27:31.634 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/148 2023-09-13T09:27:31.634 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:27:31.636 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:27:31.932 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:27:31.933 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/149) 2023-09-13T09:27:32.197 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:27:32.202 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:27:32.202 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:27:32.203 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:27:32.204 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:27:32.573 INFO:teuthology.orchestra.run.smithi084.stdout:generic/149 [not run] Reflink not supported by test filesystem type: ceph 2023-09-13T09:27:32.576 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/149 2023-09-13T09:27:32.576 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/149 2023-09-13T09:27:32.577 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:27:32.578 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:27:32.866 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:27:32.867 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/150) 2023-09-13T09:27:33.164 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:27:33.167 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:27:33.168 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:27:33.169 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:27:33.169 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:27:33.522 INFO:teuthology.orchestra.run.smithi084.stdout:generic/150 [not run] Reflink not supported by test filesystem type: ceph 2023-09-13T09:27:33.525 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/150 2023-09-13T09:27:33.526 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/150 2023-09-13T09:27:33.526 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:27:33.528 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:27:33.754 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:27:33.754 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/151) 2023-09-13T09:27:34.083 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:27:34.087 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:27:34.088 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:27:34.088 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:27:34.089 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:27:34.456 INFO:teuthology.orchestra.run.smithi084.stdout:generic/151 [not run] Reflink not supported by test filesystem type: ceph 2023-09-13T09:27:34.460 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/151 2023-09-13T09:27:34.461 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/151 2023-09-13T09:27:34.461 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:27:34.463 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:27:34.765 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:27:34.765 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/152) 2023-09-13T09:27:35.030 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:27:35.034 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:27:35.035 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:27:35.035 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:27:35.036 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:27:35.397 INFO:teuthology.orchestra.run.smithi084.stdout:generic/152 [not run] Reflink not supported by test filesystem type: ceph 2023-09-13T09:27:35.401 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/152 2023-09-13T09:27:35.401 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/152 2023-09-13T09:27:35.402 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:27:35.403 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:27:35.623 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:27:35.623 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/153) 2023-09-13T09:27:35.983 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:27:35.987 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:27:35.987 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:27:35.988 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:27:35.989 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:27:36.365 INFO:teuthology.orchestra.run.smithi084.stdout:generic/153 [not run] Reflink not supported by test filesystem type: ceph 2023-09-13T09:27:36.369 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/153 2023-09-13T09:27:36.370 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/153 2023-09-13T09:27:36.370 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:27:36.371 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:27:36.600 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:27:36.601 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/154) 2023-09-13T09:27:36.932 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:27:36.936 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:27:36.937 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:27:36.938 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:27:36.938 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:27:37.305 INFO:teuthology.orchestra.run.smithi084.stdout:generic/154 [not run] Reflink not supported by test filesystem type: ceph 2023-09-13T09:27:37.309 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/154 2023-09-13T09:27:37.309 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/154 2023-09-13T09:27:37.309 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:27:37.311 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:27:37.664 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:27:37.665 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/155) 2023-09-13T09:27:37.886 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:27:37.890 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:27:37.891 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:27:37.891 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:27:37.892 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:27:38.252 INFO:teuthology.orchestra.run.smithi084.stdout:generic/155 [not run] Reflink not supported by test filesystem type: ceph 2023-09-13T09:27:38.256 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/155 2023-09-13T09:27:38.256 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/155 2023-09-13T09:27:38.257 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:27:38.258 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:27:38.601 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:27:38.601 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/156) 2023-09-13T09:27:38.835 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:27:38.839 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:27:38.840 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:27:38.841 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:27:38.841 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:27:39.205 INFO:teuthology.orchestra.run.smithi084.stdout:generic/156 [not run] Reflink not supported by test filesystem type: ceph 2023-09-13T09:27:39.209 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/156 2023-09-13T09:27:39.209 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/156 2023-09-13T09:27:39.209 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:27:39.211 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:27:39.412 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:27:39.413 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/157) 2023-09-13T09:27:39.794 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:27:39.798 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:27:39.799 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:27:39.800 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:27:39.800 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:27:40.169 INFO:teuthology.orchestra.run.smithi084.stdout:generic/157 [not run] Reflink not supported by test filesystem type: ceph 2023-09-13T09:27:40.173 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/157 2023-09-13T09:27:40.174 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/157 2023-09-13T09:27:40.174 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:27:40.176 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:27:40.488 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:27:40.489 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/158) 2023-09-13T09:27:40.787 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:27:40.792 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:27:40.792 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:27:40.793 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:27:40.793 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:27:41.164 INFO:teuthology.orchestra.run.smithi084.stdout:generic/158 [not run] Dedupe not supported by test filesystem type: ceph 2023-09-13T09:27:41.168 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/158 2023-09-13T09:27:41.168 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/158 2023-09-13T09:27:41.168 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:27:41.170 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:27:41.527 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:27:41.528 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/159) 2023-09-13T09:27:41.778 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:27:41.782 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:27:41.788 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:27:41.788 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:27:41.788 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:27:42.146 INFO:teuthology.orchestra.run.smithi084.stdout:generic/159 [not run] file system doesn't support chattr +i 2023-09-13T09:27:42.150 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/159 2023-09-13T09:27:42.151 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/159 2023-09-13T09:27:42.151 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:27:42.152 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:27:42.187 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:27:42.187 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/160) 2023-09-13T09:27:42.387 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:27:42.391 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:27:42.391 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:27:42.392 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:27:42.392 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:27:42.779 INFO:teuthology.orchestra.run.smithi084.stdout:generic/160 [not run] file system doesn't support chattr +i 2023-09-13T09:27:42.783 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/160 2023-09-13T09:27:42.784 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/160 2023-09-13T09:27:42.784 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:27:42.785 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:27:42.819 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:27:42.820 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/161) 2023-09-13T09:27:43.020 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:27:43.024 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:27:43.025 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:27:43.025 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:27:43.026 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:27:43.852 INFO:teuthology.orchestra.run.smithi084.stdout:generic/161 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:27:43.860 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/161 2023-09-13T09:27:43.861 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/161 2023-09-13T09:27:43.861 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:27:43.879 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:27:43.999 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:27:44.000 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/162) 2023-09-13T09:27:44.201 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:27:44.205 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:27:44.206 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:27:44.207 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:27:44.207 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:27:44.731 INFO:teuthology.orchestra.run.smithi084.stdout:generic/162 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-09-13T09:27:45.022 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/162 2023-09-13T09:27:45.023 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/162 2023-09-13T09:27:45.023 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:27:45.041 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:27:45.206 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:27:45.206 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/163) 2023-09-13T09:27:45.407 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:27:45.411 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:27:45.411 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:27:45.412 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:27:45.412 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:27:45.947 INFO:teuthology.orchestra.run.smithi084.stdout:generic/163 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-09-13T09:27:46.239 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/163 2023-09-13T09:27:46.239 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/163 2023-09-13T09:27:46.239 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:27:46.259 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:27:46.414 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:27:46.415 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/164) 2023-09-13T09:27:46.616 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:27:46.620 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:27:46.620 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:27:46.621 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:27:46.621 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:27:47.483 INFO:teuthology.orchestra.run.smithi084.stdout:generic/164 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:27:47.499 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/164 2023-09-13T09:27:47.500 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/164 2023-09-13T09:27:47.500 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:27:47.502 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:27:47.570 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:27:47.571 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/165) 2023-09-13T09:27:47.776 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:27:47.780 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:27:47.781 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:27:47.781 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:27:47.782 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:27:48.703 INFO:teuthology.orchestra.run.smithi084.stdout:generic/165 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:27:48.713 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/165 2023-09-13T09:27:48.713 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/165 2023-09-13T09:27:48.714 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:27:48.718 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:27:48.778 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:27:48.778 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/166) 2023-09-13T09:27:48.983 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:27:48.987 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:27:48.987 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:27:48.988 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:27:48.988 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:27:49.826 INFO:teuthology.orchestra.run.smithi084.stdout:generic/166 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:27:49.837 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/166 2023-09-13T09:27:49.837 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/166 2023-09-13T09:27:49.838 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:27:49.840 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:27:49.913 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:27:49.913 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/167) 2023-09-13T09:27:50.133 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:27:50.136 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:27:50.137 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:27:50.138 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:27:50.138 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:27:50.826 INFO:teuthology.orchestra.run.smithi084.stdout:generic/167 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:27:50.838 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/167 2023-09-13T09:27:50.838 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/167 2023-09-13T09:27:50.838 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:27:50.871 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:27:51.138 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:27:51.139 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/168) 2023-09-13T09:27:51.339 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:27:51.343 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:27:51.343 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:27:51.344 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:27:51.344 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:27:52.143 INFO:teuthology.orchestra.run.smithi084.stdout:generic/168 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:27:52.173 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/168 2023-09-13T09:27:52.174 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/168 2023-09-13T09:27:52.174 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:27:52.177 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:27:52.383 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:27:52.384 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/169) 2023-09-13T09:27:52.589 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:27:52.593 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:27:52.594 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:27:52.594 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:27:52.595 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:27:53.388 INFO:teuthology.orchestra.run.smithi084.stdout:generic/169 1s 2023-09-13T09:27:53.392 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/169 2023-09-13T09:27:53.393 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:27:53.395 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:27:53.403 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:27:53.404 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/170) 2023-09-13T09:27:53.613 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:27:53.617 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:27:53.617 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:27:53.618 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:27:53.618 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:27:54.441 INFO:teuthology.orchestra.run.smithi084.stdout:generic/170 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:27:54.475 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/170 2023-09-13T09:27:54.476 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/170 2023-09-13T09:27:54.476 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:27:54.479 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:27:54.613 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:27:54.614 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/171) 2023-09-13T09:27:54.818 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:27:54.822 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:27:54.823 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:27:54.824 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:27:54.824 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:27:55.753 INFO:teuthology.orchestra.run.smithi084.stdout:generic/171 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:27:55.753 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/171 2023-09-13T09:27:55.753 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/171 2023-09-13T09:27:55.754 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:27:55.762 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:27:55.879 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:27:55.880 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/172) 2023-09-13T09:27:56.082 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:27:56.086 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:27:56.087 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:27:56.088 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:27:56.088 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:27:56.989 INFO:teuthology.orchestra.run.smithi084.stdout:generic/172 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:27:56.996 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/172 2023-09-13T09:27:56.997 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/172 2023-09-13T09:27:56.997 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:27:56.998 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:27:57.160 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:27:57.161 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/173) 2023-09-13T09:27:57.366 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:27:57.370 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:27:57.370 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:27:57.371 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:27:57.371 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:27:58.250 INFO:teuthology.orchestra.run.smithi084.stdout:generic/173 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:27:58.259 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/173 2023-09-13T09:27:58.259 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/173 2023-09-13T09:27:58.260 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:27:58.262 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:27:58.365 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:27:58.366 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/174) 2023-09-13T09:27:58.570 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:27:58.575 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:27:58.575 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:27:58.576 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:27:58.576 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:27:59.453 INFO:teuthology.orchestra.run.smithi084.stdout:generic/174 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:27:59.474 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/174 2023-09-13T09:27:59.475 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/174 2023-09-13T09:27:59.475 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:27:59.477 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:27:59.581 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:27:59.581 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/175) 2023-09-13T09:27:59.784 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:27:59.788 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:27:59.789 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:27:59.789 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:27:59.790 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:28:00.616 INFO:teuthology.orchestra.run.smithi084.stdout:generic/175 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:28:00.664 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/175 2023-09-13T09:28:00.664 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/175 2023-09-13T09:28:00.664 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:28:00.682 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:28:00.833 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:28:00.834 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/176) 2023-09-13T09:28:01.036 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:28:01.040 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:28:01.040 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:28:01.041 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:28:01.041 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:28:01.836 INFO:teuthology.orchestra.run.smithi084.stdout:generic/176 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:28:01.923 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/176 2023-09-13T09:28:01.923 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/176 2023-09-13T09:28:01.923 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:28:01.939 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:28:02.057 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:28:02.057 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/177) 2023-09-13T09:28:02.261 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:28:02.265 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:28:02.265 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:28:02.266 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:28:02.266 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:28:02.780 INFO:teuthology.orchestra.run.smithi084.stdout:generic/177 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-09-13T09:28:02.784 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/177 2023-09-13T09:28:02.784 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/177 2023-09-13T09:28:02.784 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:28:02.786 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:28:03.141 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:28:03.142 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/178) 2023-09-13T09:28:03.396 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:28:03.400 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:28:03.400 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:28:03.401 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:28:03.401 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:28:03.787 INFO:teuthology.orchestra.run.smithi084.stdout:generic/178 [not run] Reflink not supported by test filesystem type: ceph 2023-09-13T09:28:03.790 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/178 2023-09-13T09:28:03.791 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/178 2023-09-13T09:28:03.791 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:28:03.792 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:28:04.138 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:28:04.138 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/179) 2023-09-13T09:28:04.380 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:28:04.384 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:28:04.385 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:28:04.385 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:28:04.386 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:28:04.756 INFO:teuthology.orchestra.run.smithi084.stdout:generic/179 [not run] Reflink not supported by test filesystem type: ceph 2023-09-13T09:28:04.760 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/179 2023-09-13T09:28:04.760 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/179 2023-09-13T09:28:04.761 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:28:04.762 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:28:05.079 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:28:05.080 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/180) 2023-09-13T09:28:05.343 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:28:05.347 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:28:05.348 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:28:05.349 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:28:05.349 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:28:05.719 INFO:teuthology.orchestra.run.smithi084.stdout:generic/180 [not run] Reflink not supported by test filesystem type: ceph 2023-09-13T09:28:05.723 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/180 2023-09-13T09:28:05.723 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/180 2023-09-13T09:28:05.723 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:28:05.725 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:28:06.031 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:28:06.032 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/181) 2023-09-13T09:28:06.308 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:28:06.313 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:28:06.314 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:28:06.314 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:28:06.314 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:28:06.674 INFO:teuthology.orchestra.run.smithi084.stdout:generic/181 [not run] Reflink not supported by test filesystem type: ceph 2023-09-13T09:28:06.678 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/181 2023-09-13T09:28:06.678 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/181 2023-09-13T09:28:06.678 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:28:06.680 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:28:07.040 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:28:07.041 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/182) 2023-09-13T09:28:07.267 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:28:07.270 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:28:07.271 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:28:07.272 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:28:07.272 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:28:07.647 INFO:teuthology.orchestra.run.smithi084.stdout:generic/182 [not run] Dedupe not supported by test filesystem type: ceph 2023-09-13T09:28:07.651 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/182 2023-09-13T09:28:07.651 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/182 2023-09-13T09:28:07.651 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:28:07.653 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:28:07.936 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:28:07.937 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/183) 2023-09-13T09:28:08.250 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:28:08.253 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:28:08.254 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:28:08.255 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:28:08.255 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:28:08.982 INFO:teuthology.orchestra.run.smithi084.stdout:generic/183 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:28:08.989 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/183 2023-09-13T09:28:08.989 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/183 2023-09-13T09:28:08.990 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:28:08.992 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:28:09.157 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:28:09.158 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/184) 2023-09-13T09:28:09.393 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:28:09.396 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:28:09.397 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:28:09.398 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:28:09.398 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:28:09.778 INFO:teuthology.orchestra.run.smithi084.stdout:generic/184 0s 2023-09-13T09:28:09.783 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/184 2023-09-13T09:28:09.783 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:28:09.784 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:28:09.813 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:28:09.814 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/185) 2023-09-13T09:28:10.015 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:28:10.019 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:28:10.019 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:28:10.020 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:28:10.020 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:28:10.741 INFO:teuthology.orchestra.run.smithi084.stdout:generic/185 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:28:10.787 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/185 2023-09-13T09:28:10.787 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/185 2023-09-13T09:28:10.787 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:28:10.846 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:28:10.934 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:28:10.935 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/186) 2023-09-13T09:28:11.140 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:28:11.144 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:28:11.145 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:28:11.145 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:28:11.146 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:28:11.763 INFO:teuthology.orchestra.run.smithi084.stdout:generic/186 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:28:11.782 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/186 2023-09-13T09:28:11.782 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/186 2023-09-13T09:28:11.783 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:28:11.887 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:28:12.126 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:28:12.127 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/187) 2023-09-13T09:28:12.327 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:28:12.331 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:28:12.331 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:28:12.332 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:28:12.332 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:28:12.976 INFO:teuthology.orchestra.run.smithi084.stdout:generic/187 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:28:13.101 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/187 2023-09-13T09:28:13.101 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/187 2023-09-13T09:28:13.101 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:28:13.116 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:28:13.277 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:28:13.277 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/188) 2023-09-13T09:28:13.480 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:28:13.484 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:28:13.484 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:28:13.485 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:28:13.486 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:28:14.375 INFO:teuthology.orchestra.run.smithi084.stdout:generic/188 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:28:14.385 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/188 2023-09-13T09:28:14.386 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/188 2023-09-13T09:28:14.386 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:28:14.388 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:28:14.461 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:28:14.462 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/189) 2023-09-13T09:28:14.665 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:28:14.669 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:28:14.670 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:28:14.671 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:28:14.671 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:28:15.439 INFO:teuthology.orchestra.run.smithi084.stdout:generic/189 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:28:15.515 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/189 2023-09-13T09:28:15.516 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/189 2023-09-13T09:28:15.516 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:28:15.569 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:28:15.622 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:28:15.623 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/190) 2023-09-13T09:28:15.834 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:28:15.838 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:28:15.838 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:28:15.839 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:28:15.840 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:28:16.491 INFO:teuthology.orchestra.run.smithi084.stdout:generic/190 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:28:16.496 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/190 2023-09-13T09:28:16.497 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/190 2023-09-13T09:28:16.497 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:28:16.500 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:28:16.796 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:28:16.797 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/191) 2023-09-13T09:28:17.005 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:28:17.009 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:28:17.009 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:28:17.010 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:28:17.011 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:28:17.751 INFO:teuthology.orchestra.run.smithi084.stdout:generic/191 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:28:17.758 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/191 2023-09-13T09:28:17.758 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/191 2023-09-13T09:28:17.759 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:28:17.762 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:28:17.982 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:28:17.982 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/192) 2023-09-13T09:28:18.186 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:28:18.190 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:28:18.191 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:28:18.192 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:28:18.192 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:28:18.533 INFO:teuthology.orchestra.run.smithi084.stdout:generic/192 [not run] atime not maintained by ceph 2023-09-13T09:28:18.537 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/192 2023-09-13T09:28:18.537 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/192 2023-09-13T09:28:18.537 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:28:18.539 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:28:18.566 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:28:18.567 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/193) 2023-09-13T09:28:18.769 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:28:18.774 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:28:18.774 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:28:18.775 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:28:18.775 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:28:19.640 INFO:teuthology.orchestra.run.smithi084.stdout:generic/193 1s 2023-09-13T09:28:19.645 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/193 2023-09-13T09:28:19.645 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:28:19.646 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:28:19.942 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:28:19.943 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/194) 2023-09-13T09:28:20.229 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:28:20.233 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:28:20.234 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:28:20.234 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:28:20.235 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:28:20.944 INFO:teuthology.orchestra.run.smithi084.stdout:generic/194 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:28:20.949 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/194 2023-09-13T09:28:20.950 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/194 2023-09-13T09:28:20.950 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:28:21.123 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:28:21.177 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:28:21.178 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/195) 2023-09-13T09:28:21.379 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:28:21.382 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:28:21.383 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:28:21.384 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:28:21.384 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:28:22.159 INFO:teuthology.orchestra.run.smithi084.stdout:generic/195 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:28:22.234 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/195 2023-09-13T09:28:22.234 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/195 2023-09-13T09:28:22.234 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:28:22.237 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:28:22.341 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:28:22.341 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/196) 2023-09-13T09:28:22.574 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:28:22.578 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:28:22.579 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:28:22.580 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:28:22.580 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:28:23.363 INFO:teuthology.orchestra.run.smithi084.stdout:generic/196 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:28:23.458 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/196 2023-09-13T09:28:23.458 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/196 2023-09-13T09:28:23.458 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:28:23.460 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:28:23.523 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:28:23.524 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/197) 2023-09-13T09:28:23.727 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:28:23.731 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:28:23.731 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:28:23.732 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:28:23.732 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:28:24.592 INFO:teuthology.orchestra.run.smithi084.stdout:generic/197 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:28:24.599 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/197 2023-09-13T09:28:24.600 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/197 2023-09-13T09:28:24.600 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:28:24.603 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:28:24.731 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:28:24.732 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/198) 2023-09-13T09:28:24.936 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:28:24.940 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:28:24.940 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:28:24.941 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:28:24.941 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:28:25.675 INFO:teuthology.orchestra.run.smithi084.stdout:generic/198 0s 2023-09-13T09:28:25.679 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/198 2023-09-13T09:28:25.680 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:28:25.681 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:28:26.039 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:28:26.039 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/199) 2023-09-13T09:28:26.248 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:28:26.252 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:28:26.253 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:28:26.254 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:28:26.254 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:28:27.125 INFO:teuthology.orchestra.run.smithi084.stdout:generic/199 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:28:27.169 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/199 2023-09-13T09:28:27.169 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/199 2023-09-13T09:28:27.170 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:28:27.171 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:28:27.233 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:28:27.233 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/200) 2023-09-13T09:28:27.435 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:28:27.440 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:28:27.441 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:28:27.441 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:28:27.441 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:28:28.281 INFO:teuthology.orchestra.run.smithi084.stdout:generic/200 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:28:28.310 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/200 2023-09-13T09:28:28.310 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/200 2023-09-13T09:28:28.311 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:28:28.314 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:28:28.391 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:28:28.392 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/201) 2023-09-13T09:28:28.602 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:28:28.606 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:28:28.607 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:28:28.608 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:28:28.608 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:28:29.488 INFO:teuthology.orchestra.run.smithi084.stdout:generic/201 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:28:29.503 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/201 2023-09-13T09:28:29.503 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/201 2023-09-13T09:28:29.504 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:28:29.506 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:28:29.562 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:28:29.563 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/202) 2023-09-13T09:28:29.777 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:28:29.781 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:28:29.782 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:28:29.783 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:28:29.783 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:28:30.603 INFO:teuthology.orchestra.run.smithi084.stdout:generic/202 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:28:30.634 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/202 2023-09-13T09:28:30.634 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/202 2023-09-13T09:28:30.634 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:28:30.663 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:28:30.766 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:28:30.766 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/203) 2023-09-13T09:28:30.982 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:28:30.987 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:28:30.987 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:28:30.988 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:28:30.988 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:28:31.838 INFO:teuthology.orchestra.run.smithi084.stdout:generic/203 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:28:31.864 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/203 2023-09-13T09:28:31.864 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/203 2023-09-13T09:28:31.864 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:28:31.875 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:28:31.921 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:28:31.922 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/204) 2023-09-13T09:28:32.124 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:28:32.128 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:28:32.128 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:28:32.129 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:28:32.129 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:28:33.494 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:28:33.498 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:28:34.278 INFO:teuthology.orchestra.run.smithi084.stdout:generic/204 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-09-13T09:28:34.283 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/204 2023-09-13T09:28:34.283 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/204 2023-09-13T09:28:34.284 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:28:34.286 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:28:34.333 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:28:34.333 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/205) 2023-09-13T09:28:34.551 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:28:34.557 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:28:34.557 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:28:34.557 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:28:34.557 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:28:35.334 INFO:teuthology.orchestra.run.smithi084.stdout:generic/205 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:28:35.416 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/205 2023-09-13T09:28:35.416 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/205 2023-09-13T09:28:35.417 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:28:35.442 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:28:35.502 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:28:35.502 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/206) 2023-09-13T09:28:35.705 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:28:35.715 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:28:35.715 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:28:35.716 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:28:35.716 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:28:36.435 INFO:teuthology.orchestra.run.smithi084.stdout:generic/206 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:28:36.442 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/206 2023-09-13T09:28:36.442 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/206 2023-09-13T09:28:36.442 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:28:36.453 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:28:36.751 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:28:36.752 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/207) 2023-09-13T09:28:36.996 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:28:37.000 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:28:37.000 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:28:37.001 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:28:37.001 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:28:43.190 INFO:teuthology.orchestra.run.smithi084.stdout:generic/207 6s 2023-09-13T09:28:43.201 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/207 2023-09-13T09:28:43.202 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:28:43.203 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:28:43.567 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:28:43.568 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/208) 2023-09-13T09:28:43.782 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:28:43.786 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:28:43.786 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:28:43.787 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:28:43.788 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:29:04.117 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:29:04.121 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:29:34.388 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:29:34.391 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:30:04.465 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:30:04.473 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:30:34.575 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:30:34.580 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:31:04.963 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:31:04.967 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:31:35.051 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:31:35.054 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:31:35.098 INFO:tasks.ceph.osd.4.smithi161.stderr:2023-09-13T09:31:35.097+0000 7f74b53b3700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 117096) UID: 0 2023-09-13T09:31:35.098 INFO:tasks.ceph.osd.6.smithi161.stderr:2023-09-13T09:31:35.097+0000 7f1a51b0f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 117096) UID: 0 2023-09-13T09:31:35.099 INFO:tasks.ceph.osd.5.smithi161.stderr:2023-09-13T09:31:35.097+0000 7ffb9d22b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 117096) UID: 0 2023-09-13T09:31:35.099 INFO:tasks.ceph.osd.7.smithi161.stderr:2023-09-13T09:31:35.097+0000 7f01a431f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 117096) UID: 0 2023-09-13T09:32:04.250 INFO:teuthology.orchestra.run.smithi084.stdout:generic/208 200s 2023-09-13T09:32:04.254 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/208 2023-09-13T09:32:04.254 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:32:04.256 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:32:04.616 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:32:04.617 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/209) 2023-09-13T09:32:04.867 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:32:04.871 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:32:04.871 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:32:04.872 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:32:04.872 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:32:42.469 INFO:teuthology.orchestra.run.smithi084.stdout:generic/209 37s 2023-09-13T09:32:42.473 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/209 2023-09-13T09:32:42.473 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:32:42.475 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:32:42.726 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:32:42.726 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/210) 2023-09-13T09:32:43.063 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:32:43.067 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:32:43.067 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:32:43.068 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:32:43.068 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:32:43.486 INFO:teuthology.orchestra.run.smithi084.stdout:generic/210 0s 2023-09-13T09:32:43.491 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/210 2023-09-13T09:32:43.492 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:32:43.493 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:32:43.731 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:32:43.732 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/211) 2023-09-13T09:32:44.080 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:32:44.084 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:32:44.085 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:32:44.085 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:32:44.086 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:32:44.579 INFO:teuthology.orchestra.run.smithi084.stdout:generic/211 0s 2023-09-13T09:32:44.584 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/211 2023-09-13T09:32:44.584 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:32:44.586 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:32:44.621 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:32:44.622 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/212) 2023-09-13T09:32:44.831 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:32:44.835 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:32:44.835 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:32:44.836 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:32:44.836 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:32:45.239 INFO:teuthology.orchestra.run.smithi084.stdout:generic/212 0s 2023-09-13T09:32:45.243 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/212 2023-09-13T09:32:45.243 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:32:45.245 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:32:45.283 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:32:45.284 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/213) 2023-09-13T09:32:45.501 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:32:45.505 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:32:45.506 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:32:45.507 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:32:45.507 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:32:45.860 INFO:teuthology.orchestra.run.smithi084.stdout:generic/213 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-13T09:32:45.863 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/213 2023-09-13T09:32:45.863 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/213 2023-09-13T09:32:45.863 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:32:45.865 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:32:45.889 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:32:45.890 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/214) 2023-09-13T09:32:46.100 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:32:46.104 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:32:46.105 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:32:46.105 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:32:46.105 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:32:46.463 INFO:teuthology.orchestra.run.smithi084.stdout:generic/214 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-13T09:32:46.467 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/214 2023-09-13T09:32:46.467 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/214 2023-09-13T09:32:46.467 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:32:46.469 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:32:46.492 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:32:46.493 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/215) 2023-09-13T09:32:46.696 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:32:46.700 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:32:46.700 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:32:46.701 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:32:46.701 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:32:49.111 INFO:teuthology.orchestra.run.smithi084.stdout:generic/215 3s 2023-09-13T09:32:49.116 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/215 2023-09-13T09:32:49.117 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:32:49.119 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:32:49.170 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:32:49.171 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/216) 2023-09-13T09:32:49.389 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:32:49.393 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:32:49.393 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:32:49.394 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:32:49.394 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:32:50.202 INFO:teuthology.orchestra.run.smithi084.stdout:generic/216 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:32:50.210 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/216 2023-09-13T09:32:50.211 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/216 2023-09-13T09:32:50.211 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:32:50.214 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:32:50.313 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:32:50.314 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/217) 2023-09-13T09:32:50.513 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:32:50.517 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:32:50.518 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:32:50.519 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:32:50.519 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:32:51.169 INFO:teuthology.orchestra.run.smithi084.stdout:generic/217 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:32:51.373 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/217 2023-09-13T09:32:51.373 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/217 2023-09-13T09:32:51.374 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:32:51.393 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:32:51.490 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:32:51.491 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/218) 2023-09-13T09:32:51.703 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:32:51.706 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:32:51.707 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:32:51.708 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:32:51.708 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:32:52.568 INFO:teuthology.orchestra.run.smithi084.stdout:generic/218 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:32:52.606 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/218 2023-09-13T09:32:52.606 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/218 2023-09-13T09:32:52.607 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:32:52.608 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:32:52.699 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:32:52.699 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/219) 2023-09-13T09:32:52.901 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:32:52.905 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:32:52.906 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:32:52.906 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:32:52.907 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:32:53.244 INFO:teuthology.orchestra.run.smithi084.stdout:generic/219 [not run] disk quotas not supported by this filesystem type: ceph 2023-09-13T09:32:53.248 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/219 2023-09-13T09:32:53.249 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/219 2023-09-13T09:32:53.249 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:32:53.250 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:32:53.275 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:32:53.276 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/220) 2023-09-13T09:32:53.476 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:32:53.480 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:32:53.480 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:32:53.481 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:32:53.481 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:32:54.266 INFO:teuthology.orchestra.run.smithi084.stdout:generic/220 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:32:54.376 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/220 2023-09-13T09:32:54.377 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/220 2023-09-13T09:32:54.377 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:32:54.406 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:32:54.453 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:32:54.454 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/221) 2023-09-13T09:32:54.665 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:32:54.669 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:32:54.669 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:32:54.670 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:32:54.670 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:32:56.027 INFO:teuthology.orchestra.run.smithi084.stdout:generic/221 2s 2023-09-13T09:32:56.033 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/221 2023-09-13T09:32:56.033 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:32:56.035 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:32:56.075 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:32:56.075 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/222) 2023-09-13T09:32:56.313 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:32:56.316 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:32:56.317 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:32:56.318 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:32:56.318 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:32:57.113 INFO:teuthology.orchestra.run.smithi084.stdout:generic/222 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:32:57.202 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/222 2023-09-13T09:32:57.202 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/222 2023-09-13T09:32:57.202 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:32:57.213 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:32:57.297 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:32:57.298 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/223) 2023-09-13T09:32:57.499 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:32:57.503 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:32:57.504 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:32:57.505 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:32:57.505 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:32:57.860 INFO:teuthology.orchestra.run.smithi084.stdout:generic/223 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-13T09:32:57.864 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/223 2023-09-13T09:32:57.864 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/223 2023-09-13T09:32:57.865 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:32:57.866 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:32:57.904 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:32:57.904 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/224) 2023-09-13T09:32:58.110 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:32:58.114 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:32:58.114 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:32:58.115 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:32:58.115 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:32:58.433 INFO:teuthology.orchestra.run.smithi084.stdout:generic/224 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-09-13T09:32:58.437 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/224 2023-09-13T09:32:58.437 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/224 2023-09-13T09:32:58.437 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:32:58.439 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:32:58.463 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:32:58.463 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/225) 2023-09-13T09:32:58.664 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:32:58.668 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:32:58.669 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:32:58.669 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:32:58.669 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:32:59.063 INFO:teuthology.orchestra.run.smithi084.stdout:generic/225 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-09-13T09:32:59.067 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/225 2023-09-13T09:32:59.067 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/225 2023-09-13T09:32:59.067 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:32:59.069 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:32:59.157 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:32:59.158 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/226) 2023-09-13T09:32:59.647 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:32:59.651 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:32:59.651 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:32:59.652 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:32:59.652 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:33:00.017 INFO:teuthology.orchestra.run.smithi084.stdout:generic/226 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-09-13T09:33:00.021 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/226 2023-09-13T09:33:00.021 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/226 2023-09-13T09:33:00.021 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:33:00.023 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:33:00.061 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:33:00.061 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/227) 2023-09-13T09:33:00.267 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:33:00.271 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:33:00.272 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:33:00.272 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:33:00.273 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:33:00.976 INFO:teuthology.orchestra.run.smithi084.stdout:generic/227 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:33:01.136 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/227 2023-09-13T09:33:01.136 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/227 2023-09-13T09:33:01.137 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:33:01.156 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:33:01.286 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:33:01.287 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/228) 2023-09-13T09:33:01.495 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:33:01.500 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:33:01.500 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:33:01.500 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:33:01.501 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:33:01.886 INFO:teuthology.orchestra.run.smithi084.stdout:generic/228 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-13T09:33:01.890 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/228 2023-09-13T09:33:01.890 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/228 2023-09-13T09:33:01.890 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:33:01.892 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:33:01.921 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:33:01.921 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/229) 2023-09-13T09:33:02.122 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:33:02.126 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:33:02.127 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:33:02.128 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:33:02.128 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:33:02.944 INFO:teuthology.orchestra.run.smithi084.stdout:generic/229 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:33:02.961 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/229 2023-09-13T09:33:02.962 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/229 2023-09-13T09:33:02.962 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:33:02.964 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:33:03.089 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:33:03.090 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/230) 2023-09-13T09:33:03.306 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:33:03.310 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:33:03.311 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:33:03.311 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:33:03.312 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:33:03.666 INFO:teuthology.orchestra.run.smithi084.stdout:generic/230 [not run] disk quotas not supported by this filesystem type: ceph 2023-09-13T09:33:03.670 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/230 2023-09-13T09:33:03.670 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/230 2023-09-13T09:33:03.671 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:33:03.672 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:33:03.699 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:33:03.699 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/231) 2023-09-13T09:33:03.899 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:33:03.903 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:33:03.904 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:33:03.905 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:33:03.905 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:33:04.228 INFO:teuthology.orchestra.run.smithi084.stdout:generic/231 [not run] disk quotas not supported by this filesystem type: ceph 2023-09-13T09:33:04.231 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/231 2023-09-13T09:33:04.232 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/231 2023-09-13T09:33:04.232 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:33:04.234 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:33:04.264 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:33:04.265 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/232) 2023-09-13T09:33:04.466 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:33:04.470 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:33:04.470 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:33:04.471 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:33:04.472 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:33:04.816 INFO:teuthology.orchestra.run.smithi084.stdout:generic/232 [not run] disk quotas not supported by this filesystem type: ceph 2023-09-13T09:33:04.820 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/232 2023-09-13T09:33:04.821 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/232 2023-09-13T09:33:04.821 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:33:04.823 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:33:04.853 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:33:04.853 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/233) 2023-09-13T09:33:05.060 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:33:05.064 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:33:05.064 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:33:05.069 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:33:05.069 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:33:05.394 INFO:teuthology.orchestra.run.smithi084.stdout:generic/233 [not run] disk quotas not supported by this filesystem type: ceph 2023-09-13T09:33:05.398 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/233 2023-09-13T09:33:05.399 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/233 2023-09-13T09:33:05.399 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:33:05.400 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:33:05.430 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:33:05.431 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/234) 2023-09-13T09:33:05.632 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:33:05.636 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:33:05.636 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:33:05.637 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:33:05.637 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:33:05.971 INFO:teuthology.orchestra.run.smithi084.stdout:generic/234 [not run] disk quotas not supported by this filesystem type: ceph 2023-09-13T09:33:05.976 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/234 2023-09-13T09:33:05.976 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/234 2023-09-13T09:33:05.976 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:33:05.977 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:33:06.004 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:33:06.005 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/235) 2023-09-13T09:33:06.204 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:33:06.207 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:33:06.208 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:33:06.209 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:33:06.209 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:33:06.530 INFO:teuthology.orchestra.run.smithi084.stdout:generic/235 [not run] disk quotas not supported by this filesystem type: ceph 2023-09-13T09:33:06.534 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/235 2023-09-13T09:33:06.534 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/235 2023-09-13T09:33:06.535 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:33:06.536 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:33:06.557 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:33:06.558 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/236) 2023-09-13T09:33:06.763 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:33:06.767 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:33:06.767 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:33:06.768 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:33:06.768 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:33:08.164 INFO:teuthology.orchestra.run.smithi084.stdout:generic/236 2s 2023-09-13T09:33:08.170 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/236 2023-09-13T09:33:08.170 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:33:08.172 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:33:08.545 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:33:08.546 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/237) 2023-09-13T09:33:08.763 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:33:08.767 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:33:08.768 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:33:08.768 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:33:08.769 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:33:09.202 INFO:teuthology.orchestra.run.smithi084.stdout:generic/237 1s 2023-09-13T09:33:09.207 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/237 2023-09-13T09:33:09.207 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:33:09.209 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:33:09.517 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:33:09.517 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/238) 2023-09-13T09:33:09.793 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:33:09.797 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:33:09.798 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:33:09.799 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:33:09.799 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:33:10.636 INFO:teuthology.orchestra.run.smithi084.stdout:generic/238 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:33:10.655 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/238 2023-09-13T09:33:10.655 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/238 2023-09-13T09:33:10.656 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:33:10.660 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:33:10.772 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:33:10.772 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/239) 2023-09-13T09:33:10.989 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:33:10.993 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:33:10.993 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:33:10.994 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:33:10.994 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:34:54.321 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:34:54.331 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:35:10.166 INFO:teuthology.orchestra.run.smithi084.stdout:generic/239 119s 2023-09-13T09:35:10.171 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/239 2023-09-13T09:35:10.171 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:35:10.172 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:35:10.538 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:35:10.538 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/240) 2023-09-13T09:35:10.757 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:35:10.761 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:35:10.762 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:35:10.762 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:35:10.763 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:35:11.588 INFO:teuthology.orchestra.run.smithi084.stdout:generic/240 1s 2023-09-13T09:35:11.645 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/240 2023-09-13T09:35:11.645 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:35:11.647 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:35:11.782 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:35:11.782 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/241) 2023-09-13T09:35:12.294 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:35:12.297 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:35:12.298 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:35:12.299 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:35:12.299 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:35:24.601 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:35:24.608 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:35:55.022 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:35:55.025 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:35:55.061 INFO:tasks.ceph.osd.0.smithi084.stderr:2023-09-13T09:35:55.060+0000 7f41ea673700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 319024) UID: 0 2023-09-13T09:35:55.061 INFO:tasks.ceph.osd.1.smithi084.stderr:2023-09-13T09:35:55.060+0000 7f7780105700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 319024) UID: 0 2023-09-13T09:35:55.062 INFO:tasks.ceph.osd.3.smithi084.stderr:2023-09-13T09:35:55.060+0000 7f2433cf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 319024) UID: 0 2023-09-13T09:35:55.062 INFO:tasks.ceph.osd.2.smithi084.stderr:2023-09-13T09:35:55.060+0000 7f459a7f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 319024) UID: 0 2023-09-13T09:36:26.534 INFO:teuthology.orchestra.run.smithi084.stdout:generic/241 74s 2023-09-13T09:36:26.538 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/241 2023-09-13T09:36:26.539 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:36:26.541 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:36:27.313 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:36:27.314 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/242) 2023-09-13T09:36:28.294 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:36:28.327 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:36:28.329 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:36:28.330 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:36:28.330 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:36:29.693 INFO:teuthology.orchestra.run.smithi084.stdout:generic/242 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:36:29.706 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/242 2023-09-13T09:36:29.706 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/242 2023-09-13T09:36:29.707 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:36:29.771 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:36:29.893 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:36:29.894 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/243) 2023-09-13T09:36:30.097 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:36:30.101 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:36:30.102 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:36:30.102 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:36:30.103 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:36:30.966 INFO:teuthology.orchestra.run.smithi084.stdout:generic/243 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:36:30.995 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/243 2023-09-13T09:36:30.995 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/243 2023-09-13T09:36:30.996 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:36:30.999 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:36:31.076 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:36:31.077 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/244) 2023-09-13T09:36:31.292 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:36:31.296 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:36:31.297 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:36:31.297 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:36:31.298 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:36:31.632 INFO:teuthology.orchestra.run.smithi084.stdout:generic/244 [not run] disk quotas not supported by this filesystem type: ceph 2023-09-13T09:36:31.635 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/244 2023-09-13T09:36:31.636 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/244 2023-09-13T09:36:31.636 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:36:31.637 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:36:31.666 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:36:31.666 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/245) 2023-09-13T09:36:31.900 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:36:31.903 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:36:31.904 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:36:31.905 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:36:31.905 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:36:32.363 INFO:teuthology.orchestra.run.smithi084.stdout:generic/245 0s 2023-09-13T09:36:32.368 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/245 2023-09-13T09:36:32.369 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:36:32.370 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:36:32.737 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:36:32.737 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/246) 2023-09-13T09:36:32.992 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:36:32.996 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:36:32.997 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:36:32.998 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:36:32.998 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:36:33.392 INFO:teuthology.orchestra.run.smithi084.stdout:generic/246 0s 2023-09-13T09:36:33.404 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/246 2023-09-13T09:36:33.404 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:36:33.406 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:36:33.572 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:36:33.572 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/247) 2023-09-13T09:36:34.001 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:36:34.005 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:36:34.006 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:36:34.006 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:36:34.007 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:36:39.717 INFO:teuthology.orchestra.run.smithi084.stdout:generic/247 5s 2023-09-13T09:36:39.722 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/247 2023-09-13T09:36:39.722 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:36:39.724 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:36:39.732 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:36:39.733 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/248) 2023-09-13T09:36:40.051 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:36:40.055 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:36:40.055 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:36:40.056 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:36:40.056 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:36:40.417 INFO:teuthology.orchestra.run.smithi084.stdout:generic/248 0s 2023-09-13T09:36:40.421 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/248 2023-09-13T09:36:40.422 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:36:40.424 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:36:40.474 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:36:40.474 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/249) 2023-09-13T09:36:40.675 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:36:40.679 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:36:40.680 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:36:40.681 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:36:40.681 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:36:41.271 INFO:teuthology.orchestra.run.smithi084.stdout:generic/249 1s 2023-09-13T09:36:41.297 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/249 2023-09-13T09:36:41.297 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:36:41.299 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:36:41.653 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:36:41.654 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/250) 2023-09-13T09:36:41.929 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:36:41.933 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:36:41.933 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:36:41.934 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:36:41.934 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:36:42.319 INFO:teuthology.orchestra.run.smithi084.stdout:generic/250 [not run] require 172.21.15.84:6789:/scratch to be valid block disk 2023-09-13T09:36:42.323 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/250 2023-09-13T09:36:42.324 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/250 2023-09-13T09:36:42.324 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:36:42.325 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:36:42.353 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:36:42.354 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/251) 2023-09-13T09:36:42.573 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:36:42.577 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:36:42.577 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:36:42.578 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:36:42.578 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:36:43.086 INFO:teuthology.orchestra.run.smithi084.stdout:generic/251 [not run] FITRIM not supported on /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:36:43.106 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/251 2023-09-13T09:36:43.107 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/251 2023-09-13T09:36:43.107 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:36:43.108 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:36:43.138 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:36:43.139 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/252) 2023-09-13T09:36:43.356 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:36:43.360 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:36:43.361 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:36:43.361 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:36:43.362 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:36:43.715 INFO:teuthology.orchestra.run.smithi084.stdout:generic/252 [not run] require 172.21.15.84:6789:/scratch to be valid block disk 2023-09-13T09:36:43.719 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/252 2023-09-13T09:36:43.719 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/252 2023-09-13T09:36:43.719 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:36:43.721 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:36:43.745 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:36:43.746 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/253) 2023-09-13T09:36:43.956 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:36:43.961 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:36:43.961 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:36:43.962 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:36:43.962 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:36:44.840 INFO:teuthology.orchestra.run.smithi084.stdout:generic/253 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:36:44.842 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/253 2023-09-13T09:36:44.842 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/253 2023-09-13T09:36:44.842 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:36:44.865 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:36:44.907 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:36:44.908 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/254) 2023-09-13T09:36:45.139 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:36:45.142 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:36:45.143 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:36:45.144 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:36:45.144 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:36:46.020 INFO:teuthology.orchestra.run.smithi084.stdout:generic/254 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:36:46.041 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/254 2023-09-13T09:36:46.041 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/254 2023-09-13T09:36:46.042 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:36:46.045 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:36:46.107 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:36:46.108 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/255) 2023-09-13T09:36:46.307 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:36:46.311 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:36:46.312 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:36:46.313 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:36:46.313 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:36:46.759 INFO:teuthology.orchestra.run.smithi084.stdout:generic/255 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-13T09:36:46.762 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/255 2023-09-13T09:36:46.763 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/255 2023-09-13T09:36:46.763 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:36:46.764 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:36:47.105 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:36:47.105 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/256) 2023-09-13T09:36:47.367 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:36:47.370 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:36:47.371 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:36:47.372 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:36:47.372 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:36:47.986 INFO:teuthology.orchestra.run.smithi084.stdout:generic/256 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-09-13T09:36:47.989 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/256 2023-09-13T09:36:47.990 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/256 2023-09-13T09:36:47.990 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:36:47.991 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:36:48.033 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:36:48.034 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/257) 2023-09-13T09:36:48.239 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:36:48.242 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:36:48.243 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:36:48.244 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:36:48.244 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:36:49.140 INFO:teuthology.orchestra.run.smithi084.stdout:generic/257 1s 2023-09-13T09:36:49.144 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/257 2023-09-13T09:36:49.145 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:36:49.146 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:36:49.593 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:36:49.594 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/258) 2023-09-13T09:36:49.965 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:36:49.969 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:36:49.969 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:36:49.970 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:36:49.971 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:36:50.306 INFO:teuthology.orchestra.run.smithi084.stdout:generic/258 [not run] ceph does not support negative timestamps 2023-09-13T09:36:50.310 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/258 2023-09-13T09:36:50.310 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/258 2023-09-13T09:36:50.310 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:36:50.312 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:36:50.339 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:36:50.340 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/259) 2023-09-13T09:36:50.542 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:36:50.546 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:36:50.547 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:36:50.548 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:36:50.548 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:36:51.409 INFO:teuthology.orchestra.run.smithi084.stdout:generic/259 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:36:51.409 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/259 2023-09-13T09:36:51.410 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/259 2023-09-13T09:36:51.410 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:36:51.413 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:36:51.484 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:36:51.485 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/260) 2023-09-13T09:36:51.685 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:36:51.689 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:36:51.690 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:36:51.690 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:36:51.691 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:36:52.170 INFO:teuthology.orchestra.run.smithi084.stdout:generic/260 [not run] FITRIM not supported on /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:36:52.201 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/260 2023-09-13T09:36:52.202 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/260 2023-09-13T09:36:52.202 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:36:52.203 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:36:52.226 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:36:52.227 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/261) 2023-09-13T09:36:52.442 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:36:52.446 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:36:52.447 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:36:52.448 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:36:52.448 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:36:53.295 INFO:teuthology.orchestra.run.smithi084.stdout:generic/261 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:36:53.312 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/261 2023-09-13T09:36:53.313 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/261 2023-09-13T09:36:53.313 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:36:53.316 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:36:53.411 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:36:53.412 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/262) 2023-09-13T09:36:53.610 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:36:53.614 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:36:53.614 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:36:53.615 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:36:53.616 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:36:54.513 INFO:teuthology.orchestra.run.smithi084.stdout:generic/262 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:36:54.523 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/262 2023-09-13T09:36:54.523 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/262 2023-09-13T09:36:54.523 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:36:54.526 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:36:54.567 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:36:54.568 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/263) 2023-09-13T09:36:54.777 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:36:54.781 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:36:54.781 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:36:54.782 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:36:54.782 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:37:35.306 INFO:teuthology.orchestra.run.smithi084.stdout:generic/263 41s 2023-09-13T09:37:35.310 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/263 2023-09-13T09:37:35.311 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:37:35.313 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:37:35.529 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:37:35.530 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/264) 2023-09-13T09:37:35.938 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:37:35.941 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:37:35.942 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:37:35.943 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:37:35.943 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:37:36.799 INFO:teuthology.orchestra.run.smithi084.stdout:generic/264 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:37:36.818 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/264 2023-09-13T09:37:36.818 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/264 2023-09-13T09:37:36.818 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:37:36.829 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:37:36.880 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:37:36.880 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/265) 2023-09-13T09:37:37.084 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:37:37.088 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:37:37.088 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:37:37.089 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:37:37.089 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:37:38.035 INFO:teuthology.orchestra.run.smithi084.stdout:generic/265 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:37:38.055 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/265 2023-09-13T09:37:38.056 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/265 2023-09-13T09:37:38.056 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:37:38.059 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:37:38.092 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:37:38.092 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/266) 2023-09-13T09:37:38.291 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:37:38.295 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:37:38.295 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:37:38.296 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:37:38.296 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:37:39.159 INFO:teuthology.orchestra.run.smithi084.stdout:generic/266 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:37:39.187 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/266 2023-09-13T09:37:39.188 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/266 2023-09-13T09:37:39.188 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:37:39.217 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:37:39.251 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:37:39.252 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/267) 2023-09-13T09:37:39.455 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:37:39.459 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:37:39.459 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:37:39.460 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:37:39.460 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:37:40.280 INFO:teuthology.orchestra.run.smithi084.stdout:generic/267 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:37:40.325 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/267 2023-09-13T09:37:40.325 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/267 2023-09-13T09:37:40.326 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:37:40.328 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:37:40.383 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:37:40.384 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/268) 2023-09-13T09:37:40.587 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:37:40.591 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:37:40.592 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:37:40.593 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:37:40.593 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:37:41.520 INFO:teuthology.orchestra.run.smithi084.stdout:generic/268 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:37:41.543 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/268 2023-09-13T09:37:41.544 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/268 2023-09-13T09:37:41.544 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:37:41.554 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:37:41.584 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:37:41.585 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/269) 2023-09-13T09:37:41.797 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:37:41.801 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:37:41.801 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:37:41.802 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:37:41.802 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:37:42.161 INFO:teuthology.orchestra.run.smithi084.stdout:generic/269 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-09-13T09:37:42.165 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/269 2023-09-13T09:37:42.165 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/269 2023-09-13T09:37:42.166 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:37:42.167 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:37:42.201 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:37:42.202 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/270) 2023-09-13T09:37:42.398 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:37:42.401 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:37:42.402 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:37:42.402 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:37:42.403 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:37:42.724 INFO:teuthology.orchestra.run.smithi084.stdout:generic/270 [not run] disk quotas not supported by this filesystem type: ceph 2023-09-13T09:37:42.728 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/270 2023-09-13T09:37:42.728 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/270 2023-09-13T09:37:42.728 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:37:42.730 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:37:42.754 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:37:42.754 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/271) 2023-09-13T09:37:42.959 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:37:42.963 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:37:42.964 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:37:42.965 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:37:42.965 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:37:43.821 INFO:teuthology.orchestra.run.smithi084.stdout:generic/271 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:37:43.847 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/271 2023-09-13T09:37:43.848 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/271 2023-09-13T09:37:43.848 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:37:43.850 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:37:43.906 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:37:43.907 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/272) 2023-09-13T09:37:44.132 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:37:44.136 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:37:44.136 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:37:44.137 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:37:44.137 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:37:44.918 INFO:teuthology.orchestra.run.smithi084.stdout:generic/272 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:37:44.966 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/272 2023-09-13T09:37:44.966 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/272 2023-09-13T09:37:44.967 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:37:45.013 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:37:45.076 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:37:45.077 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/273) 2023-09-13T09:37:45.306 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:37:45.310 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:37:45.311 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:37:45.311 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:37:45.312 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:37:45.627 INFO:teuthology.orchestra.run.smithi084.stdout:generic/273 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-09-13T09:37:45.630 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/273 2023-09-13T09:37:45.631 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/273 2023-09-13T09:37:45.631 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:37:45.633 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:37:45.655 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:37:45.670 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/274) 2023-09-13T09:37:45.890 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:37:45.894 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:37:45.895 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:37:45.895 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:37:45.896 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:37:46.255 INFO:teuthology.orchestra.run.smithi084.stdout:generic/274 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-09-13T09:37:46.259 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/274 2023-09-13T09:37:46.259 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/274 2023-09-13T09:37:46.259 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:37:46.261 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:37:46.287 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:37:46.288 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/275) 2023-09-13T09:37:46.492 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:37:46.496 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:37:46.496 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:37:46.497 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:37:46.497 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:37:46.835 INFO:teuthology.orchestra.run.smithi084.stdout:generic/275 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-09-13T09:37:46.839 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/275 2023-09-13T09:37:46.839 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/275 2023-09-13T09:37:46.839 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:37:46.841 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:37:46.873 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:37:46.874 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/276) 2023-09-13T09:37:47.095 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:37:47.099 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:37:47.100 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:37:47.101 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:37:47.101 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:37:48.027 INFO:teuthology.orchestra.run.smithi084.stdout:generic/276 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:37:48.031 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/276 2023-09-13T09:37:48.032 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/276 2023-09-13T09:37:48.032 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:37:48.034 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:37:48.060 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:37:48.060 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/277) 2023-09-13T09:37:48.257 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:37:48.261 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:37:48.262 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:37:48.262 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:37:48.263 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:37:48.636 INFO:teuthology.orchestra.run.smithi084.stdout:generic/277 [not run] file system doesn't support chattr +A 2023-09-13T09:37:48.640 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/277 2023-09-13T09:37:48.640 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/277 2023-09-13T09:37:48.640 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:37:48.642 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:37:48.674 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:37:48.674 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/278) 2023-09-13T09:37:48.887 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:37:48.891 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:37:48.891 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:37:48.892 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:37:48.892 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:37:49.784 INFO:teuthology.orchestra.run.smithi084.stdout:generic/278 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:37:49.789 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/278 2023-09-13T09:37:49.790 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/278 2023-09-13T09:37:49.790 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:37:49.793 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:37:49.834 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:37:49.834 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/279) 2023-09-13T09:37:50.036 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:37:50.040 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:37:50.040 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:37:50.041 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:37:50.041 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:37:50.911 INFO:teuthology.orchestra.run.smithi084.stdout:generic/279 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:37:50.923 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/279 2023-09-13T09:37:50.924 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/279 2023-09-13T09:37:50.924 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:37:50.964 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:37:50.995 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:37:50.996 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/280) 2023-09-13T09:37:51.211 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:37:51.215 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:37:51.216 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:37:51.217 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:37:51.217 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:37:51.551 INFO:teuthology.orchestra.run.smithi084.stdout:generic/280 [not run] disk quotas not supported by this filesystem type: ceph 2023-09-13T09:37:51.555 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/280 2023-09-13T09:37:51.555 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/280 2023-09-13T09:37:51.555 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:37:51.557 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:37:51.581 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:37:51.582 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/281) 2023-09-13T09:37:51.794 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:37:51.798 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:37:51.798 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:37:51.799 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:37:51.799 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:37:52.587 INFO:teuthology.orchestra.run.smithi084.stdout:generic/281 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:37:52.634 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/281 2023-09-13T09:37:52.634 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/281 2023-09-13T09:37:52.634 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:37:52.638 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:37:52.776 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:37:52.776 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/282) 2023-09-13T09:37:52.976 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:37:52.980 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:37:52.980 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:37:52.981 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:37:52.981 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:37:53.771 INFO:teuthology.orchestra.run.smithi084.stdout:generic/282 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:37:53.903 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/282 2023-09-13T09:37:53.903 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/282 2023-09-13T09:37:53.904 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:37:53.906 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:37:53.936 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:37:53.936 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/283) 2023-09-13T09:37:54.149 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:37:54.153 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:37:54.153 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:37:54.154 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:37:54.154 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:37:55.090 INFO:teuthology.orchestra.run.smithi084.stdout:generic/283 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:37:55.104 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/283 2023-09-13T09:37:55.105 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/283 2023-09-13T09:37:55.105 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:37:55.110 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:37:55.149 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:37:55.149 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/284) 2023-09-13T09:37:55.369 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:37:55.373 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:37:55.373 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:37:55.374 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:37:55.374 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:37:56.269 INFO:teuthology.orchestra.run.smithi084.stdout:generic/284 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:37:56.294 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/284 2023-09-13T09:37:56.294 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/284 2023-09-13T09:37:56.294 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:37:56.297 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:37:56.327 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:37:56.328 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/285) 2023-09-13T09:37:56.528 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:37:56.532 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:37:56.532 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:37:56.533 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:37:56.533 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:37:57.956 INFO:teuthology.orchestra.run.smithi084.stdout:generic/285 1s 2023-09-13T09:37:57.961 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/285 2023-09-13T09:37:57.961 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:37:57.963 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:37:58.419 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:37:58.420 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/286) 2023-09-13T09:37:59.077 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:37:59.082 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:37:59.082 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:37:59.084 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:37:59.084 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:37:59.664 INFO:teuthology.orchestra.run.smithi084.stdout:generic/286 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-13T09:37:59.677 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/286 2023-09-13T09:37:59.677 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/286 2023-09-13T09:37:59.678 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:37:59.680 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:37:59.725 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:37:59.726 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/287) 2023-09-13T09:38:00.182 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:38:00.186 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:38:00.187 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:38:00.188 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:38:00.188 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:38:01.147 INFO:teuthology.orchestra.run.smithi084.stdout:generic/287 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:38:01.153 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/287 2023-09-13T09:38:01.154 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/287 2023-09-13T09:38:01.154 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:38:01.156 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:38:01.489 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:38:01.489 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/288) 2023-09-13T09:38:01.873 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:38:01.876 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:38:01.877 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:38:01.877 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:38:01.878 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:38:02.691 INFO:teuthology.orchestra.run.smithi084.stdout:generic/288 [not run] FITRIM not supported on /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:38:02.716 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/288 2023-09-13T09:38:02.717 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/288 2023-09-13T09:38:02.717 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:38:02.719 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:38:02.759 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:38:02.759 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/289) 2023-09-13T09:38:03.251 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:38:03.268 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:38:03.268 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:38:03.273 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:38:03.273 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:38:04.335 INFO:teuthology.orchestra.run.smithi084.stdout:generic/289 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:38:04.456 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/289 2023-09-13T09:38:04.457 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/289 2023-09-13T09:38:04.457 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:38:04.516 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:38:04.608 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:38:04.609 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/290) 2023-09-13T09:38:04.842 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:38:04.846 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:38:04.846 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:38:04.847 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:38:04.847 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:38:05.578 INFO:teuthology.orchestra.run.smithi084.stdout:generic/290 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:38:05.637 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/290 2023-09-13T09:38:05.637 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/290 2023-09-13T09:38:05.637 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:38:05.675 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:38:05.857 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:38:05.858 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/291) 2023-09-13T09:38:06.100 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:38:06.104 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:38:06.104 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:38:06.105 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:38:06.105 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:38:06.886 INFO:teuthology.orchestra.run.smithi084.stdout:generic/291 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:38:06.892 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/291 2023-09-13T09:38:06.892 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/291 2023-09-13T09:38:06.893 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:38:06.896 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:38:07.005 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:38:07.005 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/292) 2023-09-13T09:38:07.241 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:38:07.245 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:38:07.246 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:38:07.247 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:38:07.247 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:38:08.057 INFO:teuthology.orchestra.run.smithi084.stdout:generic/292 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:38:08.080 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/292 2023-09-13T09:38:08.080 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/292 2023-09-13T09:38:08.080 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:38:08.112 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:38:08.178 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:38:08.178 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/293) 2023-09-13T09:38:08.378 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:38:08.382 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:38:08.382 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:38:08.383 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:38:08.383 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:38:09.228 INFO:teuthology.orchestra.run.smithi084.stdout:generic/293 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:38:09.259 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/293 2023-09-13T09:38:09.259 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/293 2023-09-13T09:38:09.259 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:38:09.264 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:38:09.350 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:38:09.350 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/294) 2023-09-13T09:38:09.567 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:38:09.571 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:38:09.572 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:38:09.573 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:38:09.573 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:38:10.537 INFO:teuthology.orchestra.run.smithi084.stdout:generic/294 1s 2023-09-13T09:38:10.542 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/294 2023-09-13T09:38:10.542 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:38:10.545 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:38:10.552 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:38:10.552 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/295) 2023-09-13T09:38:10.758 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:38:10.762 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:38:10.762 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:38:10.763 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:38:10.763 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:38:11.575 INFO:teuthology.orchestra.run.smithi084.stdout:generic/295 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:38:11.639 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/295 2023-09-13T09:38:11.639 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/295 2023-09-13T09:38:11.639 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:38:11.696 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:38:11.722 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:38:11.723 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/296) 2023-09-13T09:38:11.953 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:38:11.957 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:38:11.957 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:38:11.958 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:38:11.958 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:38:12.862 INFO:teuthology.orchestra.run.smithi084.stdout:generic/296 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:38:12.872 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/296 2023-09-13T09:38:12.872 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/296 2023-09-13T09:38:12.872 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:38:12.892 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:38:12.924 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:38:12.925 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/297) 2023-09-13T09:38:13.139 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:38:13.143 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:38:13.144 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:38:13.145 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:38:13.145 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:38:13.978 INFO:teuthology.orchestra.run.smithi084.stdout:generic/297 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:38:14.008 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/297 2023-09-13T09:38:14.008 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/297 2023-09-13T09:38:14.009 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:38:14.049 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:38:14.084 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:38:14.085 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/298) 2023-09-13T09:38:14.284 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:38:14.288 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:38:14.289 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:38:14.289 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:38:14.290 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:38:15.178 INFO:teuthology.orchestra.run.smithi084.stdout:generic/298 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:38:15.226 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/298 2023-09-13T09:38:15.227 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/298 2023-09-13T09:38:15.227 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:38:15.236 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:38:15.260 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:38:15.260 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/299) 2023-09-13T09:38:15.464 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:38:15.468 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:38:15.469 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:38:15.469 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:38:15.470 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:38:15.842 INFO:teuthology.orchestra.run.smithi084.stdout:generic/299 [not run] require 172.21.15.84:6789:/scratch to be valid block disk 2023-09-13T09:38:15.846 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/299 2023-09-13T09:38:15.847 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/299 2023-09-13T09:38:15.847 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:38:15.848 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:38:15.874 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:38:15.875 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/300) 2023-09-13T09:38:16.077 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:38:16.081 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:38:16.082 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:38:16.083 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:38:16.083 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:38:16.806 INFO:teuthology.orchestra.run.smithi084.stdout:generic/300 [not run] require 172.21.15.84:6789:/scratch to be valid block disk 2023-09-13T09:38:16.810 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/300 2023-09-13T09:38:16.810 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/300 2023-09-13T09:38:16.810 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:38:16.812 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:38:16.933 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:38:16.934 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/301) 2023-09-13T09:38:17.144 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:38:17.148 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:38:17.149 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:38:17.150 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:38:17.150 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:38:17.847 INFO:teuthology.orchestra.run.smithi084.stdout:generic/301 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:38:17.918 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/301 2023-09-13T09:38:17.918 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/301 2023-09-13T09:38:17.918 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:38:17.918 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:38:18.080 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:38:18.081 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/302) 2023-09-13T09:38:18.292 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:38:18.296 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:38:18.296 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:38:18.297 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:38:18.297 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:38:19.157 INFO:teuthology.orchestra.run.smithi084.stdout:generic/302 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:38:19.164 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/302 2023-09-13T09:38:19.164 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/302 2023-09-13T09:38:19.164 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:38:19.190 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:38:19.223 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:38:19.224 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/303) 2023-09-13T09:38:19.424 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:38:19.428 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:38:19.428 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:38:19.429 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:38:19.429 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:38:19.788 INFO:teuthology.orchestra.run.smithi084.stdout:generic/303 [not run] Reflink not supported by test filesystem type: ceph 2023-09-13T09:38:19.792 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/303 2023-09-13T09:38:19.793 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/303 2023-09-13T09:38:19.793 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:38:19.794 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:38:20.000 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:38:20.001 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/304) 2023-09-13T09:38:20.389 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:38:20.393 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:38:20.393 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:38:20.394 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:38:20.394 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:38:20.756 INFO:teuthology.orchestra.run.smithi084.stdout:generic/304 [not run] Dedupe not supported by test filesystem type: ceph 2023-09-13T09:38:20.760 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/304 2023-09-13T09:38:20.760 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/304 2023-09-13T09:38:20.760 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:38:20.762 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:38:21.110 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:38:21.111 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/305) 2023-09-13T09:38:21.350 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:38:21.354 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:38:21.354 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:38:21.355 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:38:21.356 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:38:22.210 INFO:teuthology.orchestra.run.smithi084.stdout:generic/305 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:38:22.236 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/305 2023-09-13T09:38:22.237 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/305 2023-09-13T09:38:22.237 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:38:22.241 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:38:22.293 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:38:22.294 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/306) 2023-09-13T09:38:22.495 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:38:22.499 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:38:22.500 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:38:22.501 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:38:22.501 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:38:23.448 INFO:teuthology.orchestra.run.smithi084.stdout:generic/306 1s 2023-09-13T09:38:23.454 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/306 2023-09-13T09:38:23.454 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:38:23.456 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:38:23.881 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:38:23.882 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/307) 2023-09-13T09:38:24.117 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:38:24.121 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:38:24.122 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:38:24.123 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:38:24.123 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:38:25.930 INFO:teuthology.orchestra.run.smithi084.stdout:generic/307 1s 2023-09-13T09:38:25.935 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/307 2023-09-13T09:38:25.935 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:38:25.937 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:38:25.946 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:38:25.946 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/308) 2023-09-13T09:38:26.164 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:38:26.168 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:38:26.169 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:38:26.170 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:38:26.170 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:38:26.530 INFO:teuthology.orchestra.run.smithi084.stdout:generic/308 0s 2023-09-13T09:38:26.535 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/308 2023-09-13T09:38:26.535 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:38:26.537 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:38:26.559 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:38:26.560 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/309) 2023-09-13T09:38:26.765 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:38:26.769 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:38:26.770 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:38:26.771 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:38:26.771 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:38:28.173 INFO:teuthology.orchestra.run.smithi084.stdout:generic/309 2s 2023-09-13T09:38:28.179 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/309 2023-09-13T09:38:28.179 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:38:28.181 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:38:28.517 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:38:28.518 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/310) 2023-09-13T09:38:28.764 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:38:28.768 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:38:28.768 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:38:28.769 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:38:28.769 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:38:47.246 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:38:47.248 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:39:17.349 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:39:17.352 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:39:46.234 INFO:teuthology.orchestra.run.smithi084.stdout:generic/310 78s 2023-09-13T09:39:46.238 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/310 2023-09-13T09:39:46.239 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:39:46.240 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:39:46.609 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:39:46.610 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/311) 2023-09-13T09:39:46.819 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:39:46.823 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:39:46.823 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:39:46.824 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:39:46.825 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:39:47.329 INFO:teuthology.orchestra.run.smithi084.stdout:generic/311 [not run] require 172.21.15.84:6789:/scratch to be valid block disk 2023-09-13T09:39:47.333 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/311 2023-09-13T09:39:47.333 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/311 2023-09-13T09:39:47.333 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:39:47.335 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:39:47.376 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:39:47.377 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/312) 2023-09-13T09:39:47.412 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:39:47.422 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:39:47.600 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:39:47.605 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:39:47.605 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:39:47.606 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:39:47.606 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:39:47.931 INFO:teuthology.orchestra.run.smithi084.stdout:generic/312 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-13T09:39:47.934 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/312 2023-09-13T09:39:47.935 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/312 2023-09-13T09:39:47.935 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:39:47.937 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:39:47.968 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:39:47.969 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/313) 2023-09-13T09:39:48.174 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:39:48.178 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:39:48.179 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:39:48.179 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:39:48.180 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:39:52.564 INFO:teuthology.orchestra.run.smithi084.stdout:generic/313 4s 2023-09-13T09:39:52.569 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/313 2023-09-13T09:39:52.570 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:39:52.572 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:39:52.610 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:39:52.611 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/314) 2023-09-13T09:39:52.851 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:39:52.855 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:39:52.855 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:39:52.856 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:39:52.856 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:39:53.446 INFO:teuthology.orchestra.run.smithi084.stdout:generic/314 0s 2023-09-13T09:39:53.450 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/314 2023-09-13T09:39:53.451 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:39:53.452 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:39:53.487 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:39:53.488 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/315) 2023-09-13T09:39:53.690 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:39:53.694 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:39:53.695 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:39:53.696 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:39:53.696 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:39:54.041 INFO:teuthology.orchestra.run.smithi084.stdout:generic/315 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-09-13T09:39:54.046 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/315 2023-09-13T09:39:54.046 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/315 2023-09-13T09:39:54.046 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:39:54.048 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:39:54.076 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:39:54.077 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/316) 2023-09-13T09:39:54.297 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:39:54.301 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:39:54.302 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:39:54.303 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:39:54.303 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:39:54.765 INFO:teuthology.orchestra.run.smithi084.stdout:generic/316 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-09-13T09:39:54.769 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/316 2023-09-13T09:39:54.770 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/316 2023-09-13T09:39:54.770 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:39:54.771 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:39:55.144 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:39:55.145 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/317) 2023-09-13T09:39:55.362 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:39:55.365 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:39:55.366 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:39:55.367 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:39:55.367 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:39:56.959 INFO:teuthology.orchestra.run.smithi084.stdout:generic/317 1s 2023-09-13T09:39:56.964 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/317 2023-09-13T09:39:56.964 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:39:56.966 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:39:56.975 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:39:56.975 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/318) 2023-09-13T09:39:57.178 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:39:57.183 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:39:57.183 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:39:57.184 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:39:57.184 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:39:57.998 INFO:teuthology.orchestra.run.smithi084.stdout:generic/318 0s 2023-09-13T09:39:58.003 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/318 2023-09-13T09:39:58.003 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:39:58.006 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:39:58.014 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:39:58.014 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/319) 2023-09-13T09:39:58.215 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:39:58.219 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:39:58.219 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:39:58.220 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:39:58.220 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:39:58.816 INFO:teuthology.orchestra.run.smithi084.stdout:generic/319 0s 2023-09-13T09:39:58.821 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/319 2023-09-13T09:39:58.821 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:39:58.823 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:39:58.831 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:39:58.832 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/320) 2023-09-13T09:39:59.036 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:39:59.040 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:39:59.040 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:39:59.041 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:39:59.041 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:39:59.380 INFO:teuthology.orchestra.run.smithi084.stdout:generic/320 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-09-13T09:39:59.384 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/320 2023-09-13T09:39:59.384 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/320 2023-09-13T09:39:59.385 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:39:59.386 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:39:59.415 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:39:59.415 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/321) 2023-09-13T09:39:59.618 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:39:59.622 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:39:59.623 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:39:59.624 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:39:59.624 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:39:59.954 INFO:teuthology.orchestra.run.smithi084.stdout:generic/321 [not run] require 172.21.15.84:6789:/scratch to be valid block disk 2023-09-13T09:39:59.958 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/321 2023-09-13T09:39:59.958 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/321 2023-09-13T09:39:59.958 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:39:59.960 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:39:59.984 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:39:59.985 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/322) 2023-09-13T09:40:00.208 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:40:00.212 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:40:00.213 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:40:00.213 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:40:00.214 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:40:00.549 INFO:teuthology.orchestra.run.smithi084.stdout:generic/322 [not run] require 172.21.15.84:6789:/scratch to be valid block disk 2023-09-13T09:40:00.553 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/322 2023-09-13T09:40:00.553 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/322 2023-09-13T09:40:00.554 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:40:00.555 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:40:00.578 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:40:00.579 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/323) 2023-09-13T09:40:00.785 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:40:00.789 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:40:00.790 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:40:00.791 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:40:00.791 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:40:17.732 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:40:17.735 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:40:47.807 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:40:47.810 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:41:17.887 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:41:17.890 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:41:48.217 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:41:48.220 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:41:48.259 INFO:tasks.ceph.osd.0.smithi084.stderr:2023-09-13T09:41:48.258+0000 7f41ea673700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 365624) UID: 0 2023-09-13T09:41:48.259 INFO:tasks.ceph.osd.3.smithi084.stderr:2023-09-13T09:41:48.258+0000 7f2433cf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 365624) UID: 0 2023-09-13T09:41:48.260 INFO:tasks.ceph.osd.1.smithi084.stderr:2023-09-13T09:41:48.258+0000 7f7780105700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 365624) UID: 0 2023-09-13T09:41:48.260 INFO:tasks.ceph.osd.2.smithi084.stderr:2023-09-13T09:41:48.258+0000 7f459a7f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 365624) UID: 0 2023-09-13T09:42:01.629 INFO:teuthology.orchestra.run.smithi084.stdout:generic/323 121s 2023-09-13T09:42:01.773 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/323 2023-09-13T09:42:01.774 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:42:01.775 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:42:02.049 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:42:02.050 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/324) 2023-09-13T09:42:02.383 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:42:02.386 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:42:02.387 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:42:02.388 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:42:02.388 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:42:02.734 INFO:teuthology.orchestra.run.smithi084.stdout:generic/324 [not run] defragmentation not supported for fstype "ceph" 2023-09-13T09:42:02.738 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/324 2023-09-13T09:42:02.738 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/324 2023-09-13T09:42:02.739 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:42:02.740 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:42:02.767 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:42:02.768 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/325) 2023-09-13T09:42:02.968 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:42:02.972 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:42:02.973 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:42:02.974 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:42:02.974 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:42:03.385 INFO:teuthology.orchestra.run.smithi084.stdout:generic/325 [not run] require 172.21.15.84:6789:/scratch to be valid block disk 2023-09-13T09:42:03.389 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/325 2023-09-13T09:42:03.390 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/325 2023-09-13T09:42:03.390 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:42:03.391 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:42:03.416 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:42:03.416 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/326) 2023-09-13T09:42:03.622 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:42:03.626 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:42:03.626 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:42:03.627 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:42:03.627 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:42:04.289 INFO:teuthology.orchestra.run.smithi084.stdout:generic/326 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:42:04.451 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/326 2023-09-13T09:42:04.451 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/326 2023-09-13T09:42:04.452 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:42:04.455 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:42:04.573 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:42:04.574 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/327) 2023-09-13T09:42:04.776 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:42:04.780 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:42:04.780 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:42:04.781 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:42:04.781 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:42:05.621 INFO:teuthology.orchestra.run.smithi084.stdout:generic/327 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:42:05.635 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/327 2023-09-13T09:42:05.635 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/327 2023-09-13T09:42:05.635 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:42:05.638 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:42:05.712 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:42:05.713 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/328) 2023-09-13T09:42:05.932 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:42:05.936 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:42:05.936 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:42:05.937 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:42:05.937 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:42:06.774 INFO:teuthology.orchestra.run.smithi084.stdout:generic/328 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:42:06.824 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/328 2023-09-13T09:42:06.824 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/328 2023-09-13T09:42:06.824 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:42:06.841 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:42:06.907 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:42:06.907 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/329) 2023-09-13T09:42:07.126 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:42:07.133 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:42:07.133 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:42:07.133 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:42:07.133 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:42:07.966 INFO:teuthology.orchestra.run.smithi084.stdout:generic/329 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:42:08.041 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/329 2023-09-13T09:42:08.041 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/329 2023-09-13T09:42:08.041 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:42:08.054 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:42:08.081 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:42:08.081 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/330) 2023-09-13T09:42:08.280 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:42:08.284 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:42:08.285 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:42:08.285 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:42:08.286 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:42:08.969 INFO:teuthology.orchestra.run.smithi084.stdout:generic/330 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:42:09.037 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/330 2023-09-13T09:42:09.038 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/330 2023-09-13T09:42:09.038 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:42:09.176 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:42:09.246 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:42:09.247 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/331) 2023-09-13T09:42:09.458 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:42:09.462 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:42:09.462 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:42:09.463 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:42:09.463 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:42:10.387 INFO:teuthology.orchestra.run.smithi084.stdout:generic/331 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:42:10.398 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/331 2023-09-13T09:42:10.399 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/331 2023-09-13T09:42:10.399 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:42:10.402 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:42:10.437 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:42:10.438 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/332) 2023-09-13T09:42:10.654 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:42:10.658 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:42:10.658 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:42:10.659 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:42:10.659 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:42:11.383 INFO:teuthology.orchestra.run.smithi084.stdout:generic/332 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:42:11.396 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/332 2023-09-13T09:42:11.397 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/332 2023-09-13T09:42:11.397 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:42:11.409 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:42:11.578 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:42:11.579 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/333) 2023-09-13T09:42:11.789 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:42:11.793 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:42:11.793 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:42:11.794 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:42:11.795 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:42:12.661 INFO:teuthology.orchestra.run.smithi084.stdout:generic/333 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:42:12.668 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/333 2023-09-13T09:42:12.669 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/333 2023-09-13T09:42:12.669 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:42:12.678 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:42:12.747 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:42:12.748 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/334) 2023-09-13T09:42:12.969 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:42:12.973 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:42:12.973 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:42:12.974 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:42:12.974 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:42:13.850 INFO:teuthology.orchestra.run.smithi084.stdout:generic/334 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:42:13.924 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/334 2023-09-13T09:42:13.925 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/334 2023-09-13T09:42:13.925 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:42:13.930 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:42:13.966 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:42:13.967 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/335) 2023-09-13T09:42:14.176 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:42:14.180 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:42:14.181 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:42:14.181 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:42:14.181 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:42:14.521 INFO:teuthology.orchestra.run.smithi084.stdout:generic/335 [not run] require 172.21.15.84:6789:/scratch to be valid block disk 2023-09-13T09:42:14.525 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/335 2023-09-13T09:42:14.525 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/335 2023-09-13T09:42:14.525 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:42:14.527 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:42:14.555 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:42:14.555 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/336) 2023-09-13T09:42:14.768 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:42:14.771 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:42:14.772 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:42:14.773 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:42:14.773 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:42:15.128 INFO:teuthology.orchestra.run.smithi084.stdout:generic/336 [not run] require 172.21.15.84:6789:/scratch to be valid block disk 2023-09-13T09:42:15.132 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/336 2023-09-13T09:42:15.132 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/336 2023-09-13T09:42:15.132 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:42:15.134 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:42:15.170 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:42:15.171 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/337) 2023-09-13T09:42:15.382 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:42:15.386 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:42:15.387 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:42:15.387 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:42:15.388 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:42:16.001 INFO:teuthology.orchestra.run.smithi084.stdout:generic/337 0s 2023-09-13T09:42:16.006 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/337 2023-09-13T09:42:16.006 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:42:16.008 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:42:16.016 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:42:16.017 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/338) 2023-09-13T09:42:16.248 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:42:16.252 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:42:16.252 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:42:16.253 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:42:16.253 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:42:16.597 INFO:teuthology.orchestra.run.smithi084.stdout:generic/338 [not run] require 172.21.15.84:6789:/scratch to be valid block disk 2023-09-13T09:42:16.601 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/338 2023-09-13T09:42:16.601 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/338 2023-09-13T09:42:16.602 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:42:16.603 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:42:16.625 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:42:16.626 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/339) 2023-09-13T09:42:16.824 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:42:16.828 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:42:16.828 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:42:16.829 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:42:16.829 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:43:10.857 INFO:teuthology.orchestra.run.smithi084.stdout:generic/339 53s 2023-09-13T09:43:10.862 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/339 2023-09-13T09:43:10.862 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:43:10.864 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:43:10.873 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:43:10.874 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/340) 2023-09-13T09:43:11.097 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:43:11.101 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:43:11.101 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:43:11.102 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:43:11.102 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:43:14.603 INFO:teuthology.orchestra.run.smithi084.stdout:generic/340 3s 2023-09-13T09:43:14.673 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/340 2023-09-13T09:43:14.674 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:43:14.677 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:43:14.698 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:43:14.699 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/341) 2023-09-13T09:43:15.183 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:43:15.187 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:43:15.188 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:43:15.189 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:43:15.189 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:43:15.592 INFO:teuthology.orchestra.run.smithi084.stdout:generic/341 [not run] require 172.21.15.84:6789:/scratch to be valid block disk 2023-09-13T09:43:15.596 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/341 2023-09-13T09:43:15.596 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/341 2023-09-13T09:43:15.596 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:43:15.598 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:43:15.621 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:43:15.621 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/342) 2023-09-13T09:43:15.835 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:43:15.839 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:43:15.840 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:43:15.840 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:43:15.841 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:43:16.195 INFO:teuthology.orchestra.run.smithi084.stdout:generic/342 [not run] require 172.21.15.84:6789:/scratch to be valid block disk 2023-09-13T09:43:16.199 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/342 2023-09-13T09:43:16.199 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/342 2023-09-13T09:43:16.199 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:43:16.201 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:43:16.224 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:43:16.224 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/343) 2023-09-13T09:43:16.428 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:43:16.432 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:43:16.433 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:43:16.433 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:43:16.434 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:43:16.809 INFO:teuthology.orchestra.run.smithi084.stdout:generic/343 [not run] require 172.21.15.84:6789:/scratch to be valid block disk 2023-09-13T09:43:16.814 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/343 2023-09-13T09:43:16.814 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/343 2023-09-13T09:43:16.814 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:43:16.817 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:43:16.840 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:43:16.841 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/344) 2023-09-13T09:43:17.040 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:43:17.044 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:43:17.044 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:43:17.045 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:43:17.045 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:43:23.596 INFO:teuthology.orchestra.run.smithi084.stdout:generic/344 6s 2023-09-13T09:43:23.677 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/344 2023-09-13T09:43:23.677 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:43:23.680 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:43:23.697 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:43:23.697 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/345) 2023-09-13T09:43:24.175 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:43:24.186 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:43:24.187 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:43:24.189 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:43:24.189 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:43:30.367 INFO:teuthology.orchestra.run.smithi084.stdout:generic/345 6s 2023-09-13T09:43:30.380 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/345 2023-09-13T09:43:30.380 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:43:30.382 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:43:30.391 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:43:30.391 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/346) 2023-09-13T09:43:30.620 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:43:30.626 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:43:30.627 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:43:30.630 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:43:30.630 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:43:34.091 INFO:teuthology.orchestra.run.smithi084.stdout:generic/346 3s 2023-09-13T09:43:34.171 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/346 2023-09-13T09:43:34.171 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:43:34.174 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:43:34.185 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:43:34.186 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/347) 2023-09-13T09:43:34.403 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:43:34.407 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:43:34.408 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:43:34.409 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:43:34.409 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:43:34.938 INFO:teuthology.orchestra.run.smithi084.stdout:generic/347 [not run] require 172.21.15.84:6789:/scratch to be valid block disk 2023-09-13T09:43:34.941 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/347 2023-09-13T09:43:34.941 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/347 2023-09-13T09:43:34.941 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:43:34.946 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:43:34.996 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:43:34.997 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/348) 2023-09-13T09:43:35.272 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:43:35.276 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:43:35.277 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:43:35.278 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:43:35.278 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:43:35.645 INFO:teuthology.orchestra.run.smithi084.stdout:generic/348 [not run] require 172.21.15.84:6789:/scratch to be valid block disk 2023-09-13T09:43:35.650 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/348 2023-09-13T09:43:35.650 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/348 2023-09-13T09:43:35.650 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:43:35.652 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:43:35.693 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:43:35.693 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/349) 2023-09-13T09:43:35.927 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:43:35.931 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:43:35.931 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:43:35.932 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:43:35.933 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:43:36.374 INFO:teuthology.orchestra.run.smithi084.stdout:generic/349 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-09-13T09:43:36.378 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/349 2023-09-13T09:43:36.379 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/349 2023-09-13T09:43:36.379 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:43:36.381 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:43:36.409 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:43:36.410 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/350) 2023-09-13T09:43:36.630 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:43:36.634 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:43:36.634 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:43:36.635 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:43:36.635 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:43:37.545 INFO:teuthology.orchestra.run.smithi084.stdout:generic/350 1s 2023-09-13T09:43:37.549 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/350 2023-09-13T09:43:37.550 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:43:37.551 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:43:37.566 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:43:37.567 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/351) 2023-09-13T09:43:37.772 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:43:37.776 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:43:37.776 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:43:37.777 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:43:37.778 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:43:38.117 INFO:teuthology.orchestra.run.smithi084.stdout:generic/351 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-13T09:43:38.121 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/351 2023-09-13T09:43:38.122 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/351 2023-09-13T09:43:38.122 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:43:38.123 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:43:38.169 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:43:38.170 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/352) 2023-09-13T09:43:38.376 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:43:38.380 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:43:38.380 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:43:38.381 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:43:38.381 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:43:39.271 INFO:teuthology.orchestra.run.smithi084.stdout:generic/352 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:43:39.307 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/352 2023-09-13T09:43:39.308 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/352 2023-09-13T09:43:39.308 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:43:39.325 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:43:39.394 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:43:39.394 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/353) 2023-09-13T09:43:39.618 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:43:39.622 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:43:39.623 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:43:39.624 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:43:39.624 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:43:40.500 INFO:teuthology.orchestra.run.smithi084.stdout:generic/353 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:43:40.545 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/353 2023-09-13T09:43:40.546 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/353 2023-09-13T09:43:40.546 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:43:40.547 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:43:40.579 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:43:40.579 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/354) 2023-09-13T09:43:40.783 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:43:40.787 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:43:40.788 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:43:40.789 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:43:40.789 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:43:46.258 INFO:teuthology.orchestra.run.smithi084.stdout:generic/354 5s 2023-09-13T09:43:46.269 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/354 2023-09-13T09:43:46.270 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:43:46.272 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:43:46.283 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:43:46.284 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/355) 2023-09-13T09:43:46.485 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:43:46.489 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:43:46.490 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:43:46.490 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:43:46.491 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:43:47.491 INFO:teuthology.orchestra.run.smithi084.stdout:generic/355 1s 2023-09-13T09:43:47.497 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/355 2023-09-13T09:43:47.497 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:43:47.499 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:43:47.970 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:43:47.971 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/356) 2023-09-13T09:43:48.256 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:43:48.260 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:43:48.260 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:43:48.261 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:43:48.261 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:43:48.866 INFO:teuthology.orchestra.run.smithi084.stdout:generic/356 [not run] swapfiles are not supported 2023-09-13T09:43:48.870 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/356 2023-09-13T09:43:48.870 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/356 2023-09-13T09:43:48.871 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:43:48.872 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:43:48.901 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:43:48.902 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/357) 2023-09-13T09:43:49.123 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:43:49.127 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:43:49.128 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:43:49.129 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:43:49.129 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:43:49.698 INFO:teuthology.orchestra.run.smithi084.stdout:generic/357 [not run] swapfiles are not supported 2023-09-13T09:43:49.702 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/357 2023-09-13T09:43:49.702 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/357 2023-09-13T09:43:49.703 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:43:49.704 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:43:49.735 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:43:49.736 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/358) 2023-09-13T09:43:49.953 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:43:49.957 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:43:49.957 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:43:49.958 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:43:49.958 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:43:50.618 INFO:teuthology.orchestra.run.smithi084.stdout:generic/358 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:43:50.636 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/358 2023-09-13T09:43:50.637 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/358 2023-09-13T09:43:50.637 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:43:50.640 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:43:50.914 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:43:50.914 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/359) 2023-09-13T09:43:51.120 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:43:51.124 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:43:51.124 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:43:51.125 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:43:51.125 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:43:51.979 INFO:teuthology.orchestra.run.smithi084.stdout:generic/359 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:43:52.041 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/359 2023-09-13T09:43:52.041 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/359 2023-09-13T09:43:52.042 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:43:52.053 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:43:52.098 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:43:52.099 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/360) 2023-09-13T09:43:52.304 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:43:52.308 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:43:52.308 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:43:52.309 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:43:52.310 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:43:52.696 INFO:teuthology.orchestra.run.smithi084.stdout:generic/360 0s 2023-09-13T09:43:52.701 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/360 2023-09-13T09:43:52.701 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:43:52.703 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:43:52.733 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:43:52.734 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/361) 2023-09-13T09:43:52.942 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:43:52.947 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:43:52.947 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:43:52.948 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:43:52.948 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:43:53.378 INFO:teuthology.orchestra.run.smithi084.stdout:generic/361 [not run] require 172.21.15.84:6789:/scratch to be valid block disk 2023-09-13T09:43:53.382 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/361 2023-09-13T09:43:53.382 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/361 2023-09-13T09:43:53.382 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:43:53.384 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:43:53.406 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:43:53.407 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/362) 2023-09-13T09:43:53.615 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:43:53.619 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:43:53.620 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:43:53.621 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:43:53.621 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:43:53.931 INFO:teuthology.orchestra.run.smithi084.stdout:generic/362 [not run] this test requires richacl support on $SCRATCH_DEV 2023-09-13T09:43:53.935 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/362 2023-09-13T09:43:53.936 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/362 2023-09-13T09:43:53.936 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:43:53.938 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:43:53.961 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:43:53.962 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/363) 2023-09-13T09:43:54.171 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:43:54.175 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:43:54.176 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:43:54.176 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:43:54.177 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:43:54.507 INFO:teuthology.orchestra.run.smithi084.stdout:generic/363 [not run] this test requires richacl support on $SCRATCH_DEV 2023-09-13T09:43:54.510 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/363 2023-09-13T09:43:54.510 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/363 2023-09-13T09:43:54.511 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:43:54.512 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:43:54.539 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:43:54.540 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/364) 2023-09-13T09:43:54.743 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:43:54.747 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:43:54.747 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:43:54.748 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:43:54.749 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:43:55.066 INFO:teuthology.orchestra.run.smithi084.stdout:generic/364 [not run] this test requires richacl support on $SCRATCH_DEV 2023-09-13T09:43:55.070 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/364 2023-09-13T09:43:55.070 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/364 2023-09-13T09:43:55.071 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:43:55.072 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:43:55.104 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:43:55.104 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/365) 2023-09-13T09:43:55.323 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:43:55.327 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:43:55.329 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:43:55.329 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:43:55.329 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:43:55.652 INFO:teuthology.orchestra.run.smithi084.stdout:generic/365 [not run] this test requires richacl support on $SCRATCH_DEV 2023-09-13T09:43:55.656 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/365 2023-09-13T09:43:55.656 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/365 2023-09-13T09:43:55.656 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:43:55.658 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:43:55.679 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:43:55.680 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/366) 2023-09-13T09:43:55.882 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:43:55.886 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:43:55.887 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:43:55.887 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:43:55.888 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:43:56.229 INFO:teuthology.orchestra.run.smithi084.stdout:generic/366 [not run] this test requires richacl support on $SCRATCH_DEV 2023-09-13T09:43:56.233 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/366 2023-09-13T09:43:56.234 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/366 2023-09-13T09:43:56.234 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:43:56.235 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:43:56.267 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:43:56.268 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/367) 2023-09-13T09:43:56.473 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:43:56.477 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:43:56.478 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:43:56.478 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:43:56.479 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:43:56.787 INFO:teuthology.orchestra.run.smithi084.stdout:generic/367 [not run] this test requires richacl support on $SCRATCH_DEV 2023-09-13T09:43:56.791 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/367 2023-09-13T09:43:56.792 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/367 2023-09-13T09:43:56.792 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:43:56.793 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:43:56.823 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:43:56.824 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/368) 2023-09-13T09:43:57.029 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:43:57.034 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:43:57.034 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:43:57.035 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:43:57.035 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:43:57.347 INFO:teuthology.orchestra.run.smithi084.stdout:generic/368 [not run] this test requires richacl support on $SCRATCH_DEV 2023-09-13T09:43:57.351 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/368 2023-09-13T09:43:57.351 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/368 2023-09-13T09:43:57.352 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:43:57.353 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:43:57.379 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:43:57.380 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/369) 2023-09-13T09:43:57.590 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:43:57.594 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:43:57.595 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:43:57.596 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:43:57.596 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:43:57.906 INFO:teuthology.orchestra.run.smithi084.stdout:generic/369 [not run] this test requires richacl support on $SCRATCH_DEV 2023-09-13T09:43:57.910 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/369 2023-09-13T09:43:57.911 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/369 2023-09-13T09:43:57.911 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:43:57.913 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:43:57.939 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:43:57.939 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/370) 2023-09-13T09:43:58.145 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:43:58.149 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:43:58.150 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:43:58.151 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:43:58.151 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:43:58.482 INFO:teuthology.orchestra.run.smithi084.stdout:generic/370 [not run] this test requires richacl support on $SCRATCH_DEV 2023-09-13T09:43:58.486 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/370 2023-09-13T09:43:58.486 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/370 2023-09-13T09:43:58.486 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:43:58.488 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:43:58.514 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:43:58.514 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/371) 2023-09-13T09:43:58.721 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:43:58.725 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:43:58.725 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:43:58.726 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:43:58.726 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:43:59.052 INFO:teuthology.orchestra.run.smithi084.stdout:generic/371 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-13T09:43:59.056 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/371 2023-09-13T09:43:59.056 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/371 2023-09-13T09:43:59.056 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:43:59.058 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:43:59.090 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:43:59.090 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/372) 2023-09-13T09:43:59.306 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:43:59.310 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:43:59.310 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:43:59.311 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:43:59.311 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:43:59.383 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:43:59.394 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:44:00.145 INFO:teuthology.orchestra.run.smithi084.stdout:generic/372 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:44:00.203 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/372 2023-09-13T09:44:00.204 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/372 2023-09-13T09:44:00.204 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:44:00.212 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:00.257 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:44:00.258 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/373) 2023-09-13T09:44:00.466 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:44:00.470 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:44:00.470 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:44:00.471 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:44:00.472 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:01.349 INFO:teuthology.orchestra.run.smithi084.stdout:generic/373 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:44:01.383 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/373 2023-09-13T09:44:01.383 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/373 2023-09-13T09:44:01.383 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:44:01.385 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:01.412 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:44:01.413 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/374) 2023-09-13T09:44:01.642 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:44:01.646 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:44:01.647 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:44:01.647 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:44:01.648 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:02.167 INFO:teuthology.orchestra.run.smithi084.stdout:generic/374 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-09-13T09:44:02.492 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/374 2023-09-13T09:44:02.492 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/374 2023-09-13T09:44:02.493 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:44:02.497 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:02.583 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:44:02.584 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/375) 2023-09-13T09:44:02.808 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:44:02.813 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:44:02.813 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:44:02.814 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:44:02.814 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:03.228 INFO:teuthology.orchestra.run.smithi084.stdout:generic/375 0s 2023-09-13T09:44:03.232 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/375 2023-09-13T09:44:03.233 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:44:03.234 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:03.588 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:44:03.589 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/376) 2023-09-13T09:44:03.855 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:44:03.859 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:44:03.860 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:44:03.861 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:44:03.861 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:04.185 INFO:teuthology.orchestra.run.smithi084.stdout:generic/376 [not run] require 172.21.15.84:6789:/scratch to be valid block disk 2023-09-13T09:44:04.189 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/376 2023-09-13T09:44:04.189 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/376 2023-09-13T09:44:04.189 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:44:04.191 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:04.217 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:44:04.217 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/377) 2023-09-13T09:44:04.432 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:44:04.436 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:44:04.436 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:44:04.437 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:44:04.437 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:05.056 INFO:teuthology.orchestra.run.smithi084.stdout:generic/377 1s 2023-09-13T09:44:05.061 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/377 2023-09-13T09:44:05.061 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:44:05.063 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:05.071 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:44:05.072 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/378) 2023-09-13T09:44:05.287 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:44:05.291 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:44:05.291 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:44:05.292 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:44:05.293 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:05.765 INFO:teuthology.orchestra.run.smithi084.stdout:generic/378 0s 2023-09-13T09:44:05.770 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/378 2023-09-13T09:44:05.770 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:44:05.771 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:06.126 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:44:06.127 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/379) 2023-09-13T09:44:06.387 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:44:06.391 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:44:06.391 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:44:06.392 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:44:06.392 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:06.727 INFO:teuthology.orchestra.run.smithi084.stdout:generic/379 [not run] disk quotas not supported by this filesystem type: ceph 2023-09-13T09:44:06.731 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/379 2023-09-13T09:44:06.731 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/379 2023-09-13T09:44:06.731 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:44:06.733 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:06.755 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:44:06.756 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/380) 2023-09-13T09:44:06.959 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:44:06.963 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:44:06.964 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:44:06.965 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:44:06.965 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:07.286 INFO:teuthology.orchestra.run.smithi084.stdout:generic/380 [not run] disk quotas not supported by this filesystem type: ceph 2023-09-13T09:44:07.290 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/380 2023-09-13T09:44:07.290 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/380 2023-09-13T09:44:07.290 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:44:07.292 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:07.319 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:44:07.319 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/381) 2023-09-13T09:44:07.522 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:44:07.526 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:44:07.526 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:44:07.527 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:44:07.528 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:07.858 INFO:teuthology.orchestra.run.smithi084.stdout:generic/381 [not run] disk quotas not supported by this filesystem type: ceph 2023-09-13T09:44:07.862 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/381 2023-09-13T09:44:07.862 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/381 2023-09-13T09:44:07.863 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:44:07.864 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:07.893 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:44:07.894 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/382) 2023-09-13T09:44:08.109 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:44:08.113 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:44:08.114 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:44:08.115 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:44:08.115 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:08.433 INFO:teuthology.orchestra.run.smithi084.stdout:generic/382 [not run] disk quotas not supported by this filesystem type: ceph 2023-09-13T09:44:08.437 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/382 2023-09-13T09:44:08.437 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/382 2023-09-13T09:44:08.437 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:44:08.439 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:08.470 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:44:08.471 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/383) 2023-09-13T09:44:08.679 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:44:08.684 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:44:08.684 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:44:08.685 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:44:08.685 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:09.004 INFO:teuthology.orchestra.run.smithi084.stdout:generic/383 [not run] disk quotas not supported by this filesystem type: ceph 2023-09-13T09:44:09.008 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/383 2023-09-13T09:44:09.008 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/383 2023-09-13T09:44:09.008 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:44:09.010 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:09.044 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:44:09.045 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/384) 2023-09-13T09:44:09.250 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:44:09.254 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:44:09.255 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:44:09.256 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:44:09.256 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:09.597 INFO:teuthology.orchestra.run.smithi084.stdout:generic/384 [not run] disk quotas not supported by this filesystem type: ceph 2023-09-13T09:44:09.601 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/384 2023-09-13T09:44:09.601 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/384 2023-09-13T09:44:09.601 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:44:09.603 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:09.633 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:44:09.633 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/385) 2023-09-13T09:44:09.836 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:44:09.840 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:44:09.841 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:44:09.842 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:44:09.842 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:10.165 INFO:teuthology.orchestra.run.smithi084.stdout:generic/385 [not run] disk quotas not supported by this filesystem type: ceph 2023-09-13T09:44:10.169 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/385 2023-09-13T09:44:10.170 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/385 2023-09-13T09:44:10.170 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:44:10.171 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:10.195 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:44:10.196 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/386) 2023-09-13T09:44:10.397 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:44:10.401 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:44:10.402 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:44:10.402 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:44:10.403 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:10.720 INFO:teuthology.orchestra.run.smithi084.stdout:generic/386 [not run] disk quotas not supported by this filesystem type: ceph 2023-09-13T09:44:10.724 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/386 2023-09-13T09:44:10.724 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/386 2023-09-13T09:44:10.724 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:44:10.726 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:10.752 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:44:10.753 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/387) 2023-09-13T09:44:10.971 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:44:10.975 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:44:10.975 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:44:10.976 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:44:10.976 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:11.676 INFO:teuthology.orchestra.run.smithi084.stdout:generic/387 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:44:11.813 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/387 2023-09-13T09:44:11.813 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/387 2023-09-13T09:44:11.813 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:44:11.880 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:11.910 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:44:11.911 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/388) 2023-09-13T09:44:12.124 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:44:12.128 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:44:12.129 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:44:12.129 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:44:12.130 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:12.491 INFO:teuthology.orchestra.run.smithi084.stdout:generic/388 [not run] require 172.21.15.84:6789:/scratch to be local device 2023-09-13T09:44:12.495 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/388 2023-09-13T09:44:12.496 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/388 2023-09-13T09:44:12.496 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:44:12.498 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:12.520 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:44:12.520 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/389) 2023-09-13T09:44:12.725 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:44:12.729 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:44:12.730 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:44:12.733 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:44:12.733 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:13.056 INFO:teuthology.orchestra.run.smithi084.stdout:generic/389 [not run] O_TMPFILE is not supported 2023-09-13T09:44:13.060 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/389 2023-09-13T09:44:13.060 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/389 2023-09-13T09:44:13.060 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:44:13.062 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:13.084 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:44:13.085 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/390) 2023-09-13T09:44:13.287 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:44:13.291 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:44:13.291 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:44:13.292 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:44:13.293 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:13.610 INFO:teuthology.orchestra.run.smithi084.stdout:generic/390 [not run] ceph does not support freezing 2023-09-13T09:44:13.614 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/390 2023-09-13T09:44:13.614 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/390 2023-09-13T09:44:13.614 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:44:13.616 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:13.636 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:44:13.637 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/391) 2023-09-13T09:44:13.854 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:44:13.858 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:44:13.858 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:44:13.859 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:44:13.860 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:14.190 INFO:teuthology.orchestra.run.smithi084.stdout:generic/391 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-13T09:44:14.194 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/391 2023-09-13T09:44:14.194 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/391 2023-09-13T09:44:14.194 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:44:14.196 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:14.230 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:44:14.231 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/392) 2023-09-13T09:44:14.453 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:44:14.458 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:44:14.458 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:44:14.459 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:44:14.459 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:14.950 INFO:teuthology.orchestra.run.smithi084.stdout:generic/392 [not run] ceph does not support shutdown 2023-09-13T09:44:14.989 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/392 2023-09-13T09:44:14.990 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/392 2023-09-13T09:44:14.990 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:44:14.991 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:15.011 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:44:15.012 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/393) 2023-09-13T09:44:15.231 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:44:15.235 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:44:15.235 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:44:15.236 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:44:15.236 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:16.246 INFO:teuthology.orchestra.run.smithi084.stdout:generic/393 1s 2023-09-13T09:44:16.251 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/393 2023-09-13T09:44:16.251 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:44:16.253 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:16.261 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:44:16.261 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/394) 2023-09-13T09:44:16.469 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:44:16.473 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:44:16.474 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:44:16.475 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:44:16.475 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:16.830 INFO:teuthology.orchestra.run.smithi084.stdout:generic/394 0s 2023-09-13T09:44:16.835 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/394 2023-09-13T09:44:16.835 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:44:16.837 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:17.099 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:44:17.100 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/395) 2023-09-13T09:44:17.452 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:44:17.456 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:44:17.457 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:44:17.458 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:44:17.458 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:18.194 INFO:teuthology.orchestra.run.smithi084.stdout:generic/395 [not run] kernel does not support ceph encryption 2023-09-13T09:44:18.217 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/395 2023-09-13T09:44:18.218 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/395 2023-09-13T09:44:18.218 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:44:18.220 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:18.239 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:44:18.240 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/396) 2023-09-13T09:44:18.572 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:44:18.581 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:44:18.582 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:44:18.583 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:44:18.583 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:19.240 INFO:teuthology.orchestra.run.smithi084.stdout:generic/396 [not run] kernel does not support ceph encryption 2023-09-13T09:44:19.262 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/396 2023-09-13T09:44:19.263 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/396 2023-09-13T09:44:19.263 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:44:19.264 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:19.283 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:44:19.283 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/397) 2023-09-13T09:44:19.486 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:44:19.490 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:44:19.491 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:44:19.491 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:44:19.492 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:20.044 INFO:teuthology.orchestra.run.smithi084.stdout:generic/397 [not run] kernel does not support ceph encryption 2023-09-13T09:44:20.065 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/397 2023-09-13T09:44:20.066 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/397 2023-09-13T09:44:20.066 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:44:20.067 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:20.086 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:44:20.087 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/398) 2023-09-13T09:44:20.291 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:44:20.298 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:44:20.298 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:44:20.299 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:44:20.299 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:20.815 INFO:teuthology.orchestra.run.smithi084.stdout:generic/398 [not run] kernel does not support ceph encryption 2023-09-13T09:44:20.828 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/398 2023-09-13T09:44:20.829 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/398 2023-09-13T09:44:20.829 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:44:20.830 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:20.849 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:44:20.849 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/399) 2023-09-13T09:44:21.050 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:44:21.054 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:44:21.055 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:44:21.056 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:44:21.056 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:21.565 INFO:teuthology.orchestra.run.smithi084.stdout:generic/399 [not run] kernel does not support ceph encryption 2023-09-13T09:44:21.582 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/399 2023-09-13T09:44:21.582 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/399 2023-09-13T09:44:21.582 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:44:21.583 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:21.603 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:44:21.603 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/400) 2023-09-13T09:44:21.814 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:44:21.818 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:44:21.819 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:44:21.820 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:44:21.820 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:22.166 INFO:teuthology.orchestra.run.smithi084.stdout:generic/400 [not run] disk quotas not supported by this filesystem type: ceph 2023-09-13T09:44:22.179 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/400 2023-09-13T09:44:22.180 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/400 2023-09-13T09:44:22.180 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:44:22.180 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:22.196 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:44:22.196 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/401) 2023-09-13T09:44:22.411 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:44:22.415 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:44:22.415 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:44:22.416 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:44:22.416 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:23.288 INFO:teuthology.orchestra.run.smithi084.stdout:generic/401 1s 2023-09-13T09:44:23.293 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/401 2023-09-13T09:44:23.294 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:44:23.295 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:23.312 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:44:23.313 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/402) 2023-09-13T09:44:23.522 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:44:23.526 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:44:23.527 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:44:23.528 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:44:23.528 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:24.038 INFO:teuthology.orchestra.run.smithi084.stdout:generic/402 [not run] filesystem ceph timestamp bounds are unknown 2023-09-13T09:44:24.057 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/402 2023-09-13T09:44:24.057 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/402 2023-09-13T09:44:24.058 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:44:24.059 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:24.088 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:44:24.089 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/403) 2023-09-13T09:44:24.299 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:44:24.303 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:44:24.304 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:44:24.304 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:44:24.305 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:25.013 INFO:teuthology.orchestra.run.smithi084.stdout:generic/403 0s 2023-09-13T09:44:25.042 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/403 2023-09-13T09:44:25.042 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:44:25.044 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:25.053 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:44:25.053 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/404) 2023-09-13T09:44:25.257 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:44:25.261 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:44:25.261 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:44:25.262 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:44:25.262 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:25.591 INFO:teuthology.orchestra.run.smithi084.stdout:generic/404 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-13T09:44:25.595 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/404 2023-09-13T09:44:25.595 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/404 2023-09-13T09:44:25.595 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:44:25.597 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:25.626 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:44:25.627 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/405) 2023-09-13T09:44:25.823 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:44:25.827 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:44:25.828 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:44:25.828 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:44:25.829 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:26.169 INFO:teuthology.orchestra.run.smithi084.stdout:generic/405 [not run] require 172.21.15.84:6789:/scratch to be valid block disk 2023-09-13T09:44:26.173 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/405 2023-09-13T09:44:26.173 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/405 2023-09-13T09:44:26.173 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:44:26.175 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:26.201 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:44:26.201 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/406) 2023-09-13T09:44:26.428 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:44:26.432 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:44:26.432 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:44:26.433 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:44:26.434 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:28.258 INFO:teuthology.orchestra.run.smithi084.stdout:generic/406 2s 2023-09-13T09:44:28.263 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/406 2023-09-13T09:44:28.263 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:44:28.265 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:28.273 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:44:28.274 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/407) 2023-09-13T09:44:28.476 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:44:28.480 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:44:28.480 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:44:28.481 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:44:28.481 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:28.859 INFO:teuthology.orchestra.run.smithi084.stdout:generic/407 [not run] Reflink not supported by test filesystem type: ceph 2023-09-13T09:44:28.863 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/407 2023-09-13T09:44:28.863 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/407 2023-09-13T09:44:28.863 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:44:28.865 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:29.244 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:44:29.244 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/408) 2023-09-13T09:44:29.463 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:44:29.467 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:44:29.467 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:44:29.468 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:44:29.468 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:29.474 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:44:29.476 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:44:29.810 INFO:teuthology.orchestra.run.smithi084.stdout:generic/408 [not run] Dedupe not supported by test filesystem type: ceph 2023-09-13T09:44:29.814 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/408 2023-09-13T09:44:29.815 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/408 2023-09-13T09:44:29.815 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:44:29.816 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:30.183 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:44:30.184 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/409) 2023-09-13T09:44:30.397 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:44:30.401 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:44:30.402 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:44:30.403 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:44:30.403 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:30.707 INFO:teuthology.orchestra.run.smithi084.stdout:generic/409 [not run] require 172.21.15.84:6789:/scratch to be local device 2023-09-13T09:44:30.711 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/409 2023-09-13T09:44:30.711 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/409 2023-09-13T09:44:30.711 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:44:30.713 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:30.736 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:44:30.737 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/410) 2023-09-13T09:44:30.934 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:44:30.939 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:44:30.940 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:44:30.941 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:44:30.941 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:31.267 INFO:teuthology.orchestra.run.smithi084.stdout:generic/410 [not run] require 172.21.15.84:6789:/scratch to be local device 2023-09-13T09:44:31.271 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/410 2023-09-13T09:44:31.272 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/410 2023-09-13T09:44:31.272 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:44:31.273 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:31.295 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:44:31.296 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/411) 2023-09-13T09:44:31.522 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:44:31.526 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:44:31.526 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:44:31.527 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:44:31.528 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:31.853 INFO:teuthology.orchestra.run.smithi084.stdout:generic/411 [not run] require 172.21.15.84:6789:/scratch to be local device 2023-09-13T09:44:31.857 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/411 2023-09-13T09:44:31.857 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/411 2023-09-13T09:44:31.857 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:44:31.859 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:31.881 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:44:31.882 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/412) 2023-09-13T09:44:32.084 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:44:32.088 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:44:32.088 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:44:32.089 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:44:32.090 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:32.789 INFO:teuthology.orchestra.run.smithi084.stdout:generic/412 0s 2023-09-13T09:44:32.795 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/412 2023-09-13T09:44:32.795 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:44:32.797 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:32.805 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:44:32.805 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/413) 2023-09-13T09:44:33.036 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:44:33.040 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:44:33.041 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:44:33.041 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:44:33.042 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:33.462 INFO:teuthology.orchestra.run.smithi084.stdout:generic/413 [not run] mount 172.21.15.84:6789:/scratch with dax failed 2023-09-13T09:44:33.467 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/413 2023-09-13T09:44:33.468 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/413 2023-09-13T09:44:33.468 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:44:33.469 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:33.493 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:44:33.494 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/414) 2023-09-13T09:44:33.697 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:44:33.701 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:44:33.701 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:44:33.702 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:44:33.702 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:34.391 INFO:teuthology.orchestra.run.smithi084.stdout:generic/414 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:44:34.408 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/414 2023-09-13T09:44:34.408 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/414 2023-09-13T09:44:34.409 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:44:34.415 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:34.559 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:44:34.560 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/415) 2023-09-13T09:44:34.766 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:44:34.771 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:44:34.772 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:44:34.773 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:44:34.773 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:35.483 INFO:teuthology.orchestra.run.smithi084.stdout:generic/415 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:44:35.489 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/415 2023-09-13T09:44:35.489 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/415 2023-09-13T09:44:35.490 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:44:35.525 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:35.636 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:44:35.637 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/416) 2023-09-13T09:44:35.842 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:44:35.846 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:44:35.846 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:44:35.847 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:44:35.848 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:36.163 INFO:teuthology.orchestra.run.smithi084.stdout:generic/416 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-09-13T09:44:36.167 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/416 2023-09-13T09:44:36.168 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/416 2023-09-13T09:44:36.168 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:44:36.170 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:36.196 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:44:36.196 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/417) 2023-09-13T09:44:36.402 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:44:36.406 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:44:36.407 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:44:36.408 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:44:36.408 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:36.850 INFO:teuthology.orchestra.run.smithi084.stdout:generic/417 [not run] ceph does not support shutdown 2023-09-13T09:44:36.884 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/417 2023-09-13T09:44:36.884 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/417 2023-09-13T09:44:36.884 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:44:36.885 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:36.913 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:44:36.913 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/418) 2023-09-13T09:44:37.106 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:44:37.110 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:44:37.111 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:44:37.111 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:44:37.112 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:37.468 INFO:teuthology.orchestra.run.smithi084.stdout:generic/418 [not run] require 172.21.15.84:6789:/test to be valid block disk 2023-09-13T09:44:37.472 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/418 2023-09-13T09:44:37.472 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/418 2023-09-13T09:44:37.472 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:44:37.474 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:37.504 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:44:37.504 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/419) 2023-09-13T09:44:37.733 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:44:37.737 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:44:37.738 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:44:37.739 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:44:37.739 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:38.263 INFO:teuthology.orchestra.run.smithi084.stdout:generic/419 [not run] kernel does not support ceph encryption 2023-09-13T09:44:38.286 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/419 2023-09-13T09:44:38.286 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/419 2023-09-13T09:44:38.286 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:44:38.288 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:38.310 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:44:38.311 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/420) 2023-09-13T09:44:38.514 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:44:38.518 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:44:38.519 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:44:38.519 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:44:38.520 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:38.953 INFO:teuthology.orchestra.run.smithi084.stdout:generic/420 0s 2023-09-13T09:44:38.958 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/420 2023-09-13T09:44:38.958 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:44:38.960 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:39.268 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:44:39.269 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/421) 2023-09-13T09:44:39.550 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:44:39.554 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:44:39.554 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:44:39.555 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:44:39.555 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:40.067 INFO:teuthology.orchestra.run.smithi084.stdout:generic/421 [not run] kernel does not support ceph encryption 2023-09-13T09:44:40.090 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/421 2023-09-13T09:44:40.090 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/421 2023-09-13T09:44:40.090 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:44:40.091 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:40.114 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:44:40.114 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/422) 2023-09-13T09:44:40.311 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:44:40.315 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:44:40.315 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:44:40.316 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:44:40.316 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:40.659 INFO:teuthology.orchestra.run.smithi084.stdout:generic/422 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-09-13T09:44:40.663 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/422 2023-09-13T09:44:40.663 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/422 2023-09-13T09:44:40.664 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:44:40.665 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:40.691 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:44:40.692 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/423) 2023-09-13T09:44:40.923 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:44:40.928 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:44:40.928 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:44:40.929 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:44:40.929 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:41.341 INFO:teuthology.orchestra.run.smithi084.stdout:generic/423 0s 2023-09-13T09:44:41.346 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/423 2023-09-13T09:44:41.347 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:44:41.348 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:41.694 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:44:41.695 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/424) 2023-09-13T09:44:41.959 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:44:41.963 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:44:41.964 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:44:41.965 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:44:41.965 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:42.306 INFO:teuthology.orchestra.run.smithi084.stdout:generic/424 [not run] file system doesn't support any of /bin/chattr +a/+c/+d/+i 2023-09-13T09:44:42.310 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/424 2023-09-13T09:44:42.310 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/424 2023-09-13T09:44:42.310 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:44:42.312 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:42.340 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:44:42.341 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/425) 2023-09-13T09:44:42.545 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:44:42.549 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:44:42.549 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:44:42.550 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:44:42.550 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:42.894 INFO:teuthology.orchestra.run.smithi084.stdout:generic/425 [not run] xfs_io fiemap -a failed (old kernel/wrong fs?) 2023-09-13T09:44:42.897 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/425 2023-09-13T09:44:42.898 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/425 2023-09-13T09:44:42.898 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:44:42.899 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:43.235 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:44:43.236 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/426) 2023-09-13T09:44:43.471 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:44:43.475 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:44:43.475 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:44:43.476 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:44:43.476 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:44:59.629 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:44:59.708 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:45:25.035 INFO:teuthology.orchestra.run.smithi084.stdout:generic/426 41s 2023-09-13T09:45:25.121 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/426 2023-09-13T09:45:25.121 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:45:25.135 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:45:25.568 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:45:25.569 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/427) 2023-09-13T09:45:26.561 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:45:26.565 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:45:26.565 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:45:26.567 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:45:26.567 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:45:27.006 INFO:teuthology.orchestra.run.smithi084.stdout:generic/427 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-09-13T09:45:27.010 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/427 2023-09-13T09:45:27.010 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/427 2023-09-13T09:45:27.010 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:45:27.012 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:45:27.040 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:45:27.040 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/428) 2023-09-13T09:45:27.243 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:45:27.247 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:45:27.248 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:45:27.249 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:45:27.249 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:45:27.609 INFO:teuthology.orchestra.run.smithi084.stdout:generic/428 0s 2023-09-13T09:45:27.614 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/428 2023-09-13T09:45:27.614 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:45:27.616 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:45:27.644 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:45:27.645 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/429) 2023-09-13T09:45:27.846 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:45:27.850 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:45:27.850 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:45:27.851 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:45:27.852 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:45:28.347 INFO:teuthology.orchestra.run.smithi084.stdout:generic/429 [not run] kernel does not support ceph encryption 2023-09-13T09:45:28.369 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/429 2023-09-13T09:45:28.369 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/429 2023-09-13T09:45:28.369 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:45:28.370 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:45:28.401 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:45:28.401 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/430) 2023-09-13T09:45:28.602 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:45:28.606 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:45:28.607 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:45:28.608 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:45:28.608 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:45:29.029 INFO:teuthology.orchestra.run.smithi084.stdout:generic/430 1s 2023-09-13T09:45:29.041 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/430 2023-09-13T09:45:29.041 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:45:29.043 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:45:29.264 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:45:29.265 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/431) 2023-09-13T09:45:29.652 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:45:29.656 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:45:29.656 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:45:29.657 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:45:29.657 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:45:30.080 INFO:teuthology.orchestra.run.smithi084.stdout:generic/431 1s 2023-09-13T09:45:30.085 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/431 2023-09-13T09:45:30.085 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:45:30.087 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:45:30.347 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:45:30.347 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/432) 2023-09-13T09:45:30.547 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:45:30.558 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:45:30.693 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:45:30.697 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:45:30.698 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:45:30.698 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:45:30.699 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:45:31.092 INFO:teuthology.orchestra.run.smithi084.stdout:generic/432 1s 2023-09-13T09:45:31.097 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/432 2023-09-13T09:45:31.098 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:45:31.099 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:45:31.465 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:45:31.465 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/433) 2023-09-13T09:45:31.714 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:45:31.718 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:45:31.719 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:45:31.720 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:45:31.720 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:45:32.072 INFO:teuthology.orchestra.run.smithi084.stdout:generic/433 1s 2023-09-13T09:45:32.076 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/433 2023-09-13T09:45:32.077 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:45:32.079 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:45:32.416 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:45:32.417 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/434) 2023-09-13T09:45:32.645 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:45:32.649 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:45:32.649 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:45:32.650 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:45:32.651 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:45:33.023 INFO:teuthology.orchestra.run.smithi084.stdout:generic/434 1s 2023-09-13T09:45:33.028 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/434 2023-09-13T09:45:33.028 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:45:33.030 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:45:33.365 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:45:33.366 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/435) 2023-09-13T09:45:33.613 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:45:33.617 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:45:33.618 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:45:33.619 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:45:33.619 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:45:34.098 INFO:teuthology.orchestra.run.smithi084.stdout:generic/435 [not run] kernel does not support ceph encryption 2023-09-13T09:45:34.123 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/435 2023-09-13T09:45:34.123 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/435 2023-09-13T09:45:34.123 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:45:34.125 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:45:34.153 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:45:34.154 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/436) 2023-09-13T09:45:34.351 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:45:34.355 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:45:34.356 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:45:34.357 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:45:34.357 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:45:34.965 INFO:teuthology.orchestra.run.smithi084.stdout:generic/436 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-13T09:45:34.969 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/436 2023-09-13T09:45:34.969 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/436 2023-09-13T09:45:34.969 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:45:34.971 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:45:35.287 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:45:35.287 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/437) 2023-09-13T09:45:35.533 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:45:35.537 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:45:35.538 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:45:35.538 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:45:35.538 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:45:36.506 INFO:teuthology.orchestra.run.smithi084.stdout:generic/437 1s 2023-09-13T09:45:36.511 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/437 2023-09-13T09:45:36.511 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:45:36.513 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:45:36.547 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:45:36.548 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/438) 2023-09-13T09:45:36.771 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:45:36.775 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:45:36.776 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:45:36.776 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:45:36.777 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:46:00.679 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:46:00.683 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:46:30.853 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:46:30.856 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:46:40.420 INFO:teuthology.orchestra.run.smithi084.stdout:generic/438 64s 2023-09-13T09:46:40.425 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/438 2023-09-13T09:46:40.425 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:46:40.427 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:46:40.461 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:46:40.463 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/439) 2023-09-13T09:46:40.671 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:46:40.675 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:46:40.676 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:46:40.676 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:46:40.677 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:46:41.813 INFO:teuthology.orchestra.run.smithi084.stdout:generic/439 1s 2023-09-13T09:46:41.818 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/439 2023-09-13T09:46:41.819 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:46:41.820 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:46:41.853 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:46:41.854 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/440) 2023-09-13T09:46:42.068 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:46:42.072 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:46:42.073 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:46:42.074 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:46:42.074 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:46:42.643 INFO:teuthology.orchestra.run.smithi084.stdout:generic/440 [not run] kernel does not support ceph encryption 2023-09-13T09:46:42.669 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/440 2023-09-13T09:46:42.669 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/440 2023-09-13T09:46:42.670 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:46:42.670 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:46:42.694 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:46:42.695 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/441) 2023-09-13T09:46:42.904 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:46:42.909 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:46:42.909 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:46:42.910 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:46:42.910 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:46:43.328 INFO:teuthology.orchestra.run.smithi084.stdout:generic/441 [not run] require 172.21.15.84:6789:/scratch to be valid block disk 2023-09-13T09:46:43.332 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/441 2023-09-13T09:46:43.332 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/441 2023-09-13T09:46:43.332 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:46:43.334 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:46:43.360 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:46:43.361 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/442) 2023-09-13T09:46:43.568 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:46:43.572 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:46:43.573 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:46:43.573 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:46:43.574 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:46:43.924 INFO:teuthology.orchestra.run.smithi084.stdout:generic/442 [not run] require 172.21.15.84:6789:/scratch to be valid block disk 2023-09-13T09:46:43.928 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/442 2023-09-13T09:46:43.928 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/442 2023-09-13T09:46:43.928 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:46:43.930 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:46:43.960 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:46:43.961 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/443) 2023-09-13T09:46:44.163 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:46:44.168 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:46:44.168 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:46:44.169 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:46:44.169 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:46:44.542 INFO:teuthology.orchestra.run.smithi084.stdout:generic/443 0s 2023-09-13T09:46:44.547 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/443 2023-09-13T09:46:44.547 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:46:44.549 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:46:44.584 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:46:44.585 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/444) 2023-09-13T09:46:44.788 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:46:44.792 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:46:44.792 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:46:44.793 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:46:44.793 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:46:45.207 INFO:teuthology.orchestra.run.smithi084.stdout:generic/444 1s 2023-09-13T09:46:45.212 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/444 2023-09-13T09:46:45.212 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:46:45.214 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:46:45.258 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:46:45.258 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/445) 2023-09-13T09:46:45.462 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:46:45.466 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:46:45.467 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:46:45.468 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:46:45.468 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:46:46.153 INFO:teuthology.orchestra.run.smithi084.stdout:generic/445 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-13T09:46:46.157 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/445 2023-09-13T09:46:46.157 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/445 2023-09-13T09:46:46.157 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:46:46.159 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:46:46.437 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:46:46.438 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/446) 2023-09-13T09:46:46.745 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:46:46.749 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:46:46.750 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:46:46.751 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:46:46.751 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:47:01.310 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:47:01.312 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:47:01.357 INFO:tasks.ceph.mds.d.smithi161.stderr:2023-09-13T09:47:01.353+0000 7f3b9b143700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 117603) UID: 0 2023-09-13T09:47:01.357 INFO:tasks.ceph.mds.b.smithi161.stderr:2023-09-13T09:47:01.353+0000 7f40246c1700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 117603) UID: 0 2023-09-13T09:47:05.294 INFO:teuthology.orchestra.run.smithi084.stdout:generic/446 19s 2023-09-13T09:47:05.310 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/446 2023-09-13T09:47:05.310 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:47:05.318 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:47:05.329 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:47:05.329 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/447) 2023-09-13T09:47:05.574 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:47:05.578 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:47:05.579 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:47:05.579 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:47:05.580 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:47:06.453 INFO:teuthology.orchestra.run.smithi084.stdout:generic/447 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:47:06.474 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/447 2023-09-13T09:47:06.474 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/447 2023-09-13T09:47:06.475 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:47:06.509 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:47:06.540 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:47:06.540 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/448) 2023-09-13T09:47:06.750 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:47:06.754 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:47:06.754 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:47:06.755 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:47:06.755 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:47:07.918 INFO:teuthology.orchestra.run.smithi084.stdout:generic/448 1s 2023-09-13T09:47:07.923 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/448 2023-09-13T09:47:07.923 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:47:07.924 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:47:08.279 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:47:08.280 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/449) 2023-09-13T09:47:08.512 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:47:08.516 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:47:08.517 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:47:08.517 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:47:08.518 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:47:08.897 INFO:teuthology.orchestra.run.smithi084.stdout:generic/449 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-09-13T09:47:08.901 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/449 2023-09-13T09:47:08.901 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/449 2023-09-13T09:47:08.902 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:47:08.903 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:47:09.246 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:47:09.247 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/450) 2023-09-13T09:47:09.505 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:47:09.509 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:47:09.510 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:47:09.511 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:47:09.511 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:47:10.311 INFO:teuthology.orchestra.run.smithi084.stdout:generic/450 1s 2023-09-13T09:47:10.316 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/450 2023-09-13T09:47:10.316 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:47:10.318 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:47:10.647 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:47:10.648 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/451) 2023-09-13T09:47:10.901 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:47:10.905 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:47:10.906 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:47:10.907 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:47:10.907 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:47:41.432 INFO:teuthology.orchestra.run.smithi084.stdout:generic/451 30s 2023-09-13T09:47:41.436 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/451 2023-09-13T09:47:41.437 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:47:41.439 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:47:41.817 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:47:41.818 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/452) 2023-09-13T09:47:42.034 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:47:42.038 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:47:42.039 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:47:42.040 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:47:42.040 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:47:42.666 INFO:teuthology.orchestra.run.smithi084.stdout:generic/452 0s 2023-09-13T09:47:42.671 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/452 2023-09-13T09:47:42.672 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:47:42.673 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:47:42.682 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:47:42.682 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/453) 2023-09-13T09:47:42.889 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:47:42.893 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:47:42.893 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:47:42.894 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:47:42.894 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:47:43.246 INFO:teuthology.orchestra.run.smithi084.stdout:generic/453 [not run] ceph does not allow unrestricted byte streams for names 2023-09-13T09:47:43.250 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/453 2023-09-13T09:47:43.250 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/453 2023-09-13T09:47:43.251 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:47:43.252 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:47:43.276 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:47:43.277 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/454) 2023-09-13T09:47:43.485 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:47:43.489 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:47:43.489 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:47:43.490 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:47:43.490 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:47:43.863 INFO:teuthology.orchestra.run.smithi084.stdout:generic/454 [not run] ceph does not allow unrestricted byte streams for names 2023-09-13T09:47:43.867 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/454 2023-09-13T09:47:43.867 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/454 2023-09-13T09:47:43.867 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:47:43.869 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:47:43.905 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:47:43.905 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/455) 2023-09-13T09:47:44.110 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:47:44.114 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:47:44.115 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:47:44.116 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:47:44.116 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:47:44.525 INFO:teuthology.orchestra.run.smithi084.stdout:generic/455 [not run] This test requires a valid $LOGWRITES_DEV 2023-09-13T09:47:44.529 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/455 2023-09-13T09:47:44.529 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/455 2023-09-13T09:47:44.529 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:47:44.531 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:47:44.559 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:47:44.560 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/456) 2023-09-13T09:47:44.773 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:47:44.777 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:47:44.778 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:47:44.779 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:47:44.779 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:47:45.127 INFO:teuthology.orchestra.run.smithi084.stdout:generic/456 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-13T09:47:45.131 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/456 2023-09-13T09:47:45.131 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/456 2023-09-13T09:47:45.132 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:47:45.133 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:47:45.158 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:47:45.159 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/457) 2023-09-13T09:47:45.364 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:47:45.368 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:47:45.369 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:47:45.369 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:47:45.370 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:47:46.252 INFO:teuthology.orchestra.run.smithi084.stdout:generic/457 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:47:46.275 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/457 2023-09-13T09:47:46.275 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/457 2023-09-13T09:47:46.275 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:47:46.284 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:47:46.341 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:47:46.342 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/458) 2023-09-13T09:47:46.575 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:47:46.579 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:47:46.579 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:47:46.580 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:47:46.581 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:47:47.451 INFO:teuthology.orchestra.run.smithi084.stdout:generic/458 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T09:47:47.481 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/458 2023-09-13T09:47:47.481 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/458 2023-09-13T09:47:47.482 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:47:47.488 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:47:47.529 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:47:47.529 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/459) 2023-09-13T09:47:47.737 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:47:47.741 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:47:47.742 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:47:47.743 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:47:47.743 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:47:48.269 INFO:teuthology.orchestra.run.smithi084.stdout:generic/459 [not run] require 172.21.15.84:6789:/scratch to be valid block disk 2023-09-13T09:47:48.273 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/459 2023-09-13T09:47:48.274 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/459 2023-09-13T09:47:48.274 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:47:48.276 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:47:48.299 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:47:48.299 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/460) 2023-09-13T09:47:48.537 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:47:48.541 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:47:48.542 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:47:48.542 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:47:48.542 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:47:50.599 INFO:teuthology.orchestra.run.smithi084.stdout:generic/460 2s 2023-09-13T09:47:50.603 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/460 2023-09-13T09:47:50.604 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:47:50.606 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:47:50.614 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:47:50.615 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/461) 2023-09-13T09:47:50.820 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:47:50.824 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:47:50.825 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:47:50.826 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:47:50.826 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:47:51.330 INFO:teuthology.orchestra.run.smithi084.stdout:generic/461 [not run] ceph does not support shutdown 2023-09-13T09:47:51.334 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/461 2023-09-13T09:47:51.334 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/461 2023-09-13T09:47:51.335 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:47:51.336 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:47:51.358 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:47:51.359 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/462) 2023-09-13T09:47:51.564 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:47:51.568 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:47:51.568 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:47:51.569 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:47:51.569 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:47:52.178 INFO:teuthology.orchestra.run.smithi084.stdout:generic/462 [not run] mount 172.21.15.84:6789:/scratch with dax failed 2023-09-13T09:47:52.178 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/462 2023-09-13T09:47:52.179 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/462 2023-09-13T09:47:52.179 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:47:52.181 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:47:52.208 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:47:52.209 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/463) 2023-09-13T09:47:52.432 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:47:52.436 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:47:52.437 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:47:52.438 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:47:52.438 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:47:52.811 INFO:teuthology.orchestra.run.smithi084.stdout:generic/463 [not run] Reflink not supported by test filesystem type: ceph 2023-09-13T09:47:52.815 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/463 2023-09-13T09:47:52.815 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/463 2023-09-13T09:47:52.815 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:47:52.817 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:47:53.185 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:47:53.186 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/464) 2023-09-13T09:47:53.406 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:47:53.410 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:47:53.410 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:47:53.411 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:47:53.411 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:48:50.767 INFO:teuthology.orchestra.run.smithi084.stdout:generic/464 57s 2023-09-13T09:48:50.772 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/464 2023-09-13T09:48:50.772 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:48:50.774 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:48:50.782 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:48:50.783 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/465) 2023-09-13T09:48:51.013 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:48:51.017 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:48:51.017 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:48:51.018 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:48:51.018 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:48:55.824 INFO:teuthology.orchestra.run.smithi084.stdout:generic/465 4s 2023-09-13T09:48:55.836 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/465 2023-09-13T09:48:55.836 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:48:55.839 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:48:55.854 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:48:55.855 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/466) 2023-09-13T09:48:56.188 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:48:56.191 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:48:56.192 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:48:56.193 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:48:56.193 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:48:56.525 INFO:teuthology.orchestra.run.smithi084.stdout:generic/466 [not run] require 172.21.15.84:6789:/scratch to be valid block disk 2023-09-13T09:48:56.529 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/466 2023-09-13T09:48:56.529 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/466 2023-09-13T09:48:56.529 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:48:56.531 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:48:56.553 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:48:56.554 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/467) 2023-09-13T09:48:56.755 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:48:56.762 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:48:56.762 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:48:56.762 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:48:56.763 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:49:41.590 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:49:41.628 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:49:57.965 INFO:teuthology.orchestra.run.smithi084.stdout:generic/467 61s 2023-09-13T09:49:58.043 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/467 2023-09-13T09:49:58.044 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:49:58.046 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:49:58.375 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:49:58.376 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/468) 2023-09-13T09:49:59.433 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:49:59.437 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:49:59.438 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:49:59.439 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:49:59.439 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:50:00.025 INFO:teuthology.orchestra.run.smithi084.stdout:generic/468 [not run] ceph does not support shutdown 2023-09-13T09:50:00.051 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/468 2023-09-13T09:50:00.051 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/468 2023-09-13T09:50:00.051 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:50:00.052 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:50:00.082 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:50:00.083 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/469) 2023-09-13T09:50:00.293 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:50:00.296 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:50:00.297 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:50:00.297 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:50:00.298 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:50:00.648 INFO:teuthology.orchestra.run.smithi084.stdout:generic/469 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-09-13T09:50:00.652 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/469 2023-09-13T09:50:00.652 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/469 2023-09-13T09:50:00.652 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:50:00.654 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:50:00.681 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:50:00.682 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/470) 2023-09-13T09:50:00.881 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:50:00.885 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:50:00.886 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:50:00.886 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:50:00.887 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:50:01.306 INFO:teuthology.orchestra.run.smithi084.stdout:generic/470 [not run] This test requires a valid $LOGWRITES_DEV 2023-09-13T09:50:01.310 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/470 2023-09-13T09:50:01.310 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/470 2023-09-13T09:50:01.311 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:50:01.312 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:50:01.334 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:50:01.335 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/472) 2023-09-13T09:50:01.568 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:50:01.572 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:50:01.573 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:50:01.574 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:50:01.574 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:50:02.170 INFO:teuthology.orchestra.run.smithi084.stdout:generic/472 [not run] swapfiles are not supported 2023-09-13T09:50:02.173 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/472 2023-09-13T09:50:02.174 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/472 2023-09-13T09:50:02.174 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:50:02.176 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:50:02.207 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:50:02.208 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/473) 2023-09-13T09:50:02.442 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:50:02.447 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:50:02.447 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:50:02.448 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:50:02.448 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:50:02.819 INFO:teuthology.orchestra.run.smithi084.stdout:generic/473 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-09-13T09:50:02.823 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/473 2023-09-13T09:50:02.823 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/473 2023-09-13T09:50:02.823 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:50:02.825 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:50:02.854 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:50:02.855 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/474) 2023-09-13T09:50:03.088 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:50:03.092 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:50:03.092 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:50:03.093 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:50:03.093 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:50:03.572 INFO:teuthology.orchestra.run.smithi084.stdout:generic/474 [not run] ceph does not support shutdown 2023-09-13T09:50:03.602 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/474 2023-09-13T09:50:03.602 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/474 2023-09-13T09:50:03.603 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:50:03.604 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:50:03.623 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:50:03.623 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/475) 2023-09-13T09:50:03.827 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:50:03.831 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:50:03.832 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:50:03.833 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:50:03.833 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:50:04.197 INFO:teuthology.orchestra.run.smithi084.stdout:generic/475 [not run] require 172.21.15.84:6789:/scratch to be valid block disk 2023-09-13T09:50:04.201 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/475 2023-09-13T09:50:04.201 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/475 2023-09-13T09:50:04.202 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T09:50:04.203 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:50:04.225 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T09:50:04.225 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/476) 2023-09-13T09:50:04.429 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T09:50:04.433 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T09:50:04.433 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T09:50:04.434 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T09:50:04.434 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T09:50:12.519 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:50:12.541 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:50:43.403 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:50:43.440 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:51:14.467 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:51:14.487 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:51:44.771 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:51:44.780 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:52:15.155 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:52:15.180 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:52:45.467 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:52:45.471 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:53:15.871 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:53:15.874 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:53:46.173 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:53:46.184 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:53:46.540 INFO:tasks.ceph.osd.6.smithi161.stderr:2023-09-13T09:53:46.540+0000 7f1a51b0f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118310) UID: 0 2023-09-13T09:53:46.541 INFO:tasks.ceph.osd.4.smithi161.stderr:2023-09-13T09:53:46.540+0000 7f74b53b3700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118310) UID: 0 2023-09-13T09:53:46.541 INFO:tasks.ceph.osd.5.smithi161.stderr:2023-09-13T09:53:46.540+0000 7ffb9d22b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118310) UID: 0 2023-09-13T09:53:46.542 INFO:tasks.ceph.osd.7.smithi161.stderr:2023-09-13T09:53:46.542+0000 7f01a431f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118310) UID: 0 2023-09-13T09:58:38.826 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:58:38.830 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T09:58:38.908 INFO:tasks.ceph.osd.0.smithi084.stderr:2023-09-13T09:58:38.907+0000 7f41ea673700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 632567) UID: 0 2023-09-13T09:58:38.909 INFO:tasks.ceph.osd.1.smithi084.stderr:2023-09-13T09:58:38.909+0000 7f7780105700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 632567) UID: 0 2023-09-13T09:58:38.913 INFO:tasks.ceph.osd.2.smithi084.stderr:2023-09-13T09:58:38.913+0000 7f459a7f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 632567) UID: 0 2023-09-13T09:58:38.914 INFO:tasks.ceph.osd.3.smithi084.stderr:2023-09-13T09:58:38.909+0000 7f2433cf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 632567) UID: 0 2023-09-13T10:02:39.581 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T10:02:39.585 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T10:03:10.495 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T10:03:10.514 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T10:03:42.073 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T10:03:42.160 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T10:03:42.427 INFO:tasks.ceph.osd.6.smithi161.stderr:2023-09-13T10:03:42.426+0000 7f1a51b0f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118785) UID: 0 2023-09-13T10:03:42.427 INFO:tasks.ceph.osd.5.smithi161.stderr:2023-09-13T10:03:42.426+0000 7ffb9d22b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118785) UID: 0 2023-09-13T10:03:42.428 INFO:tasks.ceph.osd.7.smithi161.stderr:2023-09-13T10:03:42.426+0000 7f01a431f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118785) UID: 0 2023-09-13T10:03:42.433 INFO:tasks.ceph.osd.4.smithi161.stderr:2023-09-13T10:03:42.432+0000 7f74b53b3700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118785) UID: 0 2023-09-13T10:08:34.932 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T10:08:34.939 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T10:08:35.011 INFO:tasks.ceph.osd.3.smithi084.stderr:2023-09-13T10:08:35.010+0000 7f2433cf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 632788) UID: 0 2023-09-13T10:08:35.012 INFO:tasks.ceph.osd.2.smithi084.stderr:2023-09-13T10:08:35.007+0000 7f459a7f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 632788) UID: 0 2023-09-13T10:08:35.013 INFO:tasks.ceph.osd.1.smithi084.stderr:2023-09-13T10:08:35.009+0000 7f7780105700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 632788) UID: 0 2023-09-13T10:08:35.014 INFO:tasks.ceph.osd.0.smithi084.stderr:2023-09-13T10:08:35.005+0000 7f41ea673700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 632788) UID: 0 2023-09-13T10:08:35.014 INFO:tasks.ceph.mds.d.smithi161.stderr:2023-09-13T10:08:35.013+0000 7f3b9b143700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 118856) UID: 0 2023-09-13T10:08:35.015 INFO:tasks.ceph.mds.b.smithi161.stderr:2023-09-13T10:08:35.013+0000 7f40246c1700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 118856) UID: 0 2023-09-13T10:13:35.391 INFO:tasks.ceph.osd.6.smithi161.stderr:2023-09-13T10:13:35.389+0000 7f1a51b0f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118914) UID: 0 2023-09-13T10:13:35.393 INFO:tasks.ceph.osd.5.smithi161.stderr:2023-09-13T10:13:35.393+0000 7ffb9d22b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118914) UID: 0 2023-09-13T10:13:35.394 INFO:tasks.ceph.osd.7.smithi161.stderr:2023-09-13T10:13:35.389+0000 7f01a431f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118914) UID: 0 2023-09-13T10:13:35.397 INFO:tasks.ceph.osd.4.smithi161.stderr:2023-09-13T10:13:35.391+0000 7f74b53b3700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118914) UID: 0 2023-09-13T10:23:54.581 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T10:23:54.609 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T10:23:54.968 INFO:tasks.ceph.osd.0.smithi084.stderr:2023-09-13T10:23:54.957+0000 7f41ea673700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 632981) UID: 0 2023-09-13T10:23:54.969 INFO:tasks.ceph.osd.2.smithi084.stderr:2023-09-13T10:23:54.966+0000 7f459a7f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 632981) UID: 0 2023-09-13T10:23:54.969 INFO:tasks.ceph.osd.1.smithi084.stderr:2023-09-13T10:23:54.959+0000 7f7780105700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 632981) UID: 0 2023-09-13T10:23:54.970 INFO:tasks.ceph.osd.3.smithi084.stderr:2023-09-13T10:23:54.968+0000 7f2433cf8700 -1 received signal: Hangup from (PID: 632981) UID: 0 2023-09-13T10:23:55.532 INFO:tasks.ceph.mds.d.smithi161.stderr:2023-09-13T10:23:55.531+0000 7f3b9b143700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 119053) UID: 0 2023-09-13T10:23:55.532 INFO:tasks.ceph.mds.b.smithi161.stderr:2023-09-13T10:23:55.531+0000 7f40246c1700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 119053) UID: 0 2023-09-13T10:28:21.179 INFO:tasks.ceph.osd.4.smithi161.stderr:2023-09-13T10:28:21.178+0000 7f74b53b3700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119105) UID: 0 2023-09-13T10:28:21.200 INFO:tasks.ceph.osd.6.smithi161.stderr:2023-09-13T10:28:21.178+0000 7f1a51b0f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119105) UID: 0 2023-09-13T10:28:21.201 INFO:tasks.ceph.osd.5.smithi161.stderr:2023-09-13T10:28:21.178+0000 7ffb9d22b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119105) UID: 0 2023-09-13T10:28:21.201 INFO:tasks.ceph.osd.7.smithi161.stderr:2023-09-13T10:28:21.178+0000 7f01a431f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119105) UID: 0 2023-09-13T10:33:52.212 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T10:33:52.215 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T10:33:52.444 INFO:tasks.ceph.osd.0.smithi084.stderr:2023-09-13T10:33:52.443+0000 7f41ea673700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 633118) UID: 0 2023-09-13T10:33:52.445 INFO:tasks.ceph.osd.3.smithi084.stderr:2023-09-13T10:33:52.444+0000 7f2433cf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 633118) UID: 0 2023-09-13T10:33:52.445 INFO:tasks.ceph.osd.1.smithi084.stderr:2023-09-13T10:33:52.444+0000 7f7780105700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 633118) UID: 0 2023-09-13T10:33:52.446 INFO:tasks.ceph.osd.2.smithi084.stderr:2023-09-13T10:33:52.444+0000 7f459a7f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 633118) UID: 0 2023-09-13T10:38:01.109 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T10:38:01.163 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T10:38:01.317 INFO:tasks.ceph.mds.b.smithi161.stderr:2023-09-13T10:38:01.316+0000 7f40246c1700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 119249) UID: 0 2023-09-13T10:38:01.317 INFO:tasks.ceph.mds.d.smithi161.stderr:2023-09-13T10:38:01.316+0000 7f3b9b143700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 119249) UID: 0 2023-09-13T10:42:17.399 INFO:tasks.ceph.osd.4.smithi161.stderr:2023-09-13T10:42:17.399+0000 7f74b53b3700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119303) UID: 0 2023-09-13T10:42:17.400 INFO:tasks.ceph.osd.6.smithi161.stderr:2023-09-13T10:42:17.399+0000 7f1a51b0f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119303) UID: 0 2023-09-13T10:42:17.401 INFO:tasks.ceph.osd.5.smithi161.stderr:2023-09-13T10:42:17.399+0000 7ffb9d22b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119303) UID: 0 2023-09-13T10:42:17.401 INFO:tasks.ceph.osd.7.smithi161.stderr:2023-09-13T10:42:17.399+0000 7f01a431f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119303) UID: 0 2023-09-13T10:50:47.199 INFO:teuthology.orchestra.run.smithi084.stdout:generic/476 3643s 2023-09-13T10:50:47.225 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/476 2023-09-13T10:50:47.225 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T10:50:47.225 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T10:50:47.232 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T10:50:47.309 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/477) 2023-09-13T10:51:01.850 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T10:51:01.854 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T10:51:01.854 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T10:51:01.855 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T10:51:01.856 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T10:51:50.479 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T10:51:50.482 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T10:51:50.550 INFO:tasks.ceph.osd.3.smithi084.stderr:2023-09-13T10:51:50.549+0000 7f2433cf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 633858) UID: 0 2023-09-13T10:51:50.550 INFO:tasks.ceph.osd.2.smithi084.stderr:2023-09-13T10:51:50.549+0000 7f459a7f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 633858) UID: 0 2023-09-13T10:51:50.551 INFO:tasks.ceph.osd.1.smithi084.stderr:2023-09-13T10:51:50.549+0000 7f7780105700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 633858) UID: 0 2023-09-13T10:51:50.551 INFO:tasks.ceph.osd.0.smithi084.stderr:2023-09-13T10:51:50.549+0000 7f41ea673700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 633858) UID: 0 2023-09-13T10:51:50.636 INFO:tasks.ceph.mds.b.smithi161.stderr:2023-09-13T10:51:50.635+0000 7f40246c1700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 119428) UID: 0 2023-09-13T10:51:50.637 INFO:tasks.ceph.mds.d.smithi161.stderr:2023-09-13T10:51:50.635+0000 7f3b9b143700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 119428) UID: 0 2023-09-13T10:55:43.348 INFO:tasks.ceph.osd.4.smithi161.stderr:2023-09-13T10:55:43.347+0000 7f74b53b3700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119463) UID: 0 2023-09-13T10:55:43.349 INFO:tasks.ceph.osd.6.smithi161.stderr:2023-09-13T10:55:43.347+0000 7f1a51b0f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119463) UID: 0 2023-09-13T10:55:43.352 INFO:tasks.ceph.osd.7.smithi161.stderr:2023-09-13T10:55:43.350+0000 7f01a431f700 -1 received signal: Hangup from (PID: 119463) UID: 0 2023-09-13T10:55:43.354 INFO:tasks.ceph.osd.5.smithi161.stderr:2023-09-13T10:55:43.354+0000 7ffb9d22b700 -1 Fail to open '/proc/119463/cmdline' error = (2) No such file or directory 2023-09-13T10:55:43.355 INFO:tasks.ceph.osd.5.smithi161.stderr:2023-09-13T10:55:43.354+0000 7ffb9d22b700 -1 received signal: Hangup from (PID: 119463) UID: 0 2023-09-13T10:59:44.889 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T10:59:44.912 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T10:59:44.980 INFO:tasks.ceph.osd.1.smithi084.stderr:2023-09-13T10:59:44.979+0000 7f7780105700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 633950) UID: 0 2023-09-13T10:59:44.980 INFO:tasks.ceph.osd.2.smithi084.stderr:2023-09-13T10:59:44.979+0000 7f459a7f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 633950) UID: 0 2023-09-13T10:59:44.981 INFO:tasks.ceph.osd.0.smithi084.stderr:2023-09-13T10:59:44.978+0000 7f41ea673700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 633950) UID: 0 2023-09-13T10:59:44.981 INFO:tasks.ceph.osd.3.smithi084.stderr:2023-09-13T10:59:44.979+0000 7f2433cf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 633950) UID: 0 2023-09-13T10:59:45.044 INFO:tasks.ceph.mds.b.smithi161.stderr:2023-09-13T10:59:45.043+0000 7f40246c1700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 119523) UID: 0 2023-09-13T10:59:45.045 INFO:tasks.ceph.mds.d.smithi161.stderr:2023-09-13T10:59:45.043+0000 7f3b9b143700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 119523) UID: 0 2023-09-13T11:01:37.421 INFO:teuthology.orchestra.run.smithi084.stdout:generic/477 33s 2023-09-13T11:01:37.765 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/477 2023-09-13T11:01:37.766 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T11:01:37.768 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T11:01:38.035 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T11:01:38.036 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/478) 2023-09-13T11:01:41.144 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T11:01:41.149 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T11:01:41.150 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T11:01:41.150 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T11:01:41.151 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T11:01:52.672 INFO:teuthology.orchestra.run.smithi084.stdout:generic/478 11s 2023-09-13T11:01:52.680 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/478 2023-09-13T11:01:52.680 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T11:01:52.682 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T11:01:52.736 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T11:01:52.737 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/479) 2023-09-13T11:01:53.225 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T11:01:53.233 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T11:01:53.233 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T11:01:53.234 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T11:01:53.235 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T11:01:54.063 INFO:teuthology.orchestra.run.smithi084.stdout:generic/479 [not run] require 172.21.15.84:6789:/scratch to be valid block disk 2023-09-13T11:01:54.071 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/479 2023-09-13T11:01:54.071 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/479 2023-09-13T11:01:54.071 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T11:01:54.074 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T11:01:54.125 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T11:01:54.126 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/480) 2023-09-13T11:01:54.486 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T11:01:54.497 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T11:01:54.497 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T11:01:54.498 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T11:01:54.498 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T11:01:55.122 INFO:teuthology.orchestra.run.smithi084.stdout:generic/480 [not run] require 172.21.15.84:6789:/scratch to be valid block disk 2023-09-13T11:01:55.127 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/480 2023-09-13T11:01:55.127 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/480 2023-09-13T11:01:55.127 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T11:01:55.131 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T11:01:55.192 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T11:01:55.193 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/481) 2023-09-13T11:01:55.595 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T11:01:55.605 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T11:01:55.608 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T11:01:55.609 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T11:01:55.610 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T11:01:56.166 INFO:teuthology.orchestra.run.smithi084.stdout:generic/481 [not run] require 172.21.15.84:6789:/scratch to be valid block disk 2023-09-13T11:01:56.171 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/481 2023-09-13T11:01:56.171 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/481 2023-09-13T11:01:56.172 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T11:01:56.177 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T11:01:56.213 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T11:01:56.214 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/482) 2023-09-13T11:01:56.602 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T11:01:56.615 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T11:01:56.621 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T11:01:56.624 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T11:01:56.625 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T11:01:57.359 INFO:teuthology.orchestra.run.smithi084.stdout:generic/482 [not run] This test requires a valid $LOGWRITES_DEV 2023-09-13T11:01:57.364 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/482 2023-09-13T11:01:57.364 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/482 2023-09-13T11:01:57.365 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T11:01:57.366 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T11:01:57.405 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T11:01:57.406 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/483) 2023-09-13T11:01:57.794 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T11:01:57.802 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T11:01:57.805 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T11:01:57.806 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T11:01:57.806 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T11:01:58.337 INFO:teuthology.orchestra.run.smithi084.stdout:generic/483 [not run] require 172.21.15.84:6789:/scratch to be valid block disk 2023-09-13T11:01:58.341 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/483 2023-09-13T11:01:58.342 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/483 2023-09-13T11:01:58.342 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T11:01:58.344 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T11:01:58.378 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T11:01:58.379 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/484) 2023-09-13T11:01:58.804 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T11:01:58.814 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T11:01:58.815 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T11:01:58.816 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T11:01:58.816 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T11:01:59.415 INFO:teuthology.orchestra.run.smithi084.stdout:generic/484 [not run] require 172.21.15.84:6789:/scratch to be valid block disk 2023-09-13T11:01:59.420 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/484 2023-09-13T11:01:59.420 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/484 2023-09-13T11:01:59.420 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T11:01:59.423 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T11:01:59.459 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T11:01:59.459 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/485) 2023-09-13T11:01:59.848 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T11:01:59.852 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T11:01:59.853 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T11:01:59.854 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T11:01:59.854 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T11:02:00.454 INFO:teuthology.orchestra.run.smithi084.stdout:generic/485 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-09-13T11:02:00.466 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/485 2023-09-13T11:02:00.466 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/485 2023-09-13T11:02:00.466 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T11:02:00.472 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T11:02:00.518 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T11:02:00.519 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/486) 2023-09-13T11:02:00.912 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T11:02:00.919 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T11:02:00.920 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T11:02:00.921 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T11:02:00.921 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T11:02:02.102 INFO:teuthology.orchestra.run.smithi084.stdout:generic/486 0s 2023-09-13T11:02:02.126 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/486 2023-09-13T11:02:02.127 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T11:02:02.131 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T11:02:02.145 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T11:02:02.145 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/487) 2023-09-13T11:02:02.559 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T11:02:02.564 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T11:02:02.564 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T11:02:02.565 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T11:02:02.565 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T11:02:03.191 INFO:teuthology.orchestra.run.smithi084.stdout:generic/487 [not run] This test requires a valid $SCRATCH_LOGDEV 2023-09-13T11:02:03.199 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/487 2023-09-13T11:02:03.199 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/487 2023-09-13T11:02:03.200 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T11:02:03.201 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T11:02:03.250 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T11:02:03.251 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/488) 2023-09-13T11:02:03.650 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T11:02:03.654 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T11:02:03.655 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T11:02:03.656 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T11:02:03.656 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T11:02:04.264 INFO:teuthology.orchestra.run.smithi084.stdout:generic/488 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-09-13T11:02:04.271 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/488 2023-09-13T11:02:04.272 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/488 2023-09-13T11:02:04.272 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T11:02:04.274 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T11:02:04.312 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T11:02:04.313 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/489) 2023-09-13T11:02:04.664 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T11:02:04.670 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T11:02:04.670 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T11:02:04.671 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T11:02:04.671 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T11:02:05.239 INFO:teuthology.orchestra.run.smithi084.stdout:generic/489 [not run] require 172.21.15.84:6789:/scratch to be valid block disk 2023-09-13T11:02:05.251 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/489 2023-09-13T11:02:05.251 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/489 2023-09-13T11:02:05.252 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T11:02:05.254 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T11:02:05.313 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T11:02:05.313 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/490) 2023-09-13T11:02:05.731 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T11:02:05.739 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T11:02:05.739 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T11:02:05.740 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T11:02:05.740 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T11:02:08.695 INFO:teuthology.orchestra.run.smithi084.stdout:generic/490 2s 2023-09-13T11:02:08.699 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/490 2023-09-13T11:02:08.699 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T11:02:08.701 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T11:02:09.080 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T11:02:09.080 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/491) 2023-09-13T11:02:09.552 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T11:02:09.556 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T11:02:09.557 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T11:02:09.558 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T11:02:09.558 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T11:02:10.085 INFO:teuthology.orchestra.run.smithi084.stdout:generic/491 [not run] ceph does not support freezing 2023-09-13T11:02:10.093 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/491 2023-09-13T11:02:10.093 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/491 2023-09-13T11:02:10.093 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T11:02:10.095 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T11:02:10.152 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T11:02:10.152 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/492) 2023-09-13T11:02:10.516 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T11:02:10.525 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T11:02:10.525 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T11:02:10.530 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T11:02:10.531 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T11:02:11.093 INFO:teuthology.orchestra.run.smithi084.stdout:generic/492 [not run] xfs_io label failed (old kernel/wrong fs?) 2023-09-13T11:02:11.105 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/492 2023-09-13T11:02:11.106 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/492 2023-09-13T11:02:11.106 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T11:02:11.108 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T11:02:11.137 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T11:02:11.137 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/493) 2023-09-13T11:02:11.577 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T11:02:11.587 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T11:02:11.588 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T11:02:11.590 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T11:02:11.590 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T11:02:12.657 INFO:teuthology.orchestra.run.smithi084.stdout:generic/493 [not run] swapfiles are not supported 2023-09-13T11:02:12.662 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/493 2023-09-13T11:02:12.662 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/493 2023-09-13T11:02:12.663 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T11:02:12.664 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T11:02:12.719 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T11:02:12.720 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/494) 2023-09-13T11:02:13.104 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T11:02:13.109 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T11:02:13.109 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T11:02:13.111 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T11:02:13.111 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T11:02:14.013 INFO:teuthology.orchestra.run.smithi084.stdout:generic/494 [not run] swapfiles are not supported 2023-09-13T11:02:14.023 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/494 2023-09-13T11:02:14.024 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/494 2023-09-13T11:02:14.024 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T11:02:14.025 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T11:02:14.063 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T11:02:14.064 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/495) 2023-09-13T11:02:14.472 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T11:02:14.477 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T11:02:14.478 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T11:02:14.479 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T11:02:14.479 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T11:02:15.477 INFO:teuthology.orchestra.run.smithi084.stdout:generic/495 [not run] swapfiles are not supported 2023-09-13T11:02:15.482 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/495 2023-09-13T11:02:15.482 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/495 2023-09-13T11:02:15.483 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T11:02:15.485 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T11:02:15.540 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T11:02:15.541 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/496) 2023-09-13T11:02:15.909 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T11:02:15.916 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T11:02:15.917 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T11:02:15.918 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T11:02:15.918 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T11:02:16.907 INFO:teuthology.orchestra.run.smithi084.stdout:generic/496 [not run] swapfiles are not supported 2023-09-13T11:02:16.911 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/496 2023-09-13T11:02:16.912 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/496 2023-09-13T11:02:16.912 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T11:02:16.916 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T11:02:16.964 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T11:02:16.964 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/497) 2023-09-13T11:02:17.363 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T11:02:17.367 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T11:02:17.368 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T11:02:17.369 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T11:02:17.370 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T11:02:18.306 INFO:teuthology.orchestra.run.smithi084.stdout:generic/497 [not run] swapfiles are not supported 2023-09-13T11:02:18.310 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/497 2023-09-13T11:02:18.310 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/497 2023-09-13T11:02:18.311 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T11:02:18.324 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T11:02:18.372 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T11:02:18.373 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/498) 2023-09-13T11:02:18.792 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T11:02:18.814 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T11:02:18.815 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T11:02:18.816 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T11:02:18.816 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T11:02:19.421 INFO:teuthology.orchestra.run.smithi084.stdout:generic/498 [not run] require 172.21.15.84:6789:/scratch to be valid block disk 2023-09-13T11:02:19.425 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/498 2023-09-13T11:02:19.425 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/498 2023-09-13T11:02:19.425 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T11:02:19.427 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T11:02:19.485 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T11:02:19.485 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/499) 2023-09-13T11:02:19.856 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T11:02:19.860 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T11:02:19.861 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T11:02:19.862 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T11:02:19.862 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T11:02:20.406 INFO:teuthology.orchestra.run.smithi084.stdout:generic/499 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-09-13T11:02:20.410 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/499 2023-09-13T11:02:20.411 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/499 2023-09-13T11:02:20.411 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T11:02:20.412 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T11:02:20.470 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T11:02:20.471 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/500) 2023-09-13T11:02:20.879 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T11:02:20.884 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T11:02:20.885 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T11:02:20.886 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T11:02:20.886 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T11:02:21.502 INFO:teuthology.orchestra.run.smithi084.stdout:generic/500 [not run] require 172.21.15.84:6789:/scratch to be valid block disk 2023-09-13T11:02:21.507 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/500 2023-09-13T11:02:21.507 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/500 2023-09-13T11:02:21.507 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T11:02:21.509 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T11:02:21.541 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T11:02:21.542 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/501) 2023-09-13T11:02:21.973 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T11:02:21.977 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T11:02:21.978 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T11:02:21.985 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T11:02:21.985 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T11:02:23.289 INFO:teuthology.orchestra.run.smithi084.stdout:generic/501 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T11:02:23.337 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/501 2023-09-13T11:02:23.338 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/501 2023-09-13T11:02:23.338 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T11:02:23.340 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T11:02:23.419 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T11:02:23.420 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/502) 2023-09-13T11:02:23.783 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T11:02:23.787 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T11:02:23.787 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T11:02:23.788 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T11:02:23.789 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T11:02:24.382 INFO:teuthology.orchestra.run.smithi084.stdout:generic/502 [not run] require 172.21.15.84:6789:/scratch to be valid block disk 2023-09-13T11:02:24.386 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/502 2023-09-13T11:02:24.386 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/502 2023-09-13T11:02:24.387 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T11:02:24.389 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T11:02:24.450 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T11:02:24.454 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/503) 2023-09-13T11:02:24.879 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T11:02:24.888 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T11:02:24.890 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T11:02:24.891 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T11:02:24.891 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T11:02:25.467 INFO:teuthology.orchestra.run.smithi084.stdout:generic/503 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-13T11:02:25.475 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/503 2023-09-13T11:02:25.475 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/503 2023-09-13T11:02:25.475 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T11:02:25.477 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T11:02:25.548 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T11:02:25.548 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/504) 2023-09-13T11:02:25.949 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T11:02:25.953 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T11:02:25.953 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T11:02:25.954 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T11:02:25.954 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T11:02:26.564 INFO:teuthology.orchestra.run.smithi084.stdout:generic/504 0s 2023-09-13T11:02:26.576 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/504 2023-09-13T11:02:26.581 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T11:02:26.581 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T11:02:26.641 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T11:02:26.642 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/505) 2023-09-13T11:02:27.008 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T11:02:27.012 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T11:02:27.012 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T11:02:27.014 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T11:02:27.014 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T11:02:27.795 INFO:teuthology.orchestra.run.smithi084.stdout:generic/505 [not run] ceph does not support shutdown 2023-09-13T11:02:27.829 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/505 2023-09-13T11:02:27.829 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/505 2023-09-13T11:02:27.829 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T11:02:27.836 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T11:02:27.873 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T11:02:27.874 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/506) 2023-09-13T11:02:28.262 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T11:02:28.267 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T11:02:28.267 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T11:02:28.269 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T11:02:28.270 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T11:02:28.784 INFO:teuthology.orchestra.run.smithi084.stdout:generic/506 [not run] disk quotas not supported by this filesystem type: ceph 2023-09-13T11:02:28.788 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/506 2023-09-13T11:02:28.789 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/506 2023-09-13T11:02:28.789 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T11:02:28.791 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T11:02:28.824 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T11:02:28.824 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/507) 2023-09-13T11:02:29.183 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T11:02:29.193 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T11:02:29.193 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T11:02:29.194 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T11:02:29.194 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T11:02:29.845 INFO:teuthology.orchestra.run.smithi084.stdout:generic/507 [not run] file system doesn't support chattr +ASai 2023-09-13T11:02:29.850 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/507 2023-09-13T11:02:29.850 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/507 2023-09-13T11:02:29.851 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T11:02:29.856 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T11:02:29.916 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T11:02:29.916 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/508) 2023-09-13T11:02:30.326 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T11:02:30.332 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T11:02:30.333 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T11:02:30.333 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T11:02:30.334 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T11:02:30.827 INFO:teuthology.orchestra.run.smithi084.stdout:generic/508 [not run] lsattr not supported by test filesystem type: ceph 2023-09-13T11:02:30.832 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/508 2023-09-13T11:02:30.832 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/508 2023-09-13T11:02:30.832 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T11:02:30.842 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T11:02:30.875 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T11:02:30.875 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/509) 2023-09-13T11:02:31.274 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T11:02:31.286 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T11:02:31.289 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T11:02:31.290 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T11:02:31.290 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T11:02:31.857 INFO:teuthology.orchestra.run.smithi084.stdout:generic/509 [not run] O_TMPFILE is not supported 2023-09-13T11:02:31.865 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/509 2023-09-13T11:02:31.865 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/509 2023-09-13T11:02:31.865 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T11:02:31.867 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T11:02:31.912 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T11:02:31.913 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/510) 2023-09-13T11:02:32.362 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T11:02:32.367 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T11:02:32.367 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T11:02:32.368 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T11:02:32.368 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T11:02:32.943 INFO:teuthology.orchestra.run.smithi084.stdout:generic/510 [not run] require 172.21.15.84:6789:/scratch to be valid block disk 2023-09-13T11:02:32.947 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/510 2023-09-13T11:02:32.948 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/510 2023-09-13T11:02:32.948 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T11:02:32.951 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T11:02:32.994 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T11:02:32.995 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/511) 2023-09-13T11:02:33.355 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T11:02:33.361 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T11:02:33.363 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T11:02:33.363 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T11:02:33.364 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T11:02:33.905 INFO:teuthology.orchestra.run.smithi084.stdout:generic/511 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-09-13T11:02:33.909 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/511 2023-09-13T11:02:33.910 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/511 2023-09-13T11:02:33.910 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T11:02:33.922 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T11:02:33.986 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T11:02:33.987 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/512) 2023-09-13T11:02:34.353 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T11:02:34.360 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T11:02:34.361 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T11:02:34.373 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T11:02:34.373 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T11:02:34.969 INFO:teuthology.orchestra.run.smithi084.stdout:generic/512 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-13T11:02:34.973 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/512 2023-09-13T11:02:34.973 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/512 2023-09-13T11:02:34.973 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T11:02:34.976 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T11:02:35.037 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T11:02:35.038 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/513) 2023-09-13T11:02:35.420 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T11:02:35.439 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T11:02:35.439 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T11:02:35.440 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T11:02:35.440 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T11:02:36.671 INFO:teuthology.orchestra.run.smithi084.stdout:generic/513 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T11:02:36.724 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/513 2023-09-13T11:02:36.725 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/513 2023-09-13T11:02:36.725 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T11:02:36.736 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T11:02:36.821 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T11:02:36.822 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/514) 2023-09-13T11:02:37.240 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T11:02:37.255 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T11:02:37.255 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T11:02:37.255 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T11:02:37.255 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T11:02:38.461 INFO:teuthology.orchestra.run.smithi084.stdout:generic/514 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T11:02:38.510 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/514 2023-09-13T11:02:38.510 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/514 2023-09-13T11:02:38.511 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T11:02:38.552 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T11:02:38.653 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T11:02:38.654 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/515) 2023-09-13T11:02:39.027 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T11:02:39.031 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T11:02:39.032 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T11:02:39.033 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T11:02:39.033 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T11:02:40.125 INFO:teuthology.orchestra.run.smithi084.stdout:generic/515 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T11:02:40.225 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/515 2023-09-13T11:02:40.225 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/515 2023-09-13T11:02:40.225 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T11:02:40.318 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T11:02:40.384 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T11:02:40.385 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/516) 2023-09-13T11:02:40.833 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T11:02:40.839 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T11:02:40.839 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T11:02:40.840 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T11:02:40.840 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T11:02:41.529 INFO:teuthology.orchestra.run.smithi084.stdout:generic/516 [not run] Dedupe not supported by test filesystem type: ceph 2023-09-13T11:02:41.533 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/516 2023-09-13T11:02:41.534 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/516 2023-09-13T11:02:41.534 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T11:02:41.536 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T11:02:41.968 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T11:02:41.969 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/517) 2023-09-13T11:02:42.414 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T11:02:42.438 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T11:02:42.439 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T11:02:42.445 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T11:02:42.445 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T11:02:43.334 INFO:teuthology.orchestra.run.smithi084.stdout:generic/517 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-09-13T11:02:43.687 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/517 2023-09-13T11:02:43.687 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/517 2023-09-13T11:02:43.687 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T11:02:43.769 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T11:02:43.854 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T11:02:43.854 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/518) 2023-09-13T11:02:44.214 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T11:02:44.219 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T11:02:44.219 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T11:02:44.220 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T11:02:44.220 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T11:02:45.450 INFO:tasks.ceph.osd.6.smithi161.stderr:2023-09-13T11:02:45.450+0000 7f1a51b0f700 -1 Fail to open '/proc/119565/cmdline' error = (2) No such file or directory 2023-09-13T11:02:45.451 INFO:tasks.ceph.osd.6.smithi161.stderr:2023-09-13T11:02:45.450+0000 7f1a51b0f700 -1 received signal: Hangup from (PID: 119565) UID: 0 2023-09-13T11:02:45.452 INFO:tasks.ceph.osd.4.smithi161.stderr:2023-09-13T11:02:45.449+0000 7f74b53b3700 -1 received signal: Hangup from (PID: 119565) UID: 0 2023-09-13T11:02:45.452 INFO:tasks.ceph.osd.7.smithi161.stderr:2023-09-13T11:02:45.450+0000 7f01a431f700 -1 Fail to open '/proc/119565/cmdline' error = (2) No such file or directory 2023-09-13T11:02:45.454 INFO:tasks.ceph.osd.7.smithi161.stderr:2023-09-13T11:02:45.450+0000 7f01a431f700 -1 received signal: Hangup from (PID: 119565) UID: 0 2023-09-13T11:02:45.455 INFO:tasks.ceph.osd.5.smithi161.stderr:2023-09-13T11:02:45.451+0000 7ffb9d22b700 -1 Fail to open '/proc/119565/cmdline' error = (2) No such file or directory 2023-09-13T11:02:45.455 INFO:tasks.ceph.osd.5.smithi161.stderr:2023-09-13T11:02:45.451+0000 7ffb9d22b700 -1 received signal: Hangup from (PID: 119565) UID: 0 2023-09-13T11:02:45.456 INFO:teuthology.orchestra.run.smithi084.stdout:generic/518 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T11:02:45.476 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/518 2023-09-13T11:02:45.476 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/518 2023-09-13T11:02:45.476 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T11:02:45.505 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T11:02:45.599 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T11:02:45.600 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/519) 2023-09-13T11:02:45.986 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T11:02:45.990 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T11:02:45.991 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T11:02:45.991 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T11:02:45.992 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T11:02:46.702 INFO:teuthology.orchestra.run.smithi084.stdout:generic/519 [not run] FIBMAP not supported by this filesystem 2023-09-13T11:02:46.707 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/519 2023-09-13T11:02:46.707 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/519 2023-09-13T11:02:46.707 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T11:02:46.709 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T11:02:47.026 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T11:02:47.027 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/520) 2023-09-13T11:02:47.576 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T11:02:47.584 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T11:02:47.586 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T11:02:47.587 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T11:02:47.588 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T11:02:48.273 INFO:teuthology.orchestra.run.smithi084.stdout:generic/520 [not run] require 172.21.15.84:6789:/scratch to be valid block disk 2023-09-13T11:02:48.279 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/520 2023-09-13T11:02:48.280 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/520 2023-09-13T11:02:48.280 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T11:02:48.281 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T11:02:48.323 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T11:02:48.323 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/521) 2023-09-13T11:02:48.768 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T11:02:48.772 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T11:02:48.773 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T11:02:48.780 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T11:02:48.780 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T11:06:17.651 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T11:06:17.654 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T11:06:17.782 INFO:tasks.ceph.osd.0.smithi084.stderr:2023-09-13T11:06:17.781+0000 7f41ea673700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 656448) UID: 0 2023-09-13T11:06:17.783 INFO:tasks.ceph.osd.3.smithi084.stderr:2023-09-13T11:06:17.781+0000 7f2433cf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 656448) UID: 0 2023-09-13T11:06:17.783 INFO:tasks.ceph.osd.2.smithi084.stderr:2023-09-13T11:06:17.781+0000 7f459a7f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 656448) UID: 0 2023-09-13T11:06:17.784 INFO:tasks.ceph.osd.1.smithi084.stderr:2023-09-13T11:06:17.781+0000 7f7780105700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 656448) UID: 0 2023-09-13T11:09:51.094 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T11:09:51.097 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T11:10:21.224 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T11:10:21.227 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T11:10:51.307 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T11:10:51.313 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T11:11:21.612 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T11:11:21.615 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T11:11:51.717 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T11:11:51.720 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T11:11:51.772 INFO:tasks.ceph.osd.2.smithi084.stderr:2023-09-13T11:11:51.771+0000 7f459a7f9700 -1 Fail to open '/proc/656603/cmdline' error = (2) No such file or directory 2023-09-13T11:11:51.773 INFO:tasks.ceph.osd.2.smithi084.stderr:2023-09-13T11:11:51.771+0000 7f459a7f9700 -1 received signal: Hangup from (PID: 656603) UID: 0 2023-09-13T11:11:51.773 INFO:tasks.ceph.osd.3.smithi084.stderr:2023-09-13T11:11:51.771+0000 7f2433cf8700 -1 received signal: Hangup from (PID: 656603) UID: 0 2023-09-13T11:11:51.774 INFO:tasks.ceph.osd.0.smithi084.stderr:2023-09-13T11:11:51.771+0000 7f41ea673700 -1 received signal: Hangup from (PID: 656603) UID: 0 2023-09-13T11:11:51.774 INFO:tasks.ceph.osd.1.smithi084.stderr:2023-09-13T11:11:51.771+0000 7f7780105700 -1 received signal: Hangup from (PID: 656603) UID: 0 2023-09-13T11:15:07.859 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T11:15:07.895 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T11:15:07.962 INFO:tasks.ceph.osd.4.smithi161.stderr:2023-09-13T11:15:07.961+0000 7f74b53b3700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119825) UID: 0 2023-09-13T11:15:07.963 INFO:tasks.ceph.osd.5.smithi161.stderr:2023-09-13T11:15:07.961+0000 7ffb9d22b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119825) UID: 0 2023-09-13T11:15:07.963 INFO:tasks.ceph.osd.6.smithi161.stderr:2023-09-13T11:15:07.961+0000 7f1a51b0f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119825) UID: 0 2023-09-13T11:15:07.964 INFO:tasks.ceph.osd.7.smithi161.stderr:2023-09-13T11:15:07.961+0000 7f01a431f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119825) UID: 0 2023-09-13T11:18:35.925 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T11:18:35.928 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T11:19:06.120 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T11:19:06.123 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T11:19:36.613 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T11:19:36.616 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T11:20:06.753 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T11:20:06.756 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T11:20:36.834 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T11:20:36.837 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T11:21:06.931 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T11:21:06.935 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T11:21:37.012 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T11:21:37.016 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T11:22:07.111 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T11:22:07.114 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T11:22:37.591 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T11:22:37.594 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T11:23:07.913 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T11:23:07.917 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T11:23:38.212 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T11:23:38.214 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T11:24:08.326 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T11:24:08.330 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T11:24:38.404 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T11:24:38.409 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T11:25:08.506 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T11:25:08.509 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T11:25:08.647 INFO:tasks.ceph.osd.6.smithi161.stderr:2023-09-13T11:25:08.646+0000 7f1a51b0f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 120215) UID: 0 2023-09-13T11:25:08.648 INFO:tasks.ceph.osd.5.smithi161.stderr:2023-09-13T11:25:08.647+0000 7ffb9d22b700 -1 Fail to open '/proc/120215/cmdline' error = (2) No such file or directory 2023-09-13T11:25:08.648 INFO:tasks.ceph.osd.5.smithi161.stderr:2023-09-13T11:25:08.647+0000 7ffb9d22b700 -1 received signal: Hangup from (PID: 120215) UID: 0 2023-09-13T11:25:08.648 INFO:tasks.ceph.osd.7.smithi161.stderr:2023-09-13T11:25:08.646+0000 7f01a431f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 120215) UID: 0 2023-09-13T11:25:08.649 INFO:tasks.ceph.osd.4.smithi161.stderr:2023-09-13T11:25:08.646+0000 7f74b53b3700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 120215) UID: 0 2023-09-13T11:31:26.519 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T11:31:26.524 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T11:31:26.800 INFO:tasks.ceph.osd.0.smithi084.stderr:2023-09-13T11:31:26.799+0000 7f41ea673700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 657124) UID: 0 2023-09-13T11:31:26.801 INFO:tasks.ceph.osd.3.smithi084.stderr:2023-09-13T11:31:26.799+0000 7f2433cf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 657124) UID: 0 2023-09-13T11:31:26.801 INFO:tasks.ceph.osd.1.smithi084.stderr:2023-09-13T11:31:26.799+0000 7f7780105700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 657124) UID: 0 2023-09-13T11:31:26.802 INFO:tasks.ceph.osd.2.smithi084.stderr:2023-09-13T11:31:26.800+0000 7f459a7f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 657124) UID: 0 2023-09-13T11:34:51.928 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T11:34:51.931 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T11:34:52.063 INFO:tasks.ceph.osd.2.smithi084.stderr:2023-09-13T11:34:52.062+0000 7f459a7f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 657174) UID: 0 2023-09-13T11:34:52.063 INFO:tasks.ceph.osd.1.smithi084.stderr:2023-09-13T11:34:52.062+0000 7f7780105700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 657174) UID: 0 2023-09-13T11:34:52.064 INFO:tasks.ceph.osd.0.smithi084.stderr:2023-09-13T11:34:52.063+0000 7f41ea673700 -1 received signal: Hangup from (PID: 657174) UID: 0 2023-09-13T11:34:52.064 INFO:tasks.ceph.osd.3.smithi084.stderr:2023-09-13T11:34:52.063+0000 7f2433cf8700 -1 received signal: Hangup from (PID: 657174) UID: 0 2023-09-13T11:38:01.653 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T11:38:01.659 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T11:38:31.821 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T11:38:31.824 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T11:39:02.023 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T11:39:02.026 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T11:39:02.090 INFO:tasks.ceph.osd.5.smithi161.stderr:2023-09-13T11:39:02.089+0000 7ffb9d22b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 120449) UID: 0 2023-09-13T11:39:02.091 INFO:tasks.ceph.osd.6.smithi161.stderr:2023-09-13T11:39:02.089+0000 7f1a51b0f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 120449) UID: 0 2023-09-13T11:39:02.091 INFO:tasks.ceph.osd.7.smithi161.stderr:2023-09-13T11:39:02.089+0000 7f01a431f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 120449) UID: 0 2023-09-13T11:39:02.092 INFO:tasks.ceph.osd.4.smithi161.stderr:2023-09-13T11:39:02.089+0000 7f74b53b3700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 120449) UID: 0 2023-09-13T11:42:22.871 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T11:42:22.875 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T11:42:52.979 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T11:42:52.982 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T11:43:23.480 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T11:43:23.483 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T11:43:53.864 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T11:43:53.867 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T11:44:24.206 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T11:44:24.209 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T11:44:54.624 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T11:44:54.631 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T11:45:24.714 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T11:45:24.718 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T11:45:54.817 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T11:45:54.820 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T11:46:25.056 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T11:46:25.059 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T11:46:55.205 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T11:46:55.208 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T11:46:55.268 INFO:tasks.ceph.osd.4.smithi161.stderr:2023-09-13T11:46:55.267+0000 7f74b53b3700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 120734) UID: 0 2023-09-13T11:46:55.268 INFO:tasks.ceph.osd.5.smithi161.stderr:2023-09-13T11:46:55.267+0000 7ffb9d22b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 120734) UID: 0 2023-09-13T11:46:55.270 INFO:tasks.ceph.osd.6.smithi161.stderr:2023-09-13T11:46:55.267+0000 7f1a51b0f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 120734) UID: 0 2023-09-13T11:46:55.271 INFO:tasks.ceph.osd.7.smithi161.stderr:2023-09-13T11:46:55.267+0000 7f01a431f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 120734) UID: 0 2023-09-13T11:50:15.499 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T11:50:15.502 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T11:50:45.611 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T11:50:45.614 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T11:51:15.738 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T11:51:15.741 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T11:51:15.810 INFO:tasks.ceph.osd.1.smithi084.stderr:2023-09-13T11:51:15.809+0000 7f7780105700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 657656) UID: 0 2023-09-13T11:51:15.811 INFO:tasks.ceph.osd.0.smithi084.stderr:2023-09-13T11:51:15.809+0000 7f41ea673700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 657656) UID: 0 2023-09-13T11:51:15.811 INFO:tasks.ceph.osd.3.smithi084.stderr:2023-09-13T11:51:15.809+0000 7f2433cf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 657656) UID: 0 2023-09-13T11:51:15.812 INFO:tasks.ceph.osd.2.smithi084.stderr:2023-09-13T11:51:15.810+0000 7f459a7f9700 -1 Fail to open '/proc/657656/cmdline' error = (2) No such file or directory 2023-09-13T11:51:15.812 INFO:tasks.ceph.osd.2.smithi084.stderr:2023-09-13T11:51:15.810+0000 7f459a7f9700 -1 received signal: Hangup from (PID: 657656) UID: 0 2023-09-13T11:54:28.183 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T11:54:28.187 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T11:54:28.251 INFO:tasks.ceph.osd.4.smithi161.stderr:2023-09-13T11:54:28.249+0000 7f74b53b3700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 120894) UID: 0 2023-09-13T11:54:28.251 INFO:tasks.ceph.osd.5.smithi161.stderr:2023-09-13T11:54:28.249+0000 7ffb9d22b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 120894) UID: 0 2023-09-13T11:54:28.252 INFO:tasks.ceph.osd.7.smithi161.stderr:2023-09-13T11:54:28.249+0000 7f01a431f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 120894) UID: 0 2023-09-13T11:54:28.252 INFO:tasks.ceph.osd.6.smithi161.stderr:2023-09-13T11:54:28.249+0000 7f1a51b0f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 120894) UID: 0 2023-09-13T11:58:12.489 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T11:58:12.495 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T11:58:12.754 INFO:tasks.ceph.osd.1.smithi084.stderr:2023-09-13T11:58:12.753+0000 7f7780105700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 657760) UID: 0 2023-09-13T11:58:12.754 INFO:tasks.ceph.osd.0.smithi084.stderr:2023-09-13T11:58:12.753+0000 7f41ea673700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 657760) UID: 0 2023-09-13T11:58:12.755 INFO:tasks.ceph.osd.2.smithi084.stderr:2023-09-13T11:58:12.753+0000 7f459a7f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 657760) UID: 0 2023-09-13T11:58:12.755 INFO:tasks.ceph.osd.3.smithi084.stderr:2023-09-13T11:58:12.753+0000 7f2433cf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 657760) UID: 0 2023-09-13T12:01:34.646 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T12:01:34.649 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T12:02:05.008 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T12:02:05.012 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T12:02:35.367 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T12:02:35.373 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T12:03:05.469 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T12:03:05.472 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T12:03:35.601 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T12:03:35.605 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T12:04:05.747 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T12:04:05.750 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T12:04:35.902 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T12:04:35.907 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T12:05:06.256 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T12:05:06.260 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T12:05:36.547 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T12:05:36.550 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T12:06:06.638 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T12:06:06.641 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T12:06:36.733 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T12:06:36.736 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T12:07:07.082 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T12:07:07.085 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T12:07:37.164 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T12:07:37.167 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T12:07:37.248 INFO:tasks.ceph.osd.3.smithi084.stderr:2023-09-13T12:07:37.247+0000 7f2433cf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 658136) UID: 0 2023-09-13T12:07:37.249 INFO:tasks.ceph.osd.0.smithi084.stderr:2023-09-13T12:07:37.247+0000 7f41ea673700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 658136) UID: 0 2023-09-13T12:07:37.249 INFO:tasks.ceph.osd.1.smithi084.stderr:2023-09-13T12:07:37.247+0000 7f7780105700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 658136) UID: 0 2023-09-13T12:07:37.250 INFO:tasks.ceph.osd.2.smithi084.stderr:2023-09-13T12:07:37.248+0000 7f459a7f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 658136) UID: 0 2023-09-13T12:10:54.259 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T12:10:54.262 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T12:10:54.342 INFO:tasks.ceph.osd.3.smithi084.stderr:2023-09-13T12:10:54.341+0000 7f2433cf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 658191) UID: 0 2023-09-13T12:10:54.343 INFO:tasks.ceph.osd.2.smithi084.stderr:2023-09-13T12:10:54.342+0000 7f459a7f9700 -1 received signal: Hangup from (PID: 658191) UID: 0 2023-09-13T12:10:54.344 INFO:tasks.ceph.osd.1.smithi084.stderr:2023-09-13T12:10:54.341+0000 7f7780105700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 658191) UID: 0 2023-09-13T12:10:54.344 INFO:tasks.ceph.osd.0.smithi084.stderr:2023-09-13T12:10:54.341+0000 7f41ea673700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 658191) UID: 0 2023-09-13T12:10:54.454 INFO:tasks.ceph.osd.5.smithi161.stderr:2023-09-13T12:10:54.453+0000 7ffb9d22b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121371) UID: 0 2023-09-13T12:10:54.454 INFO:tasks.ceph.osd.6.smithi161.stderr:2023-09-13T12:10:54.453+0000 7f1a51b0f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121371) UID: 0 2023-09-13T12:10:54.455 INFO:tasks.ceph.osd.4.smithi161.stderr:2023-09-13T12:10:54.453+0000 7f74b53b3700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121371) UID: 0 2023-09-13T12:10:54.455 INFO:tasks.ceph.osd.7.smithi161.stderr:2023-09-13T12:10:54.453+0000 7f01a431f700 -1 Fail to open '/proc/121371/cmdline' error = (2) No such file or directory 2023-09-13T12:10:54.455 INFO:tasks.ceph.osd.7.smithi161.stderr:2023-09-13T12:10:54.453+0000 7f01a431f700 -1 received signal: Hangup from (PID: 121371) UID: 0 2023-09-13T12:14:19.717 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T12:14:19.720 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T12:14:49.871 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T12:14:49.874 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T12:15:19.963 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T12:15:19.966 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T12:15:50.321 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T12:15:50.324 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T12:15:50.384 INFO:tasks.ceph.osd.4.smithi161.stderr:2023-09-13T12:15:50.384+0000 7f74b53b3700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121502) UID: 0 2023-09-13T12:15:50.385 INFO:tasks.ceph.osd.6.smithi161.stderr:2023-09-13T12:15:50.384+0000 7f1a51b0f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121502) UID: 0 2023-09-13T12:15:50.386 INFO:tasks.ceph.osd.5.smithi161.stderr:2023-09-13T12:15:50.385+0000 7ffb9d22b700 -1 Fail to open '/proc/121502/cmdline' error = (2) No such file or directory 2023-09-13T12:15:50.386 INFO:tasks.ceph.osd.5.smithi161.stderr:2023-09-13T12:15:50.385+0000 7ffb9d22b700 -1 received signal: Hangup from (PID: 121502) UID: 0 2023-09-13T12:15:50.386 INFO:tasks.ceph.osd.7.smithi161.stderr:2023-09-13T12:15:50.384+0000 7f01a431f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121502) UID: 0 2023-09-13T12:19:10.176 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T12:19:10.179 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T12:19:10.256 INFO:tasks.ceph.mds.b.smithi161.stderr:2023-09-13T12:19:10.256+0000 7f40246c1700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 121551) UID: 0 2023-09-13T12:19:10.257 INFO:tasks.ceph.mds.d.smithi161.stderr:2023-09-13T12:19:10.256+0000 7f3b9b143700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 121551) UID: 0 2023-09-13T12:21:55.662 INFO:tasks.ceph.osd.6.smithi161.stderr:2023-09-13T12:21:55.660+0000 7f1a51b0f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121585) UID: 0 2023-09-13T12:21:55.663 INFO:tasks.ceph.osd.4.smithi161.stderr:2023-09-13T12:21:55.660+0000 7f74b53b3700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121585) UID: 0 2023-09-13T12:21:55.663 INFO:tasks.ceph.osd.5.smithi161.stderr:2023-09-13T12:21:55.660+0000 7ffb9d22b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121585) UID: 0 2023-09-13T12:21:55.664 INFO:tasks.ceph.osd.7.smithi161.stderr:2023-09-13T12:21:55.663+0000 7f01a431f700 -1 Fail to open '/proc/121585/cmdline' error = (2) No such file or directory 2023-09-13T12:21:55.664 INFO:tasks.ceph.osd.7.smithi161.stderr:2023-09-13T12:21:55.663+0000 7f01a431f700 -1 received signal: Hangup from (PID: 121585) UID: 0 2023-09-13T12:28:40.189 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T12:28:40.192 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T12:29:10.540 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T12:29:10.543 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T12:29:40.676 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T12:29:40.680 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T12:30:11.130 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T12:30:11.134 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T12:30:41.226 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T12:30:41.229 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T12:31:11.516 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T12:31:11.519 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T12:31:41.583 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T12:31:41.588 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T12:32:11.812 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T12:32:11.815 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T12:32:41.907 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T12:32:41.910 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T12:33:12.002 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T12:33:12.006 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T12:33:42.120 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T12:33:42.126 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T12:34:12.233 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T12:34:12.238 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T12:34:42.331 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T12:34:42.335 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T12:35:12.462 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T12:35:12.465 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T12:35:42.567 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T12:35:42.571 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T12:36:12.917 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T12:36:12.921 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T12:36:43.071 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T12:36:43.074 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T12:36:43.124 INFO:tasks.ceph.osd.3.smithi084.stderr:2023-09-13T12:36:43.124+0000 7f2433cf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 658886) UID: 0 2023-09-13T12:36:43.125 INFO:tasks.ceph.osd.0.smithi084.stderr:2023-09-13T12:36:43.124+0000 7f41ea673700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 658886) UID: 0 2023-09-13T12:36:43.125 INFO:tasks.ceph.osd.1.smithi084.stderr:2023-09-13T12:36:43.124+0000 7f7780105700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 658886) UID: 0 2023-09-13T12:36:43.125 INFO:tasks.ceph.osd.2.smithi084.stderr:2023-09-13T12:36:43.124+0000 7f459a7f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 658886) UID: 0 2023-09-13T12:39:57.089 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T12:39:57.095 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T12:40:27.272 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T12:40:27.274 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T12:40:27.316 INFO:tasks.ceph.osd.0.smithi084.stderr:2023-09-13T12:40:27.315+0000 7f41ea673700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 658965) UID: 0 2023-09-13T12:40:27.316 INFO:tasks.ceph.osd.3.smithi084.stderr:2023-09-13T12:40:27.315+0000 7f2433cf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 658965) UID: 0 2023-09-13T12:40:27.317 INFO:tasks.ceph.osd.1.smithi084.stderr:2023-09-13T12:40:27.315+0000 7f7780105700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 658965) UID: 0 2023-09-13T12:40:27.317 INFO:tasks.ceph.osd.2.smithi084.stderr:2023-09-13T12:40:27.316+0000 7f459a7f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 658965) UID: 0 2023-09-13T12:43:39.376 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T12:43:39.379 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T12:44:09.706 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T12:44:09.709 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T12:44:09.752 INFO:tasks.ceph.osd.0.smithi084.stderr:2023-09-13T12:44:09.752+0000 7f41ea673700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 659039) UID: 0 2023-09-13T12:44:09.754 INFO:tasks.ceph.osd.1.smithi084.stderr:2023-09-13T12:44:09.752+0000 7f7780105700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 659039) UID: 0 2023-09-13T12:44:09.755 INFO:tasks.ceph.osd.2.smithi084.stderr:2023-09-13T12:44:09.752+0000 7f459a7f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 659039) UID: 0 2023-09-13T12:44:09.755 INFO:tasks.ceph.osd.3.smithi084.stderr:2023-09-13T12:44:09.752+0000 7f2433cf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 659039) UID: 0 2023-09-13T12:46:18.383 INFO:teuthology.orchestra.run.smithi084.stdout:generic/521 6209s 2023-09-13T12:46:18.559 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/521 2023-09-13T12:46:18.560 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T12:46:18.562 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T12:46:18.755 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T12:46:18.756 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/522) 2023-09-13T12:46:19.686 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T12:46:19.694 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T12:46:19.695 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T12:46:19.696 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T12:46:19.696 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T12:47:28.102 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T12:47:28.105 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T12:47:28.171 INFO:tasks.ceph.osd.0.smithi084.stderr:2023-09-13T12:47:28.170+0000 7f41ea673700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 659586) UID: 0 2023-09-13T12:47:28.171 INFO:tasks.ceph.osd.2.smithi084.stderr:2023-09-13T12:47:28.170+0000 7f459a7f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 659586) UID: 0 2023-09-13T12:47:28.176 INFO:tasks.ceph.osd.1.smithi084.stderr:2023-09-13T12:47:28.170+0000 7f7780105700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 659586) UID: 0 2023-09-13T12:47:28.176 INFO:tasks.ceph.osd.3.smithi084.stderr:2023-09-13T12:47:28.175+0000 7f2433cf8700 -1 Fail to open '/proc/659586/cmdline' error = (2) No such file or directory 2023-09-13T12:47:28.176 INFO:tasks.ceph.osd.3.smithi084.stderr:2023-09-13T12:47:28.175+0000 7f2433cf8700 -1 received signal: Hangup from (PID: 659586) UID: 0 2023-09-13T12:50:00.466 INFO:teuthology.orchestra.run.smithi084.stderr:error: Compressing program wrote following message to stderr when compressing log /var/log/ceph/ceph-osd.3.log.1: 2023-09-13T12:50:00.466 INFO:teuthology.orchestra.run.smithi084.stderr:gzip: stdin: file size changed while zipping 2023-09-13T12:50:32.715 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T12:50:32.725 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T12:50:32.786 INFO:tasks.ceph.osd.4.smithi161.stderr:2023-09-13T12:50:32.785+0000 7f74b53b3700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122333) UID: 0 2023-09-13T12:50:32.786 INFO:tasks.ceph.osd.6.smithi161.stderr:2023-09-13T12:50:32.785+0000 7f1a51b0f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122333) UID: 0 2023-09-13T12:50:32.787 INFO:tasks.ceph.osd.7.smithi161.stderr:2023-09-13T12:50:32.786+0000 7f01a431f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122333) UID: 0 2023-09-13T12:50:32.787 INFO:tasks.ceph.osd.5.smithi161.stderr:2023-09-13T12:50:32.786+0000 7ffb9d22b700 -1 Fail to open '/proc/122333/cmdline' error = (2) No such file or directory 2023-09-13T12:50:32.787 INFO:tasks.ceph.osd.5.smithi161.stderr:2023-09-13T12:50:32.787+0000 7ffb9d22b700 -1 received signal: Hangup from (PID: 122333) UID: 0 2023-09-13T12:54:08.557 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T12:54:08.560 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T12:54:08.753 INFO:tasks.ceph.osd.4.smithi161.stderr:2023-09-13T12:54:08.753+0000 7f74b53b3700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122382) UID: 0 2023-09-13T12:54:08.754 INFO:tasks.ceph.osd.5.smithi161.stderr:2023-09-13T12:54:08.753+0000 7ffb9d22b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122382) UID: 0 2023-09-13T12:54:08.754 INFO:tasks.ceph.osd.6.smithi161.stderr:2023-09-13T12:54:08.754+0000 7f1a51b0f700 -1 Fail to open '/proc/122382/cmdline' error = (2) No such file or directory 2023-09-13T12:54:08.754 INFO:tasks.ceph.osd.6.smithi161.stderr:2023-09-13T12:54:08.754+0000 7f1a51b0f700 -1 received signal: Hangup from (PID: 122382) UID: 0 2023-09-13T12:54:08.755 INFO:tasks.ceph.osd.7.smithi161.stderr:2023-09-13T12:54:08.754+0000 7f01a431f700 -1 Fail to open '/proc/122382/cmdline' error = (2) No such file or directory 2023-09-13T12:54:08.755 INFO:tasks.ceph.osd.7.smithi161.stderr:2023-09-13T12:54:08.754+0000 7f01a431f700 -1 received signal: Hangup from (PID: 122382) UID: 0 2023-09-13T13:00:26.479 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:00:26.483 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:00:26.560 INFO:tasks.ceph.osd.4.smithi161.stderr:2023-09-13T13:00:26.560+0000 7f74b53b3700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122465) UID: 0 2023-09-13T13:00:26.560 INFO:tasks.ceph.osd.6.smithi161.stderr:2023-09-13T13:00:26.561+0000 7f1a51b0f700 -1 received signal: Hangup from (PID: 122465) UID: 0 2023-09-13T13:00:26.561 INFO:tasks.ceph.osd.7.smithi161.stderr:2023-09-13T13:00:26.561+0000 7f01a431f700 -1 received signal: Hangup from (PID: 122465) UID: 0 2023-09-13T13:00:26.564 INFO:tasks.ceph.osd.5.smithi161.stderr:2023-09-13T13:00:26.564+0000 7ffb9d22b700 -1 received signal: Hangup from (PID: 122465) UID: 0 2023-09-13T13:04:09.403 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:04:09.406 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:04:39.714 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:04:39.717 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:05:09.787 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:05:09.790 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:05:39.868 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:05:39.871 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:06:09.983 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:06:09.986 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:06:40.104 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:06:40.107 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:07:10.241 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:07:10.244 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:07:40.742 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:07:40.746 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:08:10.834 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:08:10.837 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:08:40.914 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:08:40.917 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:09:11.009 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:09:11.012 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:09:41.106 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:09:41.109 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:10:11.240 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:10:11.243 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:10:41.506 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:10:41.509 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:11:11.616 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:11:11.620 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:11:41.710 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:11:41.713 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:12:11.869 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:12:11.872 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:12:41.934 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:12:41.937 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:13:12.080 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:13:12.086 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:13:42.192 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:13:42.195 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:14:12.293 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:14:12.295 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:14:42.390 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:14:42.394 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:15:12.544 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:15:12.547 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:15:42.696 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:15:42.699 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:16:12.811 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:16:12.821 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:16:42.980 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:16:42.985 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:17:13.226 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:17:13.230 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:17:43.297 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:17:43.309 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:18:13.417 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:18:13.420 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:18:43.546 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:18:43.553 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:19:13.650 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:19:13.657 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:19:13.718 INFO:tasks.ceph.osd.4.smithi161.stderr:2023-09-13T13:19:13.718+0000 7f74b53b3700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123297) UID: 0 2023-09-13T13:19:13.719 INFO:tasks.ceph.osd.5.smithi161.stderr:2023-09-13T13:19:13.718+0000 7ffb9d22b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123297) UID: 0 2023-09-13T13:19:13.722 INFO:tasks.ceph.osd.7.smithi161.stderr:2023-09-13T13:19:13.722+0000 7f01a431f700 -1 Fail to open '/proc/123297/cmdline' error = (2) No such file or directory 2023-09-13T13:19:13.722 INFO:tasks.ceph.osd.7.smithi161.stderr:2023-09-13T13:19:13.722+0000 7f01a431f700 -1 received signal: Hangup from (PID: 123297) UID: 0 2023-09-13T13:19:13.723 INFO:tasks.ceph.osd.6.smithi161.stderr:2023-09-13T13:19:13.718+0000 7f1a51b0f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123297) UID: 0 2023-09-13T13:22:38.905 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:22:38.909 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:22:39.249 INFO:tasks.ceph.osd.0.smithi084.stderr:2023-09-13T13:22:39.249+0000 7f41ea673700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 660646) UID: 0 2023-09-13T13:22:39.249 INFO:tasks.ceph.osd.1.smithi084.stderr:2023-09-13T13:22:39.249+0000 7f7780105700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 660646) UID: 0 2023-09-13T13:22:39.250 INFO:tasks.ceph.osd.3.smithi084.stderr:2023-09-13T13:22:39.250+0000 7f2433cf8700 -1 Fail to open '/proc/660646/cmdline' error = (2) No such file or directory 2023-09-13T13:22:39.250 INFO:tasks.ceph.osd.3.smithi084.stderr:2023-09-13T13:22:39.250+0000 7f2433cf8700 -1 received signal: Hangup from (PID: 660646) UID: 0 2023-09-13T13:22:39.251 INFO:tasks.ceph.osd.2.smithi084.stderr:2023-09-13T13:22:39.250+0000 7f459a7f9700 -1 Fail to open '/proc/660646/cmdline' error = (2) No such file or directory 2023-09-13T13:22:39.251 INFO:tasks.ceph.osd.2.smithi084.stderr:2023-09-13T13:22:39.250+0000 7f459a7f9700 -1 received signal: Hangup from (PID: 660646) UID: 0 2023-09-13T13:34:37.616 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:34:37.648 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:34:37.733 INFO:tasks.ceph.mds.d.smithi161.stderr:2023-09-13T13:34:37.733+0000 7f3b9b143700 -1 Fail to open '/proc/123486/cmdline' error = (2) No such file or directory 2023-09-13T13:34:37.734 INFO:tasks.ceph.mds.d.smithi161.stderr:2023-09-13T13:34:37.733+0000 7f3b9b143700 -1 received signal: Hangup from (PID: 123486) UID: 0 2023-09-13T13:34:37.739 INFO:tasks.ceph.mds.b.smithi161.stderr:2023-09-13T13:34:37.739+0000 7f40246c1700 -1 Fail to open '/proc/123486/cmdline' error = (2) No such file or directory 2023-09-13T13:34:37.739 INFO:tasks.ceph.mds.b.smithi161.stderr:2023-09-13T13:34:37.739+0000 7f40246c1700 -1 received signal: Hangup from (PID: 123486) UID: 0 2023-09-13T13:37:23.635 INFO:tasks.ceph.osd.7.smithi161.stderr:2023-09-13T13:37:23.633+0000 7f01a431f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123508) UID: 0 2023-09-13T13:37:23.636 INFO:tasks.ceph.osd.5.smithi161.stderr:2023-09-13T13:37:23.634+0000 7ffb9d22b700 -1 received signal: Hangup from (PID: 123508) UID: 0 2023-09-13T13:37:23.637 INFO:tasks.ceph.osd.6.smithi161.stderr:2023-09-13T13:37:23.634+0000 7f1a51b0f700 -1 received signal: Hangup from (PID: 123508) UID: 0 2023-09-13T13:37:23.637 INFO:tasks.ceph.osd.4.smithi161.stderr:2023-09-13T13:37:23.633+0000 7f74b53b3700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123508) UID: 0 2023-09-13T13:45:19.572 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:45:19.576 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:45:19.750 INFO:tasks.ceph.osd.4.smithi161.stderr:2023-09-13T13:45:19.744+0000 7f74b53b3700 -1 received signal: Hangup from (PID: 123604) UID: 0 2023-09-13T13:45:19.751 INFO:tasks.ceph.osd.5.smithi161.stderr:2023-09-13T13:45:19.743+0000 7ffb9d22b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123604) UID: 0 2023-09-13T13:45:19.751 INFO:tasks.ceph.osd.6.smithi161.stderr:2023-09-13T13:45:19.743+0000 7f1a51b0f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123604) UID: 0 2023-09-13T13:45:19.752 INFO:tasks.ceph.osd.7.smithi161.stderr:2023-09-13T13:45:19.744+0000 7f01a431f700 -1 received signal: Hangup from (PID: 123604) UID: 0 2023-09-13T13:48:45.482 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:48:45.488 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:48:45.550 INFO:tasks.ceph.osd.6.smithi161.stderr:2023-09-13T13:48:45.549+0000 7f1a51b0f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123662) UID: 0 2023-09-13T13:48:45.550 INFO:tasks.ceph.osd.7.smithi161.stderr:2023-09-13T13:48:45.549+0000 7f01a431f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123662) UID: 0 2023-09-13T13:48:45.551 INFO:tasks.ceph.osd.5.smithi161.stderr:2023-09-13T13:48:45.551+0000 7ffb9d22b700 -1 Fail to open '/proc/123662/cmdline' error = (2) No such file or directory 2023-09-13T13:48:45.551 INFO:tasks.ceph.osd.5.smithi161.stderr:2023-09-13T13:48:45.551+0000 7ffb9d22b700 -1 received signal: Hangup from (PID: 123662) UID: 0 2023-09-13T13:48:45.552 INFO:tasks.ceph.osd.4.smithi161.stderr:2023-09-13T13:48:45.549+0000 7f74b53b3700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123662) UID: 0 2023-09-13T13:52:15.765 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:52:15.769 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:52:46.290 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:52:46.295 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:53:16.379 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:53:16.382 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:53:46.472 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:53:46.477 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:53:56.730 INFO:teuthology.orchestra.run.smithi084.stdout:generic/522 4056s 2023-09-13T13:53:56.751 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/522 2023-09-13T13:53:56.751 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T13:53:56.757 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T13:53:56.809 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T13:53:56.810 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/523) 2023-09-13T13:53:57.711 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T13:53:57.721 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T13:53:57.721 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T13:53:57.722 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T13:53:57.723 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T13:53:58.653 INFO:teuthology.orchestra.run.smithi084.stdout:generic/523 1s 2023-09-13T13:53:58.659 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/523 2023-09-13T13:53:58.660 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T13:53:58.663 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T13:53:58.675 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T13:53:58.676 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/524) 2023-09-13T13:53:59.030 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T13:53:59.034 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T13:53:59.035 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T13:53:59.035 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T13:53:59.036 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T13:54:05.368 INFO:teuthology.orchestra.run.smithi084.stdout:generic/524 6s 2023-09-13T13:54:05.375 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/524 2023-09-13T13:54:05.375 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T13:54:05.377 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T13:54:05.387 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T13:54:05.388 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/525) 2023-09-13T13:54:05.743 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T13:54:05.747 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T13:54:05.748 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T13:54:05.749 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T13:54:05.749 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T13:54:06.481 INFO:teuthology.orchestra.run.smithi084.stdout:generic/525 [not run] filesystem does not support huge file size 2023-09-13T13:54:06.504 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/525 2023-09-13T13:54:06.505 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/525 2023-09-13T13:54:06.505 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T13:54:06.509 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T13:54:06.553 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T13:54:06.554 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/526) 2023-09-13T13:54:06.882 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T13:54:06.887 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T13:54:06.888 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T13:54:06.889 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T13:54:06.889 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T13:54:07.499 INFO:teuthology.orchestra.run.smithi084.stdout:generic/526 [not run] require 172.21.15.84:6789:/scratch to be valid block disk 2023-09-13T13:54:07.504 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/526 2023-09-13T13:54:07.504 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/526 2023-09-13T13:54:07.505 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T13:54:07.507 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T13:54:07.551 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T13:54:07.552 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/527) 2023-09-13T13:54:07.884 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T13:54:07.889 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T13:54:07.890 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T13:54:07.891 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T13:54:07.891 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T13:54:08.453 INFO:teuthology.orchestra.run.smithi084.stdout:generic/527 [not run] require 172.21.15.84:6789:/scratch to be valid block disk 2023-09-13T13:54:08.457 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/527 2023-09-13T13:54:08.458 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/527 2023-09-13T13:54:08.458 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T13:54:08.460 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T13:54:08.498 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T13:54:08.498 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/528) 2023-09-13T13:54:08.815 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T13:54:08.831 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T13:54:08.832 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T13:54:08.833 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T13:54:08.833 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T13:54:09.482 INFO:teuthology.orchestra.run.smithi084.stdout:generic/528 0s 2023-09-13T13:54:09.490 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/528 2023-09-13T13:54:09.490 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T13:54:09.492 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T13:54:09.948 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T13:54:09.949 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/529) 2023-09-13T13:54:10.278 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T13:54:10.282 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T13:54:10.282 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T13:54:10.283 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T13:54:10.284 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T13:54:11.153 INFO:teuthology.orchestra.run.smithi084.stdout:generic/529 1s 2023-09-13T13:54:11.158 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/529 2023-09-13T13:54:11.158 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T13:54:11.160 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T13:54:11.175 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T13:54:11.175 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/530) 2023-09-13T13:54:11.488 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T13:54:11.493 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T13:54:11.493 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T13:54:11.499 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T13:54:11.499 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T13:54:12.214 INFO:teuthology.orchestra.run.smithi084.stdout:generic/530 [not run] ceph does not support shutdown 2023-09-13T13:54:12.233 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/530 2023-09-13T13:54:12.234 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/530 2023-09-13T13:54:12.234 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T13:54:12.242 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T13:54:12.278 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T13:54:12.279 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/531) 2023-09-13T13:54:12.610 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T13:54:12.615 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T13:54:12.615 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T13:54:12.616 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T13:54:12.616 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T13:54:13.075 INFO:teuthology.orchestra.run.smithi084.stdout:generic/531 [not run] O_TMPFILE is not supported 2023-09-13T13:54:13.084 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/531 2023-09-13T13:54:13.084 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/531 2023-09-13T13:54:13.084 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T13:54:13.086 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T13:54:13.129 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T13:54:13.130 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/532) 2023-09-13T13:54:13.468 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T13:54:13.472 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T13:54:13.473 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T13:54:13.474 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T13:54:13.474 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T13:54:13.998 INFO:teuthology.orchestra.run.smithi084.stdout:generic/532 0s 2023-09-13T13:54:14.004 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/532 2023-09-13T13:54:14.004 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T13:54:14.009 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T13:54:14.050 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T13:54:14.051 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/533) 2023-09-13T13:54:14.415 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T13:54:14.421 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T13:54:14.421 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T13:54:14.422 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T13:54:14.423 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T13:54:15.816 INFO:teuthology.orchestra.run.smithi084.stdout:generic/533 1s 2023-09-13T13:54:15.823 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/533 2023-09-13T13:54:15.823 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T13:54:15.825 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T13:54:15.857 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T13:54:15.858 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/534) 2023-09-13T13:54:16.206 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T13:54:16.217 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T13:54:16.218 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T13:54:16.219 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T13:54:16.219 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T13:54:16.627 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:54:16.629 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:54:16.755 INFO:teuthology.orchestra.run.smithi084.stdout:generic/534 [not run] require 172.21.15.84:6789:/scratch to be valid block disk 2023-09-13T13:54:16.759 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/534 2023-09-13T13:54:16.759 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/534 2023-09-13T13:54:16.759 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T13:54:16.761 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T13:54:16.789 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T13:54:16.790 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/535) 2023-09-13T13:54:17.181 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T13:54:17.185 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T13:54:17.186 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T13:54:17.187 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T13:54:17.187 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T13:54:17.713 INFO:teuthology.orchestra.run.smithi084.stdout:generic/535 [not run] require 172.21.15.84:6789:/scratch to be valid block disk 2023-09-13T13:54:17.718 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/535 2023-09-13T13:54:17.719 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/535 2023-09-13T13:54:17.719 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T13:54:17.721 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T13:54:17.742 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T13:54:17.743 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/536) 2023-09-13T13:54:18.060 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T13:54:18.065 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T13:54:18.065 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T13:54:18.066 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T13:54:18.066 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T13:54:18.738 INFO:teuthology.orchestra.run.smithi084.stdout:generic/536 [not run] ceph does not support shutdown 2023-09-13T13:54:18.774 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/536 2023-09-13T13:54:18.774 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/536 2023-09-13T13:54:18.774 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T13:54:18.776 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T13:54:18.812 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T13:54:18.812 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/537) 2023-09-13T13:54:19.155 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T13:54:19.160 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T13:54:19.160 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T13:54:19.161 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T13:54:19.161 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T13:54:19.961 INFO:teuthology.orchestra.run.smithi084.stdout:generic/537 [not run] FSTRIM not supported 2023-09-13T13:54:19.977 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/537 2023-09-13T13:54:19.978 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/537 2023-09-13T13:54:19.978 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T13:54:19.980 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T13:54:20.019 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T13:54:20.021 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/538) 2023-09-13T13:54:20.356 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T13:54:20.361 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T13:54:20.361 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T13:54:20.364 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T13:54:20.364 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T13:54:46.719 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:54:46.723 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:55:17.315 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:55:17.318 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:55:47.394 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:55:47.397 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:56:17.459 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:56:17.462 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:56:47.950 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:56:47.953 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:57:18.263 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:57:18.267 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T13:57:18.508 INFO:tasks.ceph.osd.0.smithi084.stderr:2023-09-13T13:57:18.507+0000 7f41ea673700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 672011) UID: 0 2023-09-13T13:57:18.508 INFO:tasks.ceph.osd.1.smithi084.stderr:2023-09-13T13:57:18.508+0000 7f7780105700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 672011) UID: 0 2023-09-13T13:57:18.509 INFO:tasks.ceph.osd.2.smithi084.stderr:2023-09-13T13:57:18.508+0000 7f459a7f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 672011) UID: 0 2023-09-13T13:57:18.509 INFO:tasks.ceph.osd.3.smithi084.stderr:2023-09-13T13:57:18.507+0000 7f2433cf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 672011) UID: 0 2023-09-13T14:00:34.015 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:00:34.018 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:01:04.150 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:01:04.156 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:01:34.246 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:01:34.252 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:02:04.383 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:02:04.386 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:02:34.671 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:02:34.674 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:02:34.745 INFO:tasks.ceph.osd.2.smithi084.stderr:2023-09-13T14:02:34.745+0000 7f459a7f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 675592) UID: 0 2023-09-13T14:02:34.749 INFO:tasks.ceph.osd.0.smithi084.stderr:2023-09-13T14:02:34.741+0000 7f41ea673700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 675592) UID: 0 2023-09-13T14:02:34.749 INFO:tasks.ceph.osd.3.smithi084.stderr:2023-09-13T14:02:34.749+0000 7f2433cf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 675592) UID: 0 2023-09-13T14:02:34.752 INFO:tasks.ceph.osd.1.smithi084.stderr:2023-09-13T14:02:34.749+0000 7f7780105700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 675592) UID: 0 2023-09-13T14:03:47.239 INFO:teuthology.orchestra.run.smithi084.stdout:generic/538 567s 2023-09-13T14:03:47.272 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/538 2023-09-13T14:03:47.273 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T14:03:47.276 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:03:47.767 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T14:03:47.768 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/539) 2023-09-13T14:03:48.360 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:03:48.370 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:03:48.370 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:03:48.371 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:03:48.371 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:03:51.057 INFO:teuthology.orchestra.run.smithi084.stdout:generic/539 3s 2023-09-13T14:03:51.062 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/539 2023-09-13T14:03:51.063 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T14:03:51.065 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:03:51.512 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T14:03:51.513 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/540) 2023-09-13T14:03:51.969 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:03:51.973 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:03:51.974 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:03:51.975 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:03:51.975 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:03:53.121 INFO:teuthology.orchestra.run.smithi084.stdout:generic/540 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T14:03:53.220 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/540 2023-09-13T14:03:53.220 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/540 2023-09-13T14:03:53.221 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T14:03:53.239 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:03:53.358 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T14:03:53.358 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/541) 2023-09-13T14:03:53.764 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:03:53.782 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:03:53.783 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:03:53.784 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:03:53.784 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:03:54.907 INFO:teuthology.orchestra.run.smithi084.stdout:generic/541 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T14:03:55.065 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/541 2023-09-13T14:03:55.066 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/541 2023-09-13T14:03:55.066 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T14:03:55.091 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:03:55.176 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T14:03:55.177 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/542) 2023-09-13T14:03:55.563 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:03:55.567 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:03:55.567 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:03:55.568 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:03:55.568 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:03:56.739 INFO:teuthology.orchestra.run.smithi084.stdout:generic/542 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T14:03:56.942 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/542 2023-09-13T14:03:56.943 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/542 2023-09-13T14:03:56.943 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T14:03:56.945 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:03:56.997 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T14:03:56.998 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/543) 2023-09-13T14:03:57.382 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:03:57.391 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:03:57.392 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:03:57.393 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:03:57.393 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:03:58.438 INFO:teuthology.orchestra.run.smithi084.stdout:generic/543 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T14:03:58.443 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/543 2023-09-13T14:03:58.443 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/543 2023-09-13T14:03:58.444 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T14:03:58.447 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:03:58.687 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T14:03:58.688 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/544) 2023-09-13T14:03:59.128 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:03:59.135 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:03:59.136 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:03:59.137 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:03:59.137 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:04:00.313 INFO:teuthology.orchestra.run.smithi084.stdout:generic/544 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T14:04:00.401 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/544 2023-09-13T14:04:00.401 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/544 2023-09-13T14:04:00.402 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T14:04:00.448 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:04:00.503 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T14:04:00.504 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/545) 2023-09-13T14:04:00.908 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:04:00.918 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:04:00.918 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:04:00.919 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:04:00.919 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:04:01.633 INFO:teuthology.orchestra.run.smithi084.stdout:generic/545 [not run] file system doesn't support chattr +i 2023-09-13T14:04:01.638 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/545 2023-09-13T14:04:01.638 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/545 2023-09-13T14:04:01.639 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T14:04:01.646 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:04:01.711 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T14:04:01.712 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/546) 2023-09-13T14:04:02.047 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:04:02.051 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:04:02.055 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:04:02.056 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:04:02.057 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:04:03.221 INFO:teuthology.orchestra.run.smithi084.stdout:generic/546 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-13T14:04:03.232 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/546 2023-09-13T14:04:03.233 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/546 2023-09-13T14:04:03.233 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T14:04:03.239 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:04:03.289 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T14:04:03.290 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/547) 2023-09-13T14:04:03.721 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:04:03.732 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:04:03.732 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:04:03.734 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:04:03.734 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:04:05.379 INFO:teuthology.orchestra.run.smithi084.stdout:generic/547 [not run] require 172.21.15.84:6789:/scratch to be valid block disk 2023-09-13T14:04:05.389 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/547 2023-09-13T14:04:05.390 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/547 2023-09-13T14:04:05.390 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T14:04:05.391 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:04:05.444 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T14:04:05.444 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/548) 2023-09-13T14:04:05.785 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:04:05.799 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:04:05.800 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:04:05.801 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:04:05.801 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:04:06.931 INFO:teuthology.orchestra.run.smithi084.stdout:generic/548 [not run] kernel does not support ceph encryption 2023-09-13T14:04:06.962 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/548 2023-09-13T14:04:06.963 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/548 2023-09-13T14:04:06.963 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T14:04:06.965 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:04:06.999 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T14:04:07.000 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/549) 2023-09-13T14:04:07.397 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:04:07.413 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:04:07.414 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:04:07.416 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:04:07.417 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:04:08.358 INFO:teuthology.orchestra.run.smithi084.stdout:generic/549 [not run] kernel does not support ceph encryption 2023-09-13T14:04:08.414 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/549 2023-09-13T14:04:08.414 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/549 2023-09-13T14:04:08.415 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T14:04:08.420 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:04:08.450 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T14:04:08.450 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/550) 2023-09-13T14:04:08.859 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:04:08.864 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:04:08.865 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:04:08.866 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:04:08.867 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:04:09.828 INFO:teuthology.orchestra.run.smithi084.stdout:generic/550 [not run] kernel does not support ceph encryption 2023-09-13T14:04:09.855 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/550 2023-09-13T14:04:09.855 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/550 2023-09-13T14:04:09.855 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T14:04:09.856 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:04:09.885 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T14:04:09.886 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/551) 2023-09-13T14:04:10.275 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:04:10.279 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:04:10.280 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:04:10.281 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:04:10.282 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:09:00.856 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:09:00.860 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:09:01.026 INFO:tasks.ceph.osd.7.smithi161.stderr:2023-09-13T14:09:01.025+0000 7f01a431f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 126102) UID: 0 2023-09-13T14:09:01.026 INFO:tasks.ceph.osd.6.smithi161.stderr:2023-09-13T14:09:01.025+0000 7f1a51b0f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 126102) UID: 0 2023-09-13T14:09:01.027 INFO:tasks.ceph.osd.4.smithi161.stderr:2023-09-13T14:09:01.025+0000 7f74b53b3700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 126102) UID: 0 2023-09-13T14:09:01.029 INFO:tasks.ceph.osd.5.smithi161.stderr:2023-09-13T14:09:01.025+0000 7ffb9d22b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 126102) UID: 0 2023-09-13T14:09:01.161 INFO:tasks.ceph.osd.3.smithi084.stderr:2023-09-13T14:09:01.161+0000 7f2433cf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 684848) UID: 0 2023-09-13T14:09:01.162 INFO:tasks.ceph.osd.2.smithi084.stderr:2023-09-13T14:09:01.161+0000 7f459a7f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 684848) UID: 0 2023-09-13T14:09:01.162 INFO:tasks.ceph.osd.1.smithi084.stderr:2023-09-13T14:09:01.161+0000 7f7780105700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 684848) UID: 0 2023-09-13T14:09:01.166 INFO:tasks.ceph.osd.0.smithi084.stderr:2023-09-13T14:09:01.166+0000 7f41ea673700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 684848) UID: 0 2023-09-13T14:15:20.022 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:15:20.025 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:15:50.179 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:15:50.187 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:16:20.253 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:16:20.256 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:16:50.530 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:16:50.534 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:17:08.678 INFO:tasks.ceph.osd.5.smithi161.stderr:2023-09-13T14:17:08.678+0000 7ffb93602700 -1 bdev(0x556652312000 /var/lib/ceph/osd/ceph-5/block) _aio_thread got r=-28 ((28) No space left on device) 2023-09-13T14:17:08.760 INFO:tasks.ceph.osd.5.smithi161.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-6083-g4a754ac9/rpm/el8/BUILD/ceph-18.0.0-6083-g4a754ac9/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7ffb93602700 time 2023-09-13T14:17:08.759054+0000 2023-09-13T14:17:08.761 INFO:tasks.ceph.osd.5.smithi161.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-6083-g4a754ac9/rpm/el8/BUILD/ceph-18.0.0-6083-g4a754ac9/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2023-09-13T14:17:08.761 INFO:tasks.ceph.osd.5.smithi161.stderr: ceph version 18.0.0-6083-g4a754ac9 (4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5) reef (dev) 2023-09-13T14:17:08.761 INFO:tasks.ceph.osd.5.smithi161.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd7) [0x55664e018d4f] 2023-09-13T14:17:08.761 INFO:tasks.ceph.osd.5.smithi161.stderr: 2: (KernelDevice::_aio_thread()+0x1686) [0x55664ec66d96] 2023-09-13T14:17:08.762 INFO:tasks.ceph.osd.5.smithi161.stderr: 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55664ec6c7b1] 2023-09-13T14:17:08.762 INFO:tasks.ceph.osd.5.smithi161.stderr: 4: /lib64/libpthread.so.0(+0x81cf) [0x7ffba59281cf] 2023-09-13T14:17:08.762 INFO:tasks.ceph.osd.5.smithi161.stderr: 5: clone() 2023-09-13T14:17:08.762 INFO:tasks.ceph.osd.5.smithi161.stderr:*** Caught signal (Aborted) ** 2023-09-13T14:17:08.762 INFO:tasks.ceph.osd.5.smithi161.stderr: in thread 7ffb93602700 thread_name:bstore_aio 2023-09-13T14:17:08.763 INFO:tasks.ceph.osd.5.smithi161.stderr:2023-09-13T14:17:08.760+0000 7ffb93602700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-6083-g4a754ac9/rpm/el8/BUILD/ceph-18.0.0-6083-g4a754ac9/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7ffb93602700 time 2023-09-13T14:17:08.759054+0000 2023-09-13T14:17:08.763 INFO:tasks.ceph.osd.5.smithi161.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-6083-g4a754ac9/rpm/el8/BUILD/ceph-18.0.0-6083-g4a754ac9/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2023-09-13T14:17:08.763 INFO:tasks.ceph.osd.5.smithi161.stderr: 2023-09-13T14:17:08.763 INFO:tasks.ceph.osd.5.smithi161.stderr: ceph version 18.0.0-6083-g4a754ac9 (4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5) reef (dev) 2023-09-13T14:17:08.763 INFO:tasks.ceph.osd.5.smithi161.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd7) [0x55664e018d4f] 2023-09-13T14:17:08.764 INFO:tasks.ceph.osd.5.smithi161.stderr: 2: (KernelDevice::_aio_thread()+0x1686) [0x55664ec66d96] 2023-09-13T14:17:08.764 INFO:tasks.ceph.osd.5.smithi161.stderr: 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55664ec6c7b1] 2023-09-13T14:17:08.764 INFO:tasks.ceph.osd.5.smithi161.stderr: 4: /lib64/libpthread.so.0(+0x81cf) [0x7ffba59281cf] 2023-09-13T14:17:08.764 INFO:tasks.ceph.osd.5.smithi161.stderr: 5: clone() 2023-09-13T14:17:08.764 INFO:tasks.ceph.osd.5.smithi161.stderr: 2023-09-13T14:17:08.765 INFO:tasks.ceph.osd.5.smithi161.stderr: ceph version 18.0.0-6083-g4a754ac9 (4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5) reef (dev) 2023-09-13T14:17:08.765 INFO:tasks.ceph.osd.5.smithi161.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7ffba5932ce0] 2023-09-13T14:17:08.765 INFO:tasks.ceph.osd.5.smithi161.stderr: 2: gsignal() 2023-09-13T14:17:08.765 INFO:tasks.ceph.osd.5.smithi161.stderr: 3: abort() 2023-09-13T14:17:08.766 INFO:tasks.ceph.osd.5.smithi161.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x197) [0x55664e018e0f] 2023-09-13T14:17:08.766 INFO:tasks.ceph.osd.5.smithi161.stderr: 5: (KernelDevice::_aio_thread()+0x1686) [0x55664ec66d96] 2023-09-13T14:17:08.766 INFO:tasks.ceph.osd.5.smithi161.stderr: 6: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55664ec6c7b1] 2023-09-13T14:17:08.766 INFO:tasks.ceph.osd.5.smithi161.stderr: 7: /lib64/libpthread.so.0(+0x81cf) [0x7ffba59281cf] 2023-09-13T14:17:08.766 INFO:tasks.ceph.osd.5.smithi161.stderr: 8: clone() 2023-09-13T14:17:08.767 INFO:tasks.ceph.osd.5.smithi161.stderr:2023-09-13T14:17:08.768+0000 7ffb93602700 -1 *** Caught signal (Aborted) ** 2023-09-13T14:17:08.767 INFO:tasks.ceph.osd.5.smithi161.stderr: in thread 7ffb93602700 thread_name:bstore_aio 2023-09-13T14:17:08.767 INFO:tasks.ceph.osd.5.smithi161.stderr: 2023-09-13T14:17:08.767 INFO:tasks.ceph.osd.5.smithi161.stderr: ceph version 18.0.0-6083-g4a754ac9 (4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5) reef (dev) 2023-09-13T14:17:08.768 INFO:tasks.ceph.osd.5.smithi161.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7ffba5932ce0] 2023-09-13T14:17:08.768 INFO:tasks.ceph.osd.5.smithi161.stderr: 2: gsignal() 2023-09-13T14:17:08.768 INFO:tasks.ceph.osd.5.smithi161.stderr: 3: abort() 2023-09-13T14:17:08.768 INFO:tasks.ceph.osd.5.smithi161.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x197) [0x55664e018e0f] 2023-09-13T14:17:08.768 INFO:tasks.ceph.osd.5.smithi161.stderr: 5: (KernelDevice::_aio_thread()+0x1686) [0x55664ec66d96] 2023-09-13T14:17:08.769 INFO:tasks.ceph.osd.5.smithi161.stderr: 6: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55664ec6c7b1] 2023-09-13T14:17:08.769 INFO:tasks.ceph.osd.5.smithi161.stderr: 7: /lib64/libpthread.so.0(+0x81cf) [0x7ffba59281cf] 2023-09-13T14:17:08.769 INFO:tasks.ceph.osd.5.smithi161.stderr: 8: clone() 2023-09-13T14:17:08.769 INFO:tasks.ceph.osd.5.smithi161.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-09-13T14:17:08.769 INFO:tasks.ceph.osd.5.smithi161.stderr: 2023-09-13T14:17:08.781 INFO:tasks.ceph.osd.5.smithi161.stderr: -3> 2023-09-13T14:17:08.760+0000 7ffb93602700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-6083-g4a754ac9/rpm/el8/BUILD/ceph-18.0.0-6083-g4a754ac9/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7ffb93602700 time 2023-09-13T14:17:08.759054+0000 2023-09-13T14:17:08.781 INFO:tasks.ceph.osd.5.smithi161.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-6083-g4a754ac9/rpm/el8/BUILD/ceph-18.0.0-6083-g4a754ac9/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2023-09-13T14:17:08.781 INFO:tasks.ceph.osd.5.smithi161.stderr: 2023-09-13T14:17:08.782 INFO:tasks.ceph.osd.5.smithi161.stderr: ceph version 18.0.0-6083-g4a754ac9 (4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5) reef (dev) 2023-09-13T14:17:08.782 INFO:tasks.ceph.osd.5.smithi161.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd7) [0x55664e018d4f] 2023-09-13T14:17:08.782 INFO:tasks.ceph.osd.5.smithi161.stderr: 2: (KernelDevice::_aio_thread()+0x1686) [0x55664ec66d96] 2023-09-13T14:17:08.782 INFO:tasks.ceph.osd.5.smithi161.stderr: 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55664ec6c7b1] 2023-09-13T14:17:08.782 INFO:tasks.ceph.osd.5.smithi161.stderr: 4: /lib64/libpthread.so.0(+0x81cf) [0x7ffba59281cf] 2023-09-13T14:17:08.783 INFO:tasks.ceph.osd.5.smithi161.stderr: 5: clone() 2023-09-13T14:17:08.783 INFO:tasks.ceph.osd.5.smithi161.stderr: 2023-09-13T14:17:08.783 INFO:tasks.ceph.osd.5.smithi161.stderr: 0> 2023-09-13T14:17:08.768+0000 7ffb93602700 -1 *** Caught signal (Aborted) ** 2023-09-13T14:17:08.783 INFO:tasks.ceph.osd.5.smithi161.stderr: in thread 7ffb93602700 thread_name:bstore_aio 2023-09-13T14:17:08.783 INFO:tasks.ceph.osd.5.smithi161.stderr: 2023-09-13T14:17:08.784 INFO:tasks.ceph.osd.5.smithi161.stderr: ceph version 18.0.0-6083-g4a754ac9 (4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5) reef (dev) 2023-09-13T14:17:08.784 INFO:tasks.ceph.osd.5.smithi161.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7ffba5932ce0] 2023-09-13T14:17:08.784 INFO:tasks.ceph.osd.5.smithi161.stderr: 2: gsignal() 2023-09-13T14:17:08.784 INFO:tasks.ceph.osd.5.smithi161.stderr: 3: abort() 2023-09-13T14:17:08.784 INFO:tasks.ceph.osd.5.smithi161.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x197) [0x55664e018e0f] 2023-09-13T14:17:08.785 INFO:tasks.ceph.osd.5.smithi161.stderr: 5: (KernelDevice::_aio_thread()+0x1686) [0x55664ec66d96] 2023-09-13T14:17:08.785 INFO:tasks.ceph.osd.5.smithi161.stderr: 6: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55664ec6c7b1] 2023-09-13T14:17:08.785 INFO:tasks.ceph.osd.5.smithi161.stderr: 7: /lib64/libpthread.so.0(+0x81cf) [0x7ffba59281cf] 2023-09-13T14:17:08.785 INFO:tasks.ceph.osd.5.smithi161.stderr: 8: clone() 2023-09-13T14:17:08.785 INFO:tasks.ceph.osd.5.smithi161.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-09-13T14:17:08.785 INFO:tasks.ceph.osd.5.smithi161.stderr: 2023-09-13T14:17:08.792 INFO:tasks.ceph.osd.5.smithi161.stderr: -5> 2023-09-13T14:17:08.760+0000 7ffb93602700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-6083-g4a754ac9/rpm/el8/BUILD/ceph-18.0.0-6083-g4a754ac9/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7ffb93602700 time 2023-09-13T14:17:08.759054+0000 2023-09-13T14:17:08.792 INFO:tasks.ceph.osd.5.smithi161.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-6083-g4a754ac9/rpm/el8/BUILD/ceph-18.0.0-6083-g4a754ac9/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2023-09-13T14:17:08.792 INFO:tasks.ceph.osd.5.smithi161.stderr: 2023-09-13T14:17:08.792 INFO:tasks.ceph.osd.5.smithi161.stderr: ceph version 18.0.0-6083-g4a754ac9 (4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5) reef (dev) 2023-09-13T14:17:08.792 INFO:tasks.ceph.osd.5.smithi161.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd7) [0x55664e018d4f] 2023-09-13T14:17:08.793 INFO:tasks.ceph.osd.5.smithi161.stderr: 2: (KernelDevice::_aio_thread()+0x1686) [0x55664ec66d96] 2023-09-13T14:17:08.793 INFO:tasks.ceph.osd.5.smithi161.stderr: 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55664ec6c7b1] 2023-09-13T14:17:08.793 INFO:tasks.ceph.osd.5.smithi161.stderr: 4: /lib64/libpthread.so.0(+0x81cf) [0x7ffba59281cf] 2023-09-13T14:17:08.793 INFO:tasks.ceph.osd.5.smithi161.stderr: 5: clone() 2023-09-13T14:17:08.794 INFO:tasks.ceph.osd.5.smithi161.stderr: 2023-09-13T14:17:08.794 INFO:tasks.ceph.osd.5.smithi161.stderr: -2> 2023-09-13T14:17:08.768+0000 7ffb93602700 -1 *** Caught signal (Aborted) ** 2023-09-13T14:17:08.794 INFO:tasks.ceph.osd.5.smithi161.stderr: in thread 7ffb93602700 thread_name:bstore_aio 2023-09-13T14:17:08.794 INFO:tasks.ceph.osd.5.smithi161.stderr: 2023-09-13T14:17:08.794 INFO:tasks.ceph.osd.5.smithi161.stderr: ceph version 18.0.0-6083-g4a754ac9 (4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5) reef (dev) 2023-09-13T14:17:08.795 INFO:tasks.ceph.osd.5.smithi161.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7ffba5932ce0] 2023-09-13T14:17:08.795 INFO:tasks.ceph.osd.5.smithi161.stderr: 2: gsignal() 2023-09-13T14:17:08.795 INFO:tasks.ceph.osd.5.smithi161.stderr: 3: abort() 2023-09-13T14:17:08.795 INFO:tasks.ceph.osd.5.smithi161.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x197) [0x55664e018e0f] 2023-09-13T14:17:08.795 INFO:tasks.ceph.osd.5.smithi161.stderr: 5: (KernelDevice::_aio_thread()+0x1686) [0x55664ec66d96] 2023-09-13T14:17:08.795 INFO:tasks.ceph.osd.5.smithi161.stderr: 6: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55664ec6c7b1] 2023-09-13T14:17:08.796 INFO:tasks.ceph.osd.5.smithi161.stderr: 7: /lib64/libpthread.so.0(+0x81cf) [0x7ffba59281cf] 2023-09-13T14:17:08.796 INFO:tasks.ceph.osd.5.smithi161.stderr: 8: clone() 2023-09-13T14:17:08.796 INFO:tasks.ceph.osd.5.smithi161.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-09-13T14:17:08.796 INFO:tasks.ceph.osd.5.smithi161.stderr: 2023-09-13T14:17:09.035 INFO:tasks.ceph.osd.5.smithi161.stderr:daemon-helper: command failed with exit status 5 2023-09-13T14:17:14.692 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2023-09-13T14:17:20.764 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:17:20.768 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:17:21.306 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~7s 2023-09-13T14:17:27.918 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~13s 2023-09-13T14:17:34.531 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~20s 2023-09-13T14:17:41.144 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~26s 2023-09-13T14:17:47.758 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~33s 2023-09-13T14:17:50.829 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:17:50.847 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:17:54.370 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~40s 2023-09-13T14:18:00.984 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~46s 2023-09-13T14:18:07.597 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~53s 2023-09-13T14:18:14.209 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~60s 2023-09-13T14:18:20.821 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~66s 2023-09-13T14:18:21.213 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:18:21.216 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:18:27.435 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~73s 2023-09-13T14:18:34.047 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~79s 2023-09-13T14:18:40.661 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~86s 2023-09-13T14:18:47.274 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~93s 2023-09-13T14:18:51.298 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:18:51.377 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:18:53.888 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~99s 2023-09-13T14:19:00.459 INFO:teuthology.orchestra.run.smithi084.stdout:generic/551 890s 2023-09-13T14:19:00.472 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/551 2023-09-13T14:19:00.473 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T14:19:00.474 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:00.483 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T14:19:00.484 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/552) 2023-09-13T14:19:00.501 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~106s 2023-09-13T14:19:00.876 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:19:00.880 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:19:00.881 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:19:00.882 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:19:00.882 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:01.381 INFO:teuthology.orchestra.run.smithi084.stdout:generic/552 [not run] require 172.21.15.84:6789:/scratch to be valid block disk 2023-09-13T14:19:01.388 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/552 2023-09-13T14:19:01.389 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/552 2023-09-13T14:19:01.389 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T14:19:01.391 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:01.421 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T14:19:01.421 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/553) 2023-09-13T14:19:01.621 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:19:01.626 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:19:01.626 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:19:01.627 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:19:01.627 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:02.005 INFO:teuthology.orchestra.run.smithi084.stdout:generic/553 [not run] xfs_io chattr +i failed (old kernel/wrong fs?) 2023-09-13T14:19:02.009 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/553 2023-09-13T14:19:02.009 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/553 2023-09-13T14:19:02.009 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T14:19:02.011 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:02.311 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T14:19:02.312 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/554) 2023-09-13T14:19:02.625 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:19:02.629 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:19:02.629 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:19:02.630 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:19:02.630 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:03.242 INFO:teuthology.orchestra.run.smithi084.stdout:generic/554 [not run] swapfiles are not supported 2023-09-13T14:19:03.246 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/554 2023-09-13T14:19:03.247 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/554 2023-09-13T14:19:03.247 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T14:19:03.248 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:03.621 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T14:19:03.622 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/555) 2023-09-13T14:19:03.876 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:19:03.880 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:19:03.880 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:19:03.881 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:19:03.881 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:04.269 INFO:teuthology.orchestra.run.smithi084.stdout:generic/555 [not run] xfs_io chattr +ia failed (old kernel/wrong fs?) 2023-09-13T14:19:04.273 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/555 2023-09-13T14:19:04.274 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/555 2023-09-13T14:19:04.274 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T14:19:04.275 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:04.666 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T14:19:04.666 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/556) 2023-09-13T14:19:04.886 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:19:04.890 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:19:04.891 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:19:04.892 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:19:04.892 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:05.212 INFO:teuthology.orchestra.run.smithi084.stdout:generic/556 [not run] ceph does not support casefold feature 2023-09-13T14:19:05.216 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/556 2023-09-13T14:19:05.217 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/556 2023-09-13T14:19:05.217 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T14:19:05.218 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:05.237 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T14:19:05.238 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/557) 2023-09-13T14:19:05.439 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:19:05.443 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:19:05.444 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:19:05.445 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:19:05.445 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:05.792 INFO:teuthology.orchestra.run.smithi084.stdout:generic/557 [not run] require 172.21.15.84:6789:/scratch to be valid block disk 2023-09-13T14:19:05.796 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/557 2023-09-13T14:19:05.796 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/557 2023-09-13T14:19:05.796 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T14:19:05.798 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:05.828 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T14:19:05.829 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/558) 2023-09-13T14:19:06.041 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:19:06.045 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:19:06.046 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:19:06.046 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:19:06.047 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:06.382 INFO:teuthology.orchestra.run.smithi084.stdout:generic/558 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-09-13T14:19:06.386 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/558 2023-09-13T14:19:06.386 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/558 2023-09-13T14:19:06.386 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T14:19:06.388 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:06.410 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T14:19:06.410 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/559) 2023-09-13T14:19:06.612 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:19:06.615 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:19:06.616 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:19:06.617 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:19:06.617 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:06.959 INFO:teuthology.orchestra.run.smithi084.stdout:generic/559 [not run] duperemove utility required, skipped this test 2023-09-13T14:19:06.962 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/559 2023-09-13T14:19:06.963 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/559 2023-09-13T14:19:06.963 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T14:19:06.964 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:06.994 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T14:19:06.995 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/560) 2023-09-13T14:19:07.112 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~112s 2023-09-13T14:19:07.227 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:19:07.231 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:19:07.232 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:19:07.233 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:19:07.233 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:07.574 INFO:teuthology.orchestra.run.smithi084.stdout:generic/560 [not run] duperemove utility required, skipped this test 2023-09-13T14:19:07.578 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/560 2023-09-13T14:19:07.578 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/560 2023-09-13T14:19:07.578 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T14:19:07.580 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:07.606 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T14:19:07.607 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/561) 2023-09-13T14:19:07.812 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:19:07.816 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:19:07.816 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:19:07.817 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:19:07.818 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:08.146 INFO:teuthology.orchestra.run.smithi084.stdout:generic/561 [not run] duperemove utility required, skipped this test 2023-09-13T14:19:08.150 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/561 2023-09-13T14:19:08.150 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/561 2023-09-13T14:19:08.150 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T14:19:08.152 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:08.176 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T14:19:08.177 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/562) 2023-09-13T14:19:08.395 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:19:08.399 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:19:08.399 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:19:08.400 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:19:08.400 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:09.201 INFO:teuthology.orchestra.run.smithi084.stdout:generic/562 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T14:19:09.209 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/562 2023-09-13T14:19:09.209 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/562 2023-09-13T14:19:09.209 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T14:19:09.213 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:09.293 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T14:19:09.293 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/563) 2023-09-13T14:19:09.524 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:19:09.528 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:19:09.528 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:19:09.529 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:19:09.529 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:09.879 INFO:teuthology.orchestra.run.smithi084.stdout:generic/563 [not run] cgroup2 not mounted on /sys/fs/cgroup 2023-09-13T14:19:09.883 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/563 2023-09-13T14:19:09.884 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/563 2023-09-13T14:19:09.884 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T14:19:09.885 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:09.910 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T14:19:09.911 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/564) 2023-09-13T14:19:10.118 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:19:10.122 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:19:10.122 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:19:10.123 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:19:10.123 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:10.535 INFO:teuthology.orchestra.run.smithi084.stdout:generic/564 [not run] xfs_io copy_range doesn't support -f 2023-09-13T14:19:10.539 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/564 2023-09-13T14:19:10.540 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/564 2023-09-13T14:19:10.540 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T14:19:10.541 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:10.926 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T14:19:10.926 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/565) 2023-09-13T14:19:11.178 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:19:11.182 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:19:11.183 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:19:11.184 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:19:11.184 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:11.782 INFO:teuthology.orchestra.run.smithi084.stdout:generic/565 0s 2023-09-13T14:19:11.787 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/565 2023-09-13T14:19:11.788 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T14:19:11.789 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:12.103 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T14:19:12.104 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/566) 2023-09-13T14:19:12.373 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:19:12.377 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:19:12.377 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:19:12.378 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:19:12.378 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:12.713 INFO:teuthology.orchestra.run.smithi084.stdout:generic/566 [not run] disk quotas not supported by this filesystem type: ceph 2023-09-13T14:19:12.717 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/566 2023-09-13T14:19:12.717 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/566 2023-09-13T14:19:12.717 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T14:19:12.719 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:12.740 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T14:19:12.740 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/567) 2023-09-13T14:19:12.953 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:19:12.957 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:19:12.958 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:19:12.959 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:19:12.959 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:13.720 INFO:teuthology.orchestra.run.smithi084.stdout:generic/567 0s 2023-09-13T14:19:13.723 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~119s 2023-09-13T14:19:13.725 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/567 2023-09-13T14:19:13.725 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T14:19:13.727 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:13.736 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T14:19:13.736 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/568) 2023-09-13T14:19:13.938 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:19:13.942 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:19:13.942 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:19:13.943 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:19:13.943 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:14.309 INFO:teuthology.orchestra.run.smithi084.stdout:generic/568 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-13T14:19:14.313 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/568 2023-09-13T14:19:14.313 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/568 2023-09-13T14:19:14.313 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T14:19:14.315 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:14.349 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T14:19:14.351 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/569) 2023-09-13T14:19:14.564 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:19:14.568 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:19:14.569 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:19:14.570 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:19:14.570 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:14.911 INFO:teuthology.orchestra.run.smithi084.stdout:generic/569 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-13T14:19:14.915 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/569 2023-09-13T14:19:14.915 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/569 2023-09-13T14:19:14.915 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T14:19:14.917 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:14.945 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T14:19:14.946 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/570) 2023-09-13T14:19:15.146 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:19:15.149 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:19:15.150 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:19:15.151 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:19:15.151 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:15.509 INFO:teuthology.orchestra.run.smithi084.stdout:generic/570 [not run] require 172.21.15.84:6789:/scratch to be valid block disk 2023-09-13T14:19:15.513 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/570 2023-09-13T14:19:15.513 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/570 2023-09-13T14:19:15.514 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T14:19:15.515 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:15.540 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T14:19:15.541 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/571) 2023-09-13T14:19:15.742 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:19:15.746 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:19:15.746 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:19:15.747 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:19:15.747 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:16.133 INFO:teuthology.orchestra.run.smithi084.stdout:generic/571 [not run] Require fcntl setlease support 2023-09-13T14:19:16.137 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/571 2023-09-13T14:19:16.137 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/571 2023-09-13T14:19:16.137 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T14:19:16.139 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:16.186 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T14:19:16.187 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/572) 2023-09-13T14:19:16.398 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:19:16.402 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:19:16.402 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:19:16.403 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:19:16.403 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:16.755 INFO:teuthology.orchestra.run.smithi084.stdout:generic/572 [not run] fsverity utility required, skipped this test 2023-09-13T14:19:16.758 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/572 2023-09-13T14:19:16.759 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/572 2023-09-13T14:19:16.759 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T14:19:16.761 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:16.782 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T14:19:16.783 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/573) 2023-09-13T14:19:16.989 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:19:16.993 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:19:16.994 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:19:16.995 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:19:16.995 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:17.333 INFO:teuthology.orchestra.run.smithi084.stdout:generic/573 [not run] fsverity utility required, skipped this test 2023-09-13T14:19:17.336 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/573 2023-09-13T14:19:17.338 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/573 2023-09-13T14:19:17.338 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T14:19:17.338 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:17.372 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T14:19:17.373 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/574) 2023-09-13T14:19:17.589 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:19:17.593 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:19:17.594 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:19:17.595 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:19:17.595 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:17.925 INFO:teuthology.orchestra.run.smithi084.stdout:generic/574 [not run] fsverity utility required, skipped this test 2023-09-13T14:19:17.929 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/574 2023-09-13T14:19:17.929 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/574 2023-09-13T14:19:17.929 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T14:19:17.931 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:17.970 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T14:19:17.971 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/575) 2023-09-13T14:19:18.176 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:19:18.180 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:19:18.181 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:19:18.182 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:19:18.182 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:18.535 INFO:teuthology.orchestra.run.smithi084.stdout:generic/575 [not run] fsverity utility required, skipped this test 2023-09-13T14:19:18.539 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/575 2023-09-13T14:19:18.539 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/575 2023-09-13T14:19:18.539 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T14:19:18.541 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:18.570 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T14:19:18.571 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/576) 2023-09-13T14:19:18.774 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:19:18.778 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:19:18.778 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:19:18.779 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:19:18.779 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:19.160 INFO:teuthology.orchestra.run.smithi084.stdout:generic/576 [not run] fsverity utility required, skipped this test 2023-09-13T14:19:19.164 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/576 2023-09-13T14:19:19.164 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/576 2023-09-13T14:19:19.164 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T14:19:19.166 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:19.196 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T14:19:19.196 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/577) 2023-09-13T14:19:19.401 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:19:19.405 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:19:19.406 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:19:19.409 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:19:19.409 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:19.743 INFO:teuthology.orchestra.run.smithi084.stdout:generic/577 [not run] fsverity utility required, skipped this test 2023-09-13T14:19:19.747 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/577 2023-09-13T14:19:19.747 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/577 2023-09-13T14:19:19.747 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T14:19:19.749 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:19.778 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T14:19:19.778 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/578) 2023-09-13T14:19:19.993 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:19:19.998 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:19:19.998 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:19:19.999 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:19:19.999 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:20.335 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~126s 2023-09-13T14:19:20.452 INFO:teuthology.orchestra.run.smithi084.stdout:generic/578 [not run] Reflink not supported by test filesystem type: ceph 2023-09-13T14:19:20.456 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/578 2023-09-13T14:19:20.457 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/578 2023-09-13T14:19:20.457 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T14:19:20.458 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:20.798 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T14:19:20.799 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/579) 2023-09-13T14:19:21.073 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:19:21.077 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:19:21.077 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:19:21.078 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:19:21.079 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:21.465 INFO:teuthology.orchestra.run.smithi084.stdout:generic/579 [not run] fsverity utility required, skipped this test 2023-09-13T14:19:21.467 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/579 2023-09-13T14:19:21.467 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/579 2023-09-13T14:19:21.468 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T14:19:21.468 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:21.499 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T14:19:21.501 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/580) 2023-09-13T14:19:21.685 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:19:21.687 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:19:21.706 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:19:21.711 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:19:21.711 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:19:21.712 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:19:21.712 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:22.243 INFO:teuthology.orchestra.run.smithi084.stdout:generic/580 [not run] kernel does not support ceph encryption 2023-09-13T14:19:22.265 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/580 2023-09-13T14:19:22.266 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/580 2023-09-13T14:19:22.266 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T14:19:22.268 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:22.288 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T14:19:22.289 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/581) 2023-09-13T14:19:22.494 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:19:22.498 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:19:22.498 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:19:22.499 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:19:22.499 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:23.343 INFO:teuthology.orchestra.run.smithi084.stdout:generic/581 [not run] kernel does not support ceph encryption 2023-09-13T14:19:23.368 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/581 2023-09-13T14:19:23.369 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/581 2023-09-13T14:19:23.369 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T14:19:23.370 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:23.396 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T14:19:23.397 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/582) 2023-09-13T14:19:23.602 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:19:23.606 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:19:23.607 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:19:23.608 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:19:23.608 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:24.154 INFO:teuthology.orchestra.run.smithi084.stdout:generic/582 [not run] kernel does not support ceph encryption 2023-09-13T14:19:24.174 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/582 2023-09-13T14:19:24.175 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/582 2023-09-13T14:19:24.175 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T14:19:24.176 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:24.198 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T14:19:24.198 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/583) 2023-09-13T14:19:24.406 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:19:24.411 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:19:24.411 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:19:24.412 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:19:24.412 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:24.956 INFO:teuthology.orchestra.run.smithi084.stdout:generic/583 [not run] kernel does not support ceph encryption 2023-09-13T14:19:24.982 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/583 2023-09-13T14:19:24.983 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/583 2023-09-13T14:19:24.983 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T14:19:24.984 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:25.008 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T14:19:25.009 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/584) 2023-09-13T14:19:25.242 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:19:25.246 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:19:25.246 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:19:25.247 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:19:25.248 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:25.803 INFO:teuthology.orchestra.run.smithi084.stdout:generic/584 [not run] kernel does not support ceph encryption 2023-09-13T14:19:25.826 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/584 2023-09-13T14:19:25.826 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/584 2023-09-13T14:19:25.827 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T14:19:25.828 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:25.855 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T14:19:25.856 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/585) 2023-09-13T14:19:26.057 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:19:26.061 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:19:26.062 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:19:26.063 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:19:26.063 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:26.461 INFO:teuthology.orchestra.run.smithi084.stdout:generic/585 [not run] kernel doesn't support renameat2 syscall 2023-09-13T14:19:26.465 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/585 2023-09-13T14:19:26.466 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/585 2023-09-13T14:19:26.466 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T14:19:26.468 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:26.874 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T14:19:26.875 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/586) 2023-09-13T14:19:26.948 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~132s 2023-09-13T14:19:27.087 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:19:27.092 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:19:27.092 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:19:27.093 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:19:27.093 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:27.517 INFO:teuthology.orchestra.run.smithi084.stdout:generic/586 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-13T14:19:27.521 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/586 2023-09-13T14:19:27.521 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/586 2023-09-13T14:19:27.522 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T14:19:27.523 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:27.935 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T14:19:27.936 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/587) 2023-09-13T14:19:28.141 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:19:28.146 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:19:28.146 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:19:28.147 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:19:28.147 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:28.493 INFO:teuthology.orchestra.run.smithi084.stdout:generic/587 [not run] disk quotas not supported by this filesystem type: ceph 2023-09-13T14:19:28.497 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/587 2023-09-13T14:19:28.497 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/587 2023-09-13T14:19:28.498 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T14:19:28.499 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:28.530 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T14:19:28.530 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/588) 2023-09-13T14:19:28.736 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:19:28.740 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:19:28.740 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:19:28.741 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:19:28.741 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:29.657 INFO:teuthology.orchestra.run.smithi084.stdout:generic/588 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T14:19:29.663 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/588 2023-09-13T14:19:29.663 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/588 2023-09-13T14:19:29.663 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T14:19:29.666 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:29.693 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T14:19:29.694 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/589) 2023-09-13T14:19:29.919 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:19:29.923 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:19:29.924 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:19:29.925 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:19:29.925 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:30.263 INFO:teuthology.orchestra.run.smithi084.stdout:generic/589 [not run] require 172.21.15.84:6789:/scratch to be local device 2023-09-13T14:19:30.267 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/589 2023-09-13T14:19:30.268 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/589 2023-09-13T14:19:30.268 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T14:19:30.269 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:30.290 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T14:19:30.291 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/590) 2023-09-13T14:19:30.495 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:19:30.500 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:19:30.500 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:19:30.501 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:19:30.501 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:30.846 INFO:teuthology.orchestra.run.smithi084.stdout:generic/590 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-13T14:19:30.850 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/590 2023-09-13T14:19:30.851 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/590 2023-09-13T14:19:30.851 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T14:19:30.852 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:30.881 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T14:19:30.882 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/591) 2023-09-13T14:19:31.096 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:19:31.100 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:19:31.100 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:19:31.101 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:19:31.101 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:31.568 INFO:teuthology.orchestra.run.smithi084.stdout:generic/591 0s 2023-09-13T14:19:31.573 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/591 2023-09-13T14:19:31.574 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T14:19:31.575 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:31.887 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T14:19:31.887 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/592) 2023-09-13T14:19:32.184 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:19:32.188 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:19:32.188 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:19:32.189 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:19:32.189 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:32.727 INFO:teuthology.orchestra.run.smithi084.stdout:generic/592 [not run] kernel does not support ceph encryption 2023-09-13T14:19:32.745 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/592 2023-09-13T14:19:32.745 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/592 2023-09-13T14:19:32.746 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T14:19:32.747 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:32.775 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T14:19:32.776 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/593) 2023-09-13T14:19:32.977 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:19:32.981 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:19:32.982 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:19:32.983 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:19:32.983 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:33.523 INFO:teuthology.orchestra.run.smithi084.stdout:generic/593 [not run] kernel does not support ceph encryption 2023-09-13T14:19:33.547 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/593 2023-09-13T14:19:33.547 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/593 2023-09-13T14:19:33.547 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T14:19:33.549 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:33.561 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~139s 2023-09-13T14:19:33.568 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T14:19:33.568 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/594) 2023-09-13T14:19:33.769 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:19:33.773 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:19:33.773 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:19:33.774 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:19:33.774 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:34.134 INFO:teuthology.orchestra.run.smithi084.stdout:generic/594 [not run] disk quotas not supported by this filesystem type: ceph 2023-09-13T14:19:34.138 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/594 2023-09-13T14:19:34.138 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/594 2023-09-13T14:19:34.138 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T14:19:34.140 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:34.174 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T14:19:34.175 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/595) 2023-09-13T14:19:34.397 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:19:34.401 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:19:34.402 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:19:34.403 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:19:34.403 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:34.955 INFO:teuthology.orchestra.run.smithi084.stdout:generic/595 [not run] kernel does not support ceph encryption 2023-09-13T14:19:34.981 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/595 2023-09-13T14:19:34.981 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/595 2023-09-13T14:19:34.981 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T14:19:34.983 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:35.005 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T14:19:35.005 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/596) 2023-09-13T14:19:35.223 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:19:35.227 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:19:35.227 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:19:35.228 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:19:35.228 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:35.612 INFO:teuthology.orchestra.run.smithi084.stdout:generic/596 [not run] file system doesn't support chattr +S 2023-09-13T14:19:35.616 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/596 2023-09-13T14:19:35.616 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/596 2023-09-13T14:19:35.616 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T14:19:35.618 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:35.645 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T14:19:35.646 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/597) 2023-09-13T14:19:35.851 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:19:35.855 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:19:35.856 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:19:35.857 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:19:35.857 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:36.519 INFO:teuthology.orchestra.run.smithi084.stdout:generic/597 0s 2023-09-13T14:19:36.524 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/597 2023-09-13T14:19:36.524 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T14:19:36.526 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:36.894 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T14:19:36.895 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/598) 2023-09-13T14:19:37.154 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:19:37.158 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:19:37.159 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:19:37.160 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:19:37.160 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:37.825 INFO:teuthology.orchestra.run.smithi084.stdout:generic/598 0s 2023-09-13T14:19:37.830 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/598 2023-09-13T14:19:37.830 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T14:19:37.832 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:38.202 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T14:19:38.203 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/599) 2023-09-13T14:19:38.430 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:19:38.434 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:19:38.435 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:19:38.435 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:19:38.436 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:38.916 INFO:teuthology.orchestra.run.smithi084.stdout:generic/599 [not run] ceph does not support shutdown 2023-09-13T14:19:38.941 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/599 2023-09-13T14:19:38.942 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/599 2023-09-13T14:19:38.942 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T14:19:38.943 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:38.963 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T14:19:38.964 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/600) 2023-09-13T14:19:39.171 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:19:39.175 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:19:39.176 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:19:39.177 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:19:39.177 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:39.516 INFO:teuthology.orchestra.run.smithi084.stdout:generic/600 [not run] disk quotas not supported by this filesystem type: ceph 2023-09-13T14:19:39.520 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/600 2023-09-13T14:19:39.520 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/600 2023-09-13T14:19:39.520 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T14:19:39.522 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:39.554 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T14:19:39.555 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/601) 2023-09-13T14:19:39.756 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:19:39.759 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:19:39.760 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:19:39.761 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:19:39.761 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:40.111 INFO:teuthology.orchestra.run.smithi084.stdout:generic/601 [not run] disk quotas not supported by this filesystem type: ceph 2023-09-13T14:19:40.115 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/601 2023-09-13T14:19:40.115 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/601 2023-09-13T14:19:40.115 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T14:19:40.117 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:40.138 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T14:19:40.139 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/602) 2023-09-13T14:19:40.174 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~145s 2023-09-13T14:19:40.346 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:19:40.350 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:19:40.351 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:19:40.352 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:19:40.352 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:40.882 INFO:teuthology.orchestra.run.smithi084.stdout:generic/602 [not run] kernel does not support ceph encryption 2023-09-13T14:19:40.904 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/602 2023-09-13T14:19:40.905 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/602 2023-09-13T14:19:40.905 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T14:19:40.906 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:40.934 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T14:19:40.935 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/603) 2023-09-13T14:19:41.139 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:19:41.143 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:19:41.144 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:19:41.145 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:19:41.145 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:41.498 INFO:teuthology.orchestra.run.smithi084.stdout:generic/603 [not run] disk quotas not supported by this filesystem type: ceph 2023-09-13T14:19:41.502 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/603 2023-09-13T14:19:41.503 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/603 2023-09-13T14:19:41.503 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T14:19:41.504 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:41.530 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T14:19:41.530 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/604) 2023-09-13T14:19:41.732 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:19:41.736 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:19:41.736 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:19:41.737 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:19:41.738 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:45.227 INFO:teuthology.orchestra.run.smithi084.stdout:generic/604 4s 2023-09-13T14:19:45.231 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/604 2023-09-13T14:19:45.232 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T14:19:45.233 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:45.242 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T14:19:45.243 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/605) 2023-09-13T14:19:45.464 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:19:45.468 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:19:45.468 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:19:45.469 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:19:45.469 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:46.788 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~152s 2023-09-13T14:19:47.110 INFO:teuthology.orchestra.run.smithi084.stdout:generic/605 [not run] mount 172.21.15.84:6789:/scratch with dax=always failed 2023-09-13T14:19:47.115 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/605 2023-09-13T14:19:47.115 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/605 2023-09-13T14:19:47.115 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T14:19:47.117 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:47.143 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T14:19:47.144 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/606) 2023-09-13T14:19:47.349 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:19:47.353 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:19:47.353 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:19:47.354 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:19:47.354 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:48.178 INFO:teuthology.orchestra.run.smithi084.stdout:generic/606 [not run] mount 172.21.15.84:6789:/scratch with dax=always failed 2023-09-13T14:19:48.183 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/606 2023-09-13T14:19:48.183 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/606 2023-09-13T14:19:48.183 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T14:19:48.185 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:48.209 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T14:19:48.211 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/607) 2023-09-13T14:19:48.420 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:19:48.424 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:19:48.424 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:19:48.425 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:19:48.426 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:48.783 INFO:teuthology.orchestra.run.smithi084.stdout:generic/607 [not run] xfs_io chattr +x failed (old kernel/wrong fs?) 2023-09-13T14:19:48.787 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/607 2023-09-13T14:19:48.787 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/607 2023-09-13T14:19:48.787 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T14:19:48.789 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:49.198 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T14:19:49.199 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/608) 2023-09-13T14:19:49.408 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:19:49.412 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:19:49.413 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:19:49.414 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:19:49.414 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:49.891 INFO:teuthology.orchestra.run.smithi084.stdout:generic/608 [not run] mount 172.21.15.84:6789:/scratch with dax=always failed 2023-09-13T14:19:49.896 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/608 2023-09-13T14:19:49.896 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/608 2023-09-13T14:19:49.896 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T14:19:49.898 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:49.924 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T14:19:49.925 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/609) 2023-09-13T14:19:50.138 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:19:50.142 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:19:50.143 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:19:50.144 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:19:50.144 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:50.682 INFO:teuthology.orchestra.run.smithi084.stdout:generic/609 0s 2023-09-13T14:19:50.687 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/609 2023-09-13T14:19:50.687 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T14:19:50.689 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:51.103 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T14:19:51.105 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/610) 2023-09-13T14:19:51.321 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:19:51.324 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:19:51.325 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:19:51.326 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:19:51.326 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:51.743 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:19:51.746 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:19:51.764 INFO:teuthology.orchestra.run.smithi084.stdout:generic/610 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-09-13T14:19:51.768 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/610 2023-09-13T14:19:51.768 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/610 2023-09-13T14:19:51.768 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T14:19:51.770 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:51.806 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T14:19:51.807 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/611) 2023-09-13T14:19:52.061 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:19:52.065 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:19:52.065 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:19:52.066 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:19:52.066 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:52.806 INFO:teuthology.orchestra.run.smithi084.stdout:generic/611 0s 2023-09-13T14:19:52.811 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/611 2023-09-13T14:19:52.811 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T14:19:52.813 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:52.821 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T14:19:52.822 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/612) 2023-09-13T14:19:53.059 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:19:53.062 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:19:53.063 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:19:53.064 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:19:53.064 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:53.400 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~159s 2023-09-13T14:19:53.545 INFO:teuthology.orchestra.run.smithi084.stdout:generic/612 [not run] Reflink not supported by test filesystem type: ceph 2023-09-13T14:19:53.549 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/612 2023-09-13T14:19:53.550 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/612 2023-09-13T14:19:53.550 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T14:19:53.551 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:53.938 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T14:19:53.939 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/613) 2023-09-13T14:19:54.173 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:19:54.177 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:19:54.178 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:19:54.179 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:19:54.179 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:54.734 INFO:teuthology.orchestra.run.smithi084.stdout:generic/613 [not run] kernel does not support ceph encryption 2023-09-13T14:19:54.758 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/613 2023-09-13T14:19:54.758 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/613 2023-09-13T14:19:54.759 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T14:19:54.759 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:54.788 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T14:19:54.788 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/614) 2023-09-13T14:19:54.998 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:19:55.002 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:19:55.002 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:19:55.003 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:19:55.003 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:55.563 INFO:teuthology.orchestra.run.smithi084.stdout:generic/614 [not run] test requires delayed allocation buffered writes 2023-09-13T14:19:55.592 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/614 2023-09-13T14:19:55.592 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/614 2023-09-13T14:19:55.592 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T14:19:55.594 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:19:55.629 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T14:19:55.630 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/615) 2023-09-13T14:19:55.836 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:19:55.840 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:19:55.841 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:19:55.842 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:19:55.842 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:20:00.013 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~165s 2023-09-13T14:20:06.626 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~172s 2023-09-13T14:20:13.240 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~179s 2023-09-13T14:20:19.854 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~185s 2023-09-13T14:20:21.864 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:20:21.867 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:20:26.469 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~192s 2023-09-13T14:20:28.695 INFO:teuthology.orchestra.run.smithi084.stdout:generic/615 32s 2023-09-13T14:20:28.700 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/615 2023-09-13T14:20:28.700 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T14:20:28.702 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:20:28.711 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T14:20:28.712 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/616) 2023-09-13T14:20:28.916 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:20:28.920 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:20:28.921 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:20:28.921 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:20:28.922 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:20:29.259 INFO:teuthology.orchestra.run.smithi084.stdout:generic/616 [not run] kernel does not support IO_URING 2023-09-13T14:20:29.262 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/616 2023-09-13T14:20:29.263 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/616 2023-09-13T14:20:29.263 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T14:20:29.264 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:20:29.292 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T14:20:29.293 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/617) 2023-09-13T14:20:29.528 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:20:29.532 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:20:29.533 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:20:29.534 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:20:29.534 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:20:29.912 INFO:teuthology.orchestra.run.smithi084.stdout:generic/617 [not run] kernel does not support IO_URING 2023-09-13T14:20:29.916 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/617 2023-09-13T14:20:29.917 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/617 2023-09-13T14:20:29.917 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T14:20:29.918 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:20:29.960 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T14:20:29.961 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/618) 2023-09-13T14:20:30.171 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:20:30.175 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:20:30.176 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:20:30.176 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:20:30.177 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:20:30.905 INFO:teuthology.orchestra.run.smithi084.stdout:generic/618 0s 2023-09-13T14:20:30.910 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/618 2023-09-13T14:20:30.910 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T14:20:30.912 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:20:30.920 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T14:20:30.921 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/619) 2023-09-13T14:20:31.123 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:20:31.127 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:20:31.127 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:20:31.128 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:20:31.128 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:20:31.476 INFO:teuthology.orchestra.run.smithi084.stdout:generic/619 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-13T14:20:31.481 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/619 2023-09-13T14:20:31.481 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/619 2023-09-13T14:20:31.481 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T14:20:31.482 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:20:31.516 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T14:20:31.517 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/620) 2023-09-13T14:20:31.754 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:20:31.758 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:20:31.758 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:20:31.759 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:20:31.760 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:20:32.132 INFO:teuthology.orchestra.run.smithi084.stdout:generic/620 [not run] require 172.21.15.84:6789:/scratch to be valid block disk 2023-09-13T14:20:32.136 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/620 2023-09-13T14:20:32.136 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/620 2023-09-13T14:20:32.136 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T14:20:32.138 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:20:32.161 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T14:20:32.162 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/621) 2023-09-13T14:20:32.367 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:20:32.371 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:20:32.371 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:20:32.372 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:20:32.372 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:20:32.914 INFO:teuthology.orchestra.run.smithi084.stdout:generic/621 [not run] kernel does not support ceph encryption 2023-09-13T14:20:32.937 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/621 2023-09-13T14:20:32.937 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/621 2023-09-13T14:20:32.937 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T14:20:32.939 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:20:32.965 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T14:20:32.966 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/622) 2023-09-13T14:20:33.082 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~198s 2023-09-13T14:20:33.170 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:20:33.174 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:20:33.174 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:20:33.175 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:20:33.175 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:20:33.691 INFO:teuthology.orchestra.run.smithi084.stdout:generic/622 [not run] ceph does not support shutdown 2023-09-13T14:20:33.713 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/622 2023-09-13T14:20:33.714 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/622 2023-09-13T14:20:33.714 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T14:20:33.714 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:20:33.749 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T14:20:33.750 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/623) 2023-09-13T14:20:33.956 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:20:33.960 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:20:33.960 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:20:33.961 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:20:33.961 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:20:34.504 INFO:teuthology.orchestra.run.smithi084.stdout:generic/623 [not run] ceph does not support shutdown 2023-09-13T14:20:34.529 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/623 2023-09-13T14:20:34.529 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/623 2023-09-13T14:20:34.529 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T14:20:34.530 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:20:34.561 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T14:20:34.562 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/624) 2023-09-13T14:20:34.770 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:20:34.774 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:20:34.775 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:20:34.776 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:20:34.776 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:20:35.099 INFO:teuthology.orchestra.run.smithi084.stdout:generic/624 [not run] fsverity utility required, skipped this test 2023-09-13T14:20:35.103 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/624 2023-09-13T14:20:35.103 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/624 2023-09-13T14:20:35.103 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T14:20:35.105 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:20:35.133 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T14:20:35.134 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/625) 2023-09-13T14:20:35.343 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:20:35.347 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:20:35.347 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:20:35.348 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:20:35.348 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:20:35.687 INFO:teuthology.orchestra.run.smithi084.stdout:generic/625 [not run] fsverity utility required, skipped this test 2023-09-13T14:20:35.691 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/625 2023-09-13T14:20:35.691 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/625 2023-09-13T14:20:35.691 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T14:20:35.693 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:20:35.730 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T14:20:35.731 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/626) 2023-09-13T14:20:35.934 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:20:35.938 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:20:35.938 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:20:35.939 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:20:35.940 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:20:36.326 INFO:teuthology.orchestra.run.smithi084.stdout:generic/626 [not run] kernel doesn't support renameat2 syscall 2023-09-13T14:20:36.330 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/626 2023-09-13T14:20:36.330 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/626 2023-09-13T14:20:36.330 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T14:20:36.332 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:20:36.615 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T14:20:36.616 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/627) 2023-09-13T14:20:36.934 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:20:36.938 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:20:36.939 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:20:36.940 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:20:36.940 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:20:37.339 INFO:teuthology.orchestra.run.smithi084.stdout:generic/627 [not run] require 172.21.15.84:6789:/scratch to be valid block disk 2023-09-13T14:20:37.343 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/627 2023-09-13T14:20:37.343 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/627 2023-09-13T14:20:37.344 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T14:20:37.345 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:20:37.380 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T14:20:37.381 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/628) 2023-09-13T14:20:37.589 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:20:37.594 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:20:37.594 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:20:37.595 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:20:37.595 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:20:38.479 INFO:teuthology.orchestra.run.smithi084.stdout:generic/628 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-13T14:20:38.487 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/628 2023-09-13T14:20:38.487 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/628 2023-09-13T14:20:38.487 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T14:20:38.503 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:20:38.533 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T14:20:38.534 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/629) 2023-09-13T14:20:38.744 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:20:38.747 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:20:38.748 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:20:38.749 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:20:38.749 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:20:39.094 INFO:teuthology.orchestra.run.smithi084.stdout:generic/629 [not run] require 172.21.15.84:6789:/scratch to be valid block disk 2023-09-13T14:20:39.098 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/629 2023-09-13T14:20:39.098 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/629 2023-09-13T14:20:39.098 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T14:20:39.100 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:20:39.130 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T14:20:39.130 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/630) 2023-09-13T14:20:39.332 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:20:39.336 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:20:39.336 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:20:39.337 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:20:39.337 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:20:39.694 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~205s 2023-09-13T14:20:39.871 INFO:teuthology.orchestra.run.smithi084.stdout:generic/630 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-09-13T14:20:39.978 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/630 2023-09-13T14:20:39.978 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/630 2023-09-13T14:20:39.979 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-13T14:20:39.979 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:20:40.222 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-13T14:20:40.223 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/631) 2023-09-13T14:20:40.469 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:20:40.473 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:20:40.474 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:20:40.475 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:20:40.475 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:20:46.305 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~212s 2023-09-13T14:20:52.109 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:20:52.112 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:20:52.919 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~218s 2023-09-13T14:20:59.532 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~225s 2023-09-13T14:21:06.149 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~231s 2023-09-13T14:21:11.751 INFO:teuthology.orchestra.run.smithi084.stdout:generic/631 - output mismatch (see /tmp/tmp.UxTBQ6XIL3xfstests-dev/results//generic/631.out.bad) 2023-09-13T14:21:11.786 INFO:teuthology.orchestra.run.smithi084.stdout: --- tests/generic/631.out 2023-09-13 08:26:09.892733142 +0000 2023-09-13T14:21:11.787 INFO:teuthology.orchestra.run.smithi084.stdout: +++ /tmp/tmp.UxTBQ6XIL3xfstests-dev/results//generic/631.out.bad 2023-09-13 14:21:11.719364630 +0000 2023-09-13T14:21:11.787 INFO:teuthology.orchestra.run.smithi084.stdout: @@ -1,2 +1,3560 @@ 2023-09-13T14:21:11.787 INFO:teuthology.orchestra.run.smithi084.stdout: QA output created by 631 2023-09-13T14:21:11.787 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.788 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:11.788 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:11.788 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:11.788 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:11.789 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:11.789 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.789 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:11.789 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:11.789 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:11.790 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:11.790 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:11.790 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: mount: mount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.790 INFO:teuthology.orchestra.run.smithi084.stdout: + 2023-09-13T14:21:11.790 INFO:teuthology.orchestra.run.smithi084.stdout: + 2023-09-13T14:21:11.791 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:11.791 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:11.791 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:11.791 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:11.792 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:11.792 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:11.793 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:11.793 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:11.794 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:11.794 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:11.794 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:11.794 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:11.795 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:11.795 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:11.795 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:11.795 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.795 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:11.796 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:11.796 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:11.796 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:11.796 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:11.797 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.797 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:11.797 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:11.797 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:11.797 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:11.798 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:11.798 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: mount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.798 INFO:teuthology.orchestra.run.smithi084.stdout: + 2023-09-13T14:21:11.798 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:11.799 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:11.799 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:11.799 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:11.799 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:11.800 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:11.800 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:11.800 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:11.800 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:11.800 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:11.801 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.801 INFO:teuthology.orchestra.run.smithi084.stdout: + 2023-09-13T14:21:11.801 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf'cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory: No such file or directory 2023-09-13T14:21:11.801 INFO:teuthology.orchestra.run.smithi084.stdout: + 2023-09-13T14:21:11.801 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:11.802 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:11.802 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:11.802 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:11.803 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:11.803 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:11.803 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:11.803 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:11.803 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.804 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:11.804 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:11.804 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:11.804 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:11.805 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:11.805 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.805 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:11.805 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:11.805 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:11.806 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:11.806 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:11.806 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.806 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:11.806 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:11.807 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:11.807 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:11.807 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:11.807 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.807 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:11.808 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:11.808 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:11.808 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:11.808 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:11.808 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.809 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: mount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.809 INFO:teuthology.orchestra.run.smithi084.stdout: + 2023-09-13T14:21:11.809 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:11.809 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:11.810 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:11.810 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:11.810 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:11.810 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:11.810 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:11.811 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:11.811 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:11.811 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:11.811 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:11.812 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:11.812 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:11.812 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:11.813 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:11.813 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.813 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:11.813 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:11.814 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:11.814 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:11.814 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:11.814 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.815 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.815 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:11.815 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:11.815 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:11.815 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:11.816 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:11.816 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:11.816 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:11.816 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:11.816 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:11.817 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:11.817 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.817 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:11.817 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:11.817 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:11.818 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:11.818 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:11.818 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.818 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:11.819 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:11.819 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:11.819 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:11.819 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:11.819 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.820 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:11.820 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:11.820 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:11.820 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:11.820 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:11.820 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.821 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:11.821 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:11.821 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:11.821 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:11.821 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:11.822 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.822 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:11.822 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:11.823 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:11.823 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:11.823 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:11.823 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.824 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:11.824 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:11.824 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:11.824 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:11.825 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:11.825 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.826 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:11.826 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:11.826 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:11.826 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:11.827 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:11.827 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.827 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:11.828 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:11.828 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:11.828 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:11.829 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:11.829 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.829 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:11.830 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:11.830 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:11.830 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:11.830 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:11.831 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.831 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:11.831 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:11.831 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:11.832 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:11.832 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:11.832 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.833 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:11.833 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:11.833 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:11.834 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:11.834 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:11.834 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.835 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:11.835 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:11.835 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:11.836 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:11.836 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:11.836 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.837 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:11.837 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:11.837 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:11.838 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:11.838 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.838 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:11.839 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:11.839 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:11.839 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:11.840 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:11.840 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:11.841 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.841 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:11.841 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:11.842 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:11.842 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:11.842 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:11.843 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.843 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.843 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:11.844 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.844 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:11.845 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:11.845 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:11.845 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:11.846 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:11.846 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:11.846 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:11.847 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:11.847 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:11.847 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:11.848 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:11.848 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:11.849 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:11.849 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:11.849 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.849 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:11.849 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:11.850 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:11.850 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:11.850 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:11.850 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.851 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:11.851 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:11.851 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:11.851 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:11.851 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:11.852 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.852 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:11.852 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:11.852 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:11.852 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:11.853 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:11.853 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.853 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:11.853 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:11.854 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:11.854 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:11.854 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:11.854 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.855 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:11.855 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:11.855 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:11.856 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:11.856 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:11.856 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.857 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:11.857 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:11.857 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:11.857 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:11.858 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:11.858 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.858 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.858 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:11.859 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:11.859 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:11.859 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:11.860 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:11.860 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:11.860 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:11.861 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:11.861 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:11.861 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:11.862 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.862 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:11.862 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:11.863 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:11.863 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:11.864 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:11.864 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.864 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:11.864 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:11.865 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:11.865 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:11.865 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:11.865 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.865 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:11.866 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:11.866 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:11.866 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:11.866 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:11.867 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.867 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:11.867 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:11.867 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:11.868 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:11.868 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:11.868 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.869 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:11.869 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:11.869 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:11.869 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:11.870 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:11.870 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.870 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:11.870 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:11.871 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:11.871 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:11.871 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:11.871 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.872 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:11.872 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:11.872 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:11.872 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:11.872 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:11.873 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.873 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:11.873 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:11.874 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:11.874 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:11.874 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:11.874 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.874 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:11.875 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:11.875 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:11.875 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:11.876 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:11.876 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.876 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:11.876 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:11.876 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:11.877 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:11.877 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:11.877 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.878 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:11.878 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:11.878 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:11.878 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:11.879 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:11.879 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.879 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:11.879 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:11.880 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:11.880 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:11.880 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:11.880 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.881 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:11.881 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:11.881 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:11.881 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:11.882 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:11.882 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.882 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:11.882 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:11.882 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:11.883 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:11.883 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:11.883 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.883 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:11.884 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:11.884 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:11.884 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:11.884 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:11.885 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.885 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:11.885 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:11.885 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:11.885 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:11.886 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:11.886 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.886 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.886 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:11.886 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:11.887 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:11.887 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:11.887 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:11.888 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:11.888 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:11.888 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:11.888 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:11.889 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:11.889 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.889 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:11.889 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:11.890 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:11.890 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:11.890 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:11.890 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.891 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:11.891 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:11.891 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:11.892 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:11.892 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:11.892 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.892 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:11.893 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:11.893 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:11.893 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:11.893 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:11.893 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.894 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:11.894 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:11.897 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:11.897 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:11.898 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:11.898 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.898 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:11.898 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:11.899 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:11.899 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:11.899 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:11.899 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.900 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:11.900 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:11.900 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:11.901 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:11.901 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:11.901 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.901 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:11.902 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:11.902 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:11.902 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:11.903 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:11.903 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.903 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:11.903 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:11.903 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:11.904 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:11.904 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:11.904 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.904 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:11.905 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:11.905 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:11.905 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:11.906 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:11.906 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.906 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:11.907 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:11.907 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:11.907 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:11.908 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:11.908 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.909 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:11.909 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:11.909 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:11.910 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:11.910 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:11.910 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.911 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:11.911 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:11.911 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:11.911 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:11.912 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.912 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:11.912 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:11.913 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:11.913 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:11.913 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:11.914 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:11.914 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.914 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:11.915 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:11.915 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:11.915 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:11.916 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:11.916 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.916 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:11.917 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:11.917 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:11.917 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:11.918 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:11.918 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.918 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:11.918 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:11.919 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:11.919 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:11.920 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:11.920 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.920 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:11.921 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:11.921 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:11.921 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:11.922 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:11.922 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.922 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:11.922 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:11.922 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:11.923 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:11.923 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:11.923 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.923 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:11.923 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:11.924 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:11.924 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:11.924 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:11.924 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.925 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:11.925 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:11.925 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:11.925 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:11.925 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:11.926 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.926 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:11.926 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:11.926 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:11.927 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:11.927 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:11.927 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.927 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:11.927 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:11.927 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:11.928 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:11.928 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:11.928 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.928 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:11.929 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:11.929 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:11.929 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:11.929 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:11.929 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.930 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:11.930 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:11.930 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:11.930 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:11.930 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:11.931 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.931 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:11.931 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:11.931 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:11.931 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:11.932 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:11.932 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.932 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:11.932 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:11.932 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:11.933 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:11.933 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:11.933 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.933 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:11.934 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:11.934 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:11.934 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:11.934 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:11.935 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.935 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:11.935 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:11.935 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:11.935 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:11.936 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:11.936 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.936 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:11.936 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:11.937 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:11.937 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:11.937 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:11.937 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.938 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:11.938 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:11.938 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:11.938 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:11.939 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:11.939 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.939 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:11.940 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:11.940 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:11.940 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:11.941 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:11.941 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.941 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:11.942 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:11.942 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:11.942 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:11.943 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:11.943 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.943 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:11.943 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:11.943 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.944 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: mv: /tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:11.944 INFO:teuthology.orchestra.run.smithi084.stdout: + 2023-09-13T14:21:11.944 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:11.944 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:11.945 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:11.945 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:11.945 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:11.946 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:11.946 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:11.946 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:11.946 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:11.946 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:11.947 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:11.947 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:11.947 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.947 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:11.948 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:11.948 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:11.948 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:11.948 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:11.949 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.949 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:11.949 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:11.950 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:11.950 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:11.950 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:11.950 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.950 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.951 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:11.951 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:11.951 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:11.951 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:11.951 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:11.952 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:11.952 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:11.952 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:11.952 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:11.952 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:11.953 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.953 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:11.953 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:11.954 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:11.954 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:11.954 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:11.954 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.955 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:11.955 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:11.955 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:11.955 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:11.955 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:11.955 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.956 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:11.956 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:11.956 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:11.956 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:11.957 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:11.957 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.957 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:11.958 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:11.958 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:11.958 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:11.958 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:11.959 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.959 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:11.959 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:11.960 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:11.960 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:11.960 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:11.961 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.961 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:11.961 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:11.961 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:11.962 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:11.962 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:11.962 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.962 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:11.963 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:11.963 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:11.963 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:11.963 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:11.964 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.964 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:11.964 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:11.964 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:11.965 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:11.965 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:11.965 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.965 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:11.965 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:11.966 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:11.966 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:11.966 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:11.967 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.967 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:11.967 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:11.967 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:11.968 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:11.968 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:11.968 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.968 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:11.968 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:11.969 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:11.969 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:11.969 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:11.969 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.970 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:11.970 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:11.970 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:11.970 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:11.970 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:11.971 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.971 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:11.971 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:11.971 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:11.972 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:11.972 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:11.972 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.973 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:11.973 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:11.973 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:11.974 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:11.974 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.974 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:11.975 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:11.975 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:11.975 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:11.976 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:11.976 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:11.976 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.977 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:11.977 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:11.977 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:11.978 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:11.978 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:11.978 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.979 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:11.979 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:11.979 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:11.980 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:11.980 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:11.980 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.980 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:11.980 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:11.981 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:11.981 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:11.981 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:11.981 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.982 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:11.982 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:11.982 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:11.983 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:11.983 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:11.983 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.983 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:11.983 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:11.984 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:11.984 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:11.984 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:11.984 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.985 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:11.985 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:11.985 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:11.985 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:11.986 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:11.986 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.986 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:11.986 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:11.987 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:11.987 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:11.987 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:11.987 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.988 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:11.988 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:11.988 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:11.989 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:11.989 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:11.989 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.989 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:11.990 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:11.990 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:11.990 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.990 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.990 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:11.991 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:11.991 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.991 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:11.992 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:11.992 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:11.992 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:11.992 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:11.992 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:11.993 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:11.993 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:11.993 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:11.993 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:11.994 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:11.994 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:11.994 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:11.995 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:11.995 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:11.995 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.995 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:11.996 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:11.996 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:11.996 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:11.996 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.996 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:11.997 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:11.997 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:11.997 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:11.997 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:11.997 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:11.998 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:11.998 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:11.998 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:11.999 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:11.999 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:11.999 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:12.000 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.000 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.000 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.001 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.001 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.001 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:12.002 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.002 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.002 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.002 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.002 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.003 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:12.003 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.003 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.004 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.004 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.004 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.004 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:12.005 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.005 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.005 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.006 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.006 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.007 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:12.007 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.007 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.008 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.008 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.008 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.009 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:12.009 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.009 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.010 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.010 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.010 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.011 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:12.011 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.011 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.012 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.012 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.013 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.013 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:12.013 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.013 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.014 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.014 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.014 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.015 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:12.015 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.015 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.015 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.016 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.016 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.016 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:12.016 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.017 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.017 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.017 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.017 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.017 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:12.018 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.018 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.018 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.018 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.019 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.019 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:12.019 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.019 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.019 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.020 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.020 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.020 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:12.020 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.020 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.021 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.021 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.021 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.021 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:12.021 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.022 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.022 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.022 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.022 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.022 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:12.023 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.023 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.023 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.023 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.023 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.024 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:12.024 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.024 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.024 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.024 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.025 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.025 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:12.025 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.025 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.026 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.026 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.026 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.026 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:12.027 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.029 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.030 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.030 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.030 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.030 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.031 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:12.031 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.031 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.031 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.032 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.032 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.032 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.032 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.032 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.033 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.033 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.033 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.033 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.033 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.034 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.034 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.035 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:12.035 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.035 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.036 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.036 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.036 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.036 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:12.036 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.037 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.037 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.037 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:12.037 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.037 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:12.038 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:12.038 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.038 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.038 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.038 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.039 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.039 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:12.039 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.039 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.039 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.040 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.040 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.040 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.040 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.040 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.041 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.041 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.041 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.041 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.041 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.042 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.042 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.042 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.042 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.042 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: mv: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf'cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.043 INFO:teuthology.orchestra.run.smithi084.stdout: +: No such file or directory 2023-09-13T14:21:12.043 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:12.043 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:12.043 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.043 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:12.044 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:12.044 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.044 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.044 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.044 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.045 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.045 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:12.045 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.045 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.045 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.046 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.046 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.046 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:12.046 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.046 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.047 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.047 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.047 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.047 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:12.047 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.048 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.048 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.048 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.048 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.049 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:12.049 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.049 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.049 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.049 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.050 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.050 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:12.050 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.050 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.050 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.051 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.051 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.051 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:12.051 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.051 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.052 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.052 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.052 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.052 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:12.052 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.053 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.053 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.053 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.053 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.054 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:12.054 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.054 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.054 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.055 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.055 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.055 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:12.055 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.055 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.056 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.056 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.056 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.056 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:12.057 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.057 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.057 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.058 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.058 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.058 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.059 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.059 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.059 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.060 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.060 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:12.060 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:12.061 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.061 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.061 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.062 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.062 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.062 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:12.063 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.063 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.063 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.064 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.064 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.064 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:12.065 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.065 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.065 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.065 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.065 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.066 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:12.066 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.066 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.066 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.067 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.067 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.067 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:12.067 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.068 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.068 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.068 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.068 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.068 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:12.069 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.069 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.069 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.069 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.069 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.070 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:12.070 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.070 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.070 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.070 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.071 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.071 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:12.071 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.071 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.072 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.072 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.072 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.072 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:12.072 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.073 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.073 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.073 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.074 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.074 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:12.074 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.074 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.075 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.075 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.075 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.075 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:12.076 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.076 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.076 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.076 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.077 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.077 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:12.077 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.077 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.077 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.078 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.078 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.078 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:12.078 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.079 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.079 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.079 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.079 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.079 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:12.080 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.080 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.080 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.080 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.081 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.081 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.081 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.081 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.081 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:12.082 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.082 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.082 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:12.082 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.083 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.083 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.083 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.083 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directorymv: 2023-09-13T14:21:12.083 INFO:teuthology.orchestra.run.smithi084.stdout: +cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.084 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.084 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf'cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory: No such file or directory 2023-09-13T14:21:12.084 INFO:teuthology.orchestra.run.smithi084.stdout: + 2023-09-13T14:21:12.084 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.085 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.085 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.085 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.085 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.085 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.086 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:12.086 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:12.086 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:12.086 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.087 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.087 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.087 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.087 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.088 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:12.088 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.089 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.089 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.089 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.089 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.089 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:12.090 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.090 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.090 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.090 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.091 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.091 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:12.091 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.091 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.091 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.092 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.092 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.092 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:12.092 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.093 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.093 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.093 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.093 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.093 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:12.094 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.094 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.094 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.094 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.095 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.095 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.095 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.095 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.096 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.096 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.096 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:12.096 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:12.096 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.097 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.097 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.097 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.097 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.097 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:12.098 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.098 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.098 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.098 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.098 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.099 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:12.099 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.099 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.099 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.099 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.100 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.100 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:12.100 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.100 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.100 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.101 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.101 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.101 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:12.102 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.102 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.102 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.102 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.103 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.103 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:12.103 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.103 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.104 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.104 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.104 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.104 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:12.104 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.105 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.105 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.105 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.105 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.105 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:12.106 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.106 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.106 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.106 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.107 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.107 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:12.107 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.107 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.107 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.108 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.108 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.108 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:12.109 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.109 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.109 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.109 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.109 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.110 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:12.110 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.110 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.110 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.110 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.111 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.111 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:12.111 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.111 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.112 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.112 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.112 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.112 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:12.113 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.113 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.113 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.113 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.113 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.114 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:12.114 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.114 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.114 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.115 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.115 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.115 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:12.115 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.116 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.116 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.116 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.116 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.117 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:12.117 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.117 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.117 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.117 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.118 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.118 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:12.118 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.118 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.119 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.119 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.119 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.119 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.120 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.120 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.120 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.120 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.120 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:12.121 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:12.121 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.121 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.121 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.121 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.122 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.122 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:12.122 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.122 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.123 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.123 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.123 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.123 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:12.123 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.124 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.124 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.124 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.124 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.124 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:12.125 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.125 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.125 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.125 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.125 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.125 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:12.126 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.126 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.126 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.126 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.126 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.127 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:12.127 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.127 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.127 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.128 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.128 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.128 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:12.128 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.128 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.128 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.129 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.129 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.129 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:12.129 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.129 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.130 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.130 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.130 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.130 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:12.130 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.131 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.131 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.131 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.131 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.131 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:12.132 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.132 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.132 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.132 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.133 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.133 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:12.133 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.133 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.133 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.134 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.134 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.134 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:12.134 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.134 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.135 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.135 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.135 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.135 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:12.135 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.136 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.136 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.136 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.136 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.136 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.137 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.137 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.137 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:12.137 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.138 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.138 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:12.138 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.138 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.138 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.139 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.139 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.139 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:12.139 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.139 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.140 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.140 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.140 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.140 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:12.140 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.141 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.141 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.141 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.141 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.141 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:12.142 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.142 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.142 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.142 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.142 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.143 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:12.143 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.143 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.143 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.143 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.144 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.144 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:12.144 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.144 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.144 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.145 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.145 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.145 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:12.145 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.145 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.146 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.146 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.146 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.146 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:12.146 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.147 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.147 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.147 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.147 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.147 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:12.148 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.148 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.148 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.148 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.148 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.149 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:12.149 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.149 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.149 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.149 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.150 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.150 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:12.150 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.150 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.151 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.151 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.151 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.151 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:12.151 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.152 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.152 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.152 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.152 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.152 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:12.153 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.153 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.153 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.153 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.154 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.154 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:12.154 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.154 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.154 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.154 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.155 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.155 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:12.155 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.155 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.156 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.156 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.156 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.156 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:12.156 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.157 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.157 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.157 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.157 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.157 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:12.158 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.158 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.158 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.158 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.158 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.159 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:12.159 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: mount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.159 INFO:teuthology.orchestra.run.smithi084.stdout: + 2023-09-13T14:21:12.159 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf'cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory: No such file or directory 2023-09-13T14:21:12.159 INFO:teuthology.orchestra.run.smithi084.stdout: + 2023-09-13T14:21:12.160 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.160 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.160 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.160 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.160 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.161 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.161 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:12.161 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:12.161 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.161 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.162 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.162 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.162 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.162 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:12.163 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.163 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.163 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.163 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.163 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.163 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:12.164 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.164 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.164 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.164 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.165 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.165 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:12.165 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.165 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.165 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.166 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.166 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.166 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:12.166 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.166 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.167 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.167 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.167 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.167 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:12.167 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.168 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.168 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.168 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.168 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf'cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.168 INFO:teuthology.orchestra.run.smithi084.stdout: +: No such file or directory 2023-09-13T14:21:12.169 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.169 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.169 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.169 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.169 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:12.170 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:12.170 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.170 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.170 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.170 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.171 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.171 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:12.171 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.171 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.171 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.172 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.172 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.172 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:12.172 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.172 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.173 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.173 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.173 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.173 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:12.173 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.174 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.174 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.174 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.174 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.175 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:12.175 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.175 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.175 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.175 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.176 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.176 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:12.176 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.176 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.176 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.177 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.177 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.177 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:12.177 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.177 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.178 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.178 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.178 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.178 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:12.178 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.178 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.179 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.179 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.179 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.179 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:12.179 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.180 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.180 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.180 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.180 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.180 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:12.181 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.181 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.181 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.181 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.182 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.182 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:12.182 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.182 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.182 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.183 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.183 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.183 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:12.183 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.184 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.184 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.184 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.184 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.184 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:12.184 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.185 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.185 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.185 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.185 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.185 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:12.186 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.186 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.186 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.186 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.186 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.187 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:12.187 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.187 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.187 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.188 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.188 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.188 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:12.188 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.188 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.188 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.189 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.189 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.189 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:12.189 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.189 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.190 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.190 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.190 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.190 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:12.191 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.191 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.191 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.191 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.191 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.192 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:12.192 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.192 INFO:teuthology.orchestra.run.smithi084.stdout: + 2023-09-13T14:21:12.192 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.192 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.193 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.193 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.193 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.193 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.194 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.194 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.194 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted./tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:12.194 INFO:teuthology.orchestra.run.smithi084.stdout: + 2023-09-13T14:21:12.194 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.195 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.195 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.195 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.195 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.196 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:12.196 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.196 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.196 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.197 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.197 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.197 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:12.197 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.198 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.198 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.198 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.198 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.198 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:12.199 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.199 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.199 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.199 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.199 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.200 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:12.200 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.200 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.201 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.201 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.201 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.201 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:12.202 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.202 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.202 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.202 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.202 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.203 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:12.203 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.203 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.203 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.204 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.204 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.204 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:12.204 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.205 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.205 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.205 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.205 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.206 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:12.206 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.206 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.206 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.206 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.207 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.207 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:12.207 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.207 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.208 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.208 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.208 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.208 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:12.209 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.209 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.209 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.209 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.210 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.210 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:12.210 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.210 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.210 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.211 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.211 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.211 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:12.211 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.212 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.212 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.212 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.212 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.213 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:12.213 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.213 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.213 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.214 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.214 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.214 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:12.214 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.215 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.215 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.215 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.215 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.216 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:12.216 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.216 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.216 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.216 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.217 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.217 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:12.217 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.217 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.218 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.218 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.218 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.218 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:12.219 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.219 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.219 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.219 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.220 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.220 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:12.220 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.220 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.220 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.221 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.221 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.221 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:12.221 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.222 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.222 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.222 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.222 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.222 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:12.223 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.223 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.223 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.223 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.223 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.224 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:12.224 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.224 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.224 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.224 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.225 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.225 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:12.225 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.225 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.225 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.226 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.226 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.226 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:12.226 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.226 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.227 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.227 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.227 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.227 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:12.228 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.228 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.228 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.228 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.228 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.229 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:12.229 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.229 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.229 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.229 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.230 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.230 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:12.230 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.230 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.231 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.231 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.231 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.231 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:12.232 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: mount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.232 INFO:teuthology.orchestra.run.smithi084.stdout: + 2023-09-13T14:21:12.232 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.232 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.232 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.233 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.233 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.233 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.233 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.233 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.234 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:12.234 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:12.234 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.234 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.235 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.235 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.235 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.235 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:12.235 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.236 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.236 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.236 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.236 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.236 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:12.237 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.237 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.237 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.237 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.237 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.238 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:12.238 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.238 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.238 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.238 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.239 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.239 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.239 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:12.239 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.239 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.240 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.240 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.240 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:12.240 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.241 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.241 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.241 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.241 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.241 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:12.242 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.242 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.242 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.242 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.242 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.243 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:12.243 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.243 INFO:teuthology.orchestra.run.smithi084.stdout: + 2023-09-13T14:21:12.243 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf'cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.244 INFO:teuthology.orchestra.run.smithi084.stdout: +: No such file or directory 2023-09-13T14:21:12.244 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.244 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.244 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.244 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.245 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.245 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.245 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:12.245 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:12.245 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.246 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.246 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.246 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.246 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.247 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:12.247 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.247 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.247 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.248 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.248 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.248 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:12.248 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.249 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.249 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.250 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.250 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.250 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:12.250 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: mount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.250 INFO:teuthology.orchestra.run.smithi084.stdout: + 2023-09-13T14:21:12.251 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.251 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.251 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.251 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.251 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.252 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.252 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.252 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.252 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:12.253 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:12.253 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.254 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.254 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.254 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.255 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.255 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:12.255 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.256 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.256 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.256 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.257 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.257 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:12.257 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.257 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.258 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.258 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.258 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.258 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:12.258 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.259 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.259 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.259 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.259 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.259 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:12.259 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.260 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.260 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.260 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.260 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.260 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:12.261 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.261 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.261 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.262 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.262 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.262 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.262 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.262 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.263 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.263 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:12.263 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.263 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:12.263 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.264 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.264 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.264 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.264 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.264 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:12.265 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.265 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.265 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.265 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.266 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.266 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:12.266 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: mount: mount: mount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.266 INFO:teuthology.orchestra.run.smithi084.stdout: + 2023-09-13T14:21:12.266 INFO:teuthology.orchestra.run.smithi084.stdout: + 2023-09-13T14:21:12.267 INFO:teuthology.orchestra.run.smithi084.stdout: + 2023-09-13T14:21:12.267 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.267 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf'mv: : No such file or directorycannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf' 2023-09-13T14:21:12.267 INFO:teuthology.orchestra.run.smithi084.stdout: +: No such file or directory 2023-09-13T14:21:12.267 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.268 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.268 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.268 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.268 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.268 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.268 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.269 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.269 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.269 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.269 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.269 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.270 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.270 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:12.270 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:12.270 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:12.270 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:12.271 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.271 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.271 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.271 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.271 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.271 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:12.272 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.272 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.272 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.272 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.272 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.273 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:12.273 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.273 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.273 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.273 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.274 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.274 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:12.274 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.274 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.275 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.275 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.275 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.275 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.275 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.276 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.276 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.276 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.276 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:12.277 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:12.277 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.277 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.277 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.277 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.278 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.278 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.278 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.278 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.279 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.279 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.279 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:12.279 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:12.279 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.280 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.280 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.280 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.280 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.281 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:12.281 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.281 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.281 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.281 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.282 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.282 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:12.282 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.282 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.282 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.283 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.283 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.283 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:12.283 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.284 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.284 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.284 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.284 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.284 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:12.285 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.285 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.285 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.285 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.286 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.286 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:12.286 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.286 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.286 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.287 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.287 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.287 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:12.287 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.288 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.288 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.288 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.288 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.288 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:12.289 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.289 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.289 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.289 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.289 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.290 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:12.290 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.290 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.290 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.291 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.291 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.291 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.291 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:12.291 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.292 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.292 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.292 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.292 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.293 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.293 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.293 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.293 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:12.294 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.294 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:12.294 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.294 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.294 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.295 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.295 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.295 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.295 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:12.296 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.296 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.296 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.296 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.296 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:12.297 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.297 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.297 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.297 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.297 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.298 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:12.298 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.298 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.298 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.299 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.299 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.299 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:12.299 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.299 INFO:teuthology.orchestra.run.smithi084.stdout: + 2023-09-13T14:21:12.300 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.300 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.300 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.300 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.302 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.302 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.303 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.303 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.303 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.303 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.304 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.304 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.304 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:12.304 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.304 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:12.305 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:12.305 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.305 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.306 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.306 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.306 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.306 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:12.307 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.307 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.307 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.307 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.308 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.308 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:12.308 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.308 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.309 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.309 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.309 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.309 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:12.309 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.310 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.310 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.310 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.310 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.310 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:12.311 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.311 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.311 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.311 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.311 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.312 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:12.312 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.312 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.312 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.312 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.313 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.313 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:12.313 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.313 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.313 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.313 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.314 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.314 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:12.314 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.314 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.314 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.315 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.315 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.315 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:12.315 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.315 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.316 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.316 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.316 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.316 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:12.316 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.316 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.317 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.317 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.317 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.317 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:12.317 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.318 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.318 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.318 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.318 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.318 INFO:teuthology.orchestra.run.smithi084.stdout: +cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.319 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.319 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.319 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.319 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.319 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:12.320 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:12.320 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.320 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.320 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.320 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.321 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.321 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:12.321 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.321 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.321 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.322 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.322 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.322 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:12.322 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.322 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.323 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.323 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.323 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.323 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:12.323 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.324 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.324 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.324 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.324 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.325 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:12.325 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.325 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.325 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.325 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.325 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.326 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.326 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.326 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.326 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.327 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.327 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:12.327 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:12.327 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.328 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.328 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.328 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.328 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.328 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.328 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.329 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.329 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.329 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.329 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:12.329 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:12.330 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.330 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.330 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.330 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.330 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.331 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:12.331 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.331 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.331 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.331 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.332 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.332 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:12.332 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.332 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.332 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.333 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.333 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.333 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:12.333 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.334 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.334 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.334 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.334 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.334 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:12.335 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.335 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.335 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.335 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.336 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.336 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:12.336 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.336 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.336 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.337 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.337 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.337 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:12.337 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.338 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.338 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.338 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.338 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.338 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:12.339 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.339 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.339 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.339 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.340 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.340 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:12.340 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.340 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.340 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.341 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.341 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.341 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:12.341 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.341 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.342 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.342 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.342 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.342 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.343 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.343 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.343 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.343 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.343 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.344 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.344 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:12.344 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.344 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:12.344 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.345 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.345 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.345 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.345 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.345 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.346 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:12.346 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.346 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:12.346 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.346 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.347 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.347 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.347 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.347 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:12.347 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.348 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.348 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.348 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.348 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.348 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.349 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: mount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.349 INFO:teuthology.orchestra.run.smithi084.stdout: + 2023-09-13T14:21:12.349 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.349 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.349 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.350 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.350 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.350 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.350 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.350 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.351 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:12.351 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.351 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.351 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.351 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.352 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:12.352 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:12.352 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:12.352 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.352 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.353 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.353 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.353 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.353 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:12.353 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.353 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.354 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.354 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.354 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.354 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:12.354 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.355 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.355 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.355 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.355 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.355 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:12.356 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.356 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.356 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.356 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.356 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.357 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:12.357 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: mount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.357 INFO:teuthology.orchestra.run.smithi084.stdout: + 2023-09-13T14:21:12.357 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.357 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.358 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.358 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.358 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.358 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.358 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.359 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:12.359 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.359 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.359 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:12.359 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.360 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.360 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.360 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.360 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:12.360 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.361 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.361 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.361 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.361 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.361 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:12.362 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.362 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.362 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.362 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.362 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.363 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:12.363 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.363 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.363 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.363 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.364 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.364 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:12.364 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.364 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.365 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.365 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.365 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.365 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.365 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.366 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:12.366 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.366 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.366 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.366 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:12.367 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.367 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.367 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.367 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.367 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.368 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:12.368 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.368 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.368 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.368 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.369 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.369 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:12.369 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.369 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.369 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.370 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.370 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.370 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:12.370 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.370 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.371 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.371 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.371 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.371 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.371 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.371 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.372 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.372 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.372 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted./tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:12.372 INFO:teuthology.orchestra.run.smithi084.stdout: + 2023-09-13T14:21:12.372 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.373 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.373 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.373 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.373 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.373 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:12.374 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.374 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.374 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.374 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.374 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.375 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:12.375 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.375 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.375 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.375 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.376 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.376 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:12.376 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.376 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.376 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.376 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.377 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.377 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:12.377 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.377 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.378 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.378 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.378 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.378 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.379 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.379 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.379 INFO:teuthology.orchestra.run.smithi084.stdout: + 2023-09-13T14:21:12.379 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:12.379 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.380 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.380 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.380 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.380 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.381 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.381 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.381 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.381 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.381 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.382 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.382 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.382 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.382 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.382 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.383 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.383 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.383 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.383 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:12.383 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.384 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted./tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:12.384 INFO:teuthology.orchestra.run.smithi084.stdout: + 2023-09-13T14:21:12.384 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.384 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:12.385 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.385 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:12.385 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.385 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.385 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.386 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.386 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.386 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:12.386 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.386 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.387 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.387 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.387 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.387 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:12.388 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.388 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.388 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.388 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.388 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.389 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.389 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.389 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.389 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.390 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.390 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.390 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:12.390 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.390 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.391 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.391 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:12.391 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.391 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:12.391 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.392 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.392 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.392 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.392 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.392 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:12.393 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.393 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.393 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.393 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.393 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.394 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:12.394 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.394 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.394 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.395 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.395 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.395 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:12.395 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.395 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.396 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.396 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.396 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.396 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.396 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.397 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.397 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.397 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.397 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:12.397 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:12.398 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.398 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.398 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.398 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.398 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.399 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.399 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.399 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.399 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.399 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.400 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:12.400 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:12.400 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.400 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.401 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.401 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.401 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.401 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:12.401 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.401 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.402 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.402 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.402 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.402 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:12.403 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.403 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.403 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.403 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.403 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.404 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:12.404 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.404 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.404 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.405 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.405 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.405 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.405 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.405 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.406 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.406 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.406 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:12.406 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:12.406 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.407 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.407 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.407 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.407 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.408 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:12.408 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.408 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.408 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.408 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.409 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.409 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:12.409 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.409 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.409 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.410 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.410 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.410 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:12.410 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.411 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.411 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.411 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.411 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.411 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:12.412 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.412 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.412 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.412 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.412 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.413 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:12.413 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: mount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.413 INFO:teuthology.orchestra.run.smithi084.stdout: + 2023-09-13T14:21:12.413 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.414 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.414 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.414 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.414 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.414 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.415 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.415 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.415 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:12.415 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:12.415 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.416 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.416 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.416 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.416 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.416 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:12.417 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.417 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.417 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.417 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.417 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.418 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:12.418 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.418 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.418 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.418 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.419 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.419 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.419 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.419 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.419 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.420 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.420 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:12.420 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.420 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:12.420 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.420 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.421 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.421 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.421 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:12.421 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.421 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.422 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.422 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.422 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.422 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:12.422 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.423 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.423 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.423 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.423 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.423 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:12.424 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.424 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.424 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.424 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.424 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.425 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:12.425 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.425 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.425 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.426 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.426 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.426 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:12.426 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.426 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.427 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.427 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.427 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.427 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.427 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.428 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.428 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.428 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.428 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:12.428 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:12.429 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.429 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.429 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.429 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.429 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.430 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:12.430 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.430 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.430 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.430 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.430 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.431 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:12.431 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.431 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.431 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.431 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.432 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.432 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:12.432 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.432 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.432 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.432 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.433 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.433 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:12.433 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.433 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.433 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.434 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.434 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.434 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:12.434 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.434 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.435 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.435 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.435 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.435 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.435 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.436 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.436 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.436 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.436 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:12.437 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:12.437 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.437 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.437 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.437 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.437 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.438 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:12.438 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.438 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.438 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.438 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.439 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.439 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:12.439 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.439 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.439 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.439 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: mount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.440 INFO:teuthology.orchestra.run.smithi084.stdout: +/tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.440 INFO:teuthology.orchestra.run.smithi084.stdout: + 2023-09-13T14:21:12.440 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.440 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.440 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.441 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf'cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.441 INFO:teuthology.orchestra.run.smithi084.stdout: +: No such file or directory 2023-09-13T14:21:12.441 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.441 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.441 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf'cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory: No such file or directory 2023-09-13T14:21:12.442 INFO:teuthology.orchestra.run.smithi084.stdout: + 2023-09-13T14:21:12.442 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf'cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory: No such file or directory 2023-09-13T14:21:12.442 INFO:teuthology.orchestra.run.smithi084.stdout: + 2023-09-13T14:21:12.442 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.442 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf'cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory: No such file or directory 2023-09-13T14:21:12.443 INFO:teuthology.orchestra.run.smithi084.stdout: + 2023-09-13T14:21:12.443 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.443 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.443 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf'cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory: No such file or directory 2023-09-13T14:21:12.443 INFO:teuthology.orchestra.run.smithi084.stdout: + 2023-09-13T14:21:12.443 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:12.444 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.444 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:12.444 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:12.444 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:12.444 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:12.445 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.445 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.445 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.445 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.445 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.446 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:12.446 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.446 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.446 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.447 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.447 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.447 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:12.447 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.447 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.448 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.448 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.448 INFO:teuthology.orchestra.run.smithi084.stdout: + 2023-09-13T14:21:12.448 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.448 INFO:teuthology.orchestra.run.smithi084.stdout: +cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.449 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.449 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.449 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.449 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.449 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.450 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.450 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.450 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.450 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:12.450 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:12.451 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:12.451 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.451 INFO:teuthology.orchestra.run.smithi084.stdout: + 2023-09-13T14:21:12.451 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.452 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.452 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.452 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.452 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.452 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:12.453 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.453 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.453 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.453 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:12.453 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.454 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.454 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.454 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.454 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.455 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:12.455 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.455 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.455 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.455 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.456 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.456 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:12.456 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.456 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.456 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.456 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.457 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.457 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:12.457 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: mount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.457 INFO:teuthology.orchestra.run.smithi084.stdout: + 2023-09-13T14:21:12.457 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.458 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.458 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.458 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.458 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.459 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.459 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.459 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.459 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.459 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.460 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:12.460 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.460 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.460 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:12.460 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.461 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:12.461 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.461 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.461 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.461 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.462 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.462 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.462 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.462 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.462 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.462 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.463 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:12.463 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:12.463 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.463 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.463 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.464 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.464 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.464 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:12.464 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.464 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.465 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.465 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.465 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.465 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.466 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.466 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.466 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.466 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.467 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:12.467 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:12.467 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.467 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.467 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.468 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.468 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.468 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:12.468 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.468 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.469 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.469 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.469 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.469 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.469 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:12.470 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.470 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.470 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.470 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.470 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:12.471 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.471 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.471 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.471 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.471 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.471 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:12.472 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: mount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.472 INFO:teuthology.orchestra.run.smithi084.stdout: + 2023-09-13T14:21:12.472 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.472 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.472 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.473 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.473 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.473 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:12.473 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.473 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.474 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.474 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.474 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:12.474 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.475 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.475 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.475 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.475 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:12.475 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.476 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.476 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.476 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.476 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.476 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.477 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.477 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.477 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.477 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.477 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:12.478 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:12.478 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.478 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.478 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.479 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.479 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.479 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:12.479 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.479 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.480 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.480 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.480 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.480 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:12.480 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.480 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.481 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.481 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.481 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.481 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:12.481 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.482 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.482 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.482 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.482 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.482 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:12.483 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.483 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.483 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.483 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.483 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.484 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:12.484 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.484 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.484 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.485 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.485 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.485 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:12.485 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.485 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.486 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.486 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.486 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.486 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:12.487 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.487 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.487 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.487 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.487 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.488 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:12.488 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.488 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.488 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.488 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.489 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.489 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:12.489 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.489 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.490 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.490 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.490 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.490 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.490 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.491 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.491 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:12.491 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.491 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.491 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:12.492 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.492 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.492 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.492 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.492 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.493 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:12.493 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.493 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.493 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.493 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.494 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.494 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:12.494 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.494 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.494 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.495 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.495 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.495 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:12.495 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.495 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.496 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.496 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.496 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.496 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:12.496 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.497 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.497 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.497 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.497 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.497 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:12.498 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.498 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.498 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.498 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.499 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.499 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:12.499 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.499 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.499 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.500 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.500 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.500 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:12.500 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: mount: mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.500 INFO:teuthology.orchestra.run.smithi084.stdout: + 2023-09-13T14:21:12.500 INFO:teuthology.orchestra.run.smithi084.stdout: + 2023-09-13T14:21:12.501 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.501 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.501 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.501 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.502 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.502 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.502 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.502 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.502 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.503 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.503 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.503 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.503 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:12.504 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:12.504 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:12.504 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.504 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.504 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.504 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.505 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.505 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:12.505 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.505 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.505 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.506 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.506 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.509 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:12.509 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.509 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.510 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.510 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.510 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.510 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:12.510 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.511 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.511 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.511 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.511 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.511 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:12.512 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.512 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.512 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.512 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.512 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.513 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:12.513 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.513 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.513 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.513 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.514 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.514 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:12.514 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.514 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.514 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.514 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.515 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.515 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:12.515 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.515 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.515 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.516 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.516 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.516 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:12.516 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.516 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.517 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.517 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.517 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.517 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:12.517 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.518 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.518 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.518 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.518 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.518 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:12.519 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: mount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.519 INFO:teuthology.orchestra.run.smithi084.stdout: + 2023-09-13T14:21:12.519 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.519 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf'cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory: No such file or directory 2023-09-13T14:21:12.520 INFO:teuthology.orchestra.run.smithi084.stdout: + 2023-09-13T14:21:12.520 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.520 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.520 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.521 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.521 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.521 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.521 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.521 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.522 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:12.522 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.522 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.522 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:12.523 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:12.523 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.523 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.523 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.524 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.524 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.524 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:12.524 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.524 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.525 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.525 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.525 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.525 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:12.526 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.526 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.526 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.526 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.527 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.527 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:12.527 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: mount: mount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.527 INFO:teuthology.orchestra.run.smithi084.stdout: + 2023-09-13T14:21:12.528 INFO:teuthology.orchestra.run.smithi084.stdout: + 2023-09-13T14:21:12.528 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.528 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf'cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.528 INFO:teuthology.orchestra.run.smithi084.stdout: +: No such file or directory 2023-09-13T14:21:12.529 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.529 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.529 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.529 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.530 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.530 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.530 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.530 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.531 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.531 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.531 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.531 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:12.531 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:12.532 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:12.532 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.532 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.532 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.532 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:12.533 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.533 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.533 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.533 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.534 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.534 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:12.534 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.534 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.535 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.535 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.535 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.535 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:12.535 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.536 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.536 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.536 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.536 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.537 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.537 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.537 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.537 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:12.537 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.538 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.538 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.538 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.538 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.538 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.539 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.539 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.539 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:12.539 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.539 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.540 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.540 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.540 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:12.540 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:12.541 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.541 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.541 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.541 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.541 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.542 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:12.542 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.542 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.542 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.542 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.543 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.543 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:12.543 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.543 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.544 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.544 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.544 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.544 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:12.544 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.544 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.545 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.545 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.545 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.545 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:12.546 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.546 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.546 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.546 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.546 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.547 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:12.547 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: mount: mount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.547 INFO:teuthology.orchestra.run.smithi084.stdout: + 2023-09-13T14:21:12.547 INFO:teuthology.orchestra.run.smithi084.stdout: + 2023-09-13T14:21:12.547 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: mv: mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf'cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf'cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory: No such file or directory: No such file or directory 2023-09-13T14:21:12.548 INFO:teuthology.orchestra.run.smithi084.stdout: + 2023-09-13T14:21:12.548 INFO:teuthology.orchestra.run.smithi084.stdout: + 2023-09-13T14:21:12.548 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.548 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.549 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.549 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.549 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.549 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.549 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:12.550 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.550 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:12.550 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.550 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.550 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:12.551 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.551 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.551 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.551 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.551 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.552 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:12.552 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.552 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.552 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.552 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.553 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.553 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:12.553 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.553 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.554 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.554 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.554 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.554 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:12.554 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: mount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.555 INFO:teuthology.orchestra.run.smithi084.stdout: + 2023-09-13T14:21:12.555 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.555 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.555 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.555 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.556 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.556 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.556 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:12.556 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.557 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.557 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:12.557 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.557 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.557 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.558 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.558 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.558 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.558 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.558 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:12.559 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.559 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.559 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.559 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:12.559 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.560 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.560 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.560 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.560 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.561 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:12.561 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.561 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.561 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.561 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.562 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.562 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:12.562 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.562 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.563 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.563 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.563 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.563 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.563 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.564 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.564 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.564 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:12.564 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.564 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:12.565 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.565 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.565 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.565 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.565 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.566 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:12.566 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.566 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.566 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.567 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.567 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.567 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:12.567 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.567 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.568 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.568 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.568 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.568 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:12.568 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.569 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.569 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.569 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.569 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.570 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:12.570 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.570 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.570 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.571 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.571 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.571 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:12.571 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.571 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.572 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.572 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.572 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.572 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:12.573 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.573 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.573 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.573 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.573 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.574 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:12.574 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.574 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.574 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.574 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.575 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.575 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:12.575 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.575 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.576 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.576 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.576 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.576 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:12.577 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.577 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.577 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.577 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.577 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.578 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:12.578 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.578 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.578 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.579 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.579 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.579 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:12.579 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.580 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.580 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.580 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.580 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.580 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:12.581 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.581 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.581 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.581 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.582 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.582 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:12.582 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.582 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.582 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.583 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.583 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.583 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:12.583 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.584 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.584 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.584 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.584 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.584 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:12.585 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.585 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.585 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.585 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.585 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.586 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:12.586 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.586 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.586 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.586 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.587 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.587 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:12.587 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.587 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.588 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.588 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.588 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.588 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:12.588 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.589 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.589 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.589 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.589 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.589 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:12.590 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.590 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.590 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.590 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.590 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.591 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:12.591 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.591 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.591 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.591 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.592 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.592 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:12.592 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.592 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.593 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.593 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.593 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.593 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:12.593 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.594 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.594 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.594 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.594 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged3/etc/access.conf': No such file or directory 2023-09-13T14:21:12.594 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged3: not mounted. 2023-09-13T14:21:12.595 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.595 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.595 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.595 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.595 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged1/etc/access.conf': No such file or directory 2023-09-13T14:21:12.596 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged1: not mounted. 2023-09-13T14:21:12.596 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.596 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.596 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.596 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.597 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged2/etc/access.conf': No such file or directory 2023-09-13T14:21:12.597 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged2: not mounted. 2023-09-13T14:21:12.597 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.597 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.597 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.598 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.598 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged4/etc/access.conf': No such file or directory 2023-09-13T14:21:12.598 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged4: not mounted. 2023-09-13T14:21:12.598 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.598 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.599 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.599 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.599 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged5/etc/access.conf': No such file or directory 2023-09-13T14:21:12.599 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged5: not mounted. 2023-09-13T14:21:12.599 INFO:teuthology.orchestra.run.smithi084.stdout: +mount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-09-13T14:21:12.600 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.600 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.600 INFO:teuthology.orchestra.run.smithi084.stdout: +mv: cannot stat '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.600 INFO:teuthology.orchestra.run.smithi084.stdout: +touch: cannot touch '/tmp/tmp.QSV7Ot1KO9scratch/merged0/etc/access.conf': No such file or directory 2023-09-13T14:21:12.600 INFO:teuthology.orchestra.run.smithi084.stdout: +umount: /tmp/tmp.QSV7Ot1KO9scratch/merged0: not mounted. 2023-09-13T14:21:12.601 INFO:teuthology.orchestra.run.smithi084.stdout: Silence is golden. 2023-09-13T14:21:12.601 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:21:12.601 INFO:teuthology.orchestra.run.smithi084.stdout:HINT: You _MAY_ be missing kernel fix: 2023-09-13T14:21:12.601 INFO:teuthology.orchestra.run.smithi084.stdout: 6da1b4b1ab36 xfs: fix an ABBA deadlock in xfs_rename 2023-09-13T14:21:12.602 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:21:12.603 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-13T14:21:12.604 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/631 2023-09-13T14:21:12.604 INFO:teuthology.orchestra.run.smithi084.stdout:Failures: generic/631 2023-09-13T14:21:12.604 INFO:teuthology.orchestra.run.smithi084.stdout:Failed 1 of 1 tests 2023-09-13T14:21:12.605 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:21:12.605 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-09-13T14:21:12.605 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-09-13T14:21:12.607 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.UxTBQ6XIL3xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/632) 2023-09-13T14:21:12.857 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph 2023-09-13T14:21:12.862 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-13T14:21:12.863 INFO:teuthology.orchestra.run.smithi084.stdout:MKFS_OPTIONS -- 172.21.15.84:6789:/scratch 2023-09-13T14:21:12.864 INFO:teuthology.orchestra.run.smithi084.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCOcQFlJ65kKhAAvrUKSxvdlZfKt/OfxU889Q== -o context=system_u:object_r:root_t:s0 172.21.15.84:6789:/scratch /tmp/tmp.QSV7Ot1KO9scratch 2023-09-13T14:21:12.864 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:21:13.508 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~238s 2023-09-13T14:21:20.121 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~245s 2023-09-13T14:21:22.369 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:21:22.373 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:21:26.733 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~252s 2023-09-13T14:21:33.345 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~259s 2023-09-13T14:21:39.959 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~265s 2023-09-13T14:21:46.572 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~272s 2023-09-13T14:21:52.506 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:21:52.510 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:21:53.185 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~278s 2023-09-13T14:21:59.799 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~285s 2023-09-13T14:22:06.411 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~292s 2023-09-13T14:22:13.024 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~298s 2023-09-13T14:22:19.637 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~305s 2023-09-13T14:22:19.637 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2023-09-13T14:22:19.638 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-09-13T14:22:19.638 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T14:22:19.678 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-09-13T14:22:19.679 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T14:22:19.739 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T14:22:20.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.389+0000 7fd208da8700 1 Processor -- start 2023-09-13T14:22:20.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.389+0000 7fd208da8700 1 -- start start 2023-09-13T14:22:20.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.390+0000 7fd208da8700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd20406bad0 0x7fd20406c040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T14:22:20.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.390+0000 7fd208da8700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2040b1d80 con 0x7fd204160e30 2023-09-13T14:22:20.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.390+0000 7fd208da8700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2040b2060 con 0x7fd20406c580 2023-09-13T14:22:20.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.390+0000 7fd208da8700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd20406c9f0 con 0x7fd20406bad0 2023-09-13T14:22:20.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.390+0000 7fd20259c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fd204160e30 0x7fd2040b1530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:33244/0 (socket says 172.21.15.84:33244) 2023-09-13T14:22:20.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.390+0000 7fd20259c700 1 -- 172.21.15.84:0/2335012644 learned_addr learned my addr 172.21.15.84:0/2335012644 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T14:22:20.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.390+0000 7fd201d9b700 1 --2- 172.21.15.84:0/2335012644 >> v2:172.21.15.161:3300/0 conn(0x7fd20406bad0 0x7fd20406c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T14:22:20.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.390+0000 7fd20159a700 1 -- 172.21.15.84:0/2335012644 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3456147090 0 0) 0x7fd2040b1d80 con 0x7fd204160e30 2023-09-13T14:22:20.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.390+0000 7fd20159a700 1 -- 172.21.15.84:0/2335012644 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1ec0035b0 con 0x7fd204160e30 2023-09-13T14:22:20.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.390+0000 7fd20159a700 1 -- 172.21.15.84:0/2335012644 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 535898772 0 0) 0x7fd1ec0035b0 con 0x7fd204160e30 2023-09-13T14:22:20.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.390+0000 7fd20159a700 1 -- 172.21.15.84:0/2335012644 >> v2:172.21.15.161:3300/0 conn(0x7fd20406bad0 msgr2=0x7fd20406c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T14:22:20.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.390+0000 7fd20159a700 1 --2- 172.21.15.84:0/2335012644 >> v2:172.21.15.161:3300/0 conn(0x7fd20406bad0 0x7fd20406c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T14:22:20.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.390+0000 7fd20159a700 1 -- 172.21.15.84:0/2335012644 >> v1:172.21.15.161:6789/0 conn(0x7fd20406c580 legacy=0x7fd2040adf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T14:22:20.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.390+0000 7fd20159a700 1 -- 172.21.15.84:0/2335012644 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2040b2340 con 0x7fd204160e30 2023-09-13T14:22:20.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.390+0000 7fd20159a700 1 -- 172.21.15.84:0/2335012644 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2302733408 0 0) 0x7fd1fc0019f0 con 0x7fd204160e30 2023-09-13T14:22:20.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.390+0000 7fd20159a700 1 -- 172.21.15.84:0/2335012644 >> v1:172.21.15.84:6789/0 conn(0x7fd204160e30 legacy=0x7fd2040b1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T14:22:20.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.390+0000 7fd20159a700 1 --2- 172.21.15.84:0/2335012644 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd1ec003a00 0x7fd1ec003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T14:22:20.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.390+0000 7fd20159a700 1 --2- 172.21.15.84:0/2335012644 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd1ec004850 0x7fd1ec004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T14:22:20.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.390+0000 7fd20159a700 1 --2- 172.21.15.84:0/2335012644 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1ec005210 0x7fd1ec00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T14:22:20.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.390+0000 7fd20159a700 1 -- 172.21.15.84:0/2335012644 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd20406c9f0 con 0x7fd1ec005210 2023-09-13T14:22:20.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.390+0000 7fd20159a700 1 -- 172.21.15.84:0/2335012644 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ec00c0b0 con 0x7fd1ec003a00 2023-09-13T14:22:20.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.390+0000 7fd20159a700 1 -- 172.21.15.84:0/2335012644 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ec00c270 con 0x7fd1ec004850 2023-09-13T14:22:20.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.391+0000 7fd20259c700 1 --2- 172.21.15.84:0/2335012644 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd1ec003a00 0x7fd1ec003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T14:22:20.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.391+0000 7fd202d9d700 1 --2- 172.21.15.84:0/2335012644 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1ec005210 0x7fd1ec00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T14:22:20.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.391+0000 7fd201d9b700 1 --2- 172.21.15.84:0/2335012644 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd1ec004850 0x7fd1ec004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T14:22:20.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.391+0000 7fd202d9d700 1 -- 172.21.15.84:0/2335012644 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd1ec004850 msgr2=0x7fd1ec004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T14:22:20.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.391+0000 7fd202d9d700 1 --2- 172.21.15.84:0/2335012644 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd1ec004850 0x7fd1ec004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T14:22:20.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.391+0000 7fd202d9d700 1 -- 172.21.15.84:0/2335012644 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd1ec003a00 msgr2=0x7fd1ec003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T14:22:20.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.391+0000 7fd202d9d700 1 --2- 172.21.15.84:0/2335012644 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd1ec003a00 0x7fd1ec003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T14:22:20.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.391+0000 7fd202d9d700 1 -- 172.21.15.84:0/2335012644 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1ec0035b0 con 0x7fd1ec005210 2023-09-13T14:22:20.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.391+0000 7fd202d9d700 1 -- 172.21.15.84:0/2335012644 reap_dead start 2023-09-13T14:22:20.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.391+0000 7fd202d9d700 1 --2- 172.21.15.84:0/2335012644 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1ec005210 0x7fd1ec00ba10 secure :-1 s=READY pgs=2939 cs=0 l=1 rev1=1 crypto rx=0x7fd1f40017c0 tx=0x7fd1ec005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c434f699d1997e1 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T14:22:20.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.391+0000 7fd20159a700 1 -- 172.21.15.84:0/2335012644 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f40052d0 con 0x7fd1ec005210 2023-09-13T14:22:20.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.391+0000 7fd20159a700 1 -- 172.21.15.84:0/2335012644 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1f4005430 con 0x7fd1ec005210 2023-09-13T14:22:20.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.391+0000 7fd20159a700 1 -- 172.21.15.84:0/2335012644 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f40038c0 con 0x7fd1ec005210 2023-09-13T14:22:20.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.392+0000 7fd208da8700 1 -- 172.21.15.84:0/2335012644 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1ec005210 msgr2=0x7fd1ec00ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T14:22:20.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.392+0000 7fd208da8700 1 --2- 172.21.15.84:0/2335012644 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1ec005210 0x7fd1ec00ba10 secure :-1 s=READY pgs=2939 cs=0 l=1 rev1=1 crypto rx=0x7fd1f40017c0 tx=0x7fd1ec005880 comp rx=0 tx=0).stop 2023-09-13T14:22:20.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.392+0000 7fd208da8700 1 -- 172.21.15.84:0/2335012644 shutdown_connections 2023-09-13T14:22:20.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.392+0000 7fd208da8700 1 --2- 172.21.15.84:0/2335012644 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1ec005210 0x7fd1ec00ba10 unknown :-1 s=CLOSED pgs=2939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T14:22:20.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.392+0000 7fd208da8700 1 -- 172.21.15.84:0/2335012644 >> 172.21.15.84:0/2335012644 conn(0x7fd2040d11c0 msgr2=0x7fd2040d15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T14:22:20.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.392+0000 7fd208da8700 1 -- 172.21.15.84:0/2335012644 shutdown_connections 2023-09-13T14:22:20.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.392+0000 7fd208da8700 1 -- 172.21.15.84:0/2335012644 wait complete. 2023-09-13T14:22:20.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.394+0000 7fd208da8700 1 Processor -- start 2023-09-13T14:22:20.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.394+0000 7fd208da8700 1 -- start start 2023-09-13T14:22:20.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.394+0000 7fd208da8700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd1ec005210 0x7fd2041549a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T14:22:20.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.394+0000 7fd208da8700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd20415b880 0x7fd204152220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T14:22:20.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.394+0000 7fd208da8700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd2040b4ff0 0x7fd2040aee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T14:22:20.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.394+0000 7fd208da8700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd20415bd00 con 0x7fd20415b880 2023-09-13T14:22:20.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.394+0000 7fd208da8700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd204152940 con 0x7fd2040b4ff0 2023-09-13T14:22:20.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.394+0000 7fd208da8700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2040b5760 con 0x7fd1ec005210 2023-09-13T14:22:20.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.394+0000 7fd201d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd20415b880 0x7fd204152220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T14:22:20.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.394+0000 7fd201d9b700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd20415b880 0x7fd204152220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58844/0 (socket says 172.21.15.84:58844) 2023-09-13T14:22:20.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.395+0000 7fd201d9b700 1 -- 172.21.15.84:0/1380924765 learned_addr learned my addr 172.21.15.84:0/1380924765 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T14:22:20.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.395+0000 7fd20259c700 1 --2- 172.21.15.84:0/1380924765 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd1ec005210 0x7fd2041549a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T14:22:20.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.395+0000 7fd202d9d700 1 --2- 172.21.15.84:0/1380924765 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd2040b4ff0 0x7fd2040aee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T14:22:20.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.395+0000 7fd201d9b700 1 -- 172.21.15.84:0/1380924765 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd1ec005210 msgr2=0x7fd2041549a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T14:22:20.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.395+0000 7fd201d9b700 1 --2- 172.21.15.84:0/1380924765 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd1ec005210 0x7fd2041549a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T14:22:20.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.395+0000 7fd201d9b700 1 -- 172.21.15.84:0/1380924765 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd2040b4ff0 msgr2=0x7fd2040aee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T14:22:20.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.395+0000 7fd201d9b700 1 --2- 172.21.15.84:0/1380924765 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd2040b4ff0 0x7fd2040aee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T14:22:20.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.395+0000 7fd201d9b700 1 -- 172.21.15.84:0/1380924765 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2040b5a40 con 0x7fd20415b880 2023-09-13T14:22:20.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.395+0000 7fd201d9b700 1 --2- 172.21.15.84:0/1380924765 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd20415b880 0x7fd204152220 secure :-1 s=READY pgs=2940 cs=0 l=1 rev1=1 crypto rx=0x7fd1f80119a0 tx=0x7fd1f8011cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T14:22:20.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.395+0000 7fd1f2ffd700 1 -- 172.21.15.84:0/1380924765 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f800f720 con 0x7fd20415b880 2023-09-13T14:22:20.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.395+0000 7fd1f2ffd700 1 -- 172.21.15.84:0/1380924765 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1f800f880 con 0x7fd20415b880 2023-09-13T14:22:20.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.395+0000 7fd208da8700 1 -- 172.21.15.84:0/1380924765 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2040b5d20 con 0x7fd20415b880 2023-09-13T14:22:20.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.395+0000 7fd1f2ffd700 1 -- 172.21.15.84:0/1380924765 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f800fc10 con 0x7fd20415b880 2023-09-13T14:22:20.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.395+0000 7fd208da8700 1 -- 172.21.15.84:0/1380924765 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2040b5470 con 0x7fd20415b880 2023-09-13T14:22:20.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.396+0000 7fd208da8700 1 -- 172.21.15.84:0/1380924765 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2040b6240 con 0x7fd20415b880 2023-09-13T14:22:20.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.397+0000 7fd1f2ffd700 1 -- 172.21.15.84:0/1380924765 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fd1f800fd70 con 0x7fd20415b880 2023-09-13T14:22:20.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.397+0000 7fd1f2ffd700 1 --2- 172.21.15.84:0/1380924765 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fd1e406a580 0x7fd1e406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T14:22:20.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.397+0000 7fd1f2ffd700 1 -- 172.21.15.84:0/1380924765 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd1f80890a0 con 0x7fd20415b880 2023-09-13T14:22:20.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.397+0000 7fd20259c700 1 --2- 172.21.15.84:0/1380924765 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fd1e406a580 0x7fd1e406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T14:22:20.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.398+0000 7fd20259c700 1 --2- 172.21.15.84:0/1380924765 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fd1e406a580 0x7fd1e406ca40 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc002030 tx=0x7fd1fc006040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T14:22:20.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.402+0000 7fd1f2ffd700 1 -- 172.21.15.84:0/1380924765 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fd1f8054550 con 0x7fd20415b880 2023-09-13T14:22:20.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.602+0000 7fd208da8700 1 -- 172.21.15.84:0/1380924765 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd2040b1640 con 0x7fd20415b880 2023-09-13T14:22:20.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.603+0000 7fd1f2ffd700 1 -- 172.21.15.84:0/1380924765 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+16885 (secure 0 0 0) 0x7fd1f8057b70 con 0x7fd20415b880 2023-09-13T14:22:20.603 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-13T14:22:20.604 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":42,"fsid":"0107440b-b634-42c5-a643-5d31ea826116","created":"2023-09-13T08:24:16.931917+0000","modified":"2023-09-13T14:17:10.395405+0000","last_up_change":"2023-09-13T14:17:09.386882+0000","last_in_change":"2023-09-13T08:24:19.425578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T08:24:28.583720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-09-13T08:25:59.346523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.4900000095367432,"score_stable":1.4900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-09-13T08:26:00.400448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6100000143051147,"score_stable":1.6100000143051147,"optimal_score":0.87999999523162842,"raw_score_acting":1.4199999570846558,"raw_score_stable":1.4199999570846558,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4a53ec12-1469-4356-b4e1-2b8fc9b7c0f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6817","nonce":1599532366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6819","nonce":1599532366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6823","nonce":1599532366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":1599532366},{"type":"v1","addr":"172.21.15.84:6821","nonce":1599532366}]},"public_addr":"172.21.15.84:6817/1599532366","cluster_addr":"172.21.15.84:6819/1599532366","heartbeat_back_addr":"172.21.15.84:6823/1599532366","heartbeat_front_addr":"172.21.15.84:6821/1599532366","state":["exists","up"]},{"osd":1,"uuid":"11e964a0-b80c-4afc-bfbf-e2067969db29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6825","nonce":461860977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6827","nonce":461860977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6831","nonce":461860977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":461860977},{"type":"v1","addr":"172.21.15.84:6829","nonce":461860977}]},"public_addr":"172.21.15.84:6825/461860977","cluster_addr":"172.21.15.84:6827/461860977","heartbeat_back_addr":"172.21.15.84:6831/461860977","heartbeat_front_addr":"172.21.15.84:6829/461860977","state":["exists","up"]},{"osd":2,"uuid":"3ce74529-4dd1-44c7-9576-968f5fdc0c25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6809","nonce":1168316165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6811","nonce":1168316165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6815","nonce":1168316165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":1168316165},{"type":"v1","addr":"172.21.15.84:6813","nonce":1168316165}]},"public_addr":"172.21.15.84:6809/1168316165","cluster_addr":"172.21.15.84:6811/1168316165","heartbeat_back_addr":"172.21.15.84:6815/1168316165","heartbeat_front_addr":"172.21.15.84:6813/1168316165","state":["exists","up"]},{"osd":3,"uuid":"460cb5c5-590a-4d06-a4d9-5bac2fdf33b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6801","nonce":1661609810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6803","nonce":1661609810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6807","nonce":1661609810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1661609810},{"type":"v1","addr":"172.21.15.84:6805","nonce":1661609810}]},"public_addr":"172.21.15.84:6801/1661609810","cluster_addr":"172.21.15.84:6803/1661609810","heartbeat_back_addr":"172.21.15.84:6807/1661609810","heartbeat_front_addr":"172.21.15.84:6805/1661609810","state":["exists","up"]},{"osd":4,"uuid":"bf237dd0-3ebd-44b5-8078-24a63e00d792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6801","nonce":1303562374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6803","nonce":1303562374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6807","nonce":1303562374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":1303562374},{"type":"v1","addr":"172.21.15.161:6805","nonce":1303562374}]},"public_addr":"172.21.15.161:6801/1303562374","cluster_addr":"172.21.15.161:6803/1303562374","heartbeat_back_addr":"172.21.15.161:6807/1303562374","heartbeat_front_addr":"172.21.15.161:6805/1303562374","state":["exists","up"]},{"osd":5,"uuid":"e1e538e0-5844-456b-8c6e-434d3a914af1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":41,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6818","nonce":961120854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6822","nonce":961120854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6830","nonce":961120854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":961120854},{"type":"v1","addr":"172.21.15.161:6826","nonce":961120854}]},"public_addr":"172.21.15.161:6818/961120854","cluster_addr":"172.21.15.161:6822/961120854","heartbeat_back_addr":"172.21.15.161:6830/961120854","heartbeat_front_addr":"172.21.15.161:6826/961120854","state":["exists"]},{"osd":6,"uuid":"5cb1785e-960f-4dd4-b295-9e21b2c3f875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6809","nonce":980533466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6811","nonce":980533466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6815","nonce":980533466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":980533466},{"type":"v1","addr":"172.21.15.161:6813","nonce":980533466}]},"public_addr":"172.21.15.161:6809/980533466","cluster_addr":"172.21.15.161:6811/980533466","heartbeat_back_addr":"172.21.15.161:6815/980533466","heartbeat_front_addr":"172.21.15.161:6813/980533466","state":["exists","up"]},{"osd":7,"uuid":"5acb6619-e933-4b46-b1c2-60af30acb839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6817","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6819","nonce":2479691549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6821","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6823","nonce":2479691549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6829","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6831","nonce":2479691549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6825","nonce":2479691549},{"type":"v1","addr":"172.21.15.161:6827","nonce":2479691549}]},"public_addr":"172.21.15.161:6819/2479691549","cluster_addr":"172.21.15.161:6823/2479691549","heartbeat_back_addr":"172.21.15.161:6831/2479691549","heartbeat_front_addr":"172.21.15.161:6827/2479691549","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.678857+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.685341+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.613603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.634940+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.564387+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.697347+0000","dead_epoch":41},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.637437+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T08:24:24.619397+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.a","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T14:22:20.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.605+0000 7fd208da8700 1 -- 172.21.15.84:0/1380924765 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fd1e406a580 msgr2=0x7fd1e406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T14:22:20.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.605+0000 7fd208da8700 1 --2- 172.21.15.84:0/1380924765 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fd1e406a580 0x7fd1e406ca40 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc002030 tx=0x7fd1fc006040 comp rx=0 tx=0).stop 2023-09-13T14:22:20.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.605+0000 7fd208da8700 1 -- 172.21.15.84:0/1380924765 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd20415b880 msgr2=0x7fd204152220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T14:22:20.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.605+0000 7fd208da8700 1 --2- 172.21.15.84:0/1380924765 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd20415b880 0x7fd204152220 secure :-1 s=READY pgs=2940 cs=0 l=1 rev1=1 crypto rx=0x7fd1f80119a0 tx=0x7fd1f8011cb0 comp rx=0 tx=0).stop 2023-09-13T14:22:20.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.605+0000 7fd208da8700 1 -- 172.21.15.84:0/1380924765 shutdown_connections 2023-09-13T14:22:20.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.605+0000 7fd208da8700 1 --2- 172.21.15.84:0/1380924765 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fd1e406a580 0x7fd1e406ca40 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T14:22:20.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.605+0000 7fd208da8700 1 --2- 172.21.15.84:0/1380924765 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd2040b4ff0 0x7fd2040aee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T14:22:20.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.605+0000 7fd208da8700 1 --2- 172.21.15.84:0/1380924765 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd1ec005210 0x7fd2041549a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T14:22:20.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.605+0000 7fd208da8700 1 --2- 172.21.15.84:0/1380924765 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd20415b880 0x7fd204152220 unknown :-1 s=CLOSED pgs=2940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T14:22:20.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.605+0000 7fd208da8700 1 -- 172.21.15.84:0/1380924765 >> 172.21.15.84:0/1380924765 conn(0x7fd2040d11c0 msgr2=0x7fd2040b01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T14:22:20.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.605+0000 7fd208da8700 1 -- 172.21.15.84:0/1380924765 shutdown_connections 2023-09-13T14:22:20.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.605+0000 7fd208da8700 1 -- 172.21.15.84:0/1380924765 wait complete. 2023-09-13T14:22:20.619 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T08:24:28.583720+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-13T08:25:59.346523+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.4900000095367432, 'score_stable': 1.4900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.309999942779541, 'raw_score_stable': 1.309999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-09-13T08:26:00.400448+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6100000143051147, 'score_stable': 1.6100000143051147, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.4199999570846558, 'raw_score_stable': 1.4199999570846558, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-13T14:22:20.621 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T14:22:20.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.748+0000 7f86df0fb700 1 Processor -- start 2023-09-13T14:22:20.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.748+0000 7f86df0fb700 1 -- start start 2023-09-13T14:22:20.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.749+0000 7f86df0fb700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f86d806c3c0 0x7f86d80b17a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T14:22:20.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.749+0000 7f86df0fb700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86d8160e90 con 0x7f86d8160ab0 2023-09-13T14:22:20.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.749+0000 7f86df0fb700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86d80d0820 con 0x7f86d806bf40 2023-09-13T14:22:20.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.749+0000 7f86df0fb700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86d806c850 con 0x7f86d806c3c0 2023-09-13T14:22:20.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.749+0000 7f86dce97700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f86d8160ab0 0x7f86d80cf4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:33264/0 (socket says 172.21.15.84:33264) 2023-09-13T14:22:20.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.749+0000 7f86dce97700 1 -- 172.21.15.84:0/764273186 learned_addr learned my addr 172.21.15.84:0/764273186 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-09-13T14:22:20.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.749+0000 7f86dd698700 1 --2- 172.21.15.84:0/764273186 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f86d806c3c0 0x7f86d80b17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T14:22:20.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.749+0000 7f86d77fe700 1 -- 172.21.15.84:0/764273186 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4247326832 0 0) 0x7f86d8160e90 con 0x7f86d8160ab0 2023-09-13T14:22:20.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.749+0000 7f86d77fe700 1 -- 172.21.15.84:0/764273186 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86c80035b0 con 0x7f86d8160ab0 2023-09-13T14:22:20.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.749+0000 7f86d77fe700 1 -- 172.21.15.84:0/764273186 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3764039323 0 0) 0x7f86c80035b0 con 0x7f86d8160ab0 2023-09-13T14:22:20.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.749+0000 7f86d77fe700 1 -- 172.21.15.84:0/764273186 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f86d806c3c0 msgr2=0x7f86d80b17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T14:22:20.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.749+0000 7f86d77fe700 1 --2- 172.21.15.84:0/764273186 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f86d806c3c0 0x7f86d80b17a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T14:22:20.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.749+0000 7f86d77fe700 1 -- 172.21.15.84:0/764273186 >> v1:172.21.15.161:6789/0 conn(0x7f86d806bf40 legacy=0x7f86d80b1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T14:22:20.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.749+0000 7f86d77fe700 1 -- 172.21.15.84:0/764273186 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86d80cff80 con 0x7f86d8160ab0 2023-09-13T14:22:20.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.749+0000 7f86d77fe700 1 -- 172.21.15.84:0/764273186 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2302733408 0 0) 0x7f86cc0017f0 con 0x7f86d8160ab0 2023-09-13T14:22:20.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.749+0000 7f86d77fe700 1 -- 172.21.15.84:0/764273186 >> v1:172.21.15.84:6789/0 conn(0x7f86d8160ab0 legacy=0x7f86d80cf4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T14:22:20.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.749+0000 7f86d77fe700 1 --2- 172.21.15.84:0/764273186 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f86d806c3c0 0x7f86c8003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T14:22:20.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.749+0000 7f86d77fe700 1 --2- 172.21.15.84:0/764273186 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f86c8003fb0 0x7f86c8004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T14:22:20.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.749+0000 7f86d77fe700 1 --2- 172.21.15.84:0/764273186 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86c8004d90 0x7f86c8005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T14:22:20.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.749+0000 7f86d77fe700 1 -- 172.21.15.84:0/764273186 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86d806c850 con 0x7f86c8004d90 2023-09-13T14:22:20.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.749+0000 7f86d77fe700 1 -- 172.21.15.84:0/764273186 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c800baf0 con 0x7f86c8003fb0 2023-09-13T14:22:20.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.749+0000 7f86d77fe700 1 -- 172.21.15.84:0/764273186 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86c800bcb0 con 0x7f86d806c3c0 2023-09-13T14:22:20.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.749+0000 7f86dd698700 1 --2- 172.21.15.84:0/764273186 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86c8004d90 0x7f86c8005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T14:22:20.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.749+0000 7f86dce97700 1 --2- 172.21.15.84:0/764273186 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f86d806c3c0 0x7f86c8003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T14:22:20.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.750+0000 7f86d7fff700 1 --2- 172.21.15.84:0/764273186 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f86c8003fb0 0x7f86c8004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T14:22:20.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.750+0000 7f86dd698700 1 -- 172.21.15.84:0/764273186 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f86d806c3c0 msgr2=0x7f86c8003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T14:22:20.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.750+0000 7f86dd698700 1 --2- 172.21.15.84:0/764273186 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f86d806c3c0 0x7f86c8003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T14:22:20.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.750+0000 7f86dd698700 1 -- 172.21.15.84:0/764273186 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f86c8003fb0 msgr2=0x7f86c8004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T14:22:20.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.750+0000 7f86dd698700 1 --2- 172.21.15.84:0/764273186 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f86c8003fb0 0x7f86c8004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T14:22:20.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.750+0000 7f86dd698700 1 -- 172.21.15.84:0/764273186 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86c80035b0 con 0x7f86c8004d90 2023-09-13T14:22:20.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.750+0000 7f86d7fff700 1 --2- 172.21.15.84:0/764273186 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f86c8003fb0 0x7f86c8004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T14:22:20.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.750+0000 7f86dd698700 1 --2- 172.21.15.84:0/764273186 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86c8004d90 0x7f86c8005210 secure :-1 s=READY pgs=2942 cs=0 l=1 rev1=1 crypto rx=0x7f86d0009fc0 tx=0x7f86c8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6e597981af406db server_cookie=0 in_seq=0 out_seq=0 2023-09-13T14:22:20.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.750+0000 7f86d77fe700 1 -- 172.21.15.84:0/764273186 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d000ec30 con 0x7f86c8004d90 2023-09-13T14:22:20.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.750+0000 7f86d77fe700 1 -- 172.21.15.84:0/764273186 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86d000f040 con 0x7f86c8004d90 2023-09-13T14:22:20.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.750+0000 7f86d77fe700 1 -- 172.21.15.84:0/764273186 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d0014480 con 0x7f86c8004d90 2023-09-13T14:22:20.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.750+0000 7f86df0fb700 1 -- 172.21.15.84:0/764273186 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86c8004d90 msgr2=0x7f86c8005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T14:22:20.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.750+0000 7f86df0fb700 1 --2- 172.21.15.84:0/764273186 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86c8004d90 0x7f86c8005210 secure :-1 s=READY pgs=2942 cs=0 l=1 rev1=1 crypto rx=0x7f86d0009fc0 tx=0x7f86c8005880 comp rx=0 tx=0).stop 2023-09-13T14:22:20.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.751+0000 7f86dd698700 1 -- 172.21.15.84:0/764273186 reap_dead start 2023-09-13T14:22:20.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.751+0000 7f86df0fb700 1 -- 172.21.15.84:0/764273186 shutdown_connections 2023-09-13T14:22:20.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.751+0000 7f86df0fb700 1 -- 172.21.15.84:0/764273186 >> 172.21.15.84:0/764273186 conn(0x7f86d809a470 msgr2=0x7f86d80d1170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T14:22:20.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.751+0000 7f86df0fb700 1 -- 172.21.15.84:0/764273186 shutdown_connections 2023-09-13T14:22:20.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.751+0000 7f86df0fb700 1 -- 172.21.15.84:0/764273186 wait complete. 2023-09-13T14:22:20.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.752+0000 7f86df0fb700 1 Processor -- start 2023-09-13T14:22:20.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.752+0000 7f86df0fb700 1 -- start start 2023-09-13T14:22:20.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.753+0000 7f86df0fb700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f86c8004d90 0x7f86d81f2470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T14:22:20.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.753+0000 7f86df0fb700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f86d81f29b0 0x7f86d80cd9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T14:22:20.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.753+0000 7f86df0fb700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86d80b1f30 0x7f86d80cdee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T14:22:20.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.753+0000 7f86df0fb700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86d80c8240 con 0x7f86d80b1f30 2023-09-13T14:22:20.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.753+0000 7f86df0fb700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86d80ce420 con 0x7f86c8004d90 2023-09-13T14:22:20.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.753+0000 7f86df0fb700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86d80b2430 con 0x7f86d81f29b0 2023-09-13T14:22:20.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.753+0000 7f86dd698700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86d80b1f30 0x7f86d80cdee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T14:22:20.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.753+0000 7f86dd698700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86d80b1f30 0x7f86d80cdee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58866/0 (socket says 172.21.15.84:58866) 2023-09-13T14:22:20.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.753+0000 7f86dd698700 1 -- 172.21.15.84:0/2950814435 learned_addr learned my addr 172.21.15.84:0/2950814435 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T14:22:20.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.753+0000 7f86dce97700 1 --2- 172.21.15.84:0/2950814435 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f86c8004d90 0x7f86d81f2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T14:22:20.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.753+0000 7f86d7fff700 1 --2- 172.21.15.84:0/2950814435 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f86d81f29b0 0x7f86d80cd9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T14:22:20.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.753+0000 7f86dd698700 1 -- 172.21.15.84:0/2950814435 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f86d81f29b0 msgr2=0x7f86d80cd9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T14:22:20.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.753+0000 7f86dd698700 1 --2- 172.21.15.84:0/2950814435 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f86d81f29b0 0x7f86d80cd9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T14:22:20.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.753+0000 7f86dd698700 1 -- 172.21.15.84:0/2950814435 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f86c8004d90 msgr2=0x7f86d81f2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T14:22:20.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.753+0000 7f86dd698700 1 --2- 172.21.15.84:0/2950814435 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f86c8004d90 0x7f86d81f2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T14:22:20.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.753+0000 7f86dd698700 1 -- 172.21.15.84:0/2950814435 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86d80b2710 con 0x7f86d80b1f30 2023-09-13T14:22:20.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.753+0000 7f86d7fff700 1 --2- 172.21.15.84:0/2950814435 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f86d81f29b0 0x7f86d80cd9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T14:22:20.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.753+0000 7f86dd698700 1 --2- 172.21.15.84:0/2950814435 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86d80b1f30 0x7f86d80cdee0 secure :-1 s=READY pgs=2943 cs=0 l=1 rev1=1 crypto rx=0x7f86c800bac0 tx=0x7f86d0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T14:22:20.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.753+0000 7f86d57fa700 1 -- 172.21.15.84:0/2950814435 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d0014890 con 0x7f86d80b1f30 2023-09-13T14:22:20.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.753+0000 7f86d57fa700 1 -- 172.21.15.84:0/2950814435 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86d0014a10 con 0x7f86d80b1f30 2023-09-13T14:22:20.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.753+0000 7f86df0fb700 1 -- 172.21.15.84:0/2950814435 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86d80b29f0 con 0x7f86d80b1f30 2023-09-13T14:22:20.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.753+0000 7f86d57fa700 1 -- 172.21.15.84:0/2950814435 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d0014dc0 con 0x7f86d80b1f30 2023-09-13T14:22:20.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.753+0000 7f86df0fb700 1 -- 172.21.15.84:0/2950814435 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86d80ca6e0 con 0x7f86d80b1f30 2023-09-13T14:22:20.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.754+0000 7f86df0fb700 1 -- 172.21.15.84:0/2950814435 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86d80c83b0 con 0x7f86d80b1f30 2023-09-13T14:22:20.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.755+0000 7f86d57fa700 1 -- 172.21.15.84:0/2950814435 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f86d0024070 con 0x7f86d80b1f30 2023-09-13T14:22:20.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.755+0000 7f86d57fa700 1 --2- 172.21.15.84:0/2950814435 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f86bc06a5b0 0x7f86bc06ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T14:22:20.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.755+0000 7f86d57fa700 1 -- 172.21.15.84:0/2950814435 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f86d008a810 con 0x7f86d80b1f30 2023-09-13T14:22:20.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.755+0000 7f86dce97700 1 --2- 172.21.15.84:0/2950814435 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f86bc06a5b0 0x7f86bc06ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T14:22:20.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.756+0000 7f86dce97700 1 --2- 172.21.15.84:0/2950814435 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f86bc06a5b0 0x7f86bc06ca70 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f86cc000ef0 tx=0x7f86cc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T14:22:20.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.763+0000 7f86d57fa700 1 -- 172.21.15.84:0/2950814435 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f86d0055de0 con 0x7f86d80b1f30 2023-09-13T14:22:20.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.956+0000 7f86df0fb700 1 -- 172.21.15.84:0/2950814435 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f86d804f200 con 0x7f86d80b1f30 2023-09-13T14:22:20.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.956+0000 7f86d57fa700 1 -- 172.21.15.84:0/2950814435 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v42) v1 ==== 93+0+10 (secure 0 0 0) 0x7f86d002fe80 con 0x7f86d80b1f30 2023-09-13T14:22:20.957 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-09-13T14:22:20.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.958+0000 7f86df0fb700 1 -- 172.21.15.84:0/2950814435 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f86bc06a5b0 msgr2=0x7f86bc06ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T14:22:20.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.958+0000 7f86df0fb700 1 --2- 172.21.15.84:0/2950814435 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f86bc06a5b0 0x7f86bc06ca70 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f86cc000ef0 tx=0x7f86cc009040 comp rx=0 tx=0).stop 2023-09-13T14:22:20.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.958+0000 7f86df0fb700 1 -- 172.21.15.84:0/2950814435 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86d80b1f30 msgr2=0x7f86d80cdee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T14:22:20.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.958+0000 7f86df0fb700 1 --2- 172.21.15.84:0/2950814435 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86d80b1f30 0x7f86d80cdee0 secure :-1 s=READY pgs=2943 cs=0 l=1 rev1=1 crypto rx=0x7f86c800bac0 tx=0x7f86d0009750 comp rx=0 tx=0).stop 2023-09-13T14:22:20.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.958+0000 7f86df0fb700 1 -- 172.21.15.84:0/2950814435 shutdown_connections 2023-09-13T14:22:20.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.958+0000 7f86df0fb700 1 --2- 172.21.15.84:0/2950814435 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86d80b1f30 0x7f86d80cdee0 unknown :-1 s=CLOSED pgs=2943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T14:22:20.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.958+0000 7f86df0fb700 1 --2- 172.21.15.84:0/2950814435 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f86bc06a5b0 0x7f86bc06ca70 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T14:22:20.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.958+0000 7f86df0fb700 1 --2- 172.21.15.84:0/2950814435 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f86c8004d90 0x7f86d81f2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T14:22:20.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.958+0000 7f86df0fb700 1 --2- 172.21.15.84:0/2950814435 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f86d81f29b0 0x7f86d80cd9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T14:22:20.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.958+0000 7f86df0fb700 1 -- 172.21.15.84:0/2950814435 >> 172.21.15.84:0/2950814435 conn(0x7f86d809a470 msgr2=0x7f86d80d10e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T14:22:20.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.958+0000 7f86df0fb700 1 -- 172.21.15.84:0/2950814435 shutdown_connections 2023-09-13T14:22:20.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:20.958+0000 7f86df0fb700 1 -- 172.21.15.84:0/2950814435 wait complete. 2023-09-13T14:22:20.972 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-13T14:22:21.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.098+0000 7f4a69405700 1 Processor -- start 2023-09-13T14:22:21.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.098+0000 7f4a69405700 1 -- start start 2023-09-13T14:22:21.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.099+0000 7f4a69405700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4a6415a170 0x7f4a6406e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T14:22:21.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.099+0000 7f4a69405700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f4a640cf910 0x7f4a6406ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T14:22:21.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.099+0000 7f4a69405700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a640cfe40 con 0x7f4a6406f1c0 2023-09-13T14:22:21.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.099+0000 7f4a69405700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a6415a550 con 0x7f4a6415a170 2023-09-13T14:22:21.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.099+0000 7f4a69405700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a640cf4c0 con 0x7f4a640cf910 2023-09-13T14:22:21.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.099+0000 7f4a62ffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4a6415a170 0x7f4a6406e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T14:22:21.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.099+0000 7f4a62ffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4a6415a170 0x7f4a6406e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58870/0 (socket says 172.21.15.84:58870) 2023-09-13T14:22:21.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.099+0000 7f4a62ffd700 1 -- 172.21.15.84:0/3484399739 learned_addr learned my addr 172.21.15.84:0/3484399739 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T14:22:21.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.099+0000 7f4a627fc700 1 --2- 172.21.15.84:0/3484399739 >> v2:172.21.15.161:3300/0 conn(0x7f4a640cf910 0x7f4a6406ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T14:22:21.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.099+0000 7f4a62ffd700 1 -- 172.21.15.84:0/3484399739 >> v2:172.21.15.161:3300/0 conn(0x7f4a640cf910 msgr2=0x7f4a6406ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T14:22:21.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.099+0000 7f4a62ffd700 1 --2- 172.21.15.84:0/3484399739 >> v2:172.21.15.161:3300/0 conn(0x7f4a640cf910 0x7f4a6406ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T14:22:21.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.099+0000 7f4a62ffd700 1 -- 172.21.15.84:0/3484399739 >> v1:172.21.15.161:6789/0 conn(0x7f4a6406f1c0 legacy=0x7f4a6415dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T14:22:21.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.099+0000 7f4a62ffd700 1 -- 172.21.15.84:0/3484399739 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a640ce700 con 0x7f4a6415a170 2023-09-13T14:22:21.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.099+0000 7f4a62ffd700 1 --2- 172.21.15.84:0/3484399739 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a6415a170 0x7f4a6406e740 secure :-1 s=READY pgs=2944 cs=0 l=1 rev1=1 crypto rx=0x7f4a6406d110 tx=0x7f4a5800be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6bd83122cdcd16d server_cookie=0 in_seq=0 out_seq=0 2023-09-13T14:22:21.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.099+0000 7f4a61ffb700 1 -- 172.21.15.84:0/3484399739 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a5800dcf0 con 0x7f4a6415a170 2023-09-13T14:22:21.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.099+0000 7f4a61ffb700 1 -- 172.21.15.84:0/3484399739 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a5800de50 con 0x7f4a6415a170 2023-09-13T14:22:21.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.099+0000 7f4a61ffb700 1 -- 172.21.15.84:0/3484399739 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a58004250 con 0x7f4a6415a170 2023-09-13T14:22:21.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.100+0000 7f4a69405700 1 -- 172.21.15.84:0/3484399739 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a6415a170 msgr2=0x7f4a6406e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T14:22:21.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.100+0000 7f4a69405700 1 --2- 172.21.15.84:0/3484399739 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a6415a170 0x7f4a6406e740 secure :-1 s=READY pgs=2944 cs=0 l=1 rev1=1 crypto rx=0x7f4a6406d110 tx=0x7f4a5800be70 comp rx=0 tx=0).stop 2023-09-13T14:22:21.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.100+0000 7f4a69405700 1 -- 172.21.15.84:0/3484399739 shutdown_connections 2023-09-13T14:22:21.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.100+0000 7f4a69405700 1 --2- 172.21.15.84:0/3484399739 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a6415a170 0x7f4a6406e740 unknown :-1 s=CLOSED pgs=2944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T14:22:21.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.100+0000 7f4a69405700 1 --2- 172.21.15.84:0/3484399739 >> v2:172.21.15.161:3300/0 conn(0x7f4a640cf910 0x7f4a6406ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T14:22:21.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.100+0000 7f4a69405700 1 -- 172.21.15.84:0/3484399739 >> 172.21.15.84:0/3484399739 conn(0x7f4a640cca70 msgr2=0x7f4a640cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T14:22:21.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.100+0000 7f4a69405700 1 -- 172.21.15.84:0/3484399739 shutdown_connections 2023-09-13T14:22:21.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.100+0000 7f4a69405700 1 -- 172.21.15.84:0/3484399739 wait complete. 2023-09-13T14:22:21.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.101+0000 7f4a69405700 1 Processor -- start 2023-09-13T14:22:21.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.101+0000 7f4a69405700 1 -- start start 2023-09-13T14:22:21.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.102+0000 7f4a69405700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4a6406f1c0 0x7f4a6414f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T14:22:21.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.102+0000 7f4a69405700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a640cf910 0x7f4a641f64d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T14:22:21.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.102+0000 7f4a69405700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4a6415a170 0x7f4a641f6a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T14:22:21.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.102+0000 7f4a69405700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a641e1a00 con 0x7f4a640cf910 2023-09-13T14:22:21.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.102+0000 7f4a69405700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a641e0d80 con 0x7f4a6415a170 2023-09-13T14:22:21.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.102+0000 7f4a69405700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a641e10d0 con 0x7f4a6406f1c0 2023-09-13T14:22:21.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.102+0000 7f4a627fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a640cf910 0x7f4a641f64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T14:22:21.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.102+0000 7f4a627fc700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a640cf910 0x7f4a641f64d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58878/0 (socket says 172.21.15.84:58878) 2023-09-13T14:22:21.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.102+0000 7f4a627fc700 1 -- 172.21.15.84:0/904012021 learned_addr learned my addr 172.21.15.84:0/904012021 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T14:22:21.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.102+0000 7f4a62ffd700 1 --2- 172.21.15.84:0/904012021 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4a6406f1c0 0x7f4a6414f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T14:22:21.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.102+0000 7f4a637fe700 1 --2- 172.21.15.84:0/904012021 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4a6415a170 0x7f4a641f6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T14:22:21.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.103+0000 7f4a627fc700 1 -- 172.21.15.84:0/904012021 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4a6406f1c0 msgr2=0x7f4a6414f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T14:22:21.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.103+0000 7f4a627fc700 1 --2- 172.21.15.84:0/904012021 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4a6406f1c0 0x7f4a6414f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T14:22:21.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.103+0000 7f4a627fc700 1 -- 172.21.15.84:0/904012021 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4a6415a170 msgr2=0x7f4a641f6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T14:22:21.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.103+0000 7f4a627fc700 1 --2- 172.21.15.84:0/904012021 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4a6415a170 0x7f4a641f6a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T14:22:21.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.103+0000 7f4a627fc700 1 -- 172.21.15.84:0/904012021 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a5800b7f0 con 0x7f4a640cf910 2023-09-13T14:22:21.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.103+0000 7f4a637fe700 1 --2- 172.21.15.84:0/904012021 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4a6415a170 0x7f4a641f6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T14:22:21.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.103+0000 7f4a627fc700 1 --2- 172.21.15.84:0/904012021 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a640cf910 0x7f4a641f64d0 secure :-1 s=READY pgs=2945 cs=0 l=1 rev1=1 crypto rx=0x7f4a5400c7f0 tx=0x7f4a5400cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T14:22:21.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.103+0000 7f4a4b7fe700 1 -- 172.21.15.84:0/904012021 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a54004220 con 0x7f4a640cf910 2023-09-13T14:22:21.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.103+0000 7f4a4b7fe700 1 -- 172.21.15.84:0/904012021 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a54004380 con 0x7f4a640cf910 2023-09-13T14:22:21.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.103+0000 7f4a69405700 1 -- 172.21.15.84:0/904012021 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a641e13b0 con 0x7f4a640cf910 2023-09-13T14:22:21.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.103+0000 7f4a4b7fe700 1 -- 172.21.15.84:0/904012021 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a540036a0 con 0x7f4a640cf910 2023-09-13T14:22:21.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.103+0000 7f4a69405700 1 -- 172.21.15.84:0/904012021 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a6414f950 con 0x7f4a640cf910 2023-09-13T14:22:21.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.104+0000 7f4a69405700 1 -- 172.21.15.84:0/904012021 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a641e1b70 con 0x7f4a640cf910 2023-09-13T14:22:21.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.104+0000 7f4a4b7fe700 1 -- 172.21.15.84:0/904012021 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f4a54003800 con 0x7f4a640cf910 2023-09-13T14:22:21.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.105+0000 7f4a4b7fe700 1 --2- 172.21.15.84:0/904012021 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f4a5006a580 0x7f4a5006ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T14:22:21.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.105+0000 7f4a4b7fe700 1 -- 172.21.15.84:0/904012021 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4a540885f0 con 0x7f4a640cf910 2023-09-13T14:22:21.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.105+0000 7f4a62ffd700 1 --2- 172.21.15.84:0/904012021 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f4a5006a580 0x7f4a5006ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T14:22:21.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.105+0000 7f4a62ffd700 1 --2- 172.21.15.84:0/904012021 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f4a5006a580 0x7f4a5006ca40 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f4a5800b340 tx=0x7f4a5801c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T14:22:21.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.109+0000 7f4a4b7fe700 1 -- 172.21.15.84:0/904012021 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f4a54053a20 con 0x7f4a640cf910 2023-09-13T14:22:21.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.303+0000 7f4a69405700 1 -- 172.21.15.84:0/904012021 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4a6404f200 con 0x7f4a640cf910 2023-09-13T14:22:21.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.304+0000 7f4a4b7fe700 1 -- 172.21.15.84:0/904012021 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v42) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4a54057040 con 0x7f4a640cf910 2023-09-13T14:22:21.305 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-09-13T14:22:21.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.306+0000 7f4a69405700 1 -- 172.21.15.84:0/904012021 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f4a5006a580 msgr2=0x7f4a5006ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T14:22:21.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.306+0000 7f4a69405700 1 --2- 172.21.15.84:0/904012021 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f4a5006a580 0x7f4a5006ca40 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f4a5800b340 tx=0x7f4a5801c040 comp rx=0 tx=0).stop 2023-09-13T14:22:21.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.306+0000 7f4a69405700 1 -- 172.21.15.84:0/904012021 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a640cf910 msgr2=0x7f4a641f64d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T14:22:21.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.306+0000 7f4a69405700 1 --2- 172.21.15.84:0/904012021 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a640cf910 0x7f4a641f64d0 secure :-1 s=READY pgs=2945 cs=0 l=1 rev1=1 crypto rx=0x7f4a5400c7f0 tx=0x7f4a5400cb00 comp rx=0 tx=0).stop 2023-09-13T14:22:21.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.306+0000 7f4a69405700 1 -- 172.21.15.84:0/904012021 shutdown_connections 2023-09-13T14:22:21.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.306+0000 7f4a69405700 1 --2- 172.21.15.84:0/904012021 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f4a5006a580 0x7f4a5006ca40 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T14:22:21.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.306+0000 7f4a69405700 1 --2- 172.21.15.84:0/904012021 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4a6415a170 0x7f4a641f6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T14:22:21.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.306+0000 7f4a69405700 1 --2- 172.21.15.84:0/904012021 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4a6406f1c0 0x7f4a6414f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T14:22:21.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.306+0000 7f4a69405700 1 --2- 172.21.15.84:0/904012021 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a640cf910 0x7f4a641f64d0 unknown :-1 s=CLOSED pgs=2945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T14:22:21.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.306+0000 7f4a69405700 1 -- 172.21.15.84:0/904012021 >> 172.21.15.84:0/904012021 conn(0x7f4a640cca70 msgr2=0x7f4a64158b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T14:22:21.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.306+0000 7f4a69405700 1 -- 172.21.15.84:0/904012021 shutdown_connections 2023-09-13T14:22:21.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.306+0000 7f4a69405700 1 -- 172.21.15.84:0/904012021 wait complete. 2023-09-13T14:22:21.319 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-13T14:22:21.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.444+0000 7f788f3b7700 1 Processor -- start 2023-09-13T14:22:21.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.445+0000 7f788f3b7700 1 -- start start 2023-09-13T14:22:21.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.445+0000 7f788f3b7700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f78880ca8e0 0x7f78880cf570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T14:22:21.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.445+0000 7f788f3b7700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f788815e910 0x7f78880cacc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T14:22:21.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.445+0000 7f788f3b7700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f788815e480 con 0x7f78880cd590 2023-09-13T14:22:21.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.445+0000 7f788f3b7700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78880cb200 con 0x7f78880ca8e0 2023-09-13T14:22:21.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.445+0000 7f788f3b7700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78880cfbe0 con 0x7f788815e910 2023-09-13T14:22:21.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.446+0000 7f788c952700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f788815e910 0x7f78880cacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T14:22:21.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.446+0000 7f788d153700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f78880ca8e0 0x7f78880cf570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T14:22:21.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.446+0000 7f788c952700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f788815e910 0x7f78880cacc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.84:40516/0 (socket says 172.21.15.84:40516) 2023-09-13T14:22:21.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.446+0000 7f788c952700 1 -- 172.21.15.84:0/1624768367 learned_addr learned my addr 172.21.15.84:0/1624768367 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T14:22:21.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.446+0000 7f788d954700 1 --1- 172.21.15.84:0/1624768367 >> v1:172.21.15.161:6789/0 conn(0x7f78880cd590 0x7f7888161150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.84:47704/0 (socket says 172.21.15.84:47704) 2023-09-13T14:22:21.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.446+0000 7f788c952700 1 -- 172.21.15.84:0/1624768367 >> v2:172.21.15.161:3300/0 conn(0x7f78880ca8e0 msgr2=0x7f78880cf570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T14:22:21.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.446+0000 7f788c952700 1 --2- 172.21.15.84:0/1624768367 >> v2:172.21.15.161:3300/0 conn(0x7f78880ca8e0 0x7f78880cf570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T14:22:21.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.446+0000 7f788c952700 1 -- 172.21.15.84:0/1624768367 >> v1:172.21.15.161:6789/0 conn(0x7f78880cd590 legacy=0x7f7888161150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T14:22:21.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.446+0000 7f788c952700 1 -- 172.21.15.84:0/1624768367 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f788815de30 con 0x7f788815e910 2023-09-13T14:22:21.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.446+0000 7f788d153700 1 --2- 172.21.15.84:0/1624768367 >> v2:172.21.15.161:3300/0 conn(0x7f78880ca8e0 0x7f78880cf570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T14:22:21.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.446+0000 7f788c952700 1 --2- 172.21.15.84:0/1624768367 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f788815e910 0x7f78880cacc0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f78840098f0 tx=0x7f7884009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd0037ad5e91436c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T14:22:21.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.446+0000 7f787ffff700 1 -- 172.21.15.84:0/1624768367 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7884011830 con 0x7f788815e910 2023-09-13T14:22:21.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.446+0000 7f787ffff700 1 -- 172.21.15.84:0/1624768367 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7884011990 con 0x7f788815e910 2023-09-13T14:22:21.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.446+0000 7f787ffff700 1 -- 172.21.15.84:0/1624768367 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7884011d20 con 0x7f788815e910 2023-09-13T14:22:21.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.447+0000 7f788f3b7700 1 -- 172.21.15.84:0/1624768367 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f788815e910 msgr2=0x7f78880cacc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T14:22:21.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.447+0000 7f788f3b7700 1 --2- 172.21.15.84:0/1624768367 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f788815e910 0x7f78880cacc0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f78840098f0 tx=0x7f7884009c00 comp rx=0 tx=0).stop 2023-09-13T14:22:21.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.447+0000 7f788f3b7700 1 -- 172.21.15.84:0/1624768367 shutdown_connections 2023-09-13T14:22:21.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.447+0000 7f788f3b7700 1 --2- 172.21.15.84:0/1624768367 >> v2:172.21.15.161:3300/0 conn(0x7f78880ca8e0 0x7f78880cf570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T14:22:21.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.447+0000 7f788f3b7700 1 --2- 172.21.15.84:0/1624768367 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f788815e910 0x7f78880cacc0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T14:22:21.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.447+0000 7f788f3b7700 1 -- 172.21.15.84:0/1624768367 >> 172.21.15.84:0/1624768367 conn(0x7f78880cca70 msgr2=0x7f78880cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T14:22:21.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.447+0000 7f788f3b7700 1 -- 172.21.15.84:0/1624768367 shutdown_connections 2023-09-13T14:22:21.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.447+0000 7f788f3b7700 1 -- 172.21.15.84:0/1624768367 wait complete. 2023-09-13T14:22:21.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.448+0000 7f788f3b7700 1 Processor -- start 2023-09-13T14:22:21.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.448+0000 7f788f3b7700 1 -- start start 2023-09-13T14:22:21.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.449+0000 7f788f3b7700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78880ca8e0 0x7f7888144af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T14:22:21.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.449+0000 7f788f3b7700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f78880cd590 0x7f78880b2e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T14:22:21.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.449+0000 7f788f3b7700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f788815e910 0x7f78881f6340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T14:22:21.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.449+0000 7f788f3b7700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78880b4a50 con 0x7f78880ca8e0 2023-09-13T14:22:21.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.449+0000 7f788f3b7700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78880b5d20 con 0x7f788815e910 2023-09-13T14:22:21.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.449+0000 7f788f3b7700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78880b4c80 con 0x7f78880cd590 2023-09-13T14:22:21.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.449+0000 7f788d153700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78880ca8e0 0x7f7888144af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T14:22:21.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.449+0000 7f788d153700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78880ca8e0 0x7f7888144af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58890/0 (socket says 172.21.15.84:58890) 2023-09-13T14:22:21.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.449+0000 7f788d153700 1 -- 172.21.15.84:0/226029439 learned_addr learned my addr 172.21.15.84:0/226029439 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T14:22:21.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.449+0000 7f788c952700 1 --2- 172.21.15.84:0/226029439 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f78880cd590 0x7f78880b2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T14:22:21.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.449+0000 7f788d954700 1 --2- 172.21.15.84:0/226029439 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f788815e910 0x7f78881f6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T14:22:21.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.449+0000 7f788d153700 1 -- 172.21.15.84:0/226029439 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f78880cd590 msgr2=0x7f78880b2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T14:22:21.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.449+0000 7f788d153700 1 --2- 172.21.15.84:0/226029439 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f78880cd590 0x7f78880b2e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T14:22:21.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.449+0000 7f788d153700 1 -- 172.21.15.84:0/226029439 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f788815e910 msgr2=0x7f78881f6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T14:22:21.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.449+0000 7f788d153700 1 --2- 172.21.15.84:0/226029439 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f788815e910 0x7f78881f6340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T14:22:21.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.449+0000 7f788d153700 1 -- 172.21.15.84:0/226029439 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78780094a0 con 0x7f78880ca8e0 2023-09-13T14:22:21.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.450+0000 7f788d153700 1 --2- 172.21.15.84:0/226029439 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78880ca8e0 0x7f7888144af0 secure :-1 s=READY pgs=2946 cs=0 l=1 rev1=1 crypto rx=0x7f787800ebe0 tx=0x7f787800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T14:22:21.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.450+0000 7f787dffb700 1 -- 172.21.15.84:0/226029439 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f787800c850 con 0x7f78880ca8e0 2023-09-13T14:22:21.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.450+0000 7f787dffb700 1 -- 172.21.15.84:0/226029439 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f787800c9b0 con 0x7f78880ca8e0 2023-09-13T14:22:21.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.450+0000 7f788f3b7700 1 -- 172.21.15.84:0/226029439 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7884009550 con 0x7f78880ca8e0 2023-09-13T14:22:21.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.450+0000 7f787dffb700 1 -- 172.21.15.84:0/226029439 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f787800cd40 con 0x7f78880ca8e0 2023-09-13T14:22:21.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.450+0000 7f788f3b7700 1 -- 172.21.15.84:0/226029439 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78880b5010 con 0x7f78880ca8e0 2023-09-13T14:22:21.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.451+0000 7f788f3b7700 1 -- 172.21.15.84:0/226029439 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78880c5cf0 con 0x7f78880ca8e0 2023-09-13T14:22:21.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.451+0000 7f787dffb700 1 -- 172.21.15.84:0/226029439 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7f7878013470 con 0x7f78880ca8e0 2023-09-13T14:22:21.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.452+0000 7f787dffb700 1 --2- 172.21.15.84:0/226029439 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f786c06a580 0x7f786c06ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T14:22:21.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.452+0000 7f787dffb700 1 -- 172.21.15.84:0/226029439 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7878088c60 con 0x7f78880ca8e0 2023-09-13T14:22:21.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.452+0000 7f788c952700 1 --2- 172.21.15.84:0/226029439 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f786c06a580 0x7f786c06ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T14:22:21.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.452+0000 7f788c952700 1 --2- 172.21.15.84:0/226029439 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f786c06a580 0x7f786c06ca40 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f78840098f0 tx=0x7f7884008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T14:22:21.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.456+0000 7f787dffb700 1 -- 172.21.15.84:0/226029439 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f7878054080 con 0x7f78880ca8e0 2023-09-13T14:22:21.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.654+0000 7f788f3b7700 1 -- 172.21.15.84:0/226029439 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f788804f200 con 0x7f78880ca8e0 2023-09-13T14:22:21.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.654+0000 7f787dffb700 1 -- 172.21.15.84:0/226029439 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v42) v1 ==== 100+0+11 (secure 0 0 0) 0x7f78780170a0 con 0x7f78880ca8e0 2023-09-13T14:22:21.655 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-09-13T14:22:21.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.656+0000 7f788f3b7700 1 -- 172.21.15.84:0/226029439 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f786c06a580 msgr2=0x7f786c06ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T14:22:21.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.656+0000 7f788f3b7700 1 --2- 172.21.15.84:0/226029439 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f786c06a580 0x7f786c06ca40 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f78840098f0 tx=0x7f7884008030 comp rx=0 tx=0).stop 2023-09-13T14:22:21.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.656+0000 7f788f3b7700 1 -- 172.21.15.84:0/226029439 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78880ca8e0 msgr2=0x7f7888144af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T14:22:21.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.656+0000 7f788f3b7700 1 --2- 172.21.15.84:0/226029439 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78880ca8e0 0x7f7888144af0 secure :-1 s=READY pgs=2946 cs=0 l=1 rev1=1 crypto rx=0x7f787800ebe0 tx=0x7f787800eef0 comp rx=0 tx=0).stop 2023-09-13T14:22:21.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.657+0000 7f788f3b7700 1 -- 172.21.15.84:0/226029439 shutdown_connections 2023-09-13T14:22:21.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.657+0000 7f788f3b7700 1 --2- 172.21.15.84:0/226029439 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7f786c06a580 0x7f786c06ca40 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T14:22:21.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.657+0000 7f788f3b7700 1 --2- 172.21.15.84:0/226029439 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f788815e910 0x7f78881f6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T14:22:21.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.657+0000 7f788f3b7700 1 --2- 172.21.15.84:0/226029439 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78880ca8e0 0x7f7888144af0 unknown :-1 s=CLOSED pgs=2946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T14:22:21.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.657+0000 7f788f3b7700 1 --2- 172.21.15.84:0/226029439 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f78880cd590 0x7f78880b2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T14:22:21.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.657+0000 7f788f3b7700 1 -- 172.21.15.84:0/226029439 >> 172.21.15.84:0/226029439 conn(0x7f78880cca70 msgr2=0x7f78880b0ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T14:22:21.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.657+0000 7f788f3b7700 1 -- 172.21.15.84:0/226029439 shutdown_connections 2023-09-13T14:22:21.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.657+0000 7f788f3b7700 1 -- 172.21.15.84:0/226029439 wait complete. 2023-09-13T14:22:21.672 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-09-13T14:22:21.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.796+0000 7fa0431d4700 1 Processor -- start 2023-09-13T14:22:21.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.796+0000 7fa0431d4700 1 -- start start 2023-09-13T14:22:21.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.797+0000 7fa0431d4700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa03c15d530 0x7fa03c161bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T14:22:21.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.797+0000 7fa0431d4700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa03c0ca920 0x7fa03c06d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T14:22:21.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.797+0000 7fa0431d4700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa03c1620f0 con 0x7fa03c06a620 2023-09-13T14:22:21.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.797+0000 7fa0431d4700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa03c0cff20 con 0x7fa03c15d530 2023-09-13T14:22:21.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.797+0000 7fa0431d4700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa03c0cae50 con 0x7fa03c0ca920 2023-09-13T14:22:21.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.797+0000 7fa040f70700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa03c15d530 0x7fa03c161bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T14:22:21.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.797+0000 7fa040f70700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa03c15d530 0x7fa03c161bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58898/0 (socket says 172.21.15.84:58898) 2023-09-13T14:22:21.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.797+0000 7fa040f70700 1 -- 172.21.15.84:0/352604639 learned_addr learned my addr 172.21.15.84:0/352604639 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T14:22:21.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.797+0000 7fa041771700 1 --1- 172.21.15.84:0/352604639 >> v1:172.21.15.84:6789/0 conn(0x7fa03c06a620 0x7fa03c0ce490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:33316/0 (socket says 172.21.15.84:33316) 2023-09-13T14:22:21.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.797+0000 7fa03bfff700 1 --2- 172.21.15.84:0/352604639 >> v2:172.21.15.161:3300/0 conn(0x7fa03c0ca920 0x7fa03c06d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T14:22:21.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.797+0000 7fa040f70700 1 -- 172.21.15.84:0/352604639 >> v2:172.21.15.161:3300/0 conn(0x7fa03c0ca920 msgr2=0x7fa03c06d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T14:22:21.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.797+0000 7fa040f70700 1 --2- 172.21.15.84:0/352604639 >> v2:172.21.15.161:3300/0 conn(0x7fa03c0ca920 0x7fa03c06d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T14:22:21.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.797+0000 7fa040f70700 1 -- 172.21.15.84:0/352604639 >> v1:172.21.15.84:6789/0 conn(0x7fa03c06a620 legacy=0x7fa03c0ce490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T14:22:21.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.797+0000 7fa040f70700 1 -- 172.21.15.84:0/352604639 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa03c0cb130 con 0x7fa03c15d530 2023-09-13T14:22:21.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.797+0000 7fa03b7fe700 1 -- 172.21.15.84:0/352604639 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2374655479 0 0) 0x7fa03c1620f0 con 0x7fa03c06a620 2023-09-13T14:22:21.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.797+0000 7fa03bfff700 1 --2- 172.21.15.84:0/352604639 >> v2:172.21.15.161:3300/0 conn(0x7fa03c0ca920 0x7fa03c06d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T14:22:21.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.797+0000 7fa040f70700 1 --2- 172.21.15.84:0/352604639 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa03c15d530 0x7fa03c161bb0 secure :-1 s=READY pgs=2948 cs=0 l=1 rev1=1 crypto rx=0x7fa03c0c7120 tx=0x7fa030009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e9242b60e701de server_cookie=0 in_seq=0 out_seq=0 2023-09-13T14:22:21.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.797+0000 7fa03b7fe700 1 -- 172.21.15.84:0/352604639 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa03000b870 con 0x7fa03c15d530 2023-09-13T14:22:21.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.797+0000 7fa03b7fe700 1 -- 172.21.15.84:0/352604639 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa03000b9d0 con 0x7fa03c15d530 2023-09-13T14:22:21.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.797+0000 7fa03b7fe700 1 -- 172.21.15.84:0/352604639 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa03000bd60 con 0x7fa03c15d530 2023-09-13T14:22:21.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.798+0000 7fa0431d4700 1 -- 172.21.15.84:0/352604639 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa03c15d530 msgr2=0x7fa03c161bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T14:22:21.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.798+0000 7fa0431d4700 1 --2- 172.21.15.84:0/352604639 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa03c15d530 0x7fa03c161bb0 secure :-1 s=READY pgs=2948 cs=0 l=1 rev1=1 crypto rx=0x7fa03c0c7120 tx=0x7fa030009bd0 comp rx=0 tx=0).stop 2023-09-13T14:22:21.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.798+0000 7fa0431d4700 1 -- 172.21.15.84:0/352604639 shutdown_connections 2023-09-13T14:22:21.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.798+0000 7fa0431d4700 1 --2- 172.21.15.84:0/352604639 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa03c15d530 0x7fa03c161bb0 unknown :-1 s=CLOSED pgs=2948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T14:22:21.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.798+0000 7fa0431d4700 1 --2- 172.21.15.84:0/352604639 >> v2:172.21.15.161:3300/0 conn(0x7fa03c0ca920 0x7fa03c06d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T14:22:21.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.798+0000 7fa0431d4700 1 -- 172.21.15.84:0/352604639 >> 172.21.15.84:0/352604639 conn(0x7fa03c0d00c0 msgr2=0x7fa03c0d04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T14:22:21.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.798+0000 7fa0431d4700 1 -- 172.21.15.84:0/352604639 shutdown_connections 2023-09-13T14:22:21.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.798+0000 7fa0431d4700 1 -- 172.21.15.84:0/352604639 wait complete. 2023-09-13T14:22:21.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.799+0000 7fa0431d4700 1 Processor -- start 2023-09-13T14:22:21.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.800+0000 7fa0431d4700 1 -- start start 2023-09-13T14:22:21.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.801+0000 7fa0431d4700 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa03c06a620 0x7fa03c1f29a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T14:22:21.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.801+0000 7fa0431d4700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa03c0ca920 0x7fa03c15e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T14:22:21.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.801+0000 7fa0431d4700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa03c15d530 0x7fa03c15e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T14:22:21.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.801+0000 7fa0431d4700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa03c15f1a0 con 0x7fa03c15d530 2023-09-13T14:22:21.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.801+0000 7fa0431d4700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa03c0c72c0 con 0x7fa03c0ca920 2023-09-13T14:22:21.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.801+0000 7fa0431d4700 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa03c0c75a0 con 0x7fa03c06a620 2023-09-13T14:22:21.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.801+0000 7fa041771700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa03c15d530 0x7fa03c15e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T14:22:21.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.801+0000 7fa041771700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa03c15d530 0x7fa03c15e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58908/0 (socket says 172.21.15.84:58908) 2023-09-13T14:22:21.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.801+0000 7fa041771700 1 -- 172.21.15.84:0/650698632 learned_addr learned my addr 172.21.15.84:0/650698632 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-13T14:22:21.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.801+0000 7fa040f70700 1 --2- 172.21.15.84:0/650698632 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa03c06a620 0x7fa03c1f29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T14:22:21.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.801+0000 7fa03bfff700 1 --2- 172.21.15.84:0/650698632 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa03c0ca920 0x7fa03c15e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T14:22:21.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.801+0000 7fa041771700 1 -- 172.21.15.84:0/650698632 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa03c06a620 msgr2=0x7fa03c1f29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T14:22:21.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.801+0000 7fa041771700 1 --2- 172.21.15.84:0/650698632 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa03c06a620 0x7fa03c1f29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T14:22:21.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.801+0000 7fa041771700 1 -- 172.21.15.84:0/650698632 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa03c0ca920 msgr2=0x7fa03c15e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T14:22:21.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.801+0000 7fa041771700 1 --2- 172.21.15.84:0/650698632 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa03c0ca920 0x7fa03c15e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T14:22:21.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.801+0000 7fa041771700 1 -- 172.21.15.84:0/650698632 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa030009550 con 0x7fa03c15d530 2023-09-13T14:22:21.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.801+0000 7fa040f70700 1 --2- 172.21.15.84:0/650698632 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa03c06a620 0x7fa03c1f29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T14:22:21.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.801+0000 7fa03bfff700 1 --2- 172.21.15.84:0/650698632 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa03c0ca920 0x7fa03c15e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T14:22:21.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.801+0000 7fa041771700 1 --2- 172.21.15.84:0/650698632 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa03c15d530 0x7fa03c15e980 secure :-1 s=READY pgs=2949 cs=0 l=1 rev1=1 crypto rx=0x7fa03400caf0 tx=0x7fa03400ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T14:22:21.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.801+0000 7fa0397fa700 1 -- 172.21.15.84:0/650698632 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa03400aa90 con 0x7fa03c15d530 2023-09-13T14:22:21.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.801+0000 7fa0397fa700 1 -- 172.21.15.84:0/650698632 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa03400abf0 con 0x7fa03c15d530 2023-09-13T14:22:21.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.801+0000 7fa0431d4700 1 -- 172.21.15.84:0/650698632 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa03c0c7880 con 0x7fa03c15d530 2023-09-13T14:22:21.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.801+0000 7fa0397fa700 1 -- 172.21.15.84:0/650698632 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0340070d0 con 0x7fa03c15d530 2023-09-13T14:22:21.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.801+0000 7fa0431d4700 1 -- 172.21.15.84:0/650698632 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa03c1f2ee0 con 0x7fa03c15d530 2023-09-13T14:22:21.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.802+0000 7fa0431d4700 1 -- 172.21.15.84:0/650698632 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa03c0c7da0 con 0x7fa03c15d530 2023-09-13T14:22:21.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.803+0000 7fa0397fa700 1 -- 172.21.15.84:0/650698632 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 88733+0+0 (secure 0 0 0) 0x7fa034007230 con 0x7fa03c15d530 2023-09-13T14:22:21.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.803+0000 7fa0397fa700 1 --2- 172.21.15.84:0/650698632 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fa02006a580 0x7fa02006ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T14:22:21.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.803+0000 7fa0397fa700 1 -- 172.21.15.84:0/650698632 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa034088870 con 0x7fa03c15d530 2023-09-13T14:22:21.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.803+0000 7fa040f70700 1 --2- 172.21.15.84:0/650698632 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fa02006a580 0x7fa02006ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T14:22:21.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.804+0000 7fa040f70700 1 --2- 172.21.15.84:0/650698632 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fa02006a580 0x7fa02006ca40 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fa03c15b090 tx=0x7fa030008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T14:22:21.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:21.808+0000 7fa0397fa700 1 -- 172.21.15.84:0/650698632 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fa03c0c7da0 con 0x7fa03c15d530 2023-09-13T14:22:22.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:22.021+0000 7fa0431d4700 1 -- 172.21.15.84:0/650698632 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa03c0c7da0 con 0x7fa03c15d530 2023-09-13T14:22:22.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:22.021+0000 7fa0397fa700 1 -- 172.21.15.84:0/650698632 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v42) v1 ==== 80+0+0 (secure 0 0 0) 0x7fa03c0c7da0 con 0x7fa03c15d530 2023-09-13T14:22:22.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:22.023+0000 7fa0431d4700 1 -- 172.21.15.84:0/650698632 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fa02006a580 msgr2=0x7fa02006ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T14:22:22.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:22.023+0000 7fa0431d4700 1 --2- 172.21.15.84:0/650698632 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fa02006a580 0x7fa02006ca40 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fa03c15b090 tx=0x7fa030008030 comp rx=0 tx=0).stop 2023-09-13T14:22:22.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:22.023+0000 7fa0431d4700 1 -- 172.21.15.84:0/650698632 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa03c15d530 msgr2=0x7fa03c15e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T14:22:22.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:22.023+0000 7fa0431d4700 1 --2- 172.21.15.84:0/650698632 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa03c15d530 0x7fa03c15e980 secure :-1 s=READY pgs=2949 cs=0 l=1 rev1=1 crypto rx=0x7fa03400caf0 tx=0x7fa03400ceb0 comp rx=0 tx=0).stop 2023-09-13T14:22:22.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:22.023+0000 7fa0431d4700 1 -- 172.21.15.84:0/650698632 shutdown_connections 2023-09-13T14:22:22.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:22.023+0000 7fa0431d4700 1 --2- 172.21.15.84:0/650698632 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa03c15d530 0x7fa03c15e980 unknown :-1 s=CLOSED pgs=2949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T14:22:22.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:22.023+0000 7fa0431d4700 1 --2- 172.21.15.84:0/650698632 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa03c06a620 0x7fa03c1f29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T14:22:22.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:22.023+0000 7fa0431d4700 1 --2- 172.21.15.84:0/650698632 >> [v2:172.21.15.84:6832/3568908055,v1:172.21.15.84:6833/3568908055] conn(0x7fa02006a580 0x7fa02006ca40 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T14:22:22.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:22.023+0000 7fa0431d4700 1 --2- 172.21.15.84:0/650698632 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa03c0ca920 0x7fa03c15e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T14:22:22.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:22.023+0000 7fa0431d4700 1 -- 172.21.15.84:0/650698632 >> 172.21.15.84:0/650698632 conn(0x7fa03c0d00c0 msgr2=0x7fa03c0b3870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T14:22:22.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:22.024+0000 7fa0431d4700 1 -- 172.21.15.84:0/650698632 shutdown_connections 2023-09-13T14:22:22.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-13T14:22:22.024+0000 7fa0431d4700 1 -- 172.21.15.84:0/650698632 wait complete. 2023-09-13T14:22:22.027 INFO:teuthology.orchestra.run.smithi084.stderr:listed 0 entries 2023-09-13T14:22:22.036 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-09-13T14:22:22.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T14:22:22.037 DEBUG:teuthology.orchestra.run.smithi084:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-09-13T14:22:22.076 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi084.front.sepia.ceph.com 2023-09-13T14:22:22.076 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T14:22:22.077 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-09-13T14:22:22.157 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-09-13T14:22:22.158 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T14:22:22.215 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284264k,nr_inodes=4071066,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=45,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17215 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260552k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 172.21.15.84:6789:/test /tmp/tmp.ocaSSGQzPctest ceph rw,context=system_u:object_r:root_t:s0,relatime,name=admin,secret=,fsid=0107440b-b634-42c5-a643-5d31ea826116,acl 0 0 2023-09-13T14:22:22.215 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi084.front.sepia.ceph.com 2023-09-13T14:22:22.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T14:22:22.217 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-09-13T14:22:22.271 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-13T14:22:22.272 INFO:teuthology.orchestra.run.smithi084.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-09-13T14:22:22.273 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-09-13T14:22:22.273 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T14:22:22.305 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284268k,nr_inodes=4071067,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=45,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17883 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260552k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-09-13T14:22:22.305 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi161.front.sepia.ceph.com 2023-09-13T14:22:22.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T14:22:22.306 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-09-13T14:22:22.368 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-13T14:22:22.369 INFO:teuthology.orchestra.run.smithi161.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-09-13T14:22:22.370 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-09-13T14:22:22.370 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T14:22:22.428 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284268k,nr_inodes=4071067,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=45,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17883 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260552k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-09-13T14:22:22.429 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi161.front.sepia.ceph.com 2023-09-13T14:22:22.430 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T14:22:22.430 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-09-13T14:22:22.486 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-13T14:22:22.487 INFO:teuthology.orchestra.run.smithi161.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-09-13T14:22:22.621 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:22:22.625 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:22:24.100 INFO:tasks.ceph.osd.0:Sent signal 15 2023-09-13T14:22:24.101 INFO:tasks.ceph.osd.1:Sent signal 15 2023-09-13T14:22:24.101 INFO:tasks.ceph.osd.2:Sent signal 15 2023-09-13T14:22:24.102 INFO:tasks.ceph.osd.3:Sent signal 15 2023-09-13T14:22:24.102 INFO:tasks.ceph.osd.4:Sent signal 15 2023-09-13T14:22:24.103 INFO:tasks.ceph.osd.6:Sent signal 15 2023-09-13T14:22:24.103 INFO:tasks.ceph.osd.7:Sent signal 15 2023-09-13T14:22:24.103 INFO:tasks.ceph.mds.a:Sent signal 15 2023-09-13T14:22:24.104 INFO:tasks.ceph.mds.c:Sent signal 15 2023-09-13T14:22:24.105 INFO:tasks.ceph.mds.b:Sent signal 15 2023-09-13T14:22:24.105 INFO:tasks.ceph.mds.d:Sent signal 15 2023-09-13T14:22:24.105 INFO:tasks.ceph.mon.a:Sent signal 15 2023-09-13T14:22:24.106 INFO:tasks.ceph.mon.b:Sent signal 15 2023-09-13T14:22:24.106 INFO:tasks.ceph.mon.c:Sent signal 15 2023-09-13T14:22:24.107 INFO:tasks.ceph.mgr.y:Sent signal 15 2023-09-13T14:22:24.107 INFO:tasks.ceph.mgr.x:Sent signal 15 2023-09-13T14:22:24.108 INFO:tasks.ceph.osd.4.smithi161.stderr:2023-09-13T14:22:24.103+0000 7f74b53b3700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 103559) UID: 0 2023-09-13T14:22:24.109 INFO:tasks.ceph.osd.4.smithi161.stderr:2023-09-13T14:22:24.103+0000 7f74b53b3700 -1 osd.4 42 *** Got signal Terminated *** 2023-09-13T14:22:24.109 INFO:tasks.ceph.osd.4.smithi161.stderr:2023-09-13T14:22:24.103+0000 7f74b53b3700 -1 osd.4 42 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-09-13T14:22:24.109 INFO:tasks.ceph.osd.0.smithi084.stderr:2023-09-13T14:22:24.100+0000 7f41ea673700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 103281) UID: 0 2023-09-13T14:22:24.113 INFO:tasks.ceph.osd.0.smithi084.stderr:2023-09-13T14:22:24.100+0000 7f41ea673700 -1 osd.0 42 *** Got signal Terminated *** 2023-09-13T14:22:24.114 INFO:tasks.ceph.osd.0.smithi084.stderr:2023-09-13T14:22:24.100+0000 7f41ea673700 -1 osd.0 42 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-09-13T14:22:24.114 INFO:tasks.ceph.osd.6.smithi161.stderr:2023-09-13T14:22:24.103+0000 7f1a51b0f700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 103568) UID: 0 2023-09-13T14:22:24.115 INFO:tasks.ceph.osd.6.smithi161.stderr:2023-09-13T14:22:24.103+0000 7f1a51b0f700 -1 osd.6 42 *** Got signal Terminated *** 2023-09-13T14:22:24.115 INFO:tasks.ceph.osd.6.smithi161.stderr:2023-09-13T14:22:24.103+0000 7f1a51b0f700 -1 osd.6 42 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-09-13T14:22:24.115 INFO:tasks.ceph.osd.1.smithi084.stderr:2023-09-13T14:22:24.101+0000 7f7780105700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 103286) UID: 0 2023-09-13T14:22:24.115 INFO:tasks.ceph.osd.1.smithi084.stderr:2023-09-13T14:22:24.101+0000 7f7780105700 -1 osd.1 42 *** Got signal Terminated *** 2023-09-13T14:22:24.116 INFO:tasks.ceph.osd.1.smithi084.stderr:2023-09-13T14:22:24.101+0000 7f7780105700 -1 osd.1 42 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-09-13T14:22:24.116 INFO:tasks.ceph.osd.7.smithi161.stderr:2023-09-13T14:22:24.103+0000 7f01a431f700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 103573) UID: 0 2023-09-13T14:22:24.117 INFO:tasks.ceph.osd.7.smithi161.stderr:2023-09-13T14:22:24.103+0000 7f01a431f700 -1 osd.7 42 *** Got signal Terminated *** 2023-09-13T14:22:24.117 INFO:tasks.ceph.osd.7.smithi161.stderr:2023-09-13T14:22:24.103+0000 7f01a431f700 -1 osd.7 42 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-09-13T14:22:24.117 INFO:tasks.ceph.osd.2.smithi084.stderr:2023-09-13T14:22:24.102+0000 7f459a7f9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 103294) UID: 0 2023-09-13T14:22:24.117 INFO:tasks.ceph.osd.2.smithi084.stderr:2023-09-13T14:22:24.102+0000 7f459a7f9700 -1 osd.2 42 *** Got signal Terminated *** 2023-09-13T14:22:24.118 INFO:tasks.ceph.osd.2.smithi084.stderr:2023-09-13T14:22:24.102+0000 7f459a7f9700 -1 osd.2 42 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-09-13T14:22:24.118 INFO:tasks.ceph.mds.b.smithi161.stderr:2023-09-13T14:22:24.105+0000 7f40246c1700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i b (PID: 110928) UID: 0 2023-09-13T14:22:24.119 INFO:tasks.ceph.mds.b.smithi161.stderr:2023-09-13T14:22:24.105+0000 7f40246c1700 -1 mds.b *** got signal Terminated *** 2023-09-13T14:22:24.121 INFO:tasks.ceph.mds.d.smithi161.stderr:2023-09-13T14:22:24.106+0000 7f3b9b143700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i d (PID: 110929) UID: 0 2023-09-13T14:22:24.121 INFO:tasks.ceph.mds.d.smithi161.stderr:2023-09-13T14:22:24.106+0000 7f3b9b143700 -1 mds.d *** got signal Terminated *** 2023-09-13T14:22:24.122 INFO:tasks.ceph.osd.3.smithi084.stderr:2023-09-13T14:22:24.102+0000 7f2433cf8700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 103299) UID: 0 2023-09-13T14:22:24.122 INFO:tasks.ceph.osd.3.smithi084.stderr:2023-09-13T14:22:24.102+0000 7f2433cf8700 -1 osd.3 42 *** Got signal Terminated *** 2023-09-13T14:22:24.122 INFO:tasks.ceph.osd.3.smithi084.stderr:2023-09-13T14:22:24.102+0000 7f2433cf8700 -1 osd.3 42 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-09-13T14:22:24.123 INFO:tasks.ceph.mon.b.smithi161.stderr:2023-09-13T14:22:24.106+0000 7fe8ac8b2700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i b (PID: 102916) UID: 0 2023-09-13T14:22:24.123 INFO:tasks.ceph.mon.b.smithi161.stderr:2023-09-13T14:22:24.106+0000 7fe8ac8b2700 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2023-09-13T14:22:24.124 INFO:tasks.ceph.mds.a.smithi084.stderr:2023-09-13T14:22:24.104+0000 7f786a3fc700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i a (PID: 119087) UID: 0 2023-09-13T14:22:24.124 INFO:tasks.ceph.mds.a.smithi084.stderr:2023-09-13T14:22:24.104+0000 7f786a3fc700 -1 mds.a *** got signal Terminated *** 2023-09-13T14:22:24.125 INFO:tasks.ceph.mon.c.smithi161.stderr:2023-09-13T14:22:24.107+0000 7fde74926700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i c (PID: 102918) UID: 0 2023-09-13T14:22:24.125 INFO:tasks.ceph.mon.c.smithi161.stderr:2023-09-13T14:22:24.107+0000 7fde74926700 -1 mon.c@2(peon) e1 *** Got Signal Terminated *** 2023-09-13T14:22:24.126 INFO:tasks.ceph.mds.c.smithi084.stderr:2023-09-13T14:22:24.105+0000 7f7e181ae700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i c (PID: 119088) UID: 0 2023-09-13T14:22:24.126 INFO:tasks.ceph.mds.c.smithi084.stderr:2023-09-13T14:22:24.105+0000 7f7e181ae700 -1 mds.c *** got signal Terminated *** 2023-09-13T14:22:24.127 INFO:tasks.ceph.mon.a.smithi084.stderr:2023-09-13T14:22:24.106+0000 7f4f399bc700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i a (PID: 102960) UID: 0 2023-09-13T14:22:24.127 INFO:tasks.ceph.mon.a.smithi084.stderr:2023-09-13T14:22:24.106+0000 7f4f399bc700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-09-13T14:22:24.128 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-09-13T14:22:24.108+0000 7f8165195700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mgr -f --cluster ceph -i y (PID: 103002) UID: 0 2023-09-13T14:22:24.128 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-09-13T14:22:24.108+0000 7f8165195700 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2023-09-13T14:22:24.309 INFO:tasks.ceph.mgr.x.smithi161.stderr:daemon-helper: command crashed with signal 15 2023-09-13T14:22:29.136 INFO:tasks.ceph.osd.2.smithi084.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-6083-g4a754ac9/rpm/el8/BUILD/ceph-18.0.0-6083-g4a754ac9/src/os/bluestore/BlueFS.cc: In function 'uint64_t BlueFS::_log_advance_seq()' thread 7f459a7f9700 time 2023-09-13T14:22:29.137244+0000 2023-09-13T14:22:29.136 INFO:tasks.ceph.osd.2.smithi084.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-6083-g4a754ac9/rpm/el8/BUILD/ceph-18.0.0-6083-g4a754ac9/src/os/bluestore/BlueFS.cc: 3042: FAILED ceph_assert(log.t.seq == log.seq_live) 2023-09-13T14:22:29.165 INFO:tasks.ceph.osd.2.smithi084.stderr: ceph version 18.0.0-6083-g4a754ac9 (4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5) reef (dev) 2023-09-13T14:22:29.166 INFO:tasks.ceph.osd.2.smithi084.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x55b0c8b296ef] 2023-09-13T14:22:29.166 INFO:tasks.ceph.osd.2.smithi084.stderr: 2: ceph-osd(+0x6458b5) [0x55b0c8b298b5] 2023-09-13T14:22:29.166 INFO:tasks.ceph.osd.2.smithi084.stderr: 3: ceph-osd(+0xd77e6b) [0x55b0c925be6b] 2023-09-13T14:22:29.166 INFO:tasks.ceph.osd.2.smithi084.stderr: 4: (BlueFS::_flush_and_sync_log_jump_D(unsigned long)+0x5c) [0x55b0c927167c] 2023-09-13T14:22:29.167 INFO:tasks.ceph.osd.2.smithi084.stderr: 5: (BlueFS::_compact_log_async_LD_LNF_D()+0x660) [0x55b0c927f2e0] 2023-09-13T14:22:29.167 INFO:tasks.ceph.osd.2.smithi084.stderr: 6: (BlueStore::store_allocator(Allocator*)+0xb7) [0x55b0c91ae9e7] 2023-09-13T14:22:29.167 INFO:tasks.ceph.osd.2.smithi084.stderr: 7: (BlueStore::_close_db()+0x4e2) [0x55b0c91afc42] 2023-09-13T14:22:29.167 INFO:tasks.ceph.osd.2.smithi084.stderr: 8: (BlueStore::_close_db_and_around()+0x17) [0x55b0c91b05a7] 2023-09-13T14:22:29.167 INFO:tasks.ceph.osd.2.smithi084.stderr: 9: (BlueStore::umount()+0xfa) [0x55b0c91feeca] 2023-09-13T14:22:29.168 INFO:tasks.ceph.osd.2.smithi084.stderr: 10: (OSD::shutdown()+0x2ee) [0x55b0c8c5ab9e] 2023-09-13T14:22:29.168 INFO:tasks.ceph.osd.2.smithi084.stderr: 11: (SignalHandler::entry()+0x659) [0x55b0c92c6179] 2023-09-13T14:22:29.168 INFO:tasks.ceph.osd.2.smithi084.stderr: 12: /lib64/libpthread.so.0(+0x81cf) [0x7f45a2ef61cf] 2023-09-13T14:22:29.168 INFO:tasks.ceph.osd.2.smithi084.stderr: 13: clone() 2023-09-13T14:22:29.168 INFO:tasks.ceph.osd.2.smithi084.stderr:*** Caught signal (Aborted) ** 2023-09-13T14:22:29.169 INFO:tasks.ceph.osd.2.smithi084.stderr: in thread 7f459a7f9700 thread_name:signal_handler 2023-09-13T14:22:29.169 INFO:tasks.ceph.osd.2.smithi084.stderr:2023-09-13T14:22:29.165+0000 7f459a7f9700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-6083-g4a754ac9/rpm/el8/BUILD/ceph-18.0.0-6083-g4a754ac9/src/os/bluestore/BlueFS.cc: In function 'uint64_t BlueFS::_log_advance_seq()' thread 7f459a7f9700 time 2023-09-13T14:22:29.137244+0000 2023-09-13T14:22:29.169 INFO:tasks.ceph.osd.2.smithi084.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-6083-g4a754ac9/rpm/el8/BUILD/ceph-18.0.0-6083-g4a754ac9/src/os/bluestore/BlueFS.cc: 3042: FAILED ceph_assert(log.t.seq == log.seq_live) 2023-09-13T14:22:29.169 INFO:tasks.ceph.osd.2.smithi084.stderr: 2023-09-13T14:22:29.169 INFO:tasks.ceph.osd.2.smithi084.stderr: ceph version 18.0.0-6083-g4a754ac9 (4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5) reef (dev) 2023-09-13T14:22:29.170 INFO:tasks.ceph.osd.2.smithi084.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x55b0c8b296ef] 2023-09-13T14:22:29.170 INFO:tasks.ceph.osd.2.smithi084.stderr: 2: ceph-osd(+0x6458b5) [0x55b0c8b298b5] 2023-09-13T14:22:29.170 INFO:tasks.ceph.osd.2.smithi084.stderr: 3: ceph-osd(+0xd77e6b) [0x55b0c925be6b] 2023-09-13T14:22:29.170 INFO:tasks.ceph.osd.2.smithi084.stderr: 4: (BlueFS::_flush_and_sync_log_jump_D(unsigned long)+0x5c) [0x55b0c927167c] 2023-09-13T14:22:29.170 INFO:tasks.ceph.osd.2.smithi084.stderr: 5: (BlueFS::_compact_log_async_LD_LNF_D()+0x660) [0x55b0c927f2e0] 2023-09-13T14:22:29.170 INFO:tasks.ceph.osd.2.smithi084.stderr: 6: (BlueStore::store_allocator(Allocator*)+0xb7) [0x55b0c91ae9e7] 2023-09-13T14:22:29.171 INFO:tasks.ceph.osd.2.smithi084.stderr: 7: (BlueStore::_close_db()+0x4e2) [0x55b0c91afc42] 2023-09-13T14:22:29.171 INFO:tasks.ceph.osd.2.smithi084.stderr: 8: (BlueStore::_close_db_and_around()+0x17) [0x55b0c91b05a7] 2023-09-13T14:22:29.171 INFO:tasks.ceph.osd.2.smithi084.stderr: 9: (BlueStore::umount()+0xfa) [0x55b0c91feeca] 2023-09-13T14:22:29.171 INFO:tasks.ceph.osd.2.smithi084.stderr: 10: (OSD::shutdown()+0x2ee) [0x55b0c8c5ab9e] 2023-09-13T14:22:29.171 INFO:tasks.ceph.osd.2.smithi084.stderr: 11: (SignalHandler::entry()+0x659) [0x55b0c92c6179] 2023-09-13T14:22:29.172 INFO:tasks.ceph.osd.2.smithi084.stderr: 12: /lib64/libpthread.so.0(+0x81cf) [0x7f45a2ef61cf] 2023-09-13T14:22:29.172 INFO:tasks.ceph.osd.2.smithi084.stderr: 13: clone() 2023-09-13T14:22:29.172 INFO:tasks.ceph.osd.2.smithi084.stderr: 2023-09-13T14:22:29.173 INFO:tasks.ceph.osd.2.smithi084.stderr: ceph version 18.0.0-6083-g4a754ac9 (4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5) reef (dev) 2023-09-13T14:22:29.173 INFO:tasks.ceph.osd.2.smithi084.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7f45a2f00ce0] 2023-09-13T14:22:29.173 INFO:tasks.ceph.osd.2.smithi084.stderr: 2: gsignal() 2023-09-13T14:22:29.173 INFO:tasks.ceph.osd.2.smithi084.stderr: 3: abort() 2023-09-13T14:22:29.173 INFO:tasks.ceph.osd.2.smithi084.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x55b0c8b29749] 2023-09-13T14:22:29.174 INFO:tasks.ceph.osd.2.smithi084.stderr: 5: ceph-osd(+0x6458b5) [0x55b0c8b298b5] 2023-09-13T14:22:29.174 INFO:tasks.ceph.osd.2.smithi084.stderr: 6: ceph-osd(+0xd77e6b) [0x55b0c925be6b] 2023-09-13T14:22:29.174 INFO:tasks.ceph.osd.2.smithi084.stderr: 7: (BlueFS::_flush_and_sync_log_jump_D(unsigned long)+0x5c) [0x55b0c927167c] 2023-09-13T14:22:29.174 INFO:tasks.ceph.osd.2.smithi084.stderr: 8: (BlueFS::_compact_log_async_LD_LNF_D()+0x660) [0x55b0c927f2e0] 2023-09-13T14:22:29.174 INFO:tasks.ceph.osd.2.smithi084.stderr: 9: (BlueStore::store_allocator(Allocator*)+0xb7) [0x55b0c91ae9e7] 2023-09-13T14:22:29.175 INFO:tasks.ceph.osd.2.smithi084.stderr: 10: (BlueStore::_close_db()+0x4e2) [0x55b0c91afc42] 2023-09-13T14:22:29.175 INFO:tasks.ceph.osd.2.smithi084.stderr: 11: (BlueStore::_close_db_and_around()+0x17) [0x55b0c91b05a7] 2023-09-13T14:22:29.175 INFO:tasks.ceph.osd.2.smithi084.stderr: 12: (BlueStore::umount()+0xfa) [0x55b0c91feeca] 2023-09-13T14:22:29.176 INFO:tasks.ceph.osd.2.smithi084.stderr: 13: (OSD::shutdown()+0x2ee) [0x55b0c8c5ab9e] 2023-09-13T14:22:29.176 INFO:tasks.ceph.osd.2.smithi084.stderr: 14: (SignalHandler::entry()+0x659) [0x55b0c92c6179] 2023-09-13T14:22:29.176 INFO:tasks.ceph.osd.2.smithi084.stderr: 15: /lib64/libpthread.so.0(+0x81cf) [0x7f45a2ef61cf] 2023-09-13T14:22:29.176 INFO:tasks.ceph.osd.2.smithi084.stderr: 16: clone() 2023-09-13T14:22:29.176 INFO:tasks.ceph.osd.2.smithi084.stderr:2023-09-13T14:22:29.169+0000 7f459a7f9700 -1 *** Caught signal (Aborted) ** 2023-09-13T14:22:29.176 INFO:tasks.ceph.osd.2.smithi084.stderr: in thread 7f459a7f9700 thread_name:signal_handler 2023-09-13T14:22:29.177 INFO:tasks.ceph.osd.2.smithi084.stderr: 2023-09-13T14:22:29.177 INFO:tasks.ceph.osd.2.smithi084.stderr: ceph version 18.0.0-6083-g4a754ac9 (4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5) reef (dev) 2023-09-13T14:22:29.177 INFO:tasks.ceph.osd.2.smithi084.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7f45a2f00ce0] 2023-09-13T14:22:29.177 INFO:tasks.ceph.osd.2.smithi084.stderr: 2: gsignal() 2023-09-13T14:22:29.177 INFO:tasks.ceph.osd.2.smithi084.stderr: 3: abort() 2023-09-13T14:22:29.178 INFO:tasks.ceph.osd.2.smithi084.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x55b0c8b29749] 2023-09-13T14:22:29.178 INFO:tasks.ceph.osd.2.smithi084.stderr: 5: ceph-osd(+0x6458b5) [0x55b0c8b298b5] 2023-09-13T14:22:29.178 INFO:tasks.ceph.osd.2.smithi084.stderr: 6: ceph-osd(+0xd77e6b) [0x55b0c925be6b] 2023-09-13T14:22:29.178 INFO:tasks.ceph.osd.2.smithi084.stderr: 7: (BlueFS::_flush_and_sync_log_jump_D(unsigned long)+0x5c) [0x55b0c927167c] 2023-09-13T14:22:29.178 INFO:tasks.ceph.osd.2.smithi084.stderr: 8: (BlueFS::_compact_log_async_LD_LNF_D()+0x660) [0x55b0c927f2e0] 2023-09-13T14:22:29.179 INFO:tasks.ceph.osd.2.smithi084.stderr: 9: (BlueStore::store_allocator(Allocator*)+0xb7) [0x55b0c91ae9e7] 2023-09-13T14:22:29.179 INFO:tasks.ceph.osd.2.smithi084.stderr: 10: (BlueStore::_close_db()+0x4e2) [0x55b0c91afc42] 2023-09-13T14:22:29.179 INFO:tasks.ceph.osd.2.smithi084.stderr: 11: (BlueStore::_close_db_and_around()+0x17) [0x55b0c91b05a7] 2023-09-13T14:22:29.179 INFO:tasks.ceph.osd.2.smithi084.stderr: 12: (BlueStore::umount()+0xfa) [0x55b0c91feeca] 2023-09-13T14:22:29.179 INFO:tasks.ceph.osd.2.smithi084.stderr: 13: (OSD::shutdown()+0x2ee) [0x55b0c8c5ab9e] 2023-09-13T14:22:29.180 INFO:tasks.ceph.osd.2.smithi084.stderr: 14: (SignalHandler::entry()+0x659) [0x55b0c92c6179] 2023-09-13T14:22:29.180 INFO:tasks.ceph.osd.2.smithi084.stderr: 15: /lib64/libpthread.so.0(+0x81cf) [0x7f45a2ef61cf] 2023-09-13T14:22:29.180 INFO:tasks.ceph.osd.2.smithi084.stderr: 16: clone() 2023-09-13T14:22:29.180 INFO:tasks.ceph.osd.2.smithi084.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-09-13T14:22:29.180 INFO:tasks.ceph.osd.2.smithi084.stderr: 2023-09-13T14:22:29.183 INFO:tasks.ceph.osd.2.smithi084.stderr: -1177> 2023-09-13T14:22:24.102+0000 7f459a7f9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 103294) UID: 0 2023-09-13T14:22:29.183 INFO:tasks.ceph.osd.2.smithi084.stderr: -1176> 2023-09-13T14:22:24.102+0000 7f459a7f9700 -1 osd.2 42 *** Got signal Terminated *** 2023-09-13T14:22:29.183 INFO:tasks.ceph.osd.2.smithi084.stderr: -1174> 2023-09-13T14:22:24.102+0000 7f459a7f9700 -1 osd.2 42 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-09-13T14:22:29.184 INFO:tasks.ceph.osd.2.smithi084.stderr: -1> 2023-09-13T14:22:29.165+0000 7f459a7f9700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-6083-g4a754ac9/rpm/el8/BUILD/ceph-18.0.0-6083-g4a754ac9/src/os/bluestore/BlueFS.cc: In function 'uint64_t BlueFS::_log_advance_seq()' thread 7f459a7f9700 time 2023-09-13T14:22:29.137244+0000 2023-09-13T14:22:29.184 INFO:tasks.ceph.osd.2.smithi084.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-6083-g4a754ac9/rpm/el8/BUILD/ceph-18.0.0-6083-g4a754ac9/src/os/bluestore/BlueFS.cc: 3042: FAILED ceph_assert(log.t.seq == log.seq_live) 2023-09-13T14:22:29.184 INFO:tasks.ceph.osd.2.smithi084.stderr: 2023-09-13T14:22:29.185 INFO:tasks.ceph.osd.2.smithi084.stderr: ceph version 18.0.0-6083-g4a754ac9 (4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5) reef (dev) 2023-09-13T14:22:29.185 INFO:tasks.ceph.osd.2.smithi084.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x55b0c8b296ef] 2023-09-13T14:22:29.185 INFO:tasks.ceph.osd.2.smithi084.stderr: 2: ceph-osd(+0x6458b5) [0x55b0c8b298b5] 2023-09-13T14:22:29.185 INFO:tasks.ceph.osd.2.smithi084.stderr: 3: ceph-osd(+0xd77e6b) [0x55b0c925be6b] 2023-09-13T14:22:29.185 INFO:tasks.ceph.osd.2.smithi084.stderr: 4: (BlueFS::_flush_and_sync_log_jump_D(unsigned long)+0x5c) [0x55b0c927167c] 2023-09-13T14:22:29.186 INFO:tasks.ceph.osd.2.smithi084.stderr: 5: (BlueFS::_compact_log_async_LD_LNF_D()+0x660) [0x55b0c927f2e0] 2023-09-13T14:22:29.186 INFO:tasks.ceph.osd.2.smithi084.stderr: 6: (BlueStore::store_allocator(Allocator*)+0xb7) [0x55b0c91ae9e7] 2023-09-13T14:22:29.186 INFO:tasks.ceph.osd.2.smithi084.stderr: 7: (BlueStore::_close_db()+0x4e2) [0x55b0c91afc42] 2023-09-13T14:22:29.186 INFO:tasks.ceph.osd.2.smithi084.stderr: 8: (BlueStore::_close_db_and_around()+0x17) [0x55b0c91b05a7] 2023-09-13T14:22:29.186 INFO:tasks.ceph.osd.2.smithi084.stderr: 9: (BlueStore::umount()+0xfa) [0x55b0c91feeca] 2023-09-13T14:22:29.187 INFO:tasks.ceph.osd.2.smithi084.stderr: 10: (OSD::shutdown()+0x2ee) [0x55b0c8c5ab9e] 2023-09-13T14:22:29.187 INFO:tasks.ceph.osd.2.smithi084.stderr: 11: (SignalHandler::entry()+0x659) [0x55b0c92c6179] 2023-09-13T14:22:29.187 INFO:tasks.ceph.osd.2.smithi084.stderr: 12: /lib64/libpthread.so.0(+0x81cf) [0x7f45a2ef61cf] 2023-09-13T14:22:29.187 INFO:tasks.ceph.osd.2.smithi084.stderr: 13: clone() 2023-09-13T14:22:29.187 INFO:tasks.ceph.osd.2.smithi084.stderr: 2023-09-13T14:22:29.188 INFO:tasks.ceph.osd.2.smithi084.stderr: 0> 2023-09-13T14:22:29.169+0000 7f459a7f9700 -1 *** Caught signal (Aborted) ** 2023-09-13T14:22:29.188 INFO:tasks.ceph.osd.2.smithi084.stderr: in thread 7f459a7f9700 thread_name:signal_handler 2023-09-13T14:22:29.188 INFO:tasks.ceph.osd.2.smithi084.stderr: 2023-09-13T14:22:29.188 INFO:tasks.ceph.osd.2.smithi084.stderr: ceph version 18.0.0-6083-g4a754ac9 (4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5) reef (dev) 2023-09-13T14:22:29.188 INFO:tasks.ceph.osd.2.smithi084.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7f45a2f00ce0] 2023-09-13T14:22:29.189 INFO:tasks.ceph.osd.2.smithi084.stderr: 2: gsignal() 2023-09-13T14:22:29.189 INFO:tasks.ceph.osd.2.smithi084.stderr: 3: abort() 2023-09-13T14:22:29.189 INFO:tasks.ceph.osd.2.smithi084.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x55b0c8b29749] 2023-09-13T14:22:29.189 INFO:tasks.ceph.osd.2.smithi084.stderr: 5: ceph-osd(+0x6458b5) [0x55b0c8b298b5] 2023-09-13T14:22:29.189 INFO:tasks.ceph.osd.2.smithi084.stderr: 6: ceph-osd(+0xd77e6b) [0x55b0c925be6b] 2023-09-13T14:22:29.189 INFO:tasks.ceph.osd.2.smithi084.stderr: 7: (BlueFS::_flush_and_sync_log_jump_D(unsigned long)+0x5c) [0x55b0c927167c] 2023-09-13T14:22:29.190 INFO:tasks.ceph.osd.2.smithi084.stderr: 8: (BlueFS::_compact_log_async_LD_LNF_D()+0x660) [0x55b0c927f2e0] 2023-09-13T14:22:29.190 INFO:tasks.ceph.osd.2.smithi084.stderr: 9: (BlueStore::store_allocator(Allocator*)+0xb7) [0x55b0c91ae9e7] 2023-09-13T14:22:29.190 INFO:tasks.ceph.osd.2.smithi084.stderr: 10: (BlueStore::_close_db()+0x4e2) [0x55b0c91afc42] 2023-09-13T14:22:29.190 INFO:tasks.ceph.osd.2.smithi084.stderr: 11: (BlueStore::_close_db_and_around()+0x17) [0x55b0c91b05a7] 2023-09-13T14:22:29.190 INFO:tasks.ceph.osd.2.smithi084.stderr: 12: (BlueStore::umount()+0xfa) [0x55b0c91feeca] 2023-09-13T14:22:29.191 INFO:tasks.ceph.osd.2.smithi084.stderr: 13: (OSD::shutdown()+0x2ee) [0x55b0c8c5ab9e] 2023-09-13T14:22:29.191 INFO:tasks.ceph.osd.2.smithi084.stderr: 14: (SignalHandler::entry()+0x659) [0x55b0c92c6179] 2023-09-13T14:22:29.191 INFO:tasks.ceph.osd.2.smithi084.stderr: 15: /lib64/libpthread.so.0(+0x81cf) [0x7f45a2ef61cf] 2023-09-13T14:22:29.191 INFO:tasks.ceph.osd.2.smithi084.stderr: 16: clone() 2023-09-13T14:22:29.191 INFO:tasks.ceph.osd.2.smithi084.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-09-13T14:22:29.192 INFO:tasks.ceph.osd.2.smithi084.stderr: 2023-09-13T14:22:37.921 INFO:tasks.ceph.osd.2.smithi084.stderr:daemon-helper: command crashed with signal 11 2023-09-13T14:22:52.684 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:22:52.688 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:23:22.831 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:23:22.834 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:23:52.972 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:23:52.976 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:24:23.122 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:24:23.126 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:24:53.277 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:24:53.281 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:25:23.424 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:25:23.433 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:25:53.570 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:25:53.573 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:26:23.715 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:26:23.719 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:26:53.860 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:26:53.864 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:27:23.982 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:27:23.987 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:27:54.136 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:27:54.140 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:28:24.282 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:28:24.286 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:28:54.436 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:28:54.440 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:29:24.574 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:29:24.578 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:29:54.712 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:29:54.716 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:30:24.840 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:30:24.843 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:30:54.979 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:30:54.983 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:31:25.136 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:31:25.140 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:31:55.272 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:31:55.276 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:32:25.418 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:32:25.422 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:32:55.570 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:32:55.574 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:33:25.700 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:33:25.704 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:33:55.858 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:33:55.862 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:34:26.060 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:34:26.064 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:34:56.221 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:34:56.225 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:35:26.382 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:35:26.386 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:35:56.504 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:35:56.508 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:36:26.633 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:36:26.636 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:36:56.763 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:36:56.766 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:37:26.850 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:37:26.853 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:37:57.004 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:37:57.008 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:38:27.133 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:38:27.137 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:38:57.310 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:38:57.314 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:39:27.470 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:39:27.474 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:39:57.604 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:39:57.609 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:40:27.775 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:40:27.778 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:40:57.937 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:40:57.941 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:41:28.092 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:41:28.095 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:41:58.225 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:41:58.229 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:42:28.385 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:42:28.389 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:42:58.537 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:42:58.541 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:43:28.674 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:43:28.679 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:43:58.822 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:43:58.826 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:44:28.968 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:44:28.971 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:44:59.123 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:44:59.127 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:45:29.276 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:45:29.280 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:45:59.447 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:45:59.452 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:46:29.584 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:46:29.587 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:46:59.727 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:46:59.731 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:47:29.877 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:47:29.881 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:48:00.039 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:48:00.043 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:48:30.177 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:48:30.181 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:49:00.312 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:49:00.315 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:49:30.448 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:49:30.452 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:50:00.592 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:50:00.596 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:50:30.768 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:50:30.773 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:51:00.940 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:51:00.944 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:51:31.099 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:51:31.104 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:52:01.236 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:52:01.240 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:52:31.385 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:52:31.388 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:53:01.524 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:53:01.528 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:53:31.593 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:53:31.597 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:54:01.738 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:54:01.742 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:54:31.882 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:54:31.886 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:55:02.040 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:55:02.044 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:55:32.203 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:55:32.207 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:56:02.356 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:56:02.361 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:56:32.500 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:56:32.504 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:57:02.862 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:57:02.865 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:57:33.007 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:57:33.010 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:58:03.133 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:58:03.137 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:58:33.287 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:58:33.291 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:59:03.416 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:59:03.419 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:59:33.545 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T14:59:33.549 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:00:03.691 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:00:03.695 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:00:33.856 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:00:33.860 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:01:04.009 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:01:04.012 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:01:34.156 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:01:34.161 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:02:04.292 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:02:04.295 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:02:34.438 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:02:34.442 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:03:04.584 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:03:04.587 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:03:34.756 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:03:34.760 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:04:04.874 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:04:04.877 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:04:35.018 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:04:35.022 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:05:05.146 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:05:05.150 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:05:35.256 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:05:35.260 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:06:05.392 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:06:05.396 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:06:35.469 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:06:35.473 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:07:05.682 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:07:05.686 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:07:35.842 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:07:35.846 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:08:05.961 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:08:05.964 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:08:36.080 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:08:36.085 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:09:06.240 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:09:06.244 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:09:36.394 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:09:36.400 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:10:06.538 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:10:06.564 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:10:36.692 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:10:36.695 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:11:06.854 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:11:06.859 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:11:36.998 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:11:37.001 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:12:07.171 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:12:07.175 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:12:37.298 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:12:37.302 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:13:07.428 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:13:07.432 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:13:37.565 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:13:37.570 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:14:07.703 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:14:07.706 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:14:37.832 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:14:37.836 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:15:07.981 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:15:07.984 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:15:38.057 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:15:38.061 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:16:08.211 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:16:08.215 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:16:38.347 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:16:38.351 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:17:08.499 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:17:08.503 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:17:38.652 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:17:38.657 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:18:08.904 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:18:08.908 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:18:39.049 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:18:39.053 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:19:09.187 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:19:09.190 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:19:39.320 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:19:39.324 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:20:09.445 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:20:09.449 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:20:39.576 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:20:39.580 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:21:09.728 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:21:09.732 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:21:39.947 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:21:39.950 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:22:10.193 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:22:10.197 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:22:40.284 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:22:40.288 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:23:10.355 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:23:10.360 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:23:40.475 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:23:40.479 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:24:10.627 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:24:10.631 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:24:40.764 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:24:40.768 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:25:10.932 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:25:10.936 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:25:40.993 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:25:40.997 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:26:11.162 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:26:11.167 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:26:41.301 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:26:41.304 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:27:11.458 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:27:11.462 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:27:41.618 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:27:41.622 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:28:11.779 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:28:11.783 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:28:41.926 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:28:41.930 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:29:12.063 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:29:12.067 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:29:42.218 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:29:42.222 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:30:12.363 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:30:12.369 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:30:42.510 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:30:42.513 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:31:12.598 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:31:12.602 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:31:42.718 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:31:42.723 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:32:12.854 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:32:12.858 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:32:43.038 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:32:43.043 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:33:13.190 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:33:13.194 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:33:43.328 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:33:43.332 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:34:13.480 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:34:13.483 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:34:43.615 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:34:43.619 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:35:13.765 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:35:13.769 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:35:43.905 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:35:43.909 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:36:14.024 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:36:14.028 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:36:44.178 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:36:44.181 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:37:14.325 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:37:14.329 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:37:44.481 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:37:44.485 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:38:14.625 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:38:14.633 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:38:44.786 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:38:44.790 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:39:14.913 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:39:14.916 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:39:45.058 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:39:45.062 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:40:15.174 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:40:15.178 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:40:45.271 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:40:45.275 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:41:15.425 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:41:15.430 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:41:45.569 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:41:45.573 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:42:15.716 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:42:15.719 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:42:45.840 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:42:45.844 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:43:15.959 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:43:15.963 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:43:46.104 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:43:46.108 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:44:16.241 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:44:16.244 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:44:46.371 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:44:46.375 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:45:16.517 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:45:16.520 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:45:46.662 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:45:46.666 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:46:16.817 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:46:16.821 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:46:46.963 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:46:46.967 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:47:17.100 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:47:17.104 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:47:47.232 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:47:47.236 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:48:17.369 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:48:17.372 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:48:47.522 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:48:47.526 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:49:17.659 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:49:17.663 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:49:47.818 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:49:47.822 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:50:17.950 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:50:17.954 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:50:48.098 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:50:48.102 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:51:18.260 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:51:18.263 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:51:48.414 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:51:48.417 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:52:18.556 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:52:18.559 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:52:48.684 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:52:48.688 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:53:18.835 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:53:18.838 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:53:48.989 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:53:48.992 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:54:19.119 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:54:19.124 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:54:49.318 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:54:49.322 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:55:19.459 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:55:19.463 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:55:49.607 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:55:49.610 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:56:19.810 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:56:19.814 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:56:49.953 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:56:49.957 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:57:20.077 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:57:20.081 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:57:50.206 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:57:50.210 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:58:20.335 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:58:20.339 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:58:50.480 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:58:50.484 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:59:20.650 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:59:20.653 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:59:50.806 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T15:59:50.809 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:00:20.935 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:00:20.938 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:00:51.090 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:00:51.094 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:01:21.268 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:01:21.272 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:01:51.404 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:01:51.408 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:02:21.590 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:02:21.594 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:02:51.726 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:02:51.730 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:03:21.877 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:03:21.881 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:03:52.019 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:03:52.023 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:04:22.161 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:04:22.165 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:04:52.307 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:04:52.311 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:05:22.431 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:05:22.435 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:05:52.573 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:05:52.577 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:06:22.744 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:06:22.748 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:06:52.822 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:06:52.825 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:07:22.970 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:07:22.973 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:07:53.100 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:07:53.106 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:08:23.228 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:08:23.231 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:08:53.374 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:08:53.378 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:09:23.511 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:09:23.518 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:09:53.657 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:09:53.660 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:10:23.948 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:10:23.952 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:10:54.082 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:10:54.086 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:11:24.237 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:11:24.241 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:11:54.572 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:11:54.576 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:12:24.729 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:12:24.733 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:12:54.867 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:12:54.870 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:13:25.012 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:13:25.015 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:13:55.169 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:13:55.173 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:14:25.312 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:14:25.316 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:14:55.463 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:14:55.466 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:15:25.607 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:15:25.610 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:15:55.759 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:15:55.762 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:16:25.904 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:16:25.908 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:16:56.040 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:16:56.044 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:17:26.171 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:17:26.174 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:17:56.352 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:17:56.356 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:18:26.471 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:18:26.474 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:18:56.608 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:18:56.612 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:19:26.737 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:19:26.741 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:19:56.908 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:19:56.912 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:20:27.108 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:20:27.112 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:20:57.233 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:20:57.237 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:21:27.379 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:21:27.383 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:21:57.518 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:21:57.521 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:22:27.673 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:22:27.677 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:22:57.828 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:22:57.831 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:23:27.947 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:23:27.950 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:23:58.092 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:23:58.095 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:24:28.228 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:24:28.232 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:24:58.410 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:24:58.414 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:25:28.559 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:25:28.563 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:25:58.710 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:25:58.714 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:26:28.881 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:26:28.885 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:26:59.160 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:26:59.164 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:27:29.331 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:27:29.335 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:27:59.479 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:27:59.486 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:28:29.623 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:28:29.627 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:28:59.769 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:28:59.773 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:29:29.929 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:29:29.932 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:30:00.097 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:30:00.101 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:30:30.265 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:30:30.270 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:31:00.403 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:31:00.406 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:31:30.540 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:31:30.544 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:32:00.699 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:32:00.703 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:32:30.832 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:32:30.836 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:33:00.989 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:33:00.993 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:33:31.132 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:33:31.136 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:34:01.278 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:34:01.282 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:34:31.438 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:34:31.442 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:35:01.566 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:35:01.569 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:35:31.710 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:35:31.713 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:36:01.845 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:36:01.849 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:36:31.998 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:36:32.002 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:37:02.137 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:37:02.141 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:37:32.279 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:37:32.283 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:38:02.429 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:38:02.432 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:38:32.568 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:38:32.571 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:39:02.719 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:39:02.723 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:39:32.872 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:39:32.876 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:40:03.004 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:40:03.007 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:40:33.161 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:40:33.165 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:41:03.304 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:41:03.307 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:41:33.466 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:41:33.470 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:42:03.613 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:42:03.617 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:42:33.742 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:42:33.869 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:43:04.005 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:43:04.008 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:43:34.152 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:43:34.157 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:44:04.406 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:44:04.410 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:44:34.528 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:44:34.532 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:45:04.660 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:45:04.664 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:45:34.811 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:45:34.815 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:46:04.948 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:46:04.951 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:46:35.086 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:46:35.090 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:47:05.233 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:47:05.237 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:47:35.388 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:47:35.392 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:48:05.523 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:48:05.527 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:48:35.662 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:48:35.667 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:49:05.822 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:49:05.826 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:49:35.952 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:49:35.956 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:50:06.101 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:50:06.105 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:50:36.262 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:50:36.265 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:51:06.406 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:51:06.410 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:51:36.567 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:51:36.570 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:52:06.720 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:52:06.725 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:52:36.870 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:52:36.874 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:53:06.999 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:53:07.002 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:53:37.160 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:53:37.164 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:54:07.297 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:54:07.301 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:54:37.467 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:54:37.470 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:55:07.644 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:55:07.648 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:55:37.762 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:55:37.765 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:56:07.890 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:56:07.895 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:56:38.053 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:56:38.057 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:57:08.200 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:57:08.204 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:57:38.340 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:57:38.344 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:58:08.475 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:58:08.480 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:58:38.625 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:58:38.629 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:59:08.764 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:59:08.767 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:59:38.899 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T16:59:38.904 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:00:09.061 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:00:09.064 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:00:39.121 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:00:39.126 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:01:09.224 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:01:09.228 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:01:39.469 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:01:39.473 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:02:09.550 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:02:09.555 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:02:39.705 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:02:39.709 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:03:09.858 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:03:09.861 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:03:40.062 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:03:40.066 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:04:10.225 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:04:10.229 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:04:40.359 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:04:40.363 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:05:10.494 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:05:10.499 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:05:40.631 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:05:40.634 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:06:10.766 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:06:10.773 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:06:40.852 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:06:40.857 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:07:11.022 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:07:11.026 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:07:41.166 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:07:41.170 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:08:11.310 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:08:11.313 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:08:41.412 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:08:41.416 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:09:11.542 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:09:11.546 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:09:41.698 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:09:41.702 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:10:11.827 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:10:11.831 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:10:42.006 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:10:42.010 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:11:12.175 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:11:12.179 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:11:42.353 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:11:42.356 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:12:12.497 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:12:12.503 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:12:42.641 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:12:42.645 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:13:12.785 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:13:12.789 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:13:42.946 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:13:42.949 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:14:13.090 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:14:13.093 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:14:43.218 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:14:43.222 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:15:13.353 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:15:13.357 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:15:43.498 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:15:43.502 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:16:13.686 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:16:13.689 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:16:43.862 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:16:43.866 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:17:14.010 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:17:14.014 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:17:44.156 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:17:44.160 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:18:14.302 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:18:14.306 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:18:44.464 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:18:44.468 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:19:14.602 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:19:14.607 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:19:44.765 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:19:44.768 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:20:14.895 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:20:14.899 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:20:45.023 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:20:45.027 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:21:15.169 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:21:15.174 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:21:45.331 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:21:45.334 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:22:15.456 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:22:15.460 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:22:45.599 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:22:45.603 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:23:15.736 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:23:15.740 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:23:45.865 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:23:45.869 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:24:15.977 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:24:15.980 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:24:46.107 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:24:46.111 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:25:16.288 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:25:16.292 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:25:46.350 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:25:46.353 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:26:16.427 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:26:16.431 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:26:46.564 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:26:46.568 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:27:16.633 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:27:16.640 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:27:46.760 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:27:46.763 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:28:16.896 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:28:16.900 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:28:47.223 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:28:47.226 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:29:17.301 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:29:17.305 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:29:47.370 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:29:47.373 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:30:17.444 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:30:17.448 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:30:47.558 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:30:47.561 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:31:17.677 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:31:17.681 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:31:47.905 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:31:47.909 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:32:17.991 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:32:17.995 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:32:48.111 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:32:48.115 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:33:18.230 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:33:18.234 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:33:48.358 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:33:48.361 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:34:18.477 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:34:18.481 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:34:48.612 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:34:48.616 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:35:18.740 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:35:18.744 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:35:48.885 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:35:48.889 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:36:19.028 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:36:19.032 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:36:49.174 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:36:49.178 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:37:19.237 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:37:19.241 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:37:49.370 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:37:49.374 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:38:19.722 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:38:19.770 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:38:49.883 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:38:49.887 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:39:20.027 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:39:20.030 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:39:50.155 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:39:50.158 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:40:20.299 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:40:20.303 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:40:50.460 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:40:50.464 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:41:20.528 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:41:20.532 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:41:50.658 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:41:50.662 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:42:20.819 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:42:20.824 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:42:50.892 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:42:50.896 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:43:20.962 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:43:20.966 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:43:51.085 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:43:51.088 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:44:21.204 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:44:21.208 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:44:51.365 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:44:51.369 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:45:21.517 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:45:21.521 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:45:51.587 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:45:51.590 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:46:21.731 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:46:21.736 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:46:51.842 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:46:51.847 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:47:21.913 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:47:21.917 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:47:52.039 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:47:52.044 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:48:22.183 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:48:22.187 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:48:52.314 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:48:52.318 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:49:22.446 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:49:22.450 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:49:52.582 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:49:52.586 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:50:22.726 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:50:22.730 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:50:52.853 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:50:52.857 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:51:22.999 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:51:23.003 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:51:53.221 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:51:53.224 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:52:23.379 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:52:23.383 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:52:53.528 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:52:53.532 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:53:23.659 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:53:23.663 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:53:53.820 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:53:53.825 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:54:23.982 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:54:23.986 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:54:54.137 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:54:54.141 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:55:24.282 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:55:24.289 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:55:54.429 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:55:54.433 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:56:24.565 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:56:24.569 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:56:54.731 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:56:54.736 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:57:24.875 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:57:24.878 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:57:55.014 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:57:55.018 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:58:25.168 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:58:25.172 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:58:55.320 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:58:55.324 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:59:25.681 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:59:25.685 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:59:55.828 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T17:59:55.831 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:00:25.958 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:00:25.961 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:00:56.112 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:00:56.115 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:01:26.249 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:01:26.253 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:01:56.396 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:01:56.399 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:02:26.530 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:02:26.535 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:02:56.679 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:02:56.682 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:03:26.886 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:03:26.890 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:03:57.196 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:03:57.203 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:04:27.342 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:04:27.346 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:04:57.496 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:04:57.499 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:05:27.628 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:05:27.632 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:05:57.763 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:05:57.766 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:06:27.911 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:06:27.917 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:06:58.054 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:06:58.058 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:07:28.192 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:07:28.196 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:07:58.326 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:07:58.330 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:08:28.479 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:08:28.482 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:08:58.631 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:08:58.635 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:09:28.767 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:09:28.770 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:09:58.911 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:09:58.915 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:10:29.039 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:10:29.042 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:10:59.100 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:10:59.103 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:11:29.227 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:11:29.231 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:11:59.347 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:11:59.351 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:12:29.435 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:12:29.439 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:12:59.768 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:12:59.773 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:13:29.834 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:13:29.838 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:13:59.932 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:13:59.935 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:14:29.994 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:14:29.998 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:15:00.089 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:15:00.094 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:15:30.226 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:15:30.230 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:16:00.364 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:16:00.369 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:16:30.501 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:16:30.504 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:17:00.639 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:17:00.643 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:17:30.810 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:17:30.813 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:18:00.964 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:18:00.968 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:18:31.118 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:18:31.122 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:19:01.283 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:19:01.287 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:19:31.401 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:19:31.404 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:20:01.548 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:20:01.552 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:20:31.682 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:20:31.686 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:21:01.818 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:21:01.822 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:21:31.960 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:21:31.963 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:22:02.140 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:22:02.144 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:22:32.284 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:22:32.287 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:23:02.431 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:23:02.435 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:23:32.586 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:23:32.595 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:24:02.748 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:24:02.751 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:24:32.869 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:24:32.873 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:25:03.023 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:25:03.026 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:25:33.164 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:25:33.168 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:26:03.319 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:26:03.322 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:26:33.471 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:26:33.476 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:27:03.616 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:27:03.619 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:27:33.769 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:27:33.774 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:28:03.915 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:28:03.918 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:28:34.053 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:28:34.057 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:29:04.206 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:29:04.210 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:29:34.345 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:29:34.350 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:30:04.498 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:30:04.501 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:30:34.567 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:30:34.571 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:31:04.636 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:31:04.639 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:31:34.697 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:31:34.703 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:32:04.833 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:32:04.836 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:32:34.970 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:32:34.974 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:33:05.105 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:33:05.109 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:33:35.258 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:33:35.261 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:34:05.402 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:34:05.406 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:34:35.528 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:34:35.532 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:35:05.674 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:35:05.678 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:35:35.812 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:35:35.817 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:36:05.940 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:36:05.944 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:36:36.078 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:36:36.082 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:37:06.234 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:37:06.237 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:37:36.412 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:37:36.416 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:38:06.550 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:38:06.553 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:38:36.692 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:38:36.696 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:39:06.845 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:39:06.849 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:39:37.005 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:39:37.009 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:40:07.148 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:40:07.151 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:40:37.302 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:40:37.305 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:41:07.446 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:41:07.450 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:41:37.578 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:41:37.582 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:42:07.750 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:42:07.754 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:42:37.896 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:42:37.899 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:43:08.039 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:43:08.042 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:43:38.192 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:43:38.196 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:44:08.344 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:44:08.348 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:44:38.472 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:44:38.476 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:45:08.617 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:45:08.621 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:45:38.771 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:45:38.775 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:46:08.900 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:46:08.903 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:46:39.021 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:46:39.025 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:47:09.184 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:47:09.187 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:47:39.322 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:47:39.326 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:48:09.451 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:48:09.455 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:48:39.580 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:48:39.584 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:49:09.709 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:49:09.713 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:49:39.847 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:49:39.852 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:50:10.010 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:50:10.014 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:50:40.130 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:50:40.133 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:51:10.276 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:51:10.280 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:51:40.426 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:51:40.430 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:52:10.588 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:52:10.594 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:52:40.739 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:52:40.742 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:53:10.859 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:53:10.863 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:53:40.989 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:53:40.993 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:54:11.105 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:54:11.108 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:54:41.248 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:54:41.252 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:55:11.614 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:55:11.618 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:55:41.765 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:55:41.769 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:56:11.902 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:56:11.905 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:56:42.056 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:56:42.060 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:57:12.210 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:57:12.214 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:57:42.357 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:57:42.361 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:58:12.493 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:58:12.497 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:58:42.631 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:58:42.635 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:59:12.777 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:59:12.780 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:59:42.905 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T18:59:42.909 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:00:13.043 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:00:13.047 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:00:43.173 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:00:43.176 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:01:13.285 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:01:13.289 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:01:43.431 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:01:43.435 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:02:13.619 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:02:13.623 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:02:43.765 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:02:43.769 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:03:13.902 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:03:13.906 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:03:44.023 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:03:44.027 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:04:14.150 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:04:14.154 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:04:44.315 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:04:44.320 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:05:14.452 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:05:14.457 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:05:44.607 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:05:44.611 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:06:14.768 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:06:14.772 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:06:44.921 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:06:44.925 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:07:15.116 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:07:15.120 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:07:45.265 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:07:45.268 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:08:15.428 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:08:15.432 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:08:45.690 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:08:45.693 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:09:15.836 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:09:15.839 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:09:45.991 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:09:45.995 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:10:16.139 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:10:16.143 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:10:46.276 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:10:46.280 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:11:16.421 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:11:16.424 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:11:46.557 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:11:46.560 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:12:16.728 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:12:16.732 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:12:46.850 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:12:46.853 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:13:16.998 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:13:17.002 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:13:47.123 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:13:47.126 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:14:17.253 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:14:17.260 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:14:47.416 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:14:47.419 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:15:17.553 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:15:17.557 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:15:47.682 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:15:47.686 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:16:17.820 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:16:17.824 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:16:47.974 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:16:47.978 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:17:18.179 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:17:18.183 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:17:48.241 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:17:48.245 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:18:18.379 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:18:18.383 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:18:48.525 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:18:48.529 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:19:18.678 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:19:18.682 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:19:48.830 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:19:48.837 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:20:18.982 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:20:18.986 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:20:49.284 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:20:49.288 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:21:19.438 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:21:19.443 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:21:49.583 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:21:49.587 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:22:19.735 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:22:19.739 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:22:49.866 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:22:49.870 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:23:20.021 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:23:20.024 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:23:50.218 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:23:50.222 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:24:20.345 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:24:20.350 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:24:50.483 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:24:50.489 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:25:20.621 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:25:20.625 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:25:50.749 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:25:50.753 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:26:20.884 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:26:20.887 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:26:51.050 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:26:51.054 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:27:21.163 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:27:21.166 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:27:51.301 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:27:51.304 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:28:21.429 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:28:21.432 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:28:51.559 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:28:51.563 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:29:21.671 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:29:21.675 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:29:51.808 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:29:51.813 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:30:21.929 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:30:21.933 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:30:52.077 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:30:52.080 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:31:22.215 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:31:22.219 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:31:52.392 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:31:52.396 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:32:22.539 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:32:22.542 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:32:52.676 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:32:52.680 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:33:22.822 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:33:22.831 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:33:52.969 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:33:52.973 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:34:23.113 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:34:23.116 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:34:53.259 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:34:53.263 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:35:23.414 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:35:23.417 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:35:53.535 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:35:53.539 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:36:23.672 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:36:23.675 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:36:53.810 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:36:53.814 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:37:23.964 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:37:23.968 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:37:54.115 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:37:54.118 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:38:24.385 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:38:24.388 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:38:54.543 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:38:54.546 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:39:24.681 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:39:24.685 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:39:54.827 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:39:54.830 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:40:24.969 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:40:24.973 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:40:55.119 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:40:55.122 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:41:25.249 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:41:25.253 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:41:55.403 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:41:55.406 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:42:25.563 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:42:25.567 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:42:55.699 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:42:55.703 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:43:25.832 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:43:25.835 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:43:55.980 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:43:55.984 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:44:26.149 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:44:26.153 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:44:56.303 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:44:56.307 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:45:26.448 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:45:26.451 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:45:56.590 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:45:56.595 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:46:26.742 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:46:26.746 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:46:56.889 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:46:56.893 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:47:26.990 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:47:26.993 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:47:57.151 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:47:57.155 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:48:27.211 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:48:27.214 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:48:57.331 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:48:57.335 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:49:27.458 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:49:27.462 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:49:57.519 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:49:57.523 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:50:27.639 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:50:27.642 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:50:57.766 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:50:57.769 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:51:27.903 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:51:27.906 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:51:58.022 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:51:58.026 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:52:28.160 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:52:28.164 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:52:58.279 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:52:58.283 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:53:28.423 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:53:28.427 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:53:58.575 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:53:58.579 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:54:28.712 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:54:28.716 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:54:58.839 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:54:58.842 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:55:28.975 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:55:28.979 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:55:59.119 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:55:59.123 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:56:29.255 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:56:29.259 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:56:59.375 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:56:59.378 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:57:29.519 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:57:29.523 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:57:59.672 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:57:59.677 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:58:29.816 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:58:29.819 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:58:59.927 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:58:59.931 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:59:30.055 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T19:59:30.058 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T20:00:00.132 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T20:00:00.140 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T20:00:30.285 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T20:00:30.289 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T20:01:00.454 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T20:01:00.458 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T20:01:30.523 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T20:01:30.528 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T20:02:00.643 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T20:02:00.647 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T20:02:30.787 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T20:02:30.790 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T20:03:00.948 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T20:03:00.951 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T20:03:31.092 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T20:03:31.096 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T20:04:01.227 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T20:04:01.230 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T20:04:31.319 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T20:04:31.323 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T20:05:01.449 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T20:05:01.453 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T20:05:31.569 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T20:05:31.572 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T20:06:01.729 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T20:06:01.733 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T20:06:32.090 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T20:06:32.094 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T20:07:02.226 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T20:07:02.230 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T20:07:32.387 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T20:07:32.390 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T20:08:02.531 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T20:08:02.534 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T20:08:32.652 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T20:08:32.656 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T20:09:02.969 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T20:09:02.972 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T20:09:33.120 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T20:09:33.124 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T20:10:03.256 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T20:10:03.260 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T20:10:33.386 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T20:10:33.390 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T20:11:03.513 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T20:11:03.516 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T20:11:33.653 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T20:11:33.657 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T20:12:03.808 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T20:12:03.811 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T20:12:33.946 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T20:12:33.950 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T20:13:04.083 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T20:13:04.086 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-13T20:13:10.169 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2023-09-13T20:13:10.170 DEBUG:teuthology.task.console_log:Killing console logger for smithi084 2023-09-13T20:13:10.171 DEBUG:teuthology.task.console_log:Killing console logger for smithi161 2023-09-13T20:13:10.171 DEBUG:teuthology.exit:Finished running handlers